Jul 06 23:57:11.114819 ip-10-0-133-139 systemd[1]: Starting Kubernetes Kubelet...
Jul 06 23:57:11.470691 ip-10-0-133-139 kubenswrapper[2551]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:57:11.470691 ip-10-0-133-139 kubenswrapper[2551]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 06 23:57:11.470691 ip-10-0-133-139 kubenswrapper[2551]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:57:11.470691 ip-10-0-133-139 kubenswrapper[2551]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 06 23:57:11.470691 ip-10-0-133-139 kubenswrapper[2551]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 06 23:57:11.472419 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.472324    2551 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 06 23:57:11.477102 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477086    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:57:11.477102 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477102    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:57:11.477165 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477106    2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:57:11.477165 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477110    2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:57:11.477165 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477114    2551 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:57:11.477165 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477118    2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:57:11.477165 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477121    2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:57:11.477165 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477125    2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:57:11.477165 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477130    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:57:11.477165 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477133    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:57:11.477165 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477136    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:57:11.477165 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477139    2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:57:11.477165 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477142    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:57:11.477165 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477145    2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:57:11.477165 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477148    2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:57:11.477165 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477151    2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:57:11.477165 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477154    2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:57:11.477165 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477156    2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:57:11.477165 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477159    2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:57:11.477165 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477162    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:57:11.477165 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477165    2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:57:11.477710 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477168    2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:57:11.477710 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477170    2551 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:57:11.477710 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477173    2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:57:11.477710 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477177    2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:57:11.477710 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477180    2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:57:11.477710 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477182    2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:57:11.477710 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477186    2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:57:11.477710 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477188    2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:57:11.477710 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477192    2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:57:11.477710 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477194    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:57:11.477710 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477197    2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:57:11.477710 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477200    2551 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:57:11.477710 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477202    2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:57:11.477710 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477205    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:57:11.477710 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477208    2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:57:11.477710 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477212    2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:57:11.477710 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477216    2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:57:11.477710 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477219    2551 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:57:11.477710 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477221    2551 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:57:11.477710 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477224    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:57:11.478213 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477227    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:57:11.478213 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477230    2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:57:11.478213 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477233    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:57:11.478213 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477235    2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:57:11.478213 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477238    2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:57:11.478213 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477241    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:57:11.478213 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477244    2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:57:11.478213 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477247    2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:57:11.478213 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477250    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:57:11.478213 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477252    2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:57:11.478213 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477255    2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:57:11.478213 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477258    2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:57:11.478213 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477262    2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:57:11.478213 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477268    2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:57:11.478213 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477271    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:57:11.478213 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477274    2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:57:11.478213 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477277    2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:57:11.478213 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477280    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:57:11.478213 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477283    2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:57:11.478701 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477285    2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:57:11.478701 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477288    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:57:11.478701 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477298    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:57:11.478701 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477301    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:57:11.478701 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477304    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:57:11.478701 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477306    2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:57:11.478701 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477309    2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:57:11.478701 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477312    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:57:11.478701 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477314    2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:57:11.478701 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477317    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:57:11.478701 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477319    2551 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:57:11.478701 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477323    2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:57:11.478701 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477326    2551 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:57:11.478701 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477329    2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:57:11.478701 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477331    2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:57:11.478701 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477334    2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:57:11.478701 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477337    2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:57:11.478701 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477339    2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:57:11.478701 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477342    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:57:11.478701 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477344    2551 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:57:11.479231 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477347    2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:57:11.479231 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477350    2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:57:11.479231 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477352    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:57:11.479231 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477355    2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:57:11.479231 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477357    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:57:11.479231 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477360    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:57:11.479231 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477364    2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:57:11.479231 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477367    2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:57:11.479231 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477370    2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:57:11.479231 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477373    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:57:11.479231 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477375    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:57:11.479231 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477378    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:57:11.479231 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477381    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:57:11.479231 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477384    2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:57:11.479231 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477386    2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:57:11.479231 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477390    2551 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:57:11.479231 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477393    2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:57:11.479231 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477395    2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:57:11.479231 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.477398    2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:57:11.479231 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478233    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:57:11.479795 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478243    2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:57:11.479795 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478248    2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:57:11.479795 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478253    2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:57:11.479795 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478257    2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:57:11.479795 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478260    2551 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:57:11.479795 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478263    2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:57:11.479795 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478266    2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:57:11.479795 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478269    2551 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:57:11.479795 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478272    2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:57:11.479795 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478274    2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:57:11.479795 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478277    2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:57:11.479795 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478280    2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:57:11.479795 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478283    2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:57:11.479795 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478285    2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:57:11.479795 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478288    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:57:11.479795 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478291    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:57:11.479795 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478294    2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:57:11.479795 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478299    2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:57:11.479795 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478303    2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:57:11.480330 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478306    2551 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:57:11.480330 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478309    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:57:11.480330 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478312    2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:57:11.480330 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478315    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:57:11.480330 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478318    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:57:11.480330 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478322    2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:57:11.480330 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478325    2551 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:57:11.480330 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478328    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:57:11.480330 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478330    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:57:11.480330 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478333    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:57:11.480330 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478336    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:57:11.480330 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478338    2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:57:11.480330 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478341    2551 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:57:11.480330 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478345    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:57:11.480330 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478348    2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:57:11.480330 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478351    2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:57:11.480330 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478354    2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:57:11.480330 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478357    2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:57:11.480330 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478360    2551 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:57:11.480330 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478363    2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:57:11.480866 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478366    2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:57:11.480866 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478368    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:57:11.480866 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478371    2551 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:57:11.480866 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478373    2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:57:11.480866 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478376    2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:57:11.480866 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478379    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:57:11.480866 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478381    2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:57:11.480866 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478384    2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:57:11.480866 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478387    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:57:11.480866 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478390    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:57:11.480866 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478393    2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:57:11.480866 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478396    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:57:11.480866 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478399    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:57:11.480866 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478401    2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:57:11.480866 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478404    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:57:11.480866 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478407    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:57:11.480866 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478410    2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:57:11.480866 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478413    2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:57:11.480866 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478416    2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:57:11.480866 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478418    2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:57:11.481380 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478421    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:57:11.481380 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478424    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:57:11.481380 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478427    2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:57:11.481380 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478429    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:57:11.481380 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478432    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:57:11.481380 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478435    2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:57:11.481380 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478438    2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:57:11.481380 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478441    2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:57:11.481380 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478444    2551 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:57:11.481380 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478447    2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:57:11.481380 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478450    2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:57:11.481380 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478452    2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:57:11.481380 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478458    2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:57:11.481380 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478461    2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:57:11.481380 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478463    2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:57:11.481380 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478466    2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:57:11.481380 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478469    2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:57:11.481380 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478471    2551 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:57:11.481380 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478474    2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:57:11.481380 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478476    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:57:11.481898 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478479    2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:57:11.481898 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478482    2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:57:11.481898 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478484    2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:57:11.481898 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478489    2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:57:11.481898 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478494    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:57:11.481898 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478497    2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:57:11.481898 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478500    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:57:11.481898 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478503    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:57:11.481898 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478509    2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:57:11.481898 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478511    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:57:11.481898 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478514    2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:57:11.481898 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478517    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:57:11.481898 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478520    2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:57:11.481898 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478523    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:57:11.481898 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478526    2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:57:11.481898 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478528    2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:57:11.481898 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478532    2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:57:11.481898 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478535    2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:57:11.481898 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478538    2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:57:11.482387 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478988    2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:57:11.482387 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478995    2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:57:11.482387 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.478998    2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:57:11.482387 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479001    2551 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:57:11.482387 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479004    2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:57:11.482387 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479007    2551 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:57:11.482387 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479010    2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:57:11.482387 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479012    2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:57:11.482387 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479015    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:57:11.482387 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479020    2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:57:11.482387 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479024    2551 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:57:11.482387 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479028    2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:57:11.482387 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479030    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:57:11.482387 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479033    2551 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:57:11.482387 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479036    2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:57:11.482387 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479040    2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:57:11.482387 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479043    2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:57:11.482387 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479046    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:57:11.482387 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479048    2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:57:11.482387 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479051    2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:57:11.482915 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479054    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:57:11.482915 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479060    2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:57:11.482915 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479063    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:57:11.482915 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479066    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:57:11.482915 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479069    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:57:11.482915 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479072    2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:57:11.482915 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479074    2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:57:11.482915 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479077    2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:57:11.482915 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479080    2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:57:11.482915 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479083    2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:57:11.482915 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479086    2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:57:11.482915 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479090    2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:57:11.482915 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479094    2551 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:57:11.482915 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479097    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:57:11.482915 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479100    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:57:11.482915 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479103    2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:57:11.482915 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479105    2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:57:11.482915 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479108    2551 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:57:11.482915 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479111    2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:57:11.483436 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479114    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:57:11.483436 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479116    2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:57:11.483436 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479119    2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:57:11.483436 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479123    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:57:11.483436 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479125    2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:57:11.483436 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479128    2551 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:57:11.483436 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479131    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:57:11.483436 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479133    2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:57:11.483436 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479136    2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:57:11.483436 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479139    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:57:11.483436 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479141    2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:57:11.483436 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479145    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:57:11.483436 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479147    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:57:11.483436 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479150    2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:57:11.483436 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479155    2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:57:11.483436 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479158    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:57:11.483436 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479161    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:57:11.483436 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479163    2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:57:11.483436 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479166    2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:57:11.483436 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479169    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:57:11.483976 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479171    2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:57:11.483976 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479174    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:57:11.483976 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479177    2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:57:11.483976 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479180    2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:57:11.483976 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479182    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:57:11.483976 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479185    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:57:11.483976 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479188    2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:57:11.483976 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479191    2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:57:11.483976 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479194    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:57:11.483976 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479196    2551 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:57:11.483976 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479199    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:57:11.483976 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479201    2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:57:11.483976 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479205    2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:57:11.483976 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479207    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:57:11.483976 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479210    2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:57:11.483976 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479213    2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:57:11.483976 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479215    2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:57:11.483976 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479218    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:57:11.483976 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479221    2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:57:11.483976 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479225    2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:57:11.484483 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479228    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:57:11.484483 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479230    2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:57:11.484483 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479233    2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:57:11.484483 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479236    2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:57:11.484483 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479239    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:57:11.484483 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479242    2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:57:11.484483 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479247    2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:57:11.484483 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479250    2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:57:11.484483 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479252    2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:57:11.484483 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479255    2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:57:11.484483 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479258    2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:57:11.484483 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479261    2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:57:11.484483 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479263    2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:57:11.484483 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479268    2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:57:11.484483 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479271    2551 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:57:11.484483 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479275    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:57:11.484483 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479278    2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:57:11.484483 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479281    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:57:11.484483 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479285    2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.479288    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479366    2551 flags.go:64] FLAG: --address="0.0.0.0"
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479373    2551 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479380    2551 flags.go:64] FLAG: --anonymous-auth="true"
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479385    2551 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479391    2551 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479397    2551 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479403    2551 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479409    2551 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479413    2551 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479416    2551 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479420    2551 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479423    2551 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479427    2551 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479430    2551 flags.go:64] FLAG: --cgroup-root=""
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479433    2551 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479436    2551 flags.go:64] FLAG: --client-ca-file=""
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479439    2551 flags.go:64] FLAG: --cloud-provider="external"
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479445    2551 flags.go:64] FLAG: --cluster-dns="[]"
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479452    2551 flags.go:64] FLAG: --cluster-domain=""
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479455    2551 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479458    2551 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479461    2551 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 06 23:57:11.484998 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479465    2551 flags.go:64] FLAG: --container-log-max-files="5"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479469    2551 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479473    2551 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479476    2551 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479480    2551 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479483    2551 flags.go:64] FLAG: --contention-profiling="false"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479486    2551 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479489    2551 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479493    2551 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479496    2551 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479502    2551 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479505    2551 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479508    2551 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479511    2551 flags.go:64] FLAG: --enable-load-reader="false"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479514    2551 flags.go:64] FLAG: --enable-server="true"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479517    2551 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479522    2551 flags.go:64] FLAG: --event-burst="100"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479525    2551 flags.go:64] FLAG: --event-qps="50"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479529    2551 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479532    2551 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479535    2551 flags.go:64] FLAG: --eviction-hard=""
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479539    2551 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479542    2551 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479545    2551 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479549    2551 flags.go:64] FLAG: --eviction-soft=""
Jul 06 23:57:11.485634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479552    2551 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479555    2551 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479559    2551 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479564    2551 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479567    2551 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479571    2551 flags.go:64] FLAG: --fail-swap-on="true"
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479574    2551 flags.go:64] FLAG: --feature-gates=""
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479578    2551 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479581    2551 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479599    2551 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479603    2551 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479606    2551 flags.go:64] FLAG: --healthz-port="10248"
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479610    2551 flags.go:64] FLAG: --help="false"
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479613    2551 flags.go:64] FLAG: --hostname-override="ip-10-0-133-139.ec2.internal"
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479616    2551 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479620    2551 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479623    2551 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479627    2551 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479631    2551 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479635    2551 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479638    2551 flags.go:64] FLAG: --image-service-endpoint=""
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479641    2551 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479644    2551 flags.go:64] FLAG: --kube-api-burst="100"
Jul 06 23:57:11.486329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479647    2551 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479650    2551 flags.go:64] FLAG: --kube-api-qps="50"
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479653    2551 flags.go:64] FLAG: --kube-reserved=""
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479657    2551 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479660    2551 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479663    2551 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479666    2551 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479669    2551 flags.go:64] FLAG: --lock-file=""
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479672    2551 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479675    2551 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479679    2551 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479686    2551 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479690    2551 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479693    2551 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479697    2551 flags.go:64] FLAG: --logging-format="text"
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479700    2551 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479703    2551 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479706    2551 flags.go:64] FLAG: --manifest-url=""
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479709    2551 flags.go:64] FLAG: --manifest-url-header=""
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479714    2551 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479717    2551 flags.go:64] FLAG: --max-open-files="1000000"
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479721    2551 flags.go:64] FLAG: --max-pods="110"
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479724    2551 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479728    2551 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479731    2551 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 06 23:57:11.486972 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479734    2551 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479737    2551 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479740    2551 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479744    2551 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479752    2551 flags.go:64] FLAG: --node-status-max-images="50"
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479755    2551 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479758    2551 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479761    2551 flags.go:64] FLAG: --pod-cidr=""
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479764    2551 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479770    2551 flags.go:64] FLAG: --pod-manifest-path=""
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479773    2551 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479776    2551 flags.go:64] FLAG: --pods-per-core="0"
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479779    2551 flags.go:64] FLAG: --port="10250"
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479782    2551 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479785    2551 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0792b5c165860c697"
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479789    2551 flags.go:64] FLAG: --qos-reserved=""
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479792    2551 flags.go:64] FLAG: --read-only-port="10255"
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479795    2551 flags.go:64] FLAG: --register-node="true"
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479799    2551 flags.go:64] FLAG: --register-with-taints=""
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479803    2551 flags.go:64] FLAG: --registry-burst="10"
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479808    2551 flags.go:64] FLAG: --registry-qps="5"
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479811    2551 flags.go:64] FLAG: --reserved-cpus=""
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479814    2551 flags.go:64] FLAG: --reserved-memory=""
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479819    2551 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479822    2551 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 06 23:57:11.487821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479825    2551 flags.go:64] FLAG: --rotate-certificates="false"
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479828    2551 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479831    2551 flags.go:64] FLAG: --runonce="false"
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479834    2551 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479837    2551 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479841    2551 flags.go:64] FLAG: --seccomp-default="false"
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479844    2551 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479847    2551 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479850    2551 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479853    2551 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479856    2551 flags.go:64] FLAG: --storage-driver-password="root"
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479860    2551 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479863    2551 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479866    2551 flags.go:64] FLAG: --storage-driver-user="root"
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479869    2551 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479872    2551 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479875    2551 flags.go:64] FLAG: --system-cgroups=""
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479878    2551 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479884    2551 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479887    2551 flags.go:64] FLAG: --tls-cert-file=""
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479890    2551 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479894    2551 flags.go:64] FLAG: --tls-min-version=""
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479897    2551 flags.go:64] FLAG: --tls-private-key-file=""
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479900    2551 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479903    2551 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 06 23:57:11.488757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479908    2551 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479911    2551 flags.go:64] FLAG: --v="2"
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479916    2551 flags.go:64] FLAG: --version="false"
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479920    2551 flags.go:64] FLAG: --vmodule=""
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479924    2551 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.479927    2551 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480052    2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480057    2551 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480061    2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480065    2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480068    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480071    2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480073    2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480076    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480079    2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480082    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480085    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480088    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480091    2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480094    2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480098    2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:57:11.489700 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480102    2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480106    2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480109    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480112    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480115    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480118    2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480121    2551 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480123    2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480126    2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480130    2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480133    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480137    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480140    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480144    2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480147    2551 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480150    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480153    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480156    2551 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480158    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480161    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480163    2551 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:57:11.490259 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480166    2551 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:57:11.490856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480169    2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:57:11.490856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480171    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:57:11.490856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480174    2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:57:11.490856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480177    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:57:11.490856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480179    2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:57:11.490856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480182    2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:57:11.490856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480185    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:57:11.490856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480188    2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:57:11.490856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480190    2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:57:11.490856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480197    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:57:11.490856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480199    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:57:11.490856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480202    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:57:11.490856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480205    2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:57:11.490856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480207    2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:57:11.490856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480210    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:57:11.490856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480213    2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:57:11.490856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480215    2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:57:11.490856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480218    2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:57:11.490856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480220    2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:57:11.490856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480223    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:57:11.491371 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480226    2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:57:11.491371 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480231    2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:57:11.491371 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480235    2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:57:11.491371 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480239    2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:57:11.491371 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480242    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:57:11.491371 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480245    2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:57:11.491371 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480248    2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:57:11.491371 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480251    2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:57:11.491371 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480254    2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:57:11.491371 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480257    2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:57:11.491371 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480260    2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:57:11.491371 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480262    2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:57:11.491371 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480265    2551 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:57:11.491371 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480268    2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:57:11.491371 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480270    2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:57:11.491371 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480273    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:57:11.491371 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480276    2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:57:11.491371 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480279    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:57:11.491371 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480281    2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:57:11.491880 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480284    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:57:11.491880 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480287    2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:57:11.491880 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480290    2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:57:11.491880 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480293    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:57:11.491880 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480296    2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:57:11.491880 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480298    2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:57:11.491880 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480301    2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:57:11.491880 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480304    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:57:11.491880 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480306    2551 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:57:11.491880 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480309    2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:57:11.491880 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480312    2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:57:11.491880 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480315    2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:57:11.491880 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480318    2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:57:11.491880 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480320    2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:57:11.491880 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480325    2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:57:11.491880 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480327    2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:57:11.491880 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480333    2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:57:11.491880 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480337    2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:57:11.491880 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480340    2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:57:11.492372 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480343    2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:57:11.492372 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480346    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:57:11.492372 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480349    2551 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:57:11.492372 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.480351    2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:57:11.492372 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.480357    2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:57:11.492372 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.488255    2551 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 06 23:57:11.492372 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.488276    2551 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 06 23:57:11.492372 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.489055    2551 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 06 23:57:11.492372 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.489083    2551 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 06 23:57:11.492372 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489421    2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:57:11.492372 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489433    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:57:11.492372 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489439    2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:57:11.492372 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489445    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:57:11.492372 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489451    2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:57:11.492756 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489456    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:57:11.492756 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489459    2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:57:11.492756 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489462    2551 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:57:11.492756 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489465    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:57:11.492756 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489469    2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:57:11.492756 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489472    2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:57:11.492756 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489474    2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:57:11.492756 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489477    2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:57:11.492756 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489480    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:57:11.492756 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489483    2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:57:11.492756 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489485    2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:57:11.492756 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489488    2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:57:11.492756 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489491    2551 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:57:11.492756 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489494    2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:57:11.492756 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489497    2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:57:11.492756 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489500    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:57:11.492756 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489502    2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:57:11.492756 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489505    2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:57:11.492756 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489508    2551 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:57:11.492756 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489511    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:57:11.493261 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489515    2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:57:11.493261 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489519    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:57:11.493261 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489523    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:57:11.493261 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489527    2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:57:11.493261 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489532    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:57:11.493261 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489535    2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:57:11.493261 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489543    2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:57:11.493261 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489547    2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:57:11.493261 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489550    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:57:11.493261 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489553    2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:57:11.493261 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489555    2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:57:11.493261 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489558    2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:57:11.493261 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489561    2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:57:11.493261 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489564    2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:57:11.493261 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489567    2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:57:11.493261 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489571    2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:57:11.493261 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489575    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:57:11.493261 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489578    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:57:11.493261 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489582    2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:57:11.493856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489598    2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:57:11.493856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489601    2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:57:11.493856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489604    2551 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:57:11.493856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489607    2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:57:11.493856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489610    2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:57:11.493856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489613    2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:57:11.493856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489615    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:57:11.493856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489618    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:57:11.493856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489621    2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:57:11.493856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489624    2551 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:57:11.493856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489626    2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:57:11.493856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489629    2551 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:57:11.493856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489632    2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:57:11.493856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489635    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:57:11.493856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489637    2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:57:11.493856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489640    2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:57:11.493856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489643    2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:57:11.493856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489646    2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:57:11.493856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489651    2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:57:11.493856 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489656    2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:57:11.494440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489659    2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:57:11.494440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489662    2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:57:11.494440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489665    2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:57:11.494440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489669    2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:57:11.494440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489671    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:57:11.494440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489675    2551 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:57:11.494440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489677    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:57:11.494440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489681    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:57:11.494440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489683    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:57:11.494440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489686    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:57:11.494440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489689    2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:57:11.494440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489692    2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:57:11.494440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489695    2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:57:11.494440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489698    2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:57:11.494440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489700    2551 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:57:11.494440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489703    2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:57:11.494440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489706    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:57:11.494440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489710    2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:57:11.494440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489713    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:57:11.494440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489716    2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:57:11.494970 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489719    2551 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:57:11.494970 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489722    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:57:11.494970 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489725    2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:57:11.494970 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489728    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:57:11.494970 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489731    2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:57:11.494970 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489733    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:57:11.494970 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489736    2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:57:11.494970 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489739    2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:57:11.494970 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489741    2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:57:11.494970 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489744    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:57:11.494970 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489747    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:57:11.494970 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489750    2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:57:11.494970 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489753    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:57:11.494970 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489756    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:57:11.494970 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489759    2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:57:11.495359 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.489765    2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:57:11.495359 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489897    2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 06 23:57:11.495359 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489903    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 06 23:57:11.495359 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489906    2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 06 23:57:11.495359 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489909    2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 06 23:57:11.495359 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489912    2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 06 23:57:11.495359 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489915    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 06 23:57:11.495359 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489918    2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 06 23:57:11.495359 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489921    2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 06 23:57:11.495359 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489924    2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 06 23:57:11.495359 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489926    2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 06 23:57:11.495359 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489930    2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 06 23:57:11.495359 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489934    2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 06 23:57:11.495359 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489939    2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 06 23:57:11.495359 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489943    2551 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 06 23:57:11.495788 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489946    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 06 23:57:11.495788 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489949    2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 06 23:57:11.495788 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489952    2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 06 23:57:11.495788 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489955    2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 06 23:57:11.495788 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489958    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 06 23:57:11.495788 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489961    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 06 23:57:11.495788 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489964    2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 06 23:57:11.495788 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489967    2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 06 23:57:11.495788 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489970    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 06 23:57:11.495788 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489973    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 06 23:57:11.495788 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489976    2551 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 06 23:57:11.495788 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489979    2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 06 23:57:11.495788 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489981    2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 06 23:57:11.495788 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489984    2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 06 23:57:11.495788 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489987    2551 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 06 23:57:11.495788 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489990    2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 06 23:57:11.495788 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489993    2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 06 23:57:11.495788 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489996    2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 06 23:57:11.495788 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.489999    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 06 23:57:11.495788 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490002    2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 06 23:57:11.496323 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490004    2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 06 23:57:11.496323 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490007    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 06 23:57:11.496323 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490010    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 06 23:57:11.496323 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490012    2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 06 23:57:11.496323 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490015    2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 06 23:57:11.496323 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490017    2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 06 23:57:11.496323 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490020    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 06 23:57:11.496323 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490023    2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 06 23:57:11.496323 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490026    2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 06 23:57:11.496323 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490029    2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 06 23:57:11.496323 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490031    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 06 23:57:11.496323 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490035    2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 06 23:57:11.496323 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490038    2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 06 23:57:11.496323 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490040    2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 06 23:57:11.496323 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490043    2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 06 23:57:11.496323 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490046    2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 06 23:57:11.496323 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490049    2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 06 23:57:11.496323 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490052    2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 06 23:57:11.496323 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490055    2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 06 23:57:11.496828 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490057    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 06 23:57:11.496828 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490060    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 06 23:57:11.496828 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490063    2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 06 23:57:11.496828 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490065    2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 06 23:57:11.496828 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490068    2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 06 23:57:11.496828 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490070    2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 06 23:57:11.496828 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490074    2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 06 23:57:11.496828 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490077    2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 06 23:57:11.496828 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490079    2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 06 23:57:11.496828 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490082    2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 06 23:57:11.496828 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490085    2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 06 23:57:11.496828 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490087    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 06 23:57:11.496828 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490090    2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 06 23:57:11.496828 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490092    2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 06 23:57:11.496828 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490095    2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 06 23:57:11.496828 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490099    2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 06 23:57:11.496828 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490102    2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 06 23:57:11.496828 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490105    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 06 23:57:11.496828 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490108    2551 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 06 23:57:11.497307 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490111    2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 06 23:57:11.497307 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490113    2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 06 23:57:11.497307 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490116    2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 06 23:57:11.497307 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490119    2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 06 23:57:11.497307 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490122    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 06 23:57:11.497307 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490124    2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 06 23:57:11.497307 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490127    2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 06 23:57:11.497307 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490130    2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 06 23:57:11.497307 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490133    2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 06 23:57:11.497307 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490135    2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 06 23:57:11.497307 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490138    2551 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 06 23:57:11.497307 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490141    2551 feature_gate.go:328] unrecognized feature gate: Example
Jul 06 23:57:11.497307 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490143    2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 06 23:57:11.497307 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490146    2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 06 23:57:11.497307 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490149    2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 06 23:57:11.497307 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490153    2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 06 23:57:11.497307 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490157    2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 06 23:57:11.497307 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490160    2551 feature_gate.go:328] unrecognized feature gate: Example2
Jul 06 23:57:11.497307 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490163    2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 06 23:57:11.497307 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490167    2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 06 23:57:11.497844 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490170    2551 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 06 23:57:11.497844 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490173    2551 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 06 23:57:11.497844 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490175    2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 06 23:57:11.497844 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490178    2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 06 23:57:11.497844 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490181    2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 06 23:57:11.497844 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490183    2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 06 23:57:11.497844 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:11.490186    2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 06 23:57:11.497844 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.490191    2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 06 23:57:11.497844 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.490299    2551 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 06 23:57:11.497844 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.494077    2551 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 06 23:57:11.497844 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.495535    2551 server.go:1019] "Starting client certificate rotation"
Jul 06 23:57:11.497844 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.495643    2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 23:57:11.497844 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.495676    2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 06 23:57:11.498213 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.498199    2551 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 23:57:11.501126 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.501107    2551 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 06 23:57:11.515870 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.515842    2551 log.go:25] "Validated CRI v1 runtime API"
Jul 06 23:57:11.518161 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.518142    2551 log.go:25] "Validated CRI v1 image API"
Jul 06 23:57:11.519103 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.519087    2551 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 06 23:57:11.522810 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.522787    2551 fs.go:135] Filesystem UUIDs: map[54e8333d-bce2-4540-b664-b426e7e738ea:/dev/nvme0n1p4 78d86ac9-a5d0-4077-b042-8be5bc1833ec:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 06 23:57:11.522896 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.522809    2551 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 06 23:57:11.527396 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.527275    2551 manager.go:216] Machine: {Timestamp:2026-07-06 23:57:11.526784406 +0000 UTC m=+0.306179056 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:2499996 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec296b713ea6e5075d7a7c23b641dce9 SystemUUID:ec296b71-3ea6-e507-5d7a-7c23b641dce9 BootID:fffdd79c-a999-45ed-90e1-11f7a3d10c55 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b8:3d:31:1c:eb Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b8:3d:31:1c:eb Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:dc:93:e1:d9:3e Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 06 23:57:11.527396 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.527384    2551 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 06 23:57:11.527547 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.527531    2551 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 06 23:57:11.529949 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.529917    2551 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 06 23:57:11.530128 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.529951    2551 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-139.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 06 23:57:11.530203 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.530189    2551 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 23:57:11.531391 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.531375    2551 topology_manager.go:138] "Creating topology manager with none policy"
Jul 06 23:57:11.531460 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.531395    2551 container_manager_linux.go:309] "Creating device plugin manager"
Jul 06 23:57:11.531460 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.531408    2551 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 23:57:11.532301 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.532289    2551 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 06 23:57:11.533957 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.533945    2551 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 06 23:57:11.538337 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.538322    2551 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 23:57:11.538485 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.538473    2551 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 06 23:57:11.538545 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.538512    2551 kubelet.go:486] "Attempting to sync node with API server"
Jul 06 23:57:11.538545 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.538534    2551 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 06 23:57:11.538681 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.538550    2551 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 06 23:57:11.538681 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.538565    2551 kubelet.go:398] "Adding apiserver pod source"
Jul 06 23:57:11.538772 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.538679    2551 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 06 23:57:11.539629 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.539609    2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 23:57:11.539723 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.539641    2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 06 23:57:11.541944 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.541925    2551 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 06 23:57:11.544937 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.544912    2551 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 06 23:57:11.545022 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.544965    2551 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 06 23:57:11.546324 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.546311    2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 06 23:57:11.546369 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.546329    2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 06 23:57:11.546369 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.546336    2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 06 23:57:11.546369 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.546342    2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 06 23:57:11.546369 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.546352    2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 06 23:57:11.546369 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.546358    2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 06 23:57:11.546369 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.546366    2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 06 23:57:11.546369 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.546371    2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 06 23:57:11.546609 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.546379    2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 06 23:57:11.546609 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.546385    2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 06 23:57:11.546609 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.546394    2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 06 23:57:11.546609 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.546399    2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 06 23:57:11.547154 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.547137    2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 06 23:57:11.547154 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.547150    2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 06 23:57:11.550478 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:11.550452    2551 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 06 23:57:11.550613 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.550468    2551 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-139.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 06 23:57:11.550675 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:11.550630    2551 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 06 23:57:11.550870 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.550857    2551 server.go:1268] "Started kubelet"
Jul 06 23:57:11.551019 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.550950    2551 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 06 23:57:11.551116 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.551049    2551 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 06 23:57:11.551613 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.551584    2551 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 06 23:57:11.551823 ip-10-0-133-139 systemd[1]: Started Kubernetes Kubelet.
Jul 06 23:57:11.553037 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.553018    2551 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 06 23:57:11.553836 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.553821    2551 server.go:310] "Adding debug handlers to kubelet server"
Jul 06 23:57:11.556376 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:11.555431    2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-139.ec2.internal.18bfd8b0da54a145  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-139.ec2.internal,UID:ip-10-0-133-139.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-139.ec2.internal,},FirstTimestamp:2026-07-06 23:57:11.550828869 +0000 UTC m=+0.330223520,LastTimestamp:2026-07-06 23:57:11.550828869 +0000 UTC m=+0.330223520,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-139.ec2.internal,}"
Jul 06 23:57:11.558277 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:11.558256    2551 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 06 23:57:11.560034 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.560016    2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2rnhz"
Jul 06 23:57:11.560548 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.560521    2551 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 06 23:57:11.560634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.560527    2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 06 23:57:11.560715 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:11.560693    2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 06 23:57:11.561262 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.561243    2551 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 06 23:57:11.561262 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.561243    2551 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 06 23:57:11.561427 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.561269    2551 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 06 23:57:11.561427 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.561371    2551 reconstruct.go:97] "Volume reconstruction finished"
Jul 06 23:57:11.561427 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.561379    2551 reconciler.go:29] "Reconciler: start to sync state"
Jul 06 23:57:11.561580 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.561526    2551 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 06 23:57:11.561580 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.561563    2551 factory.go:55] Registering systemd factory
Jul 06 23:57:11.561580 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.561573    2551 factory.go:223] Registration of the systemd container factory successfully
Jul 06 23:57:11.561817 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.561803    2551 factory.go:153] Registering CRI-O factory
Jul 06 23:57:11.561817 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.561819    2551 factory.go:223] Registration of the crio container factory successfully
Jul 06 23:57:11.561887 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.561841    2551 factory.go:103] Registering Raw factory
Jul 06 23:57:11.561887 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.561858    2551 manager.go:1196] Started watching for new ooms in manager
Jul 06 23:57:11.562247 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.562235    2551 manager.go:349] Starting recovery of all containers
Jul 06 23:57:11.563101 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:11.563080    2551 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 06 23:57:11.563206 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:11.563185    2551 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-139.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 06 23:57:11.568434 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.568415    2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-2rnhz"
Jul 06 23:57:11.574360 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.574308    2551 manager.go:354] Recovery completed
Jul 06 23:57:11.577311 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:11.577291    2551 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 06 23:57:11.580476 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.580462    2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:57:11.582368 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.582347    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:57:11.582441 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.582385    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:57:11.582441 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.582402    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:57:11.583020 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.583004    2551 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 06 23:57:11.583020 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.583019    2551 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 06 23:57:11.583152 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.583038    2551 state_mem.go:36] "Initialized new in-memory state store"
Jul 06 23:57:11.583152 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.583047    2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:57:11.583786 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.583771    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:57:11.583852 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.583802    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:57:11.583852 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.583817    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:57:11.585286 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.585273    2551 policy_none.go:49] "None policy: Start"
Jul 06 23:57:11.585349 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.585290    2551 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 06 23:57:11.585349 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.585301    2551 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 06 23:57:11.587446 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.587434    2551 policy_none.go:47] "Start"
Jul 06 23:57:11.623325 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.623161    2551 manager.go:337] "Starting Device Plugin manager"
Jul 06 23:57:11.623456 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:11.623365    2551 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 06 23:57:11.623456 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.623380    2551 server.go:87] "Starting device plugin registration server"
Jul 06 23:57:11.623678 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.623664    2551 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 06 23:57:11.623720 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.623681    2551 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 06 23:57:11.623818 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.623795    2551 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 06 23:57:11.623905 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.623892    2551 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 06 23:57:11.623905 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.623904    2551 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 06 23:57:11.624452 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:11.624428    2551 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 06 23:57:11.624574 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:11.624491    2551 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 06 23:57:11.686390 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.686332    2551 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 06 23:57:11.688691 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.687496    2551 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 06 23:57:11.688691 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.687545    2551 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 06 23:57:11.688691 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.687569    2551 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 06 23:57:11.688691 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:11.687606    2551 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 06 23:57:11.689888 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.689861    2551 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:57:11.724682 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.724653    2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:57:11.725607 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.725591    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:57:11.725715 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.725621    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:57:11.725715 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.725636    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:57:11.725715 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.725663    2551 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-139.ec2.internal"
Jul 06 23:57:11.732235 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.732220    2551 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-139.ec2.internal"
Jul 06 23:57:11.732309 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:11.732242    2551 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-139.ec2.internal\": node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 06 23:57:11.756758 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:11.756737    2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 06 23:57:11.788363 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.788341    2551 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal"]
Jul 06 23:57:11.788425 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.788402    2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:57:11.789244 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.789227    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:57:11.789334 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.789264    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:57:11.789334 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.789279    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:57:11.791886 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.791870    2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:57:11.792024 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.792010    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal"
Jul 06 23:57:11.792071 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.792039    2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:57:11.792565 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.792549    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:57:11.792672 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.792583    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:57:11.792672 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.792598    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:57:11.792672 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.792551    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:57:11.792672 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.792659    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:57:11.792672 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.792670    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:57:11.794948 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.794931    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal"
Jul 06 23:57:11.795050 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.794956    2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 06 23:57:11.796316 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.796295    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientMemory"
Jul 06 23:57:11.796403 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.796331    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasNoDiskPressure"
Jul 06 23:57:11.796403 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.796349    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeHasSufficientPID"
Jul 06 23:57:11.819317 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:11.819302    2551 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-139.ec2.internal\" not found" node="ip-10-0-133-139.ec2.internal"
Jul 06 23:57:11.824151 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:11.824122    2551 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-139.ec2.internal\" not found" node="ip-10-0-133-139.ec2.internal"
Jul 06 23:57:11.857399 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:11.857375    2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 06 23:57:11.863115 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.863088    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9babfa7336fea69e033ea2de5a041c6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal\" (UID: \"9babfa7336fea69e033ea2de5a041c6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal"
Jul 06 23:57:11.863205 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.863124    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9babfa7336fea69e033ea2de5a041c6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal\" (UID: \"9babfa7336fea69e033ea2de5a041c6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal"
Jul 06 23:57:11.863205 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.863142    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/098c8f1e1bab8bfb614b320b9ae089b4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-139.ec2.internal\" (UID: \"098c8f1e1bab8bfb614b320b9ae089b4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal"
Jul 06 23:57:11.958221 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:11.958157    2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 06 23:57:11.963373 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.963358    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9babfa7336fea69e033ea2de5a041c6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal\" (UID: \"9babfa7336fea69e033ea2de5a041c6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal"
Jul 06 23:57:11.963445 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.963408    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9babfa7336fea69e033ea2de5a041c6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal\" (UID: \"9babfa7336fea69e033ea2de5a041c6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal"
Jul 06 23:57:11.963445 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.963426    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/098c8f1e1bab8bfb614b320b9ae089b4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-139.ec2.internal\" (UID: \"098c8f1e1bab8bfb614b320b9ae089b4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal"
Jul 06 23:57:11.963518 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.963452    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/098c8f1e1bab8bfb614b320b9ae089b4-config\") pod \"kube-apiserver-proxy-ip-10-0-133-139.ec2.internal\" (UID: \"098c8f1e1bab8bfb614b320b9ae089b4\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal"
Jul 06 23:57:11.963518 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.963458    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9babfa7336fea69e033ea2de5a041c6e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal\" (UID: \"9babfa7336fea69e033ea2de5a041c6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal"
Jul 06 23:57:11.963518 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:11.963472    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9babfa7336fea69e033ea2de5a041c6e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal\" (UID: \"9babfa7336fea69e033ea2de5a041c6e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal"
Jul 06 23:57:12.059680 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:12.059641    2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 06 23:57:12.127276 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:12.127247    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal"
Jul 06 23:57:12.128448 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:12.128427    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal"
Jul 06 23:57:12.160602 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:12.160565    2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 06 23:57:12.267265 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:12.267162    2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 06 23:57:12.368186 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:12.368153    2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 06 23:57:12.468916 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:12.468882    2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 06 23:57:12.495411 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:12.495387    2551 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 06 23:57:12.495862 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:12.495565    2551 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 06 23:57:12.569106 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:12.569076    2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 06 23:57:12.575013 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:12.574974    2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-05 23:52:12 +0000 UTC" deadline="2027-12-14 14:31:06.844887223 +0000 UTC"
Jul 06 23:57:12.575129 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:12.575013    2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12614h33m54.269880789s"
Jul 06 23:57:12.669391 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:12.669361    2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 06 23:57:12.669801 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:12.669771    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9babfa7336fea69e033ea2de5a041c6e.slice/crio-c63c243eca728280271a3391cb621915f07caeb3a1325b7e7582ceba64a4230b WatchSource:0}: Error finding container c63c243eca728280271a3391cb621915f07caeb3a1325b7e7582ceba64a4230b: Status 404 returned error can't find the container with id c63c243eca728280271a3391cb621915f07caeb3a1325b7e7582ceba64a4230b
Jul 06 23:57:12.670201 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:12.670167    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod098c8f1e1bab8bfb614b320b9ae089b4.slice/crio-70acca2bd07939e8f1644d450c3714672a292683e133cfc026fbdff9570e1b5b WatchSource:0}: Error finding container 70acca2bd07939e8f1644d450c3714672a292683e133cfc026fbdff9570e1b5b: Status 404 returned error can't find the container with id 70acca2bd07939e8f1644d450c3714672a292683e133cfc026fbdff9570e1b5b
Jul 06 23:57:12.674691 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:12.674675    2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 06 23:57:12.691284 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:12.691234    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal" event={"ID":"098c8f1e1bab8bfb614b320b9ae089b4","Type":"ContainerStarted","Data":"70acca2bd07939e8f1644d450c3714672a292683e133cfc026fbdff9570e1b5b"}
Jul 06 23:57:12.692302 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:12.692281    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal" event={"ID":"9babfa7336fea69e033ea2de5a041c6e","Type":"ContainerStarted","Data":"c63c243eca728280271a3391cb621915f07caeb3a1325b7e7582ceba64a4230b"}
Jul 06 23:57:12.770591 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:12.770552    2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 06 23:57:12.780155 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:12.780134    2551 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:57:12.871311 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:12.871234    2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 06 23:57:12.972387 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:12.972360    2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 06 23:57:13.015944 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.015911    2551 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:57:13.072693 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:13.072648    2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-133-139.ec2.internal\" not found"
Jul 06 23:57:13.095124 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.095098    2551 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:57:13.162152 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.161838    2551 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal"
Jul 06 23:57:13.176595 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.176568    2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 23:57:13.178213 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.178005    2551 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal"
Jul 06 23:57:13.193640 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.193615    2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 06 23:57:13.541019 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.540932    2551 apiserver.go:52] "Watching apiserver"
Jul 06 23:57:13.550815 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.550789    2551 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 06 23:57:13.551918 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.551898    2551 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 06 23:57:13.552279 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.552243    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-jbkpl","openshift-cluster-node-tuning-operator/tuned-k25ls","openshift-image-registry/node-ca-94sl8","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal","openshift-multus/multus-additional-cni-plugins-rtq89","openshift-multus/network-metrics-daemon-wm7tt","openshift-network-operator/iptables-alerter-v76sk","openshift-ovn-kubernetes/ovnkube-node-2547n","kube-system/konnectivity-agent-xwsf4","kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48","openshift-dns/node-resolver-zpbjs","openshift-multus/multus-58shk","openshift-network-diagnostics/network-check-target-hrttl"]
Jul 06 23:57:13.554708 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.554685    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.557702 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.557673    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.558355 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.558188    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 06 23:57:13.558355 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.558216    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 06 23:57:13.558355 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.558188    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 06 23:57:13.558658 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.558632    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 06 23:57:13.558718 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.558688    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6xgt2\""
Jul 06 23:57:13.559912 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.559888    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-94sl8"
Jul 06 23:57:13.561473 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.561455    2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 06 23:57:13.561880 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.561830    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 06 23:57:13.561986 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.561887    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:57:13.561986 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.561979    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sf2zg\""
Jul 06 23:57:13.562294 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.562279    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:13.562366 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:13.562347    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jbkpl" podUID="cce87a14-ec61-4e46-b630-4488f0c25032"
Jul 06 23:57:13.564724 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.564703    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.565999 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.565976    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 06 23:57:13.566098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.566009    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 06 23:57:13.566098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.566022    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p9hkp\""
Jul 06 23:57:13.566098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.566009    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 06 23:57:13.567111 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.567092    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:13.567212 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:13.567189    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm7tt" podUID="084ae393-acaf-4d47-8460-64ada80ae79f"
Jul 06 23:57:13.568258 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.568237    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-xs2x2\""
Jul 06 23:57:13.568423 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.568404    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 06 23:57:13.568500 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.568477    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 06 23:57:13.569866 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.569847    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v76sk"
Jul 06 23:57:13.572148 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.572129    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.574043 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.573978    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xntdl\""
Jul 06 23:57:13.574155 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.574045    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 06 23:57:13.574155 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.574052    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:57:13.574155 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.574058    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 06 23:57:13.574706 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.574686    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xwsf4"
Jul 06 23:57:13.575209 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575190    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/628c1362-ba80-4198-b958-90631d8c4f8a-host\") pod \"node-ca-94sl8\" (UID: \"628c1362-ba80-4198-b958-90631d8c4f8a\") " pod="openshift-image-registry/node-ca-94sl8"
Jul 06 23:57:13.575260 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575229    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-kubernetes\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.575298 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575255    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-host\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.575333 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575291    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh54f\" (UniqueName: \"kubernetes.io/projected/628c1362-ba80-4198-b958-90631d8c4f8a-kube-api-access-bh54f\") pod \"node-ca-94sl8\" (UID: \"628c1362-ba80-4198-b958-90631d8c4f8a\") " pod="openshift-image-registry/node-ca-94sl8"
Jul 06 23:57:13.575370 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575322    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cce87a14-ec61-4e46-b630-4488f0c25032-dbus\") pod \"global-pull-secret-syncer-jbkpl\" (UID: \"cce87a14-ec61-4e46-b630-4488f0c25032\") " pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:13.575370 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575364    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-multus-cni-dir\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.575441 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575389    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-multus-socket-dir-parent\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.575441 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575414    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2081578e-abe2-40a8-ab5b-a430646f0e38-multus-daemon-config\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.575503 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575438    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-run\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.575503 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575465    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cce87a14-ec61-4e46-b630-4488f0c25032-kubelet-config\") pod \"global-pull-secret-syncer-jbkpl\" (UID: \"cce87a14-ec61-4e46-b630-4488f0c25032\") " pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:13.575503 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575487    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-host-run-k8s-cni-cncf-io\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.575640 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575502    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-modprobe-d\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.575640 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575540    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-cnibin\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.575640 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575598    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-host-run-netns\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.575640 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575621    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-host-var-lib-cni-multus\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.575779 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575645    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-etc-kubernetes\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.575779 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575677    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-sysctl-conf\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.575779 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575708    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-lib-modules\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.575892 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575776    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfsft\" (UniqueName: \"kubernetes.io/projected/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-kube-api-access-zfsft\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.575892 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575827    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-host-var-lib-cni-bin\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.575892 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575860    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-multus-conf-dir\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.576069 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575930    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 06 23:57:13.576069 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575907    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-systemd\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.576069 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575965    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 06 23:57:13.576069 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.575981    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2081578e-abe2-40a8-ab5b-a430646f0e38-cni-binary-copy\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.576069 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.576008    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret\") pod \"global-pull-secret-syncer-jbkpl\" (UID: \"cce87a14-ec61-4e46-b630-4488f0c25032\") " pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:13.576069 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.576035    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-host-var-lib-kubelet\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.576069 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.576060    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9z7t\" (UniqueName: \"kubernetes.io/projected/2081578e-abe2-40a8-ab5b-a430646f0e38-kube-api-access-x9z7t\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.576400 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.576110    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-sysctl-d\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.576400 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.576162    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-sys\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.576400 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.576217    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/628c1362-ba80-4198-b958-90631d8c4f8a-serviceca\") pod \"node-ca-94sl8\" (UID: \"628c1362-ba80-4198-b958-90631d8c4f8a\") " pod="openshift-image-registry/node-ca-94sl8"
Jul 06 23:57:13.576400 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.576234    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-host-run-multus-certs\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.576400 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.576253    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-tuned\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.576400 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.576290    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-tmp\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.576400 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.576334    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-sysconfig\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.576400 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.576380    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-os-release\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.576862 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.576409    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-system-cni-dir\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.576862 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.576428    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-hostroot\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.576862 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.576463    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-var-lib-kubelet\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.577163 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.577142    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:13.577258 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:13.577234    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrttl" podUID="98de894c-93c0-4f1f-8916-e17f6d902621"
Jul 06 23:57:13.578583 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.578562    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 06 23:57:13.578710 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.578656    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 06 23:57:13.579763 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.579745    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.581568 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.581546    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 06 23:57:13.582185 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.582164    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 06 23:57:13.582453 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.582428    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 06 23:57:13.582453 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.582428    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lkwqk\""
Jul 06 23:57:13.582640 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.582493    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zpbjs"
Jul 06 23:57:13.582879 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.582859    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8jrcf\""
Jul 06 23:57:13.584298 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.583846    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 06 23:57:13.587659 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.587634    2551 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 06 23:57:13.587822 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.587804    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 06 23:57:13.587945 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.587925    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 06 23:57:13.588868 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.588726    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 06 23:57:13.588868 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.588743    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 06 23:57:13.589089 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.589001    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ztzj5\""
Jul 06 23:57:13.589089 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.589007    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 06 23:57:13.589089 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.589057    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6sq55\""
Jul 06 23:57:13.620536 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.620500    2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mk2pt"
Jul 06 23:57:13.628381 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.628355    2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mk2pt"
Jul 06 23:57:13.662688 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.662670    2551 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 06 23:57:13.676858 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.676835    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-log-socket\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.676858 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.676863    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad267d1f-91ae-433d-a788-f628363570e0-tmp-dir\") pod \"node-resolver-zpbjs\" (UID: \"ad267d1f-91ae-433d-a788-f628363570e0\") " pod="openshift-dns/node-resolver-zpbjs"
Jul 06 23:57:13.677029 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.676892    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret\") pod \"global-pull-secret-syncer-jbkpl\" (UID: \"cce87a14-ec61-4e46-b630-4488f0c25032\") " pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:13.677029 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.676919    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-host-var-lib-kubelet\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.677029 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.676937    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x9z7t\" (UniqueName: \"kubernetes.io/projected/2081578e-abe2-40a8-ab5b-a430646f0e38-kube-api-access-x9z7t\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.677029 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.676958    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-sysctl-d\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.677029 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.676982    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-sys\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.677029 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677005    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-run-systemd\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.677029 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677022    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/981c6f6b-7c41-45aa-9721-f90eee6b57ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.677400 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677028    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-host-var-lib-kubelet\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.677400 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677038    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/628c1362-ba80-4198-b958-90631d8c4f8a-serviceca\") pod \"node-ca-94sl8\" (UID: \"628c1362-ba80-4198-b958-90631d8c4f8a\") " pod="openshift-image-registry/node-ca-94sl8"
Jul 06 23:57:13.677400 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677088    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-host-run-multus-certs\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.677400 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:13.677105    2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:57:13.677400 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677123    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-tmp\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.677400 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677154    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-registration-dir\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.677400 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:13.677176    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret podName:cce87a14-ec61-4e46-b630-4488f0c25032 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:14.177154283 +0000 UTC m=+2.956548944 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret") pod "global-pull-secret-syncer-jbkpl" (UID: "cce87a14-ec61-4e46-b630-4488f0c25032") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:57:13.677400 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677204    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-host-run-multus-certs\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.677400 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677278    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-sysconfig\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.677400 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677307    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-os-release\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.677400 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677334    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-system-cni-dir\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.677400 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677366    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-sys\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.677400 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677382    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-hostroot\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.678098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677418    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-var-lib-kubelet\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.678098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677443    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plc8z\" (UniqueName: \"kubernetes.io/projected/084ae393-acaf-4d47-8460-64ada80ae79f-kube-api-access-plc8z\") pod \"network-metrics-daemon-wm7tt\" (UID: \"084ae393-acaf-4d47-8460-64ada80ae79f\") " pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:13.678098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677467    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/628c1362-ba80-4198-b958-90631d8c4f8a-host\") pod \"node-ca-94sl8\" (UID: \"628c1362-ba80-4198-b958-90631d8c4f8a\") " pod="openshift-image-registry/node-ca-94sl8"
Jul 06 23:57:13.678098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677489    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-kubernetes\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.678098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677510    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-sysctl-d\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.678098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677515    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-host\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.678098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677533    2551 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 06 23:57:13.678098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677575    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-systemd-units\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.678098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677580    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-hostroot\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.678098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677602    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-sys-fs\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.678098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677636    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-var-lib-kubelet\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.678098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677638    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-kubernetes\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.678098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677638    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh54f\" (UniqueName: \"kubernetes.io/projected/628c1362-ba80-4198-b958-90631d8c4f8a-kube-api-access-bh54f\") pod \"node-ca-94sl8\" (UID: \"628c1362-ba80-4198-b958-90631d8c4f8a\") " pod="openshift-image-registry/node-ca-94sl8"
Jul 06 23:57:13.678098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677662    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-sysconfig\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.678098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677680    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-multus-cni-dir\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.678098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677690    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-system-cni-dir\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.678098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677716    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/628c1362-ba80-4198-b958-90631d8c4f8a-host\") pod \"node-ca-94sl8\" (UID: \"628c1362-ba80-4198-b958-90631d8c4f8a\") " pod="openshift-image-registry/node-ca-94sl8"
Jul 06 23:57:13.678098 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677738    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-os-release\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.678924 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677749    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-run\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.678924 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677763    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-host\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.678924 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677776    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/884a13e6-5634-47f4-9644-ec00e1dc9150-agent-certs\") pod \"konnectivity-agent-xwsf4\" (UID: \"884a13e6-5634-47f4-9644-ec00e1dc9150\") " pod="kube-system/konnectivity-agent-xwsf4"
Jul 06 23:57:13.678924 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677813    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-cnibin\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.678924 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677836    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-host-run-netns\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.678924 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677869    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-run\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.678924 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677880    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-multus-cni-dir\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.678924 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677873    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-host-var-lib-cni-multus\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.678924 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677908    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-cnibin\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.678924 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677917    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-host-run-netns\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.678924 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677959    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-etc-kubernetes\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.678924 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678004    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-host-var-lib-cni-multus\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.678924 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.677529    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/628c1362-ba80-4198-b958-90631d8c4f8a-serviceca\") pod \"node-ca-94sl8\" (UID: \"628c1362-ba80-4198-b958-90631d8c4f8a\") " pod="openshift-image-registry/node-ca-94sl8"
Jul 06 23:57:13.678924 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678044    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-sysctl-conf\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.678924 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678077    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-lib-modules\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.678924 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678116    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfsft\" (UniqueName: \"kubernetes.io/projected/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-kube-api-access-zfsft\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.678924 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678190    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-run-openvswitch\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.678924 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678200    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-sysctl-conf\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.679716 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678214    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-multus-conf-dir\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.679716 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678221    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-etc-kubernetes\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.679716 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678253    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-multus-conf-dir\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.679716 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678253    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-lib-modules\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.679716 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678256    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-systemd\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.679716 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678458    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-systemd\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.679716 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678481    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-cni-bin\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.679716 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678542    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.679716 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678615    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/79bba9af-47c1-4fe3-ad16-2e1ec681adee-env-overrides\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.679716 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678650    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tl8j\" (UniqueName: \"kubernetes.io/projected/79bba9af-47c1-4fe3-ad16-2e1ec681adee-kube-api-access-2tl8j\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.679716 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678681    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/981c6f6b-7c41-45aa-9721-f90eee6b57ff-system-cni-dir\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.679716 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678706    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/981c6f6b-7c41-45aa-9721-f90eee6b57ff-cnibin\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.679716 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678754    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2081578e-abe2-40a8-ab5b-a430646f0e38-cni-binary-copy\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.679716 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678804    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-cni-netd\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.679716 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678890    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/981c6f6b-7c41-45aa-9721-f90eee6b57ff-os-release\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.679716 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678920    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/981c6f6b-7c41-45aa-9721-f90eee6b57ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.679716 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678949    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/981c6f6b-7c41-45aa-9721-f90eee6b57ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.680360 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.678979    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-tuned\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.680360 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679007    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hxnd\" (UniqueName: \"kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd\") pod \"network-check-target-hrttl\" (UID: \"98de894c-93c0-4f1f-8916-e17f6d902621\") " pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:13.680360 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679035    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.680360 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679087    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-kubelet\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.680360 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679108    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/79bba9af-47c1-4fe3-ad16-2e1ec681adee-ovn-node-metrics-cert\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.680360 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679158    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs\") pod \"network-metrics-daemon-wm7tt\" (UID: \"084ae393-acaf-4d47-8460-64ada80ae79f\") " pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:13.680360 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679220    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-socket-dir\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.680360 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679251    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-device-dir\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.680360 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679279    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/624536fc-d434-4aa6-b34c-11673ed0ab66-iptables-alerter-script\") pod \"iptables-alerter-v76sk\" (UID: \"624536fc-d434-4aa6-b34c-11673ed0ab66\") " pod="openshift-network-operator/iptables-alerter-v76sk"
Jul 06 23:57:13.680360 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679299    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-node-log\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.680360 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679348    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-run-ovn-kubernetes\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.680360 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679379    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/79bba9af-47c1-4fe3-ad16-2e1ec681adee-ovnkube-config\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.680360 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679385    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2081578e-abe2-40a8-ab5b-a430646f0e38-cni-binary-copy\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.680360 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679419    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/79bba9af-47c1-4fe3-ad16-2e1ec681adee-ovnkube-script-lib\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.680360 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679462    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mpb5z\" (UniqueName: \"kubernetes.io/projected/624536fc-d434-4aa6-b34c-11673ed0ab66-kube-api-access-mpb5z\") pod \"iptables-alerter-v76sk\" (UID: \"624536fc-d434-4aa6-b34c-11673ed0ab66\") " pod="openshift-network-operator/iptables-alerter-v76sk"
Jul 06 23:57:13.680360 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679488    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cce87a14-ec61-4e46-b630-4488f0c25032-dbus\") pod \"global-pull-secret-syncer-jbkpl\" (UID: \"cce87a14-ec61-4e46-b630-4488f0c25032\") " pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:13.681001 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679514    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-multus-socket-dir-parent\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.681001 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679556    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2081578e-abe2-40a8-ab5b-a430646f0e38-multus-daemon-config\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.681001 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679590    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-run-netns\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.681001 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679599    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-multus-socket-dir-parent\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.681001 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679618    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-var-lib-openvswitch\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.681001 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679617    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cce87a14-ec61-4e46-b630-4488f0c25032-dbus\") pod \"global-pull-secret-syncer-jbkpl\" (UID: \"cce87a14-ec61-4e46-b630-4488f0c25032\") " pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:13.681001 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679645    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad267d1f-91ae-433d-a788-f628363570e0-hosts-file\") pod \"node-resolver-zpbjs\" (UID: \"ad267d1f-91ae-433d-a788-f628363570e0\") " pod="openshift-dns/node-resolver-zpbjs"
Jul 06 23:57:13.681001 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679675    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cce87a14-ec61-4e46-b630-4488f0c25032-kubelet-config\") pod \"global-pull-secret-syncer-jbkpl\" (UID: \"cce87a14-ec61-4e46-b630-4488f0c25032\") " pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:13.681001 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679828    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-host-run-k8s-cni-cncf-io\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.681001 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679856    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-modprobe-d\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.681001 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679857    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cce87a14-ec61-4e46-b630-4488f0c25032-kubelet-config\") pod \"global-pull-secret-syncer-jbkpl\" (UID: \"cce87a14-ec61-4e46-b630-4488f0c25032\") " pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:13.681001 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679883    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-slash\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.681001 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679923    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-host-run-k8s-cni-cncf-io\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.681001 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.679910    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/884a13e6-5634-47f4-9644-ec00e1dc9150-konnectivity-ca\") pod \"konnectivity-agent-xwsf4\" (UID: \"884a13e6-5634-47f4-9644-ec00e1dc9150\") " pod="kube-system/konnectivity-agent-xwsf4"
Jul 06 23:57:13.681001 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.680013    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-modprobe-d\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.681001 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.680036    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-etc-selinux\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.681001 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.680062    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhdzs\" (UniqueName: \"kubernetes.io/projected/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-kube-api-access-hhdzs\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.681757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.680086    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2081578e-abe2-40a8-ab5b-a430646f0e38-multus-daemon-config\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.681757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.680089    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-etc-openvswitch\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.681757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.680139    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqxck\" (UniqueName: \"kubernetes.io/projected/ad267d1f-91ae-433d-a788-f628363570e0-kube-api-access-kqxck\") pod \"node-resolver-zpbjs\" (UID: \"ad267d1f-91ae-433d-a788-f628363570e0\") " pod="openshift-dns/node-resolver-zpbjs"
Jul 06 23:57:13.681757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.680168    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/981c6f6b-7c41-45aa-9721-f90eee6b57ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.681757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.680200    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s9x2g\" (UniqueName: \"kubernetes.io/projected/981c6f6b-7c41-45aa-9721-f90eee6b57ff-kube-api-access-s9x2g\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.681757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.680226    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/624536fc-d434-4aa6-b34c-11673ed0ab66-host-slash\") pod \"iptables-alerter-v76sk\" (UID: \"624536fc-d434-4aa6-b34c-11673ed0ab66\") " pod="openshift-network-operator/iptables-alerter-v76sk"
Jul 06 23:57:13.681757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.680256    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-host-var-lib-cni-bin\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.681757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.680280    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-run-ovn\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.681757 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.680306    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2081578e-abe2-40a8-ab5b-a430646f0e38-host-var-lib-cni-bin\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.682113 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.681776    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-etc-tuned\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.682113 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.681905    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-tmp\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.692449 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.692367    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfsft\" (UniqueName: \"kubernetes.io/projected/3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab-kube-api-access-zfsft\") pod \"tuned-k25ls\" (UID: \"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab\") " pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.692449 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.692400    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh54f\" (UniqueName: \"kubernetes.io/projected/628c1362-ba80-4198-b958-90631d8c4f8a-kube-api-access-bh54f\") pod \"node-ca-94sl8\" (UID: \"628c1362-ba80-4198-b958-90631d8c4f8a\") " pod="openshift-image-registry/node-ca-94sl8"
Jul 06 23:57:13.692449 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.692384    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9z7t\" (UniqueName: \"kubernetes.io/projected/2081578e-abe2-40a8-ab5b-a430646f0e38-kube-api-access-x9z7t\") pod \"multus-58shk\" (UID: \"2081578e-abe2-40a8-ab5b-a430646f0e38\") " pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.781334 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781289    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqxck\" (UniqueName: \"kubernetes.io/projected/ad267d1f-91ae-433d-a788-f628363570e0-kube-api-access-kqxck\") pod \"node-resolver-zpbjs\" (UID: \"ad267d1f-91ae-433d-a788-f628363570e0\") " pod="openshift-dns/node-resolver-zpbjs"
Jul 06 23:57:13.781334 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781332    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/981c6f6b-7c41-45aa-9721-f90eee6b57ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.781606 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781359    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s9x2g\" (UniqueName: \"kubernetes.io/projected/981c6f6b-7c41-45aa-9721-f90eee6b57ff-kube-api-access-s9x2g\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.781606 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781385    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/624536fc-d434-4aa6-b34c-11673ed0ab66-host-slash\") pod \"iptables-alerter-v76sk\" (UID: \"624536fc-d434-4aa6-b34c-11673ed0ab66\") " pod="openshift-network-operator/iptables-alerter-v76sk"
Jul 06 23:57:13.781606 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781407    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-run-ovn\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.781606 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781432    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-log-socket\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.781606 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781455    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad267d1f-91ae-433d-a788-f628363570e0-tmp-dir\") pod \"node-resolver-zpbjs\" (UID: \"ad267d1f-91ae-433d-a788-f628363570e0\") " pod="openshift-dns/node-resolver-zpbjs"
Jul 06 23:57:13.781606 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781496    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-run-systemd\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.781606 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781520    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/981c6f6b-7c41-45aa-9721-f90eee6b57ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.781606 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781563    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-registration-dir\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.781606 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781593    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plc8z\" (UniqueName: \"kubernetes.io/projected/084ae393-acaf-4d47-8460-64ada80ae79f-kube-api-access-plc8z\") pod \"network-metrics-daemon-wm7tt\" (UID: \"084ae393-acaf-4d47-8460-64ada80ae79f\") " pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:13.782060 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781619    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-systemd-units\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.782060 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781642    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-sys-fs\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.782060 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781669    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/884a13e6-5634-47f4-9644-ec00e1dc9150-agent-certs\") pod \"konnectivity-agent-xwsf4\" (UID: \"884a13e6-5634-47f4-9644-ec00e1dc9150\") " pod="kube-system/konnectivity-agent-xwsf4"
Jul 06 23:57:13.782060 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781697    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-run-openvswitch\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.782060 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781724    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-cni-bin\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.782060 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781749    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.782060 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781776    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/79bba9af-47c1-4fe3-ad16-2e1ec681adee-env-overrides\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.782060 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781784    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/981c6f6b-7c41-45aa-9721-f90eee6b57ff-tuning-conf-dir\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.782060 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781801    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tl8j\" (UniqueName: \"kubernetes.io/projected/79bba9af-47c1-4fe3-ad16-2e1ec681adee-kube-api-access-2tl8j\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.782060 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781826    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/981c6f6b-7c41-45aa-9721-f90eee6b57ff-system-cni-dir\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.782060 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781854    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/981c6f6b-7c41-45aa-9721-f90eee6b57ff-cnibin\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.782060 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781878    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-cni-netd\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.782060 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781904    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/981c6f6b-7c41-45aa-9721-f90eee6b57ff-os-release\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.782060 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781929    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/981c6f6b-7c41-45aa-9721-f90eee6b57ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.782060 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781955    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/981c6f6b-7c41-45aa-9721-f90eee6b57ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.782060 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.781982    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hxnd\" (UniqueName: \"kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd\") pod \"network-check-target-hrttl\" (UID: \"98de894c-93c0-4f1f-8916-e17f6d902621\") " pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:13.782060 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782008    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.782938 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782035    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-kubelet\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.782938 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782066    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/79bba9af-47c1-4fe3-ad16-2e1ec681adee-ovn-node-metrics-cert\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.782938 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782092    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs\") pod \"network-metrics-daemon-wm7tt\" (UID: \"084ae393-acaf-4d47-8460-64ada80ae79f\") " pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:13.782938 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782117    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-socket-dir\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.782938 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782142    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-device-dir\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.782938 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782167    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/624536fc-d434-4aa6-b34c-11673ed0ab66-iptables-alerter-script\") pod \"iptables-alerter-v76sk\" (UID: \"624536fc-d434-4aa6-b34c-11673ed0ab66\") " pod="openshift-network-operator/iptables-alerter-v76sk"
Jul 06 23:57:13.782938 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782173    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-log-socket\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.782938 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782196    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-node-log\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.782938 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782236    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/624536fc-d434-4aa6-b34c-11673ed0ab66-host-slash\") pod \"iptables-alerter-v76sk\" (UID: \"624536fc-d434-4aa6-b34c-11673ed0ab66\") " pod="openshift-network-operator/iptables-alerter-v76sk"
Jul 06 23:57:13.782938 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782276    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-run-ovn\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.782938 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782281    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/981c6f6b-7c41-45aa-9721-f90eee6b57ff-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.782938 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782281    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-run-systemd\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.782938 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782416    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-socket-dir\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.782938 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782495    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-run-openvswitch\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.782938 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:13.782506    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:57:13.782938 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782619    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-run-ovn-kubernetes\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.782938 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782647    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ad267d1f-91ae-433d-a788-f628363570e0-tmp-dir\") pod \"node-resolver-zpbjs\" (UID: \"ad267d1f-91ae-433d-a788-f628363570e0\") " pod="openshift-dns/node-resolver-zpbjs"
Jul 06 23:57:13.782938 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782659    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/79bba9af-47c1-4fe3-ad16-2e1ec681adee-ovnkube-config\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.783843 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782689    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/79bba9af-47c1-4fe3-ad16-2e1ec681adee-ovnkube-script-lib\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.783843 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:13.782756    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs podName:084ae393-acaf-4d47-8460-64ada80ae79f nodeName:}" failed. No retries permitted until 2026-07-06 23:57:14.282736042 +0000 UTC m=+3.062130680 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs") pod "network-metrics-daemon-wm7tt" (UID: "084ae393-acaf-4d47-8460-64ada80ae79f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:57:13.783843 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782803    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/981c6f6b-7c41-45aa-9721-f90eee6b57ff-os-release\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.783843 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782805    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-systemd-units\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.783843 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782852    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.783843 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782853    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-cni-bin\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.783843 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782886    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-node-log\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.783843 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782901    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/981c6f6b-7c41-45aa-9721-f90eee6b57ff-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.783843 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782906    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/981c6f6b-7c41-45aa-9721-f90eee6b57ff-cni-binary-copy\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.783843 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782919    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-sys-fs\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.783843 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782928    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.783843 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782946    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/981c6f6b-7c41-45aa-9721-f90eee6b57ff-system-cni-dir\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.783843 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.782965    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mpb5z\" (UniqueName: \"kubernetes.io/projected/624536fc-d434-4aa6-b34c-11673ed0ab66-kube-api-access-mpb5z\") pod \"iptables-alerter-v76sk\" (UID: \"624536fc-d434-4aa6-b34c-11673ed0ab66\") " pod="openshift-network-operator/iptables-alerter-v76sk"
Jul 06 23:57:13.783843 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783021    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-device-dir\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.783843 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783166    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-run-netns\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.783843 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783201    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/981c6f6b-7c41-45aa-9721-f90eee6b57ff-cnibin\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.784679 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783226    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-registration-dir\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.784679 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783265    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-run-ovn-kubernetes\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.784679 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783297    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-var-lib-openvswitch\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.784679 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783323    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad267d1f-91ae-433d-a788-f628363570e0-hosts-file\") pod \"node-resolver-zpbjs\" (UID: \"ad267d1f-91ae-433d-a788-f628363570e0\") " pod="openshift-dns/node-resolver-zpbjs"
Jul 06 23:57:13.784679 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783326    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/79bba9af-47c1-4fe3-ad16-2e1ec681adee-ovnkube-config\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.784679 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783365    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-cni-netd\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.784679 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783376    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/79bba9af-47c1-4fe3-ad16-2e1ec681adee-env-overrides\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.784679 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783398    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-kubelet\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.784679 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783401    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-run-netns\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.784679 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783446    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ad267d1f-91ae-433d-a788-f628363570e0-hosts-file\") pod \"node-resolver-zpbjs\" (UID: \"ad267d1f-91ae-433d-a788-f628363570e0\") " pod="openshift-dns/node-resolver-zpbjs"
Jul 06 23:57:13.784679 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783451    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-var-lib-openvswitch\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.784679 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783495    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-slash\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.784679 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783524    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/884a13e6-5634-47f4-9644-ec00e1dc9150-konnectivity-ca\") pod \"konnectivity-agent-xwsf4\" (UID: \"884a13e6-5634-47f4-9644-ec00e1dc9150\") " pod="kube-system/konnectivity-agent-xwsf4"
Jul 06 23:57:13.784679 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783581    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/624536fc-d434-4aa6-b34c-11673ed0ab66-iptables-alerter-script\") pod \"iptables-alerter-v76sk\" (UID: \"624536fc-d434-4aa6-b34c-11673ed0ab66\") " pod="openshift-network-operator/iptables-alerter-v76sk"
Jul 06 23:57:13.784679 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783584    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-etc-selinux\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.784679 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783640    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhdzs\" (UniqueName: \"kubernetes.io/projected/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-kube-api-access-hhdzs\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.784679 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783697    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-etc-openvswitch\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.785565 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783735    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/79bba9af-47c1-4fe3-ad16-2e1ec681adee-ovnkube-script-lib\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.785565 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783753    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-etc-selinux\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.785565 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783642    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-host-slash\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.785565 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.783799    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/79bba9af-47c1-4fe3-ad16-2e1ec681adee-etc-openvswitch\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.785565 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.784018    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/884a13e6-5634-47f4-9644-ec00e1dc9150-konnectivity-ca\") pod \"konnectivity-agent-xwsf4\" (UID: \"884a13e6-5634-47f4-9644-ec00e1dc9150\") " pod="kube-system/konnectivity-agent-xwsf4"
Jul 06 23:57:13.786278 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.786242    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/884a13e6-5634-47f4-9644-ec00e1dc9150-agent-certs\") pod \"konnectivity-agent-xwsf4\" (UID: \"884a13e6-5634-47f4-9644-ec00e1dc9150\") " pod="kube-system/konnectivity-agent-xwsf4"
Jul 06 23:57:13.786373 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.786319    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/79bba9af-47c1-4fe3-ad16-2e1ec681adee-ovn-node-metrics-cert\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.793772 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.793721    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s9x2g\" (UniqueName: \"kubernetes.io/projected/981c6f6b-7c41-45aa-9721-f90eee6b57ff-kube-api-access-s9x2g\") pod \"multus-additional-cni-plugins-rtq89\" (UID: \"981c6f6b-7c41-45aa-9721-f90eee6b57ff\") " pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.794956 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.794933    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqxck\" (UniqueName: \"kubernetes.io/projected/ad267d1f-91ae-433d-a788-f628363570e0-kube-api-access-kqxck\") pod \"node-resolver-zpbjs\" (UID: \"ad267d1f-91ae-433d-a788-f628363570e0\") " pod="openshift-dns/node-resolver-zpbjs"
Jul 06 23:57:13.800336 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:13.800314    2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:57:13.800336 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:13.800338    2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:57:13.800497 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:13.800352    2551 projected.go:196] Error preparing data for projected volume kube-api-access-5hxnd for pod openshift-network-diagnostics/network-check-target-hrttl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:57:13.800497 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:13.800434    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd podName:98de894c-93c0-4f1f-8916-e17f6d902621 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:14.300413953 +0000 UTC m=+3.079808612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5hxnd" (UniqueName: "kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd") pod "network-check-target-hrttl" (UID: "98de894c-93c0-4f1f-8916-e17f6d902621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:57:13.802311 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.802283    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhdzs\" (UniqueName: \"kubernetes.io/projected/e2a5c7a6-f372-46a1-91a8-96107aad7dc2-kube-api-access-hhdzs\") pod \"aws-ebs-csi-driver-node-fwc48\" (UID: \"e2a5c7a6-f372-46a1-91a8-96107aad7dc2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.802792 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.802764    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plc8z\" (UniqueName: \"kubernetes.io/projected/084ae393-acaf-4d47-8460-64ada80ae79f-kube-api-access-plc8z\") pod \"network-metrics-daemon-wm7tt\" (UID: \"084ae393-acaf-4d47-8460-64ada80ae79f\") " pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:13.802882 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.802773    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mpb5z\" (UniqueName: \"kubernetes.io/projected/624536fc-d434-4aa6-b34c-11673ed0ab66-kube-api-access-mpb5z\") pod \"iptables-alerter-v76sk\" (UID: \"624536fc-d434-4aa6-b34c-11673ed0ab66\") " pod="openshift-network-operator/iptables-alerter-v76sk"
Jul 06 23:57:13.803171 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.803154    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tl8j\" (UniqueName: \"kubernetes.io/projected/79bba9af-47c1-4fe3-ad16-2e1ec681adee-kube-api-access-2tl8j\") pod \"ovnkube-node-2547n\" (UID: \"79bba9af-47c1-4fe3-ad16-2e1ec681adee\") " pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.865599 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.865567    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-58shk"
Jul 06 23:57:13.872695 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.872671    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-k25ls"
Jul 06 23:57:13.880635 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.880609    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-94sl8"
Jul 06 23:57:13.889792 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.889767    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:13.896822 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.896798    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-rtq89"
Jul 06 23:57:13.903667 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.903647    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-v76sk"
Jul 06 23:57:13.909453 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.909432    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xwsf4"
Jul 06 23:57:13.916368 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.916349    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48"
Jul 06 23:57:13.921020 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:13.920997    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zpbjs"
Jul 06 23:57:14.187333 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:14.187244    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret\") pod \"global-pull-secret-syncer-jbkpl\" (UID: \"cce87a14-ec61-4e46-b630-4488f0c25032\") " pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:14.187512 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:14.187405    2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:57:14.187512 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:14.187479    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret podName:cce87a14-ec61-4e46-b630-4488f0c25032 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:15.187459759 +0000 UTC m=+3.966854404 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret") pod "global-pull-secret-syncer-jbkpl" (UID: "cce87a14-ec61-4e46-b630-4488f0c25032") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:57:14.288334 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:14.288300    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs\") pod \"network-metrics-daemon-wm7tt\" (UID: \"084ae393-acaf-4d47-8460-64ada80ae79f\") " pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:14.288492 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:14.288474    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:57:14.288568 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:14.288558    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs podName:084ae393-acaf-4d47-8460-64ada80ae79f nodeName:}" failed. No retries permitted until 2026-07-06 23:57:15.28854315 +0000 UTC m=+4.067937800 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs") pod "network-metrics-daemon-wm7tt" (UID: "084ae393-acaf-4d47-8460-64ada80ae79f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:57:14.389700 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:14.389662    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hxnd\" (UniqueName: \"kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd\") pod \"network-check-target-hrttl\" (UID: \"98de894c-93c0-4f1f-8916-e17f6d902621\") " pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:14.389873 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:14.389838    2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:57:14.389873 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:14.389863    2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:57:14.389873 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:14.389874    2551 projected.go:196] Error preparing data for projected volume kube-api-access-5hxnd for pod openshift-network-diagnostics/network-check-target-hrttl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:57:14.389989 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:14.389927    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd podName:98de894c-93c0-4f1f-8916-e17f6d902621 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:15.389913005 +0000 UTC m=+4.169307642 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5hxnd" (UniqueName: "kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd") pod "network-check-target-hrttl" (UID: "98de894c-93c0-4f1f-8916-e17f6d902621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:57:14.632131 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:14.631853    2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:52:14 +0000 UTC" deadline="2028-01-09 20:52:38.411020484 +0000 UTC"
Jul 06 23:57:14.632131 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:14.631895    2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13244h55m23.779129926s"
Jul 06 23:57:14.651837 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:14.651783    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79bba9af_47c1_4fe3_ad16_2e1ec681adee.slice/crio-29c273ca6abd45a982afc893cc66b72498fc5857d86aa363111d0287afda67a5 WatchSource:0}: Error finding container 29c273ca6abd45a982afc893cc66b72498fc5857d86aa363111d0287afda67a5: Status 404 returned error can't find the container with id 29c273ca6abd45a982afc893cc66b72498fc5857d86aa363111d0287afda67a5
Jul 06 23:57:14.655353 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:14.655291    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad267d1f_91ae_433d_a788_f628363570e0.slice/crio-984e086a9f5e98bd9dfbb549da1725c952537cb6ccafdd5bb3d3b812b688149c WatchSource:0}: Error finding container 984e086a9f5e98bd9dfbb549da1725c952537cb6ccafdd5bb3d3b812b688149c: Status 404 returned error can't find the container with id 984e086a9f5e98bd9dfbb549da1725c952537cb6ccafdd5bb3d3b812b688149c
Jul 06 23:57:14.676948 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:14.676921    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod884a13e6_5634_47f4_9644_ec00e1dc9150.slice/crio-6de4cae65915993fc36fe6154b637e5f14bc86d8acc2b473d9cd0d21583fa5c3 WatchSource:0}: Error finding container 6de4cae65915993fc36fe6154b637e5f14bc86d8acc2b473d9cd0d21583fa5c3: Status 404 returned error can't find the container with id 6de4cae65915993fc36fe6154b637e5f14bc86d8acc2b473d9cd0d21583fa5c3
Jul 06 23:57:14.679427 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:14.679409    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod624536fc_d434_4aa6_b34c_11673ed0ab66.slice/crio-c11455a092511c56cf3dd3a1a0a817c6842be4c8f7a35e8ada6c5d8fac7887f6 WatchSource:0}: Error finding container c11455a092511c56cf3dd3a1a0a817c6842be4c8f7a35e8ada6c5d8fac7887f6: Status 404 returned error can't find the container with id c11455a092511c56cf3dd3a1a0a817c6842be4c8f7a35e8ada6c5d8fac7887f6
Jul 06 23:57:14.680920 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:14.680795    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2081578e_abe2_40a8_ab5b_a430646f0e38.slice/crio-3f7843da38d6472a16072e9a24f73c5eb219850974eac1b252aa24edbfcf0804 WatchSource:0}: Error finding container 3f7843da38d6472a16072e9a24f73c5eb219850974eac1b252aa24edbfcf0804: Status 404 returned error can't find the container with id 3f7843da38d6472a16072e9a24f73c5eb219850974eac1b252aa24edbfcf0804
Jul 06 23:57:14.682248 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:14.681915    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod628c1362_ba80_4198_b958_90631d8c4f8a.slice/crio-ec8abba9ce6de760dccab83f157ac21be6bb1b52f98a44d073683e251550949b WatchSource:0}: Error finding container ec8abba9ce6de760dccab83f157ac21be6bb1b52f98a44d073683e251550949b: Status 404 returned error can't find the container with id ec8abba9ce6de760dccab83f157ac21be6bb1b52f98a44d073683e251550949b
Jul 06 23:57:14.682979 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:14.682787    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3685aea4_dbc3_4dbc_bf0a_6a1c67c5b0ab.slice/crio-29cdfacb2c91f6b90a8ba9fb7a37e5db44a0637aefdd78afaa3084500ce37337 WatchSource:0}: Error finding container 29cdfacb2c91f6b90a8ba9fb7a37e5db44a0637aefdd78afaa3084500ce37337: Status 404 returned error can't find the container with id 29cdfacb2c91f6b90a8ba9fb7a37e5db44a0637aefdd78afaa3084500ce37337
Jul 06 23:57:14.685374 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:14.685224    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2a5c7a6_f372_46a1_91a8_96107aad7dc2.slice/crio-d2d8939c315161949104d05a1f341ced06bf16111bee2f93f1e7b1ecc7d4c6ca WatchSource:0}: Error finding container d2d8939c315161949104d05a1f341ced06bf16111bee2f93f1e7b1ecc7d4c6ca: Status 404 returned error can't find the container with id d2d8939c315161949104d05a1f341ced06bf16111bee2f93f1e7b1ecc7d4c6ca
Jul 06 23:57:14.687785 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:14.687768    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:14.687932 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:14.687901    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm7tt" podUID="084ae393-acaf-4d47-8460-64ada80ae79f"
Jul 06 23:57:14.696712 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:14.696681    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48" event={"ID":"e2a5c7a6-f372-46a1-91a8-96107aad7dc2","Type":"ContainerStarted","Data":"d2d8939c315161949104d05a1f341ced06bf16111bee2f93f1e7b1ecc7d4c6ca"}
Jul 06 23:57:14.697968 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:14.697940    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k25ls" event={"ID":"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab","Type":"ContainerStarted","Data":"29cdfacb2c91f6b90a8ba9fb7a37e5db44a0637aefdd78afaa3084500ce37337"}
Jul 06 23:57:14.699229 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:14.699172    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-94sl8" event={"ID":"628c1362-ba80-4198-b958-90631d8c4f8a","Type":"ContainerStarted","Data":"ec8abba9ce6de760dccab83f157ac21be6bb1b52f98a44d073683e251550949b"}
Jul 06 23:57:14.700632 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:14.700593    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xwsf4" event={"ID":"884a13e6-5634-47f4-9644-ec00e1dc9150","Type":"ContainerStarted","Data":"6de4cae65915993fc36fe6154b637e5f14bc86d8acc2b473d9cd0d21583fa5c3"}
Jul 06 23:57:14.701835 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:14.701810    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zpbjs" event={"ID":"ad267d1f-91ae-433d-a788-f628363570e0","Type":"ContainerStarted","Data":"984e086a9f5e98bd9dfbb549da1725c952537cb6ccafdd5bb3d3b812b688149c"}
Jul 06 23:57:14.702930 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:14.702905    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtq89" event={"ID":"981c6f6b-7c41-45aa-9721-f90eee6b57ff","Type":"ContainerStarted","Data":"89ef67ca1c84b7b75270e8b1e1612e8a2c36bf458eeaab67f57ccddfeeec5d11"}
Jul 06 23:57:14.704035 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:14.704014    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-58shk" event={"ID":"2081578e-abe2-40a8-ab5b-a430646f0e38","Type":"ContainerStarted","Data":"3f7843da38d6472a16072e9a24f73c5eb219850974eac1b252aa24edbfcf0804"}
Jul 06 23:57:14.705322 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:14.705294    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v76sk" event={"ID":"624536fc-d434-4aa6-b34c-11673ed0ab66","Type":"ContainerStarted","Data":"c11455a092511c56cf3dd3a1a0a817c6842be4c8f7a35e8ada6c5d8fac7887f6"}
Jul 06 23:57:14.706562 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:14.706538    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2547n" event={"ID":"79bba9af-47c1-4fe3-ad16-2e1ec681adee","Type":"ContainerStarted","Data":"29c273ca6abd45a982afc893cc66b72498fc5857d86aa363111d0287afda67a5"}
Jul 06 23:57:15.197257 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:15.196342    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret\") pod \"global-pull-secret-syncer-jbkpl\" (UID: \"cce87a14-ec61-4e46-b630-4488f0c25032\") " pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:15.197257 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:15.196746    2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:57:15.197257 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:15.196819    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret podName:cce87a14-ec61-4e46-b630-4488f0c25032 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:17.196798106 +0000 UTC m=+5.976192749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret") pod "global-pull-secret-syncer-jbkpl" (UID: "cce87a14-ec61-4e46-b630-4488f0c25032") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:57:15.298660 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:15.297986    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs\") pod \"network-metrics-daemon-wm7tt\" (UID: \"084ae393-acaf-4d47-8460-64ada80ae79f\") " pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:15.298660 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:15.298182    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:57:15.298660 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:15.298254    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs podName:084ae393-acaf-4d47-8460-64ada80ae79f nodeName:}" failed. No retries permitted until 2026-07-06 23:57:17.298232131 +0000 UTC m=+6.077626770 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs") pod "network-metrics-daemon-wm7tt" (UID: "084ae393-acaf-4d47-8460-64ada80ae79f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:57:15.399426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:15.398757    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hxnd\" (UniqueName: \"kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd\") pod \"network-check-target-hrttl\" (UID: \"98de894c-93c0-4f1f-8916-e17f6d902621\") " pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:15.399426 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:15.398961    2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:57:15.399426 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:15.398983    2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:57:15.399426 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:15.398997    2551 projected.go:196] Error preparing data for projected volume kube-api-access-5hxnd for pod openshift-network-diagnostics/network-check-target-hrttl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:57:15.399426 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:15.399058    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd podName:98de894c-93c0-4f1f-8916-e17f6d902621 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:17.399039231 +0000 UTC m=+6.178433871 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5hxnd" (UniqueName: "kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd") pod "network-check-target-hrttl" (UID: "98de894c-93c0-4f1f-8916-e17f6d902621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:57:15.633179 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:15.633067    2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-05 23:52:14 +0000 UTC" deadline="2028-01-03 06:42:54.162306829 +0000 UTC"
Jul 06 23:57:15.633179 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:15.633135    2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13086h45m38.529175465s"
Jul 06 23:57:15.690434 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:15.690229    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:15.690434 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:15.690371    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrttl" podUID="98de894c-93c0-4f1f-8916-e17f6d902621"
Jul 06 23:57:15.690434 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:15.690424    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:15.690760 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:15.690569    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jbkpl" podUID="cce87a14-ec61-4e46-b630-4488f0c25032"
Jul 06 23:57:15.730963 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:15.730043    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal" event={"ID":"098c8f1e1bab8bfb614b320b9ae089b4","Type":"ContainerStarted","Data":"cea6a5461bd77d695a3442320aa7d63b97cf77a0840a19dbc9f58a28b8b98a74"}
Jul 06 23:57:15.737659 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:15.737621    2551 generic.go:356] "Generic (PLEG): container finished" podID="9babfa7336fea69e033ea2de5a041c6e" containerID="47a1be946f0e026dca368c44e7eab9c2064bf5a2f470f8fbcde7382e0d7034db" exitCode=0
Jul 06 23:57:15.737860 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:15.737688    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal" event={"ID":"9babfa7336fea69e033ea2de5a041c6e","Type":"ContainerDied","Data":"47a1be946f0e026dca368c44e7eab9c2064bf5a2f470f8fbcde7382e0d7034db"}
Jul 06 23:57:15.750642 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:15.750566    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-139.ec2.internal" podStartSLOduration=2.750549906 podStartE2EDuration="2.750549906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:57:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:15.750257402 +0000 UTC m=+4.529652063" watchObservedRunningTime="2026-07-06 23:57:15.750549906 +0000 UTC m=+4.529944567"
Jul 06 23:57:16.688299 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:16.687831    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:16.688299 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:16.687980    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm7tt" podUID="084ae393-acaf-4d47-8460-64ada80ae79f"
Jul 06 23:57:16.764670 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:16.764562    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal" event={"ID":"9babfa7336fea69e033ea2de5a041c6e","Type":"ContainerStarted","Data":"8620480f4d1b31d9045f84cd07b3d1af8262681c56e86f16fc21d0efeb1fb853"}
Jul 06 23:57:17.216661 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:17.215907    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret\") pod \"global-pull-secret-syncer-jbkpl\" (UID: \"cce87a14-ec61-4e46-b630-4488f0c25032\") " pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:17.216661 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:17.216153    2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:57:17.216661 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:17.216232    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret podName:cce87a14-ec61-4e46-b630-4488f0c25032 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:21.216213359 +0000 UTC m=+9.995607999 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret") pod "global-pull-secret-syncer-jbkpl" (UID: "cce87a14-ec61-4e46-b630-4488f0c25032") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:57:17.317333 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:17.316604    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs\") pod \"network-metrics-daemon-wm7tt\" (UID: \"084ae393-acaf-4d47-8460-64ada80ae79f\") " pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:17.317333 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:17.316772    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:57:17.317333 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:17.316842    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs podName:084ae393-acaf-4d47-8460-64ada80ae79f nodeName:}" failed. No retries permitted until 2026-07-06 23:57:21.316820979 +0000 UTC m=+10.096215620 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs") pod "network-metrics-daemon-wm7tt" (UID: "084ae393-acaf-4d47-8460-64ada80ae79f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:57:17.417345 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:17.417301    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hxnd\" (UniqueName: \"kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd\") pod \"network-check-target-hrttl\" (UID: \"98de894c-93c0-4f1f-8916-e17f6d902621\") " pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:17.417627 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:17.417606    2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:57:17.417719 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:17.417639    2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:57:17.417719 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:17.417654    2551 projected.go:196] Error preparing data for projected volume kube-api-access-5hxnd for pod openshift-network-diagnostics/network-check-target-hrttl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:57:17.417837 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:17.417757    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd podName:98de894c-93c0-4f1f-8916-e17f6d902621 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:21.41769878 +0000 UTC m=+10.197093438 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5hxnd" (UniqueName: "kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd") pod "network-check-target-hrttl" (UID: "98de894c-93c0-4f1f-8916-e17f6d902621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:57:17.688768 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:17.688681    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:17.689264 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:17.688835    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jbkpl" podUID="cce87a14-ec61-4e46-b630-4488f0c25032"
Jul 06 23:57:17.689342 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:17.689293    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:17.689450 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:17.689390    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrttl" podUID="98de894c-93c0-4f1f-8916-e17f6d902621"
Jul 06 23:57:18.688847 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:18.688812    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:18.689424 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:18.688990    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm7tt" podUID="084ae393-acaf-4d47-8460-64ada80ae79f"
Jul 06 23:57:19.689627 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:19.688887    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:19.689627 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:19.689030    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrttl" podUID="98de894c-93c0-4f1f-8916-e17f6d902621"
Jul 06 23:57:19.689627 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:19.689473    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:19.689627 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:19.689596    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jbkpl" podUID="cce87a14-ec61-4e46-b630-4488f0c25032"
Jul 06 23:57:20.688127 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:20.688090    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:20.688328 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:20.688253    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm7tt" podUID="084ae393-acaf-4d47-8460-64ada80ae79f"
Jul 06 23:57:21.255710 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:21.255670    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret\") pod \"global-pull-secret-syncer-jbkpl\" (UID: \"cce87a14-ec61-4e46-b630-4488f0c25032\") " pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:21.256213 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:21.255831    2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:57:21.256213 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:21.255901    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret podName:cce87a14-ec61-4e46-b630-4488f0c25032 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:29.255879863 +0000 UTC m=+18.035274503 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret") pod "global-pull-secret-syncer-jbkpl" (UID: "cce87a14-ec61-4e46-b630-4488f0c25032") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:57:21.356904 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:21.356864    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs\") pod \"network-metrics-daemon-wm7tt\" (UID: \"084ae393-acaf-4d47-8460-64ada80ae79f\") " pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:21.357096 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:21.357005    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:57:21.357096 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:21.357074    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs podName:084ae393-acaf-4d47-8460-64ada80ae79f nodeName:}" failed. No retries permitted until 2026-07-06 23:57:29.357054665 +0000 UTC m=+18.136449315 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs") pod "network-metrics-daemon-wm7tt" (UID: "084ae393-acaf-4d47-8460-64ada80ae79f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:57:21.457726 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:21.457685    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hxnd\" (UniqueName: \"kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd\") pod \"network-check-target-hrttl\" (UID: \"98de894c-93c0-4f1f-8916-e17f6d902621\") " pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:21.458353 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:21.457953    2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:57:21.458353 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:21.457987    2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:57:21.458353 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:21.458000    2551 projected.go:196] Error preparing data for projected volume kube-api-access-5hxnd for pod openshift-network-diagnostics/network-check-target-hrttl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:57:21.458353 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:21.458072    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd podName:98de894c-93c0-4f1f-8916-e17f6d902621 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:29.458049997 +0000 UTC m=+18.237444637 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5hxnd" (UniqueName: "kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd") pod "network-check-target-hrttl" (UID: "98de894c-93c0-4f1f-8916-e17f6d902621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:57:21.689644 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:21.689563    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:21.689792 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:21.689679    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jbkpl" podUID="cce87a14-ec61-4e46-b630-4488f0c25032"
Jul 06 23:57:21.690006 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:21.689984    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:21.690099 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:21.690083    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrttl" podUID="98de894c-93c0-4f1f-8916-e17f6d902621"
Jul 06 23:57:22.687833 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:22.687795    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:22.688379 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:22.687950    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm7tt" podUID="084ae393-acaf-4d47-8460-64ada80ae79f"
Jul 06 23:57:23.688125 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:23.688087    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:23.688595 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:23.688219    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jbkpl" podUID="cce87a14-ec61-4e46-b630-4488f0c25032"
Jul 06 23:57:23.688754 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:23.688733    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:23.688867 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:23.688847    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrttl" podUID="98de894c-93c0-4f1f-8916-e17f6d902621"
Jul 06 23:57:24.688276 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:24.688243    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:24.688854 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:24.688384    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm7tt" podUID="084ae393-acaf-4d47-8460-64ada80ae79f"
Jul 06 23:57:25.687921 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:25.687883    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:25.688098 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:25.688003    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrttl" podUID="98de894c-93c0-4f1f-8916-e17f6d902621"
Jul 06 23:57:25.688149 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:25.688095    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:25.688223 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:25.688201    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jbkpl" podUID="cce87a14-ec61-4e46-b630-4488f0c25032"
Jul 06 23:57:26.688720 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:26.688683    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:26.689188 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:26.688824    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm7tt" podUID="084ae393-acaf-4d47-8460-64ada80ae79f"
Jul 06 23:57:27.688152 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:27.688116    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:27.688318 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:27.688260    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrttl" podUID="98de894c-93c0-4f1f-8916-e17f6d902621"
Jul 06 23:57:27.688380 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:27.688324    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:27.688468 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:27.688446    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jbkpl" podUID="cce87a14-ec61-4e46-b630-4488f0c25032"
Jul 06 23:57:28.688223 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:28.688183    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:28.688697 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:28.688339    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm7tt" podUID="084ae393-acaf-4d47-8460-64ada80ae79f"
Jul 06 23:57:29.316744 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:29.316705    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret\") pod \"global-pull-secret-syncer-jbkpl\" (UID: \"cce87a14-ec61-4e46-b630-4488f0c25032\") " pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:29.316950 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:29.316859    2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:57:29.316950 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:29.316936    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret podName:cce87a14-ec61-4e46-b630-4488f0c25032 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:45.316913789 +0000 UTC m=+34.096308438 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret") pod "global-pull-secret-syncer-jbkpl" (UID: "cce87a14-ec61-4e46-b630-4488f0c25032") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:57:29.417478 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:29.417440    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs\") pod \"network-metrics-daemon-wm7tt\" (UID: \"084ae393-acaf-4d47-8460-64ada80ae79f\") " pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:29.417669 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:29.417615    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:57:29.417728 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:29.417676    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs podName:084ae393-acaf-4d47-8460-64ada80ae79f nodeName:}" failed. No retries permitted until 2026-07-06 23:57:45.417660913 +0000 UTC m=+34.197055572 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs") pod "network-metrics-daemon-wm7tt" (UID: "084ae393-acaf-4d47-8460-64ada80ae79f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:57:29.518073 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:29.518033    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hxnd\" (UniqueName: \"kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd\") pod \"network-check-target-hrttl\" (UID: \"98de894c-93c0-4f1f-8916-e17f6d902621\") " pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:29.518221 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:29.518171    2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:57:29.518221 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:29.518194    2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:57:29.518221 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:29.518203    2551 projected.go:196] Error preparing data for projected volume kube-api-access-5hxnd for pod openshift-network-diagnostics/network-check-target-hrttl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:57:29.518391 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:29.518261    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd podName:98de894c-93c0-4f1f-8916-e17f6d902621 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:45.518247202 +0000 UTC m=+34.297641836 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5hxnd" (UniqueName: "kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd") pod "network-check-target-hrttl" (UID: "98de894c-93c0-4f1f-8916-e17f6d902621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:57:29.688021 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:29.687932    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:29.688183 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:29.687944    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:29.688183 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:29.688049    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrttl" podUID="98de894c-93c0-4f1f-8916-e17f6d902621"
Jul 06 23:57:29.688183 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:29.688125    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jbkpl" podUID="cce87a14-ec61-4e46-b630-4488f0c25032"
Jul 06 23:57:30.688688 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:30.688645    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:30.689163 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:30.688802    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm7tt" podUID="084ae393-acaf-4d47-8460-64ada80ae79f"
Jul 06 23:57:31.689361 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:31.689316    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:31.689815 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:31.689472    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrttl" podUID="98de894c-93c0-4f1f-8916-e17f6d902621"
Jul 06 23:57:31.689815 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:31.689537    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:31.689815 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:31.689636    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jbkpl" podUID="cce87a14-ec61-4e46-b630-4488f0c25032"
Jul 06 23:57:32.688393 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:32.688363    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:32.688577 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:32.688500    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm7tt" podUID="084ae393-acaf-4d47-8460-64ada80ae79f"
Jul 06 23:57:33.688129 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:33.688089    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:33.688588 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:33.688089    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:33.688588 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:33.688230    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jbkpl" podUID="cce87a14-ec61-4e46-b630-4488f0c25032"
Jul 06 23:57:33.688588 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:33.688294    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrttl" podUID="98de894c-93c0-4f1f-8916-e17f6d902621"
Jul 06 23:57:34.688919 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.688611    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:34.689708 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:34.689028    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm7tt" podUID="084ae393-acaf-4d47-8460-64ada80ae79f"
Jul 06 23:57:34.806031 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.805948    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-58shk" event={"ID":"2081578e-abe2-40a8-ab5b-a430646f0e38","Type":"ContainerStarted","Data":"fb6861b5b6b0ccc48e9e2c8edd42a0c77cc5ea0f6e0f22a4230f2d9846622741"}
Jul 06 23:57:34.809179 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.809146    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2547n" event={"ID":"79bba9af-47c1-4fe3-ad16-2e1ec681adee","Type":"ContainerStarted","Data":"ecb3937f66b01de55150d901e4c0c25cd85a5cd27c2f6f1bee3394728c71012b"}
Jul 06 23:57:34.809323 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.809236    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2547n" event={"ID":"79bba9af-47c1-4fe3-ad16-2e1ec681adee","Type":"ContainerStarted","Data":"1b89a8eff2e3e86c6eefc42e4ccb33d24721a148aad924df2057a7e8c282e239"}
Jul 06 23:57:34.809323 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.809289    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2547n" event={"ID":"79bba9af-47c1-4fe3-ad16-2e1ec681adee","Type":"ContainerStarted","Data":"a4fc64d33f29086c148eb94fedafcf6e1319a8359db1b2e451cb5ff5af97bea9"}
Jul 06 23:57:34.809408 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.809336    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2547n" event={"ID":"79bba9af-47c1-4fe3-ad16-2e1ec681adee","Type":"ContainerStarted","Data":"97e3bc04ac4852c8d2be81d677243c0912067e2a887de989f54c2dac176e6819"}
Jul 06 23:57:34.809408 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.809377    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2547n" event={"ID":"79bba9af-47c1-4fe3-ad16-2e1ec681adee","Type":"ContainerStarted","Data":"bdc1ebe05c903ab3530f1247ae55fbdf0aaf7741acefbe703e5979fcb6f53037"}
Jul 06 23:57:34.809408 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.809406    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2547n" event={"ID":"79bba9af-47c1-4fe3-ad16-2e1ec681adee","Type":"ContainerStarted","Data":"7195725bdddb628ac845e4f53c1c11462f4fedd18dfc32a5837e2e84a8c2ce7b"}
Jul 06 23:57:34.810722 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.810695    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48" event={"ID":"e2a5c7a6-f372-46a1-91a8-96107aad7dc2","Type":"ContainerStarted","Data":"78a519f48619667ce545cabc7473bed76a5bdf6b3a3caaad54fb0f65953bdc37"}
Jul 06 23:57:34.812032 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.812006    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-k25ls" event={"ID":"3685aea4-dbc3-4dbc-bf0a-6a1c67c5b0ab","Type":"ContainerStarted","Data":"376a642cec3c28ae40c5d603f81368ae1c8bfd203070a4fbb532821ad2acea34"}
Jul 06 23:57:34.813448 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.813422    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-94sl8" event={"ID":"628c1362-ba80-4198-b958-90631d8c4f8a","Type":"ContainerStarted","Data":"afad0f7392f856ec98aae47857914c7c4b69f27322f3d7a8c9a84df0e28ddaca"}
Jul 06 23:57:34.814954 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.814926    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xwsf4" event={"ID":"884a13e6-5634-47f4-9644-ec00e1dc9150","Type":"ContainerStarted","Data":"ee97060000432d1253d8f9afc3f34ba60486049eedecf11855ac3b35afe8f9f2"}
Jul 06 23:57:34.816443 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.816413    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zpbjs" event={"ID":"ad267d1f-91ae-433d-a788-f628363570e0","Type":"ContainerStarted","Data":"8e4bd0337aac1bfa54658a804925b134737a5d712d552034e82637824693862e"}
Jul 06 23:57:34.818053 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.818028    2551 generic.go:356] "Generic (PLEG): container finished" podID="981c6f6b-7c41-45aa-9721-f90eee6b57ff" containerID="e3ef63b280e9f7dabc2db8cf93aaa4265cc1bfd4d8f19d4e802c3f93e219fee0" exitCode=0
Jul 06 23:57:34.818153 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.818058    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtq89" event={"ID":"981c6f6b-7c41-45aa-9721-f90eee6b57ff","Type":"ContainerDied","Data":"e3ef63b280e9f7dabc2db8cf93aaa4265cc1bfd4d8f19d4e802c3f93e219fee0"}
Jul 06 23:57:34.827432 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.827391    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-58shk" podStartSLOduration=3.542711991 podStartE2EDuration="22.827379873s" totalImagesPullingTime="19.284667882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:34.826591314 +0000 UTC m=+23.605985973" watchObservedRunningTime="2026-07-06 23:57:34.827379873 +0000 UTC m=+23.606774526"
Jul 06 23:57:34.827741 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.827708    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-139.ec2.internal" podStartSLOduration=21.827699542 podStartE2EDuration="21.827699542s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:57:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:16.785777393 +0000 UTC m=+5.565172056" watchObservedRunningTime="2026-07-06 23:57:34.827699542 +0000 UTC m=+23.607094199"
Jul 06 23:57:34.864038 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.863984    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xwsf4" podStartSLOduration=7.451736092 podStartE2EDuration="22.863965032s" totalImagesPullingTime="15.41222894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:34.86350396 +0000 UTC m=+23.642898617" watchObservedRunningTime="2026-07-06 23:57:34.863965032 +0000 UTC m=+23.643359688"
Jul 06 23:57:34.899643 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.899587    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zpbjs" podStartSLOduration=3.682364889 podStartE2EDuration="22.899570554s" totalImagesPullingTime="19.217205665s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:34.880546657 +0000 UTC m=+23.659941315" watchObservedRunningTime="2026-07-06 23:57:34.899570554 +0000 UTC m=+23.678965210"
Jul 06 23:57:34.899857 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.899832    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-k25ls" podStartSLOduration=3.676356304 podStartE2EDuration="22.899823677s" totalImagesPullingTime="19.223467373s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:34.899396537 +0000 UTC m=+23.678791198" watchObservedRunningTime="2026-07-06 23:57:34.899823677 +0000 UTC m=+23.679218334"
Jul 06 23:57:34.914911 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:34.914864    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-94sl8" podStartSLOduration=3.7031008659999998 podStartE2EDuration="22.914843943s" totalImagesPullingTime="19.211743077s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:34.914696826 +0000 UTC m=+23.694091507" watchObservedRunningTime="2026-07-06 23:57:34.914843943 +0000 UTC m=+23.694238599"
Jul 06 23:57:35.324015 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:35.323991    2551 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 06 23:57:35.635208 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:35.635073    2551 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-06T23:57:35.324012042Z","UUID":"f3a953ea-c0cc-4951-8501-146af03e9ca8","Handler":null,"Name":"","Endpoint":""}
Jul 06 23:57:35.636655 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:35.636630    2551 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 06 23:57:35.636767 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:35.636670    2551 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 06 23:57:35.688259 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:35.688230    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:35.688477 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:35.688351    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jbkpl" podUID="cce87a14-ec61-4e46-b630-4488f0c25032"
Jul 06 23:57:35.688477 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:35.688411    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:35.688633 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:35.688522    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrttl" podUID="98de894c-93c0-4f1f-8916-e17f6d902621"
Jul 06 23:57:35.826564 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:35.826505    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48" event={"ID":"e2a5c7a6-f372-46a1-91a8-96107aad7dc2","Type":"ContainerStarted","Data":"97fec4d139f6400ca5168217bc62c4ebd2627ae8768bacb8a37b524041f9b9c4"}
Jul 06 23:57:35.829015 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:35.828962    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-v76sk" event={"ID":"624536fc-d434-4aa6-b34c-11673ed0ab66","Type":"ContainerStarted","Data":"05a3ede363089f5c229fa39bce7acfa0fbe02a20bf6b96fd7feb3d34555e4743"}
Jul 06 23:57:35.844942 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:35.844870    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-v76sk" podStartSLOduration=4.623094538 podStartE2EDuration="23.844850488s" totalImagesPullingTime="19.22175595s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:35.844433304 +0000 UTC m=+24.623827962" watchObservedRunningTime="2026-07-06 23:57:35.844850488 +0000 UTC m=+24.624245147"
Jul 06 23:57:36.687943 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:36.687875    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:36.688087 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:36.687990    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm7tt" podUID="084ae393-acaf-4d47-8460-64ada80ae79f"
Jul 06 23:57:36.832899 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:36.832867    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48" event={"ID":"e2a5c7a6-f372-46a1-91a8-96107aad7dc2","Type":"ContainerStarted","Data":"5940df6503be264ccf1f0339bd7deaa57a473baa85507be0de1a3809fee26df7"}
Jul 06 23:57:36.855852 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:36.855799    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fwc48" podStartSLOduration=3.603321507 podStartE2EDuration="24.855782434s" totalImagesPullingTime="21.252460927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:57:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:36.855530906 +0000 UTC m=+25.634925560" watchObservedRunningTime="2026-07-06 23:57:36.855782434 +0000 UTC m=+25.635177090"
Jul 06 23:57:37.688738 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:37.688584    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:37.688923 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:37.688583    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:37.688923 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:37.688843    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrttl" podUID="98de894c-93c0-4f1f-8916-e17f6d902621"
Jul 06 23:57:37.689040 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:37.688912    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jbkpl" podUID="cce87a14-ec61-4e46-b630-4488f0c25032"
Jul 06 23:57:37.838923 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:37.838885    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2547n" event={"ID":"79bba9af-47c1-4fe3-ad16-2e1ec681adee","Type":"ContainerStarted","Data":"5a7d95cf256f59f52143842320c38a70ff71b40a9d3a6fe0eb36001c5d6ea341"}
Jul 06 23:57:38.387444 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:38.387410    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xwsf4"
Jul 06 23:57:38.388024 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:38.388000    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xwsf4"
Jul 06 23:57:38.688561 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:38.688477    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:38.688719 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:38.688611    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm7tt" podUID="084ae393-acaf-4d47-8460-64ada80ae79f"
Jul 06 23:57:39.688603 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:39.688332    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:39.689218 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:39.688373    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:39.689218 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:39.688623    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrttl" podUID="98de894c-93c0-4f1f-8916-e17f6d902621"
Jul 06 23:57:39.689218 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:39.688680    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jbkpl" podUID="cce87a14-ec61-4e46-b630-4488f0c25032"
Jul 06 23:57:39.845264 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:39.845234    2551 generic.go:356] "Generic (PLEG): container finished" podID="981c6f6b-7c41-45aa-9721-f90eee6b57ff" containerID="f76c9279946ac978be485d3e48a0f6758776312d9b2915b9356390f6929e6e2a" exitCode=0
Jul 06 23:57:39.845429 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:39.845320    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtq89" event={"ID":"981c6f6b-7c41-45aa-9721-f90eee6b57ff","Type":"ContainerDied","Data":"f76c9279946ac978be485d3e48a0f6758776312d9b2915b9356390f6929e6e2a"}
Jul 06 23:57:39.848916 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:39.848881    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2547n" event={"ID":"79bba9af-47c1-4fe3-ad16-2e1ec681adee","Type":"ContainerStarted","Data":"dd48c1e106fcc5ab943fcdba4b9bc76d0533ef2eff14a6d56e940dfd5ae4b5de"}
Jul 06 23:57:39.849185 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:39.849162    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:39.849310 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:39.849220    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:39.849310 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:39.849259    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:39.865009 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:39.864987    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:39.865142 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:39.865088    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:57:39.906358 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:39.906310    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2547n" podStartSLOduration=8.621982029 podStartE2EDuration="27.906295479s" totalImagesPullingTime="19.28431345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:39.904249277 +0000 UTC m=+28.683643934" watchObservedRunningTime="2026-07-06 23:57:39.906295479 +0000 UTC m=+28.685690135"
Jul 06 23:57:40.687849 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:40.687815    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:40.688057 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:40.687963    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm7tt" podUID="084ae393-acaf-4d47-8460-64ada80ae79f"
Jul 06 23:57:41.214554 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:41.212293    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wm7tt"]
Jul 06 23:57:41.214554 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:41.212528    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:41.214554 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:41.212695    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm7tt" podUID="084ae393-acaf-4d47-8460-64ada80ae79f"
Jul 06 23:57:41.214554 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:41.212984    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jbkpl"]
Jul 06 23:57:41.214554 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:41.213105    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:41.214554 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:41.213906    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jbkpl" podUID="cce87a14-ec61-4e46-b630-4488f0c25032"
Jul 06 23:57:41.216211 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:41.216186    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hrttl"]
Jul 06 23:57:41.216349 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:41.216274    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:41.216403 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:41.216375    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrttl" podUID="98de894c-93c0-4f1f-8916-e17f6d902621"
Jul 06 23:57:41.289263 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:41.289169    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xwsf4"
Jul 06 23:57:41.289414 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:41.289293    2551 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 06 23:57:41.289850 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:41.289829    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xwsf4"
Jul 06 23:57:41.855531 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:41.855476    2551 generic.go:356] "Generic (PLEG): container finished" podID="981c6f6b-7c41-45aa-9721-f90eee6b57ff" containerID="34e70d069d1c5222ebd27521d2de61321aad2f289e96e68956b50b7def8b94d4" exitCode=0
Jul 06 23:57:41.855703 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:41.855531    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtq89" event={"ID":"981c6f6b-7c41-45aa-9721-f90eee6b57ff","Type":"ContainerDied","Data":"34e70d069d1c5222ebd27521d2de61321aad2f289e96e68956b50b7def8b94d4"}
Jul 06 23:57:42.688521 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:42.688351    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:42.688879 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:42.688362    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:42.688879 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:42.688363    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:42.688879 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:42.688661    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jbkpl" podUID="cce87a14-ec61-4e46-b630-4488f0c25032"
Jul 06 23:57:42.688879 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:42.688776    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm7tt" podUID="084ae393-acaf-4d47-8460-64ada80ae79f"
Jul 06 23:57:42.688879 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:42.688848    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrttl" podUID="98de894c-93c0-4f1f-8916-e17f6d902621"
Jul 06 23:57:43.862799 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:43.862767    2551 generic.go:356] "Generic (PLEG): container finished" podID="981c6f6b-7c41-45aa-9721-f90eee6b57ff" containerID="3dc20d4d0cf8ffc55a1aa5b28a98402012dbef57cdb35ca563b890c2d9739276" exitCode=0
Jul 06 23:57:43.863302 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:43.862813    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtq89" event={"ID":"981c6f6b-7c41-45aa-9721-f90eee6b57ff","Type":"ContainerDied","Data":"3dc20d4d0cf8ffc55a1aa5b28a98402012dbef57cdb35ca563b890c2d9739276"}
Jul 06 23:57:44.688760 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:44.688722    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:44.688934 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:44.688733    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:44.688934 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:44.688733    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:44.688934 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:44.688885    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm7tt" podUID="084ae393-acaf-4d47-8460-64ada80ae79f"
Jul 06 23:57:44.689062 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:44.689003    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrttl" podUID="98de894c-93c0-4f1f-8916-e17f6d902621"
Jul 06 23:57:44.689117 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:44.689096    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jbkpl" podUID="cce87a14-ec61-4e46-b630-4488f0c25032"
Jul 06 23:57:45.334636 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:45.334602    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret\") pod \"global-pull-secret-syncer-jbkpl\" (UID: \"cce87a14-ec61-4e46-b630-4488f0c25032\") " pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:45.335030 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:45.334751    2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 06 23:57:45.335030 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:45.334811    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret podName:cce87a14-ec61-4e46-b630-4488f0c25032 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:17.334796876 +0000 UTC m=+66.114191514 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret") pod "global-pull-secret-syncer-jbkpl" (UID: "cce87a14-ec61-4e46-b630-4488f0c25032") : object "kube-system"/"original-pull-secret" not registered
Jul 06 23:57:45.435483 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:45.435448    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs\") pod \"network-metrics-daemon-wm7tt\" (UID: \"084ae393-acaf-4d47-8460-64ada80ae79f\") " pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:45.435653 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:45.435617    2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:57:45.435703 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:45.435694    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs podName:084ae393-acaf-4d47-8460-64ada80ae79f nodeName:}" failed. No retries permitted until 2026-07-06 23:58:17.4356722 +0000 UTC m=+66.215066837 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs") pod "network-metrics-daemon-wm7tt" (UID: "084ae393-acaf-4d47-8460-64ada80ae79f") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 06 23:57:45.536853 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:45.536821    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hxnd\" (UniqueName: \"kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd\") pod \"network-check-target-hrttl\" (UID: \"98de894c-93c0-4f1f-8916-e17f6d902621\") " pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:45.537029 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:45.537009    2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 06 23:57:45.537090 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:45.537032    2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 06 23:57:45.537090 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:45.537042    2551 projected.go:196] Error preparing data for projected volume kube-api-access-5hxnd for pod openshift-network-diagnostics/network-check-target-hrttl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:57:45.537181 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:45.537103    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd podName:98de894c-93c0-4f1f-8916-e17f6d902621 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:17.537085488 +0000 UTC m=+66.316480127 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5hxnd" (UniqueName: "kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd") pod "network-check-target-hrttl" (UID: "98de894c-93c0-4f1f-8916-e17f6d902621") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 06 23:57:46.688032 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:46.687996    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:46.688624 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:46.688168    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:46.688624 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:46.688179    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:46.688624 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:46.688176    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-hrttl" podUID="98de894c-93c0-4f1f-8916-e17f6d902621"
Jul 06 23:57:46.688624 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:46.688306    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jbkpl" podUID="cce87a14-ec61-4e46-b630-4488f0c25032"
Jul 06 23:57:46.688624 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:46.688409    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wm7tt" podUID="084ae393-acaf-4d47-8460-64ada80ae79f"
Jul 06 23:57:47.861711 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.861633    2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-133-139.ec2.internal" event="NodeReady"
Jul 06 23:57:47.862114 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.861796    2551 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 06 23:57:47.898127 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.898098    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5844969b86-5hwj9"]
Jul 06 23:57:47.900112 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.900087    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:47.903464 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.903439    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 06 23:57:47.903821 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.903804    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 06 23:57:47.903909 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.903860    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 06 23:57:47.904015 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.903971    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qtrrj\""
Jul 06 23:57:47.908142 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.908121    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sgzpt"]
Jul 06 23:57:47.909857 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.909839    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 06 23:57:47.910229 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.910212    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:57:47.912833 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.912814    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 06 23:57:47.912833 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.912824    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s7rq7\""
Jul 06 23:57:47.912966 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.912836    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 06 23:57:47.918418 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.918399    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2z2qv"]
Jul 06 23:57:47.920443 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.920430    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2z2qv"
Jul 06 23:57:47.920971 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.920944    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5844969b86-5hwj9"]
Jul 06 23:57:47.923321 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.923140    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2f46f\""
Jul 06 23:57:47.923321 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.923268    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 06 23:57:47.923321 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.923140    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 06 23:57:47.923598 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.923462    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sgzpt"]
Jul 06 23:57:47.924063 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.924038    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 06 23:57:47.931373 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:47.931351    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2z2qv"]
Jul 06 23:57:48.056320 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.056292    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/262963f5-50b1-4f77-88ea-7f92a44fa4c7-tmp-dir\") pod \"dns-default-sgzpt\" (UID: \"262963f5-50b1-4f77-88ea-7f92a44fa4c7\") " pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:57:48.056455 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.056326    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5de2afde-897e-4f5b-a5b6-9154ac1943cd-cert\") pod \"ingress-canary-2z2qv\" (UID: \"5de2afde-897e-4f5b-a5b6-9154ac1943cd\") " pod="openshift-ingress-canary/ingress-canary-2z2qv"
Jul 06 23:57:48.056455 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.056345    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8rqx\" (UniqueName: \"kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-kube-api-access-d8rqx\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.056455 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.056364    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/262963f5-50b1-4f77-88ea-7f92a44fa4c7-config-volume\") pod \"dns-default-sgzpt\" (UID: \"262963f5-50b1-4f77-88ea-7f92a44fa4c7\") " pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:57:48.056591 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.056459    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cgb9\" (UniqueName: \"kubernetes.io/projected/262963f5-50b1-4f77-88ea-7f92a44fa4c7-kube-api-access-4cgb9\") pod \"dns-default-sgzpt\" (UID: \"262963f5-50b1-4f77-88ea-7f92a44fa4c7\") " pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:57:48.056591 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.056501    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-certificates\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.056591 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.056555    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-image-registry-private-configuration\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.056591 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.056573    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-trusted-ca\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.056758 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.056616    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-tls\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.056758 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.056629    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-bound-sa-token\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.056758 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.056657    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls\") pod \"dns-default-sgzpt\" (UID: \"262963f5-50b1-4f77-88ea-7f92a44fa4c7\") " pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:57:48.056758 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.056672    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-ca-trust-extracted\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.056758 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.056707    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-installation-pull-secrets\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.056945 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.056790    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjvf7\" (UniqueName: \"kubernetes.io/projected/5de2afde-897e-4f5b-a5b6-9154ac1943cd-kube-api-access-xjvf7\") pod \"ingress-canary-2z2qv\" (UID: \"5de2afde-897e-4f5b-a5b6-9154ac1943cd\") " pod="openshift-ingress-canary/ingress-canary-2z2qv"
Jul 06 23:57:48.158195 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.158108    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjvf7\" (UniqueName: \"kubernetes.io/projected/5de2afde-897e-4f5b-a5b6-9154ac1943cd-kube-api-access-xjvf7\") pod \"ingress-canary-2z2qv\" (UID: \"5de2afde-897e-4f5b-a5b6-9154ac1943cd\") " pod="openshift-ingress-canary/ingress-canary-2z2qv"
Jul 06 23:57:48.158195 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.158153    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/262963f5-50b1-4f77-88ea-7f92a44fa4c7-tmp-dir\") pod \"dns-default-sgzpt\" (UID: \"262963f5-50b1-4f77-88ea-7f92a44fa4c7\") " pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:57:48.158195 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.158170    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5de2afde-897e-4f5b-a5b6-9154ac1943cd-cert\") pod \"ingress-canary-2z2qv\" (UID: \"5de2afde-897e-4f5b-a5b6-9154ac1943cd\") " pod="openshift-ingress-canary/ingress-canary-2z2qv"
Jul 06 23:57:48.158195 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.158185    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d8rqx\" (UniqueName: \"kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-kube-api-access-d8rqx\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.158544 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.158204    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/262963f5-50b1-4f77-88ea-7f92a44fa4c7-config-volume\") pod \"dns-default-sgzpt\" (UID: \"262963f5-50b1-4f77-88ea-7f92a44fa4c7\") " pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:57:48.158544 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.158321    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cgb9\" (UniqueName: \"kubernetes.io/projected/262963f5-50b1-4f77-88ea-7f92a44fa4c7-kube-api-access-4cgb9\") pod \"dns-default-sgzpt\" (UID: \"262963f5-50b1-4f77-88ea-7f92a44fa4c7\") " pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:57:48.158544 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.158361    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-certificates\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.158544 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.158397    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-image-registry-private-configuration\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.158544 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.158425    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-trusted-ca\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.158544 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.158482    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-tls\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.158544 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.158506    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-bound-sa-token\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.158885 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.158565    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls\") pod \"dns-default-sgzpt\" (UID: \"262963f5-50b1-4f77-88ea-7f92a44fa4c7\") " pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:57:48.158885 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.158570    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/262963f5-50b1-4f77-88ea-7f92a44fa4c7-tmp-dir\") pod \"dns-default-sgzpt\" (UID: \"262963f5-50b1-4f77-88ea-7f92a44fa4c7\") " pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:57:48.158885 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.158590    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-ca-trust-extracted\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.158885 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.158618    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-installation-pull-secrets\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.158885 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:48.158626    2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:57:48.158885 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:48.158640    2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5844969b86-5hwj9: secret "image-registry-tls" not found
Jul 06 23:57:48.158885 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:48.158689    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-tls podName:5691ef86-f03f-4f15-81ce-0fb0c5f0faa1 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:48.658673749 +0000 UTC m=+37.438068383 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-tls") pod "image-registry-5844969b86-5hwj9" (UID: "5691ef86-f03f-4f15-81ce-0fb0c5f0faa1") : secret "image-registry-tls" not found
Jul 06 23:57:48.158885 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.158884    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/262963f5-50b1-4f77-88ea-7f92a44fa4c7-config-volume\") pod \"dns-default-sgzpt\" (UID: \"262963f5-50b1-4f77-88ea-7f92a44fa4c7\") " pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:57:48.159242 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:48.158969    2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:57:48.159242 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:48.159015    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls podName:262963f5-50b1-4f77-88ea-7f92a44fa4c7 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:48.659000568 +0000 UTC m=+37.438395203 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls") pod "dns-default-sgzpt" (UID: "262963f5-50b1-4f77-88ea-7f92a44fa4c7") : secret "dns-default-metrics-tls" not found
Jul 06 23:57:48.159242 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.159125    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-certificates\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.159242 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.159199    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-ca-trust-extracted\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.159647 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.159625    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-trusted-ca\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.162097 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.162074    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-image-registry-private-configuration\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.162189 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.162081    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-installation-pull-secrets\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.162252 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.162230    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5de2afde-897e-4f5b-a5b6-9154ac1943cd-cert\") pod \"ingress-canary-2z2qv\" (UID: \"5de2afde-897e-4f5b-a5b6-9154ac1943cd\") " pod="openshift-ingress-canary/ingress-canary-2z2qv"
Jul 06 23:57:48.169970 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.169944    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cgb9\" (UniqueName: \"kubernetes.io/projected/262963f5-50b1-4f77-88ea-7f92a44fa4c7-kube-api-access-4cgb9\") pod \"dns-default-sgzpt\" (UID: \"262963f5-50b1-4f77-88ea-7f92a44fa4c7\") " pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:57:48.170427 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.170405    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjvf7\" (UniqueName: \"kubernetes.io/projected/5de2afde-897e-4f5b-a5b6-9154ac1943cd-kube-api-access-xjvf7\") pod \"ingress-canary-2z2qv\" (UID: \"5de2afde-897e-4f5b-a5b6-9154ac1943cd\") " pod="openshift-ingress-canary/ingress-canary-2z2qv"
Jul 06 23:57:48.170532 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.170457    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-bound-sa-token\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.170868 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.170850    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8rqx\" (UniqueName: \"kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-kube-api-access-d8rqx\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.230306 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.230269    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2z2qv"
Jul 06 23:57:48.244426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.244378    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-x44jg"]
Jul 06 23:57:48.247471 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.247455    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-x44jg"
Jul 06 23:57:48.251641 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.251617    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 06 23:57:48.251938 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.251918    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-4mm2g\""
Jul 06 23:57:48.254070 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.254047    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 06 23:57:48.257973 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.257952    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-x44jg"]
Jul 06 23:57:48.348800 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.348635    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tgcp5"]
Jul 06 23:57:48.352595 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.352574    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tgcp5"
Jul 06 23:57:48.355249 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.355232    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 06 23:57:48.355586 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.355570    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 06 23:57:48.355644 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.355593    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 06 23:57:48.355644 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.355629    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 06 23:57:48.355720 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.355679    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-w28rg\""
Jul 06 23:57:48.359485 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.359465    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8lrg\" (UniqueName: \"kubernetes.io/projected/bd2ca9a4-cf90-4bbe-9007-02fecdb5904d-kube-api-access-z8lrg\") pod \"network-check-source-989f8b8dc-x44jg\" (UID: \"bd2ca9a4-cf90-4bbe-9007-02fecdb5904d\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-x44jg"
Jul 06 23:57:48.363762 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.363739    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tgcp5"]
Jul 06 23:57:48.366491 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.366474    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2z2qv"]
Jul 06 23:57:48.369928 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:48.369910    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5de2afde_897e_4f5b_a5b6_9154ac1943cd.slice/crio-b9d08b745350336bcdc76c9f721acb97513a2d45f85860657d4268f91dea7248 WatchSource:0}: Error finding container b9d08b745350336bcdc76c9f721acb97513a2d45f85860657d4268f91dea7248: Status 404 returned error can't find the container with id b9d08b745350336bcdc76c9f721acb97513a2d45f85860657d4268f91dea7248
Jul 06 23:57:48.460300 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.460207    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z8lrg\" (UniqueName: \"kubernetes.io/projected/bd2ca9a4-cf90-4bbe-9007-02fecdb5904d-kube-api-access-z8lrg\") pod \"network-check-source-989f8b8dc-x44jg\" (UID: \"bd2ca9a4-cf90-4bbe-9007-02fecdb5904d\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-x44jg"
Jul 06 23:57:48.460300 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.460264    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/488f9eff-fbd5-4d2d-acf1-0d0a00d19a52-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-tgcp5\" (UID: \"488f9eff-fbd5-4d2d-acf1-0d0a00d19a52\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tgcp5"
Jul 06 23:57:48.460300 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.460301    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/488f9eff-fbd5-4d2d-acf1-0d0a00d19a52-config\") pod \"service-ca-operator-5d46d9ffd4-tgcp5\" (UID: \"488f9eff-fbd5-4d2d-acf1-0d0a00d19a52\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tgcp5"
Jul 06 23:57:48.460482 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.460327    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldrqb\" (UniqueName: \"kubernetes.io/projected/488f9eff-fbd5-4d2d-acf1-0d0a00d19a52-kube-api-access-ldrqb\") pod \"service-ca-operator-5d46d9ffd4-tgcp5\" (UID: \"488f9eff-fbd5-4d2d-acf1-0d0a00d19a52\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tgcp5"
Jul 06 23:57:48.469151 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.469124    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8lrg\" (UniqueName: \"kubernetes.io/projected/bd2ca9a4-cf90-4bbe-9007-02fecdb5904d-kube-api-access-z8lrg\") pod \"network-check-source-989f8b8dc-x44jg\" (UID: \"bd2ca9a4-cf90-4bbe-9007-02fecdb5904d\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-x44jg"
Jul 06 23:57:48.557699 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.557663    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-x44jg"
Jul 06 23:57:48.560958 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.560939    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/488f9eff-fbd5-4d2d-acf1-0d0a00d19a52-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-tgcp5\" (UID: \"488f9eff-fbd5-4d2d-acf1-0d0a00d19a52\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tgcp5"
Jul 06 23:57:48.561023 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.560983    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/488f9eff-fbd5-4d2d-acf1-0d0a00d19a52-config\") pod \"service-ca-operator-5d46d9ffd4-tgcp5\" (UID: \"488f9eff-fbd5-4d2d-acf1-0d0a00d19a52\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tgcp5"
Jul 06 23:57:48.561023 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.561018    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldrqb\" (UniqueName: \"kubernetes.io/projected/488f9eff-fbd5-4d2d-acf1-0d0a00d19a52-kube-api-access-ldrqb\") pod \"service-ca-operator-5d46d9ffd4-tgcp5\" (UID: \"488f9eff-fbd5-4d2d-acf1-0d0a00d19a52\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tgcp5"
Jul 06 23:57:48.562057 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.561647    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/488f9eff-fbd5-4d2d-acf1-0d0a00d19a52-config\") pod \"service-ca-operator-5d46d9ffd4-tgcp5\" (UID: \"488f9eff-fbd5-4d2d-acf1-0d0a00d19a52\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tgcp5"
Jul 06 23:57:48.563202 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.563180    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/488f9eff-fbd5-4d2d-acf1-0d0a00d19a52-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-tgcp5\" (UID: \"488f9eff-fbd5-4d2d-acf1-0d0a00d19a52\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tgcp5"
Jul 06 23:57:48.570281 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.570258    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldrqb\" (UniqueName: \"kubernetes.io/projected/488f9eff-fbd5-4d2d-acf1-0d0a00d19a52-kube-api-access-ldrqb\") pod \"service-ca-operator-5d46d9ffd4-tgcp5\" (UID: \"488f9eff-fbd5-4d2d-acf1-0d0a00d19a52\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tgcp5"
Jul 06 23:57:48.661145 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.661106    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tgcp5"
Jul 06 23:57:48.661404 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.661382    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-tls\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:48.661486 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.661420    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls\") pod \"dns-default-sgzpt\" (UID: \"262963f5-50b1-4f77-88ea-7f92a44fa4c7\") " pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:57:48.661575 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:48.661558    2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:57:48.661619 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:48.661577    2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5844969b86-5hwj9: secret "image-registry-tls" not found
Jul 06 23:57:48.661619 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:48.661581    2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:57:48.661683 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:48.661627    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls podName:262963f5-50b1-4f77-88ea-7f92a44fa4c7 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:49.661614134 +0000 UTC m=+38.441008768 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls") pod "dns-default-sgzpt" (UID: "262963f5-50b1-4f77-88ea-7f92a44fa4c7") : secret "dns-default-metrics-tls" not found
Jul 06 23:57:48.661683 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:48.661642    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-tls podName:5691ef86-f03f-4f15-81ce-0fb0c5f0faa1 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:49.66163544 +0000 UTC m=+38.441030075 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-tls") pod "image-registry-5844969b86-5hwj9" (UID: "5691ef86-f03f-4f15-81ce-0fb0c5f0faa1") : secret "image-registry-tls" not found
Jul 06 23:57:48.679225 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.679141    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-x44jg"]
Jul 06 23:57:48.681578 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:48.681554    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd2ca9a4_cf90_4bbe_9007_02fecdb5904d.slice/crio-d65a8ebbde5cb52ff4e748bba276a2a90d89f15f39bc1b779103ce671b57053c WatchSource:0}: Error finding container d65a8ebbde5cb52ff4e748bba276a2a90d89f15f39bc1b779103ce671b57053c: Status 404 returned error can't find the container with id d65a8ebbde5cb52ff4e748bba276a2a90d89f15f39bc1b779103ce671b57053c
Jul 06 23:57:48.688109 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.688088    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:57:48.688217 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.688089    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:57:48.688302 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.688088    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:57:48.690813 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.690793    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 23:57:48.690937 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.690855    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 23:57:48.690937 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.690922    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wdx8b\""
Jul 06 23:57:48.691089 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.690984    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v6xkb\""
Jul 06 23:57:48.786224 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.786195    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tgcp5"]
Jul 06 23:57:48.789525 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:57:48.789486    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod488f9eff_fbd5_4d2d_acf1_0d0a00d19a52.slice/crio-9f14b7f76e92ca184efdbf5bfcc7ebb97ec82e14d58b429906749712a418e30f WatchSource:0}: Error finding container 9f14b7f76e92ca184efdbf5bfcc7ebb97ec82e14d58b429906749712a418e30f: Status 404 returned error can't find the container with id 9f14b7f76e92ca184efdbf5bfcc7ebb97ec82e14d58b429906749712a418e30f
Jul 06 23:57:48.876116 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.876069    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-x44jg" event={"ID":"bd2ca9a4-cf90-4bbe-9007-02fecdb5904d","Type":"ContainerStarted","Data":"d65a8ebbde5cb52ff4e748bba276a2a90d89f15f39bc1b779103ce671b57053c"}
Jul 06 23:57:48.877413 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.877384    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2z2qv" event={"ID":"5de2afde-897e-4f5b-a5b6-9154ac1943cd","Type":"ContainerStarted","Data":"b9d08b745350336bcdc76c9f721acb97513a2d45f85860657d4268f91dea7248"}
Jul 06 23:57:48.880565 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.880538    2551 generic.go:356] "Generic (PLEG): container finished" podID="981c6f6b-7c41-45aa-9721-f90eee6b57ff" containerID="98adc510201b3edfd86a8fd10c6d14a9aec2683df7c948fcac3f1092c0a8263b" exitCode=0
Jul 06 23:57:48.880680 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.880615    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtq89" event={"ID":"981c6f6b-7c41-45aa-9721-f90eee6b57ff","Type":"ContainerDied","Data":"98adc510201b3edfd86a8fd10c6d14a9aec2683df7c948fcac3f1092c0a8263b"}
Jul 06 23:57:48.881910 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:48.881891    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tgcp5" event={"ID":"488f9eff-fbd5-4d2d-acf1-0d0a00d19a52","Type":"ContainerStarted","Data":"9f14b7f76e92ca184efdbf5bfcc7ebb97ec82e14d58b429906749712a418e30f"}
Jul 06 23:57:49.670673 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:49.670629    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-tls\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:49.670873 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:49.670696    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls\") pod \"dns-default-sgzpt\" (UID: \"262963f5-50b1-4f77-88ea-7f92a44fa4c7\") " pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:57:49.670873 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:49.670803    2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:57:49.670873 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:49.670808    2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:57:49.670873 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:49.670829    2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5844969b86-5hwj9: secret "image-registry-tls" not found
Jul 06 23:57:49.670873 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:49.670864    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls podName:262963f5-50b1-4f77-88ea-7f92a44fa4c7 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:51.670846126 +0000 UTC m=+40.450240765 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls") pod "dns-default-sgzpt" (UID: "262963f5-50b1-4f77-88ea-7f92a44fa4c7") : secret "dns-default-metrics-tls" not found
Jul 06 23:57:49.670873 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:49.670878    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-tls podName:5691ef86-f03f-4f15-81ce-0fb0c5f0faa1 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:51.670872346 +0000 UTC m=+40.450266981 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-tls") pod "image-registry-5844969b86-5hwj9" (UID: "5691ef86-f03f-4f15-81ce-0fb0c5f0faa1") : secret "image-registry-tls" not found
Jul 06 23:57:49.891772 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:49.891620    2551 generic.go:356] "Generic (PLEG): container finished" podID="981c6f6b-7c41-45aa-9721-f90eee6b57ff" containerID="11f2500cf9f12774da1df0f350a895138e407c4fc27ed339b5570c80bfc644b7" exitCode=0
Jul 06 23:57:49.891772 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:49.891707    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtq89" event={"ID":"981c6f6b-7c41-45aa-9721-f90eee6b57ff","Type":"ContainerDied","Data":"11f2500cf9f12774da1df0f350a895138e407c4fc27ed339b5570c80bfc644b7"}
Jul 06 23:57:50.747184 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.746972    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-84bwn"]
Jul 06 23:57:50.773765 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.773708    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-84bwn"]
Jul 06 23:57:50.773939 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.773870    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:50.777907 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.777880    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 06 23:57:50.777907 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.777902    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 06 23:57:50.778097 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.777997    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 06 23:57:50.779057 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.779029    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9lqq6\""
Jul 06 23:57:50.779057 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.779043    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 06 23:57:50.880052 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.880018    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h87sf\" (UniqueName: \"kubernetes.io/projected/9a2d4701-006a-429f-adad-126f71953faf-kube-api-access-h87sf\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:50.880240 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.880070    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:50.880240 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.880097    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a2d4701-006a-429f-adad-126f71953faf-crio-socket\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:50.880240 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.880196    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a2d4701-006a-429f-adad-126f71953faf-data-volume\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:50.880360 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.880248    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a2d4701-006a-429f-adad-126f71953faf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:50.897122 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.897094    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-rtq89" event={"ID":"981c6f6b-7c41-45aa-9721-f90eee6b57ff","Type":"ContainerStarted","Data":"2666ee11dade26f322675adb05303a8f22ba5dc34cb203d96cb118eb36cf226b"}
Jul 06 23:57:50.950891 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.950839    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-rtq89" podStartSLOduration=9.674421064 podStartE2EDuration="38.950821993s" totalImagesPullingTime="29.276400929s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:57:12 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:50.949179623 +0000 UTC m=+39.728574279" watchObservedRunningTime="2026-07-06 23:57:50.950821993 +0000 UTC m=+39.730216673"
Jul 06 23:57:50.981554 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.981502    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a2d4701-006a-429f-adad-126f71953faf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:50.981707 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:50.981602    2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:57:50.981707 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.981623    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h87sf\" (UniqueName: \"kubernetes.io/projected/9a2d4701-006a-429f-adad-126f71953faf-kube-api-access-h87sf\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:50.981707 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:50.981675    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a2d4701-006a-429f-adad-126f71953faf-kube-rbac-proxy-cm podName:9a2d4701-006a-429f-adad-126f71953faf nodeName:}" failed. No retries permitted until 2026-07-06 23:57:51.481656685 +0000 UTC m=+40.261051341 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a2d4701-006a-429f-adad-126f71953faf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-84bwn" (UID: "9a2d4701-006a-429f-adad-126f71953faf") : configmap "kube-rbac-proxy" not found
Jul 06 23:57:50.981836 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.981712    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:50.981836 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.981746    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a2d4701-006a-429f-adad-126f71953faf-crio-socket\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:50.981836 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.981811    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a2d4701-006a-429f-adad-126f71953faf-data-volume\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:50.981932 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:50.981849    2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:57:50.981932 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:50.981899    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls podName:9a2d4701-006a-429f-adad-126f71953faf nodeName:}" failed. No retries permitted until 2026-07-06 23:57:51.481885611 +0000 UTC m=+40.261280250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-84bwn" (UID: "9a2d4701-006a-429f-adad-126f71953faf") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:57:50.982065 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.982044    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/9a2d4701-006a-429f-adad-126f71953faf-crio-socket\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:50.982112 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.982096    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/9a2d4701-006a-429f-adad-126f71953faf-data-volume\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:50.995497 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:50.995468    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h87sf\" (UniqueName: \"kubernetes.io/projected/9a2d4701-006a-429f-adad-126f71953faf-kube-api-access-h87sf\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:51.487131 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:51.487094    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:51.487270 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:51.487156    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a2d4701-006a-429f-adad-126f71953faf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:51.487270 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:51.487228    2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:57:51.487270 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:51.487246    2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:57:51.487374 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:51.487279    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a2d4701-006a-429f-adad-126f71953faf-kube-rbac-proxy-cm podName:9a2d4701-006a-429f-adad-126f71953faf nodeName:}" failed. No retries permitted until 2026-07-06 23:57:52.487266916 +0000 UTC m=+41.266661551 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a2d4701-006a-429f-adad-126f71953faf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-84bwn" (UID: "9a2d4701-006a-429f-adad-126f71953faf") : configmap "kube-rbac-proxy" not found
Jul 06 23:57:51.487374 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:51.487300    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls podName:9a2d4701-006a-429f-adad-126f71953faf nodeName:}" failed. No retries permitted until 2026-07-06 23:57:52.487286268 +0000 UTC m=+41.266680904 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-84bwn" (UID: "9a2d4701-006a-429f-adad-126f71953faf") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:57:51.688214 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:51.688174    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-tls\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:51.688406 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:51.688243    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls\") pod \"dns-default-sgzpt\" (UID: \"262963f5-50b1-4f77-88ea-7f92a44fa4c7\") " pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:57:51.688406 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:51.688374    2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:57:51.688406 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:51.688395    2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5844969b86-5hwj9: secret "image-registry-tls" not found
Jul 06 23:57:51.688573 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:51.688457    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-tls podName:5691ef86-f03f-4f15-81ce-0fb0c5f0faa1 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:55.6884359 +0000 UTC m=+44.467830538 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-tls") pod "image-registry-5844969b86-5hwj9" (UID: "5691ef86-f03f-4f15-81ce-0fb0c5f0faa1") : secret "image-registry-tls" not found
Jul 06 23:57:51.688573 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:51.688480    2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:57:51.688573 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:51.688556    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls podName:262963f5-50b1-4f77-88ea-7f92a44fa4c7 nodeName:}" failed. No retries permitted until 2026-07-06 23:57:55.688538537 +0000 UTC m=+44.467933194 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls") pod "dns-default-sgzpt" (UID: "262963f5-50b1-4f77-88ea-7f92a44fa4c7") : secret "dns-default-metrics-tls" not found
Jul 06 23:57:52.495337 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:52.495301    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:52.495917 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:52.495388    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a2d4701-006a-429f-adad-126f71953faf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:52.495917 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:52.495460    2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:57:52.495917 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:52.495482    2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:57:52.495917 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:52.495545    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls podName:9a2d4701-006a-429f-adad-126f71953faf nodeName:}" failed. No retries permitted until 2026-07-06 23:57:54.495531044 +0000 UTC m=+43.274925695 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-84bwn" (UID: "9a2d4701-006a-429f-adad-126f71953faf") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:57:52.495917 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:52.495561    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a2d4701-006a-429f-adad-126f71953faf-kube-rbac-proxy-cm podName:9a2d4701-006a-429f-adad-126f71953faf nodeName:}" failed. No retries permitted until 2026-07-06 23:57:54.495554721 +0000 UTC m=+43.274949356 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a2d4701-006a-429f-adad-126f71953faf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-84bwn" (UID: "9a2d4701-006a-429f-adad-126f71953faf") : configmap "kube-rbac-proxy" not found
Jul 06 23:57:52.527356 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:52.527330    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zpbjs_ad267d1f-91ae-433d-a788-f628363570e0/dns-node-resolver/0.log"
Jul 06 23:57:53.128423 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:53.128394    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-94sl8_628c1362-ba80-4198-b958-90631d8c4f8a/node-ca/0.log"
Jul 06 23:57:53.905355 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:53.905318    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tgcp5" event={"ID":"488f9eff-fbd5-4d2d-acf1-0d0a00d19a52","Type":"ContainerStarted","Data":"b4900487e22ca1dfa7913a5703d4008a7f2113e55dbfbe786800d61224a3a21a"}
Jul 06 23:57:53.906835 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:53.906810    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-x44jg" event={"ID":"bd2ca9a4-cf90-4bbe-9007-02fecdb5904d","Type":"ContainerStarted","Data":"45cee8126c23246153c0f651c4ee901770ed506475f11533de9c422a3d5c7be1"}
Jul 06 23:57:53.908497 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:53.908474    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2z2qv" event={"ID":"5de2afde-897e-4f5b-a5b6-9154ac1943cd","Type":"ContainerStarted","Data":"da04ac7a14cf3266eb9657c5fbab12f604980c311e8a7c171cc6d7d41e0a7649"}
Jul 06 23:57:53.921549 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:53.921497    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tgcp5" podStartSLOduration=1.876134051 podStartE2EDuration="5.921482964s" totalImagesPullingTime="4.045348913s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:53.920728314 +0000 UTC m=+42.700122970" watchObservedRunningTime="2026-07-06 23:57:53.921482964 +0000 UTC m=+42.700877645"
Jul 06 23:57:53.927168 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:53.927145    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2z2qv_5de2afde-897e-4f5b-a5b6-9154ac1943cd/serve-healthcheck-canary/0.log"
Jul 06 23:57:53.940102 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:53.940042    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2z2qv" podStartSLOduration=2.474920546 podStartE2EDuration="6.940021922s" totalImagesPullingTime="4.465101376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:53.938953225 +0000 UTC m=+42.718347881" watchObservedRunningTime="2026-07-06 23:57:53.940021922 +0000 UTC m=+42.719416582"
Jul 06 23:57:53.954820 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:53.954763    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-x44jg" podStartSLOduration=1.792092055 podStartE2EDuration="5.954741364s" totalImagesPullingTime="4.162649309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:57:53.953390764 +0000 UTC m=+42.732785427" watchObservedRunningTime="2026-07-06 23:57:53.954741364 +0000 UTC m=+42.734136023"
Jul 06 23:57:54.511659 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:54.511612    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:54.511861 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:54.511765    2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:57:54.511861 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:54.511790    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a2d4701-006a-429f-adad-126f71953faf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:54.511861 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:54.511841    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls podName:9a2d4701-006a-429f-adad-126f71953faf nodeName:}" failed. No retries permitted until 2026-07-06 23:57:58.511823163 +0000 UTC m=+47.291217818 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-84bwn" (UID: "9a2d4701-006a-429f-adad-126f71953faf") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:57:54.512025 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:54.511873    2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:57:54.512025 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:54.511926    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a2d4701-006a-429f-adad-126f71953faf-kube-rbac-proxy-cm podName:9a2d4701-006a-429f-adad-126f71953faf nodeName:}" failed. No retries permitted until 2026-07-06 23:57:58.511914634 +0000 UTC m=+47.291309268 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a2d4701-006a-429f-adad-126f71953faf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-84bwn" (UID: "9a2d4701-006a-429f-adad-126f71953faf") : configmap "kube-rbac-proxy" not found
Jul 06 23:57:55.720946 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:55.720910    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-tls\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:57:55.720946 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:55.720955    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls\") pod \"dns-default-sgzpt\" (UID: \"262963f5-50b1-4f77-88ea-7f92a44fa4c7\") " pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:57:55.721392 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:55.721046    2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:57:55.721392 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:55.721057    2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:57:55.721392 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:55.721084    2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5844969b86-5hwj9: secret "image-registry-tls" not found
Jul 06 23:57:55.721392 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:55.721111    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls podName:262963f5-50b1-4f77-88ea-7f92a44fa4c7 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:03.72109649 +0000 UTC m=+52.500491129 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls") pod "dns-default-sgzpt" (UID: "262963f5-50b1-4f77-88ea-7f92a44fa4c7") : secret "dns-default-metrics-tls" not found
Jul 06 23:57:55.721392 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:55.721132    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-tls podName:5691ef86-f03f-4f15-81ce-0fb0c5f0faa1 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:03.721118738 +0000 UTC m=+52.500513390 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-tls") pod "image-registry-5844969b86-5hwj9" (UID: "5691ef86-f03f-4f15-81ce-0fb0c5f0faa1") : secret "image-registry-tls" not found
Jul 06 23:57:58.542819 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:58.542776    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a2d4701-006a-429f-adad-126f71953faf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:58.543217 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:57:58.542891    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:57:58.543217 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:58.542912    2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 06 23:57:58.543217 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:58.542984    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/9a2d4701-006a-429f-adad-126f71953faf-kube-rbac-proxy-cm podName:9a2d4701-006a-429f-adad-126f71953faf nodeName:}" failed. No retries permitted until 2026-07-06 23:58:06.542970448 +0000 UTC m=+55.322365083 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/9a2d4701-006a-429f-adad-126f71953faf-kube-rbac-proxy-cm") pod "insights-runtime-extractor-84bwn" (UID: "9a2d4701-006a-429f-adad-126f71953faf") : configmap "kube-rbac-proxy" not found
Jul 06 23:57:58.543217 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:58.543038    2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:57:58.543217 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:57:58.543096    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls podName:9a2d4701-006a-429f-adad-126f71953faf nodeName:}" failed. No retries permitted until 2026-07-06 23:58:06.543081694 +0000 UTC m=+55.322476329 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-84bwn" (UID: "9a2d4701-006a-429f-adad-126f71953faf") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:58:03.780223 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:03.780186    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-tls\") pod \"image-registry-5844969b86-5hwj9\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") " pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:58:03.780688 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:03.780242    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls\") pod \"dns-default-sgzpt\" (UID: \"262963f5-50b1-4f77-88ea-7f92a44fa4c7\") " pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:58:03.780688 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:58:03.780331    2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 06 23:58:03.780688 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:58:03.780348    2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5844969b86-5hwj9: secret "image-registry-tls" not found
Jul 06 23:58:03.780688 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:58:03.780395    2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 06 23:58:03.780688 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:58:03.780409    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-tls podName:5691ef86-f03f-4f15-81ce-0fb0c5f0faa1 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:19.780393791 +0000 UTC m=+68.559788426 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-tls") pod "image-registry-5844969b86-5hwj9" (UID: "5691ef86-f03f-4f15-81ce-0fb0c5f0faa1") : secret "image-registry-tls" not found
Jul 06 23:58:03.780688 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:58:03.780442    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls podName:262963f5-50b1-4f77-88ea-7f92a44fa4c7 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:19.780429572 +0000 UTC m=+68.559824210 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls") pod "dns-default-sgzpt" (UID: "262963f5-50b1-4f77-88ea-7f92a44fa4c7") : secret "dns-default-metrics-tls" not found
Jul 06 23:58:06.602435 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:06.602397    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:58:06.602900 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:06.602462    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a2d4701-006a-429f-adad-126f71953faf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:58:06.602900 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:58:06.602559    2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 06 23:58:06.602900 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:58:06.602618    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls podName:9a2d4701-006a-429f-adad-126f71953faf nodeName:}" failed. No retries permitted until 2026-07-06 23:58:22.602603756 +0000 UTC m=+71.381998391 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls") pod "insights-runtime-extractor-84bwn" (UID: "9a2d4701-006a-429f-adad-126f71953faf") : secret "insights-runtime-extractor-tls" not found
Jul 06 23:58:06.603014 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:06.602921    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/9a2d4701-006a-429f-adad-126f71953faf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:58:11.866600 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:11.866575    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2547n"
Jul 06 23:58:15.618350 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.618315    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-jfrqt"]
Jul 06 23:58:15.621038 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.621021    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfrqt"
Jul 06 23:58:15.623774 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.623755    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 06 23:58:15.623874 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.623755    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 06 23:58:15.625000 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.624986    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-qlj69\""
Jul 06 23:58:15.635630 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.635605    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-jfrqt"]
Jul 06 23:58:15.658619 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.655767    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5844969b86-5hwj9"]
Jul 06 23:58:15.658619 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:58:15.656257    2551 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-5844969b86-5hwj9" podUID="5691ef86-f03f-4f15-81ce-0fb0c5f0faa1"
Jul 06 23:58:15.669316 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.669291    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78d2e680-f53b-4237-b8e6-6c57c3f1a977-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-jfrqt\" (UID: \"78d2e680-f53b-4237-b8e6-6c57c3f1a977\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfrqt"
Jul 06 23:58:15.669457 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.669376    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/78d2e680-f53b-4237-b8e6-6c57c3f1a977-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-jfrqt\" (UID: \"78d2e680-f53b-4237-b8e6-6c57c3f1a977\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfrqt"
Jul 06 23:58:15.754404 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.754373    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-tkr2w"]
Jul 06 23:58:15.756364 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.756343    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-tkr2w"
Jul 06 23:58:15.759095 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.759072    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-kswnl\""
Jul 06 23:58:15.759334 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.759319    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 06 23:58:15.759659 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.759646    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 06 23:58:15.770113 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.770091    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78d2e680-f53b-4237-b8e6-6c57c3f1a977-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-jfrqt\" (UID: \"78d2e680-f53b-4237-b8e6-6c57c3f1a977\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfrqt"
Jul 06 23:58:15.770229 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.770138    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/78d2e680-f53b-4237-b8e6-6c57c3f1a977-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-jfrqt\" (UID: \"78d2e680-f53b-4237-b8e6-6c57c3f1a977\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfrqt"
Jul 06 23:58:15.770731 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.770715    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/78d2e680-f53b-4237-b8e6-6c57c3f1a977-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-jfrqt\" (UID: \"78d2e680-f53b-4237-b8e6-6c57c3f1a977\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfrqt"
Jul 06 23:58:15.772637 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.772614    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78d2e680-f53b-4237-b8e6-6c57c3f1a977-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-jfrqt\" (UID: \"78d2e680-f53b-4237-b8e6-6c57c3f1a977\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfrqt"
Jul 06 23:58:15.779314 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.779292    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-tkr2w"]
Jul 06 23:58:15.870868 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.870842    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wghvr\" (UniqueName: \"kubernetes.io/projected/a6128722-3c79-444d-8079-27c045ab076f-kube-api-access-wghvr\") pod \"downloads-685bfb5f64-tkr2w\" (UID: \"a6128722-3c79-444d-8079-27c045ab076f\") " pod="openshift-console/downloads-685bfb5f64-tkr2w"
Jul 06 23:58:15.929095 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.929054    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfrqt"
Jul 06 23:58:15.959182 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.959154    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:58:15.964692 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.964672    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:58:15.971889 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.971861    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wghvr\" (UniqueName: \"kubernetes.io/projected/a6128722-3c79-444d-8079-27c045ab076f-kube-api-access-wghvr\") pod \"downloads-685bfb5f64-tkr2w\" (UID: \"a6128722-3c79-444d-8079-27c045ab076f\") " pod="openshift-console/downloads-685bfb5f64-tkr2w"
Jul 06 23:58:15.980849 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:15.980818    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wghvr\" (UniqueName: \"kubernetes.io/projected/a6128722-3c79-444d-8079-27c045ab076f-kube-api-access-wghvr\") pod \"downloads-685bfb5f64-tkr2w\" (UID: \"a6128722-3c79-444d-8079-27c045ab076f\") " pod="openshift-console/downloads-685bfb5f64-tkr2w"
Jul 06 23:58:16.060490 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.060457    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-jfrqt"]
Jul 06 23:58:16.063462 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:58:16.063423    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78d2e680_f53b_4237_b8e6_6c57c3f1a977.slice/crio-78d6f0ec097644b5fe55a664d95c16b28b7bf11426a650b3c531595c571d75d3 WatchSource:0}: Error finding container 78d6f0ec097644b5fe55a664d95c16b28b7bf11426a650b3c531595c571d75d3: Status 404 returned error can't find the container with id 78d6f0ec097644b5fe55a664d95c16b28b7bf11426a650b3c531595c571d75d3
Jul 06 23:58:16.064802 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.064780    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-tkr2w"
Jul 06 23:58:16.072617 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.072595    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-image-registry-private-configuration\") pod \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") "
Jul 06 23:58:16.072715 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.072640    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-ca-trust-extracted\") pod \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") "
Jul 06 23:58:16.072715 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.072680    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-bound-sa-token\") pod \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") "
Jul 06 23:58:16.072819 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.072720    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-trusted-ca\") pod \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") "
Jul 06 23:58:16.072819 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.072740    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-installation-pull-secrets\") pod \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") "
Jul 06 23:58:16.072819 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.072768    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8rqx\" (UniqueName: \"kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-kube-api-access-d8rqx\") pod \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") "
Jul 06 23:58:16.072960 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.072864    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-certificates\") pod \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\" (UID: \"5691ef86-f03f-4f15-81ce-0fb0c5f0faa1\") "
Jul 06 23:58:16.073033 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.073008    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5691ef86-f03f-4f15-81ce-0fb0c5f0faa1" (UID: "5691ef86-f03f-4f15-81ce-0fb0c5f0faa1"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 06 23:58:16.073167 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.073146    2551 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-ca-trust-extracted\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 06 23:58:16.073286 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.073254    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5691ef86-f03f-4f15-81ce-0fb0c5f0faa1" (UID: "5691ef86-f03f-4f15-81ce-0fb0c5f0faa1"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:58:16.073352 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.073308    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5691ef86-f03f-4f15-81ce-0fb0c5f0faa1" (UID: "5691ef86-f03f-4f15-81ce-0fb0c5f0faa1"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:58:16.075041 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.075012    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5691ef86-f03f-4f15-81ce-0fb0c5f0faa1" (UID: "5691ef86-f03f-4f15-81ce-0fb0c5f0faa1"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:58:16.075123 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.075035    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-kube-api-access-d8rqx" (OuterVolumeSpecName: "kube-api-access-d8rqx") pod "5691ef86-f03f-4f15-81ce-0fb0c5f0faa1" (UID: "5691ef86-f03f-4f15-81ce-0fb0c5f0faa1"). InnerVolumeSpecName "kube-api-access-d8rqx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:58:16.075123 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.075111    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5691ef86-f03f-4f15-81ce-0fb0c5f0faa1" (UID: "5691ef86-f03f-4f15-81ce-0fb0c5f0faa1"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:58:16.075204 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.075185    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5691ef86-f03f-4f15-81ce-0fb0c5f0faa1" (UID: "5691ef86-f03f-4f15-81ce-0fb0c5f0faa1"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:58:16.174273 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.174244    2551 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-certificates\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 06 23:58:16.174273 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.174270    2551 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-image-registry-private-configuration\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 06 23:58:16.174273 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.174280    2551 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-bound-sa-token\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 06 23:58:16.174478 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.174288    2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-trusted-ca\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 06 23:58:16.174478 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.174296    2551 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-installation-pull-secrets\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 06 23:58:16.174478 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.174306    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8rqx\" (UniqueName: \"kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-kube-api-access-d8rqx\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 06 23:58:16.185895 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.185860    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-tkr2w"]
Jul 06 23:58:16.189313 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:58:16.189286    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6128722_3c79_444d_8079_27c045ab076f.slice/crio-fa94560c0ce578bc03d34e43b915e20646799e24169cb127ba631014f0d1def2 WatchSource:0}: Error finding container fa94560c0ce578bc03d34e43b915e20646799e24169cb127ba631014f0d1def2: Status 404 returned error can't find the container with id fa94560c0ce578bc03d34e43b915e20646799e24169cb127ba631014f0d1def2
Jul 06 23:58:16.964058 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.964021    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-tkr2w" event={"ID":"a6128722-3c79-444d-8079-27c045ab076f","Type":"ContainerStarted","Data":"fa94560c0ce578bc03d34e43b915e20646799e24169cb127ba631014f0d1def2"}
Jul 06 23:58:16.965545 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.965433    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5844969b86-5hwj9"
Jul 06 23:58:16.965681 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:16.965573    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfrqt" event={"ID":"78d2e680-f53b-4237-b8e6-6c57c3f1a977","Type":"ContainerStarted","Data":"78d6f0ec097644b5fe55a664d95c16b28b7bf11426a650b3c531595c571d75d3"}
Jul 06 23:58:17.003534 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.003171    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5844969b86-5hwj9"]
Jul 06 23:58:17.007441 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.007414    2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5844969b86-5hwj9"]
Jul 06 23:58:17.080995 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.080899    2551 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1-registry-tls\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 06 23:58:17.384491 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.384452    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret\") pod \"global-pull-secret-syncer-jbkpl\" (UID: \"cce87a14-ec61-4e46-b630-4488f0c25032\") " pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:58:17.387296 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.387272    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 06 23:58:17.397272 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.397252    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cce87a14-ec61-4e46-b630-4488f0c25032-original-pull-secret\") pod \"global-pull-secret-syncer-jbkpl\" (UID: \"cce87a14-ec61-4e46-b630-4488f0c25032\") " pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:58:17.485021 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.484981    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs\") pod \"network-metrics-daemon-wm7tt\" (UID: \"084ae393-acaf-4d47-8460-64ada80ae79f\") " pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:58:17.487692 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.487665    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 06 23:58:17.497966 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.497935    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/084ae393-acaf-4d47-8460-64ada80ae79f-metrics-certs\") pod \"network-metrics-daemon-wm7tt\" (UID: \"084ae393-acaf-4d47-8460-64ada80ae79f\") " pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:58:17.498845 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.498830    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jbkpl"
Jul 06 23:58:17.514467 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.514446    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wdx8b\""
Jul 06 23:58:17.522696 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.522672    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wm7tt"
Jul 06 23:58:17.585774 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.585737    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hxnd\" (UniqueName: \"kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd\") pod \"network-check-target-hrttl\" (UID: \"98de894c-93c0-4f1f-8916-e17f6d902621\") " pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:58:17.589889 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.589600    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hxnd\" (UniqueName: \"kubernetes.io/projected/98de894c-93c0-4f1f-8916-e17f6d902621-kube-api-access-5hxnd\") pod \"network-check-target-hrttl\" (UID: \"98de894c-93c0-4f1f-8916-e17f6d902621\") " pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:58:17.638129 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.638026    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jbkpl"]
Jul 06 23:58:17.641360 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:58:17.641323    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcce87a14_ec61_4e46_b630_4488f0c25032.slice/crio-faa3acc2487fa4c2b281ca9f538f03f814fa328764729295b8db97560b2e5189 WatchSource:0}: Error finding container faa3acc2487fa4c2b281ca9f538f03f814fa328764729295b8db97560b2e5189: Status 404 returned error can't find the container with id faa3acc2487fa4c2b281ca9f538f03f814fa328764729295b8db97560b2e5189
Jul 06 23:58:17.671634 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.671603    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wm7tt"]
Jul 06 23:58:17.675071 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:58:17.675041    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod084ae393_acaf_4d47_8460_64ada80ae79f.slice/crio-f46b483dc17c814600611e7a186459b999dccca716a11c3fc00d82be1fb8eaf3 WatchSource:0}: Error finding container f46b483dc17c814600611e7a186459b999dccca716a11c3fc00d82be1fb8eaf3: Status 404 returned error can't find the container with id f46b483dc17c814600611e7a186459b999dccca716a11c3fc00d82be1fb8eaf3
Jul 06 23:58:17.693955 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.693930    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5691ef86-f03f-4f15-81ce-0fb0c5f0faa1" path="/var/lib/kubelet/pods/5691ef86-f03f-4f15-81ce-0fb0c5f0faa1/volumes"
Jul 06 23:58:17.809721 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.809685    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-v6xkb\""
Jul 06 23:58:17.817911 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.817878    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:58:17.963788 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.963756    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-hrttl"]
Jul 06 23:58:17.966863 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:58:17.966825    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98de894c_93c0_4f1f_8916_e17f6d902621.slice/crio-b13da62cbb1c1b2593cd1659207c191041734248ad48017f3362c4091e17c5cc WatchSource:0}: Error finding container b13da62cbb1c1b2593cd1659207c191041734248ad48017f3362c4091e17c5cc: Status 404 returned error can't find the container with id b13da62cbb1c1b2593cd1659207c191041734248ad48017f3362c4091e17c5cc
Jul 06 23:58:17.970928 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.970900    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfrqt" event={"ID":"78d2e680-f53b-4237-b8e6-6c57c3f1a977","Type":"ContainerStarted","Data":"73ca16316068f8c574c78c3c8ab0205efce9efd3b9dfe8715a684aea06e39da1"}
Jul 06 23:58:17.972589 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.972502    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wm7tt" event={"ID":"084ae393-acaf-4d47-8460-64ada80ae79f","Type":"ContainerStarted","Data":"f46b483dc17c814600611e7a186459b999dccca716a11c3fc00d82be1fb8eaf3"}
Jul 06 23:58:17.973804 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.973746    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jbkpl" event={"ID":"cce87a14-ec61-4e46-b630-4488f0c25032","Type":"ContainerStarted","Data":"faa3acc2487fa4c2b281ca9f538f03f814fa328764729295b8db97560b2e5189"}
Jul 06 23:58:17.989588 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:17.989545    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-jfrqt" podStartSLOduration=1.870721021 podStartE2EDuration="2.98952547s" totalImagesPullingTime="1.118804449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:17.988930665 +0000 UTC m=+66.768325323" watchObservedRunningTime="2026-07-06 23:58:17.98952547 +0000 UTC m=+66.768920187"
Jul 06 23:58:18.981005 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:18.980906    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wm7tt" event={"ID":"084ae393-acaf-4d47-8460-64ada80ae79f","Type":"ContainerStarted","Data":"d01d7717afced6c0027038166034022f1458be9f20d3a3304a1c3202a246e5b9"}
Jul 06 23:58:18.981005 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:18.980979    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wm7tt" event={"ID":"084ae393-acaf-4d47-8460-64ada80ae79f","Type":"ContainerStarted","Data":"54f9488a7bd4e1551d6c5a1e34e0a892142c0b7c1eade20be27bb90374132ac6"}
Jul 06 23:58:18.982924 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:18.982834    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hrttl" event={"ID":"98de894c-93c0-4f1f-8916-e17f6d902621","Type":"ContainerStarted","Data":"9b92915d9db45b04c6b721bdc716c53f1a519ccb6c0ef69306d5eee8238b9616"}
Jul 06 23:58:18.982924 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:18.982897    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-hrttl" event={"ID":"98de894c-93c0-4f1f-8916-e17f6d902621","Type":"ContainerStarted","Data":"b13da62cbb1c1b2593cd1659207c191041734248ad48017f3362c4091e17c5cc"}
Jul 06 23:58:18.999019 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:18.998915    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wm7tt" podStartSLOduration=65.996050237 podStartE2EDuration="1m6.998895722s" totalImagesPullingTime="1.002845485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:18.997208533 +0000 UTC m=+67.776603192" watchObservedRunningTime="2026-07-06 23:58:18.998895722 +0000 UTC m=+67.778290385"
Jul 06 23:58:19.012694 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:19.012631    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-hrttl" podStartSLOduration=67.012612168 podStartE2EDuration="1m7.012612168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:57:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:19.011655237 +0000 UTC m=+67.791049894" watchObservedRunningTime="2026-07-06 23:58:19.012612168 +0000 UTC m=+67.792006826"
Jul 06 23:58:19.188444 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:19.188069    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-82hxp"]
Jul 06 23:58:19.192327 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:19.192296    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-82hxp"
Jul 06 23:58:19.195158 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:19.194998    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-g6q45\""
Jul 06 23:58:19.195656 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:19.195491    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 06 23:58:19.200148 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:19.200089    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-82hxp"]
Jul 06 23:58:19.299885 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:19.299792    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a8f5a672-6d6a-47ed-9b24-99f3165bcf66-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-82hxp\" (UID: \"a8f5a672-6d6a-47ed-9b24-99f3165bcf66\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-82hxp"
Jul 06 23:58:19.401230 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:19.401178    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a8f5a672-6d6a-47ed-9b24-99f3165bcf66-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-82hxp\" (UID: \"a8f5a672-6d6a-47ed-9b24-99f3165bcf66\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-82hxp"
Jul 06 23:58:19.401388 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:58:19.401336    2551 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 06 23:58:19.401445 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:58:19.401398    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a8f5a672-6d6a-47ed-9b24-99f3165bcf66-tls-certificates podName:a8f5a672-6d6a-47ed-9b24-99f3165bcf66 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:19.901382642 +0000 UTC m=+68.680777286 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/a8f5a672-6d6a-47ed-9b24-99f3165bcf66-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-82hxp" (UID: "a8f5a672-6d6a-47ed-9b24-99f3165bcf66") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 06 23:58:19.805499 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:19.805458    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls\") pod \"dns-default-sgzpt\" (UID: \"262963f5-50b1-4f77-88ea-7f92a44fa4c7\") " pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:58:19.808057 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:19.808029    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/262963f5-50b1-4f77-88ea-7f92a44fa4c7-metrics-tls\") pod \"dns-default-sgzpt\" (UID: \"262963f5-50b1-4f77-88ea-7f92a44fa4c7\") " pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:58:19.906591 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:19.906554    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a8f5a672-6d6a-47ed-9b24-99f3165bcf66-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-82hxp\" (UID: \"a8f5a672-6d6a-47ed-9b24-99f3165bcf66\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-82hxp"
Jul 06 23:58:19.909560 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:19.909536    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/a8f5a672-6d6a-47ed-9b24-99f3165bcf66-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-82hxp\" (UID: \"a8f5a672-6d6a-47ed-9b24-99f3165bcf66\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-82hxp"
Jul 06 23:58:19.987848 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:19.987779    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:58:20.021213 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:20.021178    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-s7rq7\""
Jul 06 23:58:20.028672 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:20.028645    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:58:20.104754 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:20.104689    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-82hxp"
Jul 06 23:58:20.210439 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:20.210368    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sgzpt"]
Jul 06 23:58:20.214440 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:58:20.214405    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod262963f5_50b1_4f77_88ea_7f92a44fa4c7.slice/crio-c66f3df097a0f8a7f5dad21e5689cb8eac336431bd7d44ecba43c9c368160a65 WatchSource:0}: Error finding container c66f3df097a0f8a7f5dad21e5689cb8eac336431bd7d44ecba43c9c368160a65: Status 404 returned error can't find the container with id c66f3df097a0f8a7f5dad21e5689cb8eac336431bd7d44ecba43c9c368160a65
Jul 06 23:58:20.284406 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:20.284374    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-82hxp"]
Jul 06 23:58:20.288194 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:58:20.288155    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8f5a672_6d6a_47ed_9b24_99f3165bcf66.slice/crio-df92cdefe41097f2ae11d6851015f6d42513510a1b2f54e62de614081f563142 WatchSource:0}: Error finding container df92cdefe41097f2ae11d6851015f6d42513510a1b2f54e62de614081f563142: Status 404 returned error can't find the container with id df92cdefe41097f2ae11d6851015f6d42513510a1b2f54e62de614081f563142
Jul 06 23:58:20.993832 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:20.993771    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-82hxp" event={"ID":"a8f5a672-6d6a-47ed-9b24-99f3165bcf66","Type":"ContainerStarted","Data":"df92cdefe41097f2ae11d6851015f6d42513510a1b2f54e62de614081f563142"}
Jul 06 23:58:20.995025 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:20.994992    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sgzpt" event={"ID":"262963f5-50b1-4f77-88ea-7f92a44fa4c7","Type":"ContainerStarted","Data":"c66f3df097a0f8a7f5dad21e5689cb8eac336431bd7d44ecba43c9c368160a65"}
Jul 06 23:58:22.628595 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:22.628560    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:58:22.632296 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:22.632240    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/9a2d4701-006a-429f-adad-126f71953faf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-84bwn\" (UID: \"9a2d4701-006a-429f-adad-126f71953faf\") " pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:58:22.888559 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:22.888506    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9lqq6\""
Jul 06 23:58:22.896847 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:22.896824    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-84bwn"
Jul 06 23:58:23.008657 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:23.008616    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jbkpl" event={"ID":"cce87a14-ec61-4e46-b630-4488f0c25032","Type":"ContainerStarted","Data":"12d09d17b350c8b0fef80dbf1d30d3f4386fc8e3c41d2f4d174d7803a6c238bc"}
Jul 06 23:58:23.024611 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:23.024505    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jbkpl" podStartSLOduration=66.250795347 podStartE2EDuration="1m11.024485447s" totalImagesPullingTime="4.7736901s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:57:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:23.023426272 +0000 UTC m=+71.802820954" watchObservedRunningTime="2026-07-06 23:58:23.024485447 +0000 UTC m=+71.803880105"
Jul 06 23:58:24.440525 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:24.440479    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-84bwn"]
Jul 06 23:58:24.443852 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:58:24.443823    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a2d4701_006a_429f_adad_126f71953faf.slice/crio-bf13b99d3fac77d9f97ac0ce3911bde08378b545bffa76e1694b17b531a1122a WatchSource:0}: Error finding container bf13b99d3fac77d9f97ac0ce3911bde08378b545bffa76e1694b17b531a1122a: Status 404 returned error can't find the container with id bf13b99d3fac77d9f97ac0ce3911bde08378b545bffa76e1694b17b531a1122a
Jul 06 23:58:25.018247 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.018111    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sgzpt" event={"ID":"262963f5-50b1-4f77-88ea-7f92a44fa4c7","Type":"ContainerStarted","Data":"57653e83ff943e158d37591f00613d8384e8525517b733df98828e155c9d69f6"}
Jul 06 23:58:25.018247 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.018182    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sgzpt" event={"ID":"262963f5-50b1-4f77-88ea-7f92a44fa4c7","Type":"ContainerStarted","Data":"b87c78f68b8a8a2d24fbcf4c15c7888a4e2abe0d8ded357aaba09c77174e5447"}
Jul 06 23:58:25.018247 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.018216    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:58:25.019455 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.019429    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-84bwn" event={"ID":"9a2d4701-006a-429f-adad-126f71953faf","Type":"ContainerStarted","Data":"bf13b99d3fac77d9f97ac0ce3911bde08378b545bffa76e1694b17b531a1122a"}
Jul 06 23:58:25.021324 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.021300    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-82hxp" event={"ID":"a8f5a672-6d6a-47ed-9b24-99f3165bcf66","Type":"ContainerStarted","Data":"5eb806cbc0b8e020f0cea378635114efd775735d45e9ab68daa573ae52953f47"}
Jul 06 23:58:25.021542 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.021505    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-82hxp"
Jul 06 23:58:25.027817 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.027794    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-82hxp"
Jul 06 23:58:25.050819 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.050774    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sgzpt" podStartSLOduration=33.964826666 podStartE2EDuration="38.050760515s" totalImagesPullingTime="4.085933849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:25.035754637 +0000 UTC m=+73.815149295" watchObservedRunningTime="2026-07-06 23:58:25.050760515 +0000 UTC m=+73.830155173"
Jul 06 23:58:25.050934 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.050887    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-82hxp" podStartSLOduration=2.045238316 podStartE2EDuration="6.050881088s" totalImagesPullingTime="4.005642772s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:25.050202678 +0000 UTC m=+73.829597348" watchObservedRunningTime="2026-07-06 23:58:25.050881088 +0000 UTC m=+73.830275728"
Jul 06 23:58:25.227947 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.226752    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg"]
Jul 06 23:58:25.229736 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.229135    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg"
Jul 06 23:58:25.232380 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.232091    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 06 23:58:25.232380 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.232090    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 06 23:58:25.234589 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.234230    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 06 23:58:25.234589 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.234302    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qznnm\""
Jul 06 23:58:25.234589 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.234477    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 06 23:58:25.234589 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.234477    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 06 23:58:25.242944 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.242862    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg"]
Jul 06 23:58:25.351965 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.351667    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n4vr\" (UniqueName: \"kubernetes.io/projected/0faada77-a5f3-4d39-9cf5-d78cfec24315-kube-api-access-2n4vr\") pod \"prometheus-operator-567f7b8b7c-4sqxg\" (UID: \"0faada77-a5f3-4d39-9cf5-d78cfec24315\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg"
Jul 06 23:58:25.351965 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.351715    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0faada77-a5f3-4d39-9cf5-d78cfec24315-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4sqxg\" (UID: \"0faada77-a5f3-4d39-9cf5-d78cfec24315\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg"
Jul 06 23:58:25.351965 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.351746    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0faada77-a5f3-4d39-9cf5-d78cfec24315-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4sqxg\" (UID: \"0faada77-a5f3-4d39-9cf5-d78cfec24315\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg"
Jul 06 23:58:25.351965 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.351795    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0faada77-a5f3-4d39-9cf5-d78cfec24315-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4sqxg\" (UID: \"0faada77-a5f3-4d39-9cf5-d78cfec24315\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg"
Jul 06 23:58:25.453143 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.453094    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n4vr\" (UniqueName: \"kubernetes.io/projected/0faada77-a5f3-4d39-9cf5-d78cfec24315-kube-api-access-2n4vr\") pod \"prometheus-operator-567f7b8b7c-4sqxg\" (UID: \"0faada77-a5f3-4d39-9cf5-d78cfec24315\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg"
Jul 06 23:58:25.453630 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.453162    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0faada77-a5f3-4d39-9cf5-d78cfec24315-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4sqxg\" (UID: \"0faada77-a5f3-4d39-9cf5-d78cfec24315\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg"
Jul 06 23:58:25.453630 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.453196    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0faada77-a5f3-4d39-9cf5-d78cfec24315-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4sqxg\" (UID: \"0faada77-a5f3-4d39-9cf5-d78cfec24315\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg"
Jul 06 23:58:25.453630 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.453248    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0faada77-a5f3-4d39-9cf5-d78cfec24315-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4sqxg\" (UID: \"0faada77-a5f3-4d39-9cf5-d78cfec24315\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg"
Jul 06 23:58:25.454318 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:58:25.454034    2551 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 06 23:58:25.454318 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:58:25.454114    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0faada77-a5f3-4d39-9cf5-d78cfec24315-prometheus-operator-tls podName:0faada77-a5f3-4d39-9cf5-d78cfec24315 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:25.954091537 +0000 UTC m=+74.733486187 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/0faada77-a5f3-4d39-9cf5-d78cfec24315-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-4sqxg" (UID: "0faada77-a5f3-4d39-9cf5-d78cfec24315") : secret "prometheus-operator-tls" not found
Jul 06 23:58:25.454318 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.454204    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0faada77-a5f3-4d39-9cf5-d78cfec24315-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-4sqxg\" (UID: \"0faada77-a5f3-4d39-9cf5-d78cfec24315\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg"
Jul 06 23:58:25.462272 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.462215    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0faada77-a5f3-4d39-9cf5-d78cfec24315-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-4sqxg\" (UID: \"0faada77-a5f3-4d39-9cf5-d78cfec24315\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg"
Jul 06 23:58:25.465017 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.464975    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n4vr\" (UniqueName: \"kubernetes.io/projected/0faada77-a5f3-4d39-9cf5-d78cfec24315-kube-api-access-2n4vr\") pod \"prometheus-operator-567f7b8b7c-4sqxg\" (UID: \"0faada77-a5f3-4d39-9cf5-d78cfec24315\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg"
Jul 06 23:58:25.957492 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.957442    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0faada77-a5f3-4d39-9cf5-d78cfec24315-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4sqxg\" (UID: \"0faada77-a5f3-4d39-9cf5-d78cfec24315\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg"
Jul 06 23:58:25.960599 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:25.960541    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/0faada77-a5f3-4d39-9cf5-d78cfec24315-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-4sqxg\" (UID: \"0faada77-a5f3-4d39-9cf5-d78cfec24315\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg"
Jul 06 23:58:26.151745 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:26.151708    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg"
Jul 06 23:58:26.321988 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:26.321954    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg"]
Jul 06 23:58:26.325189 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:58:26.325161    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0faada77_a5f3_4d39_9cf5_d78cfec24315.slice/crio-590c8720e9b33901974b605df80899f9f729e058e1df1d3f7d4f1d84b30046b0 WatchSource:0}: Error finding container 590c8720e9b33901974b605df80899f9f729e058e1df1d3f7d4f1d84b30046b0: Status 404 returned error can't find the container with id 590c8720e9b33901974b605df80899f9f729e058e1df1d3f7d4f1d84b30046b0
Jul 06 23:58:27.031939 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:27.031895    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg" event={"ID":"0faada77-a5f3-4d39-9cf5-d78cfec24315","Type":"ContainerStarted","Data":"590c8720e9b33901974b605df80899f9f729e058e1df1d3f7d4f1d84b30046b0"}
Jul 06 23:58:31.898456 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:31.898418    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d569b87c-z6zfr"]
Jul 06 23:58:31.901584 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:31.901555    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:31.905673 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:31.905644    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 06 23:58:31.905818 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:31.905693    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 06 23:58:31.905818 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:31.905743    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 06 23:58:31.905818 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:31.905694    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 06 23:58:31.905982 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:31.905820    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 06 23:58:31.905982 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:31.905693    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-whz66\""
Jul 06 23:58:31.910869 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:31.910847    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 06 23:58:31.914704 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:31.914669    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d569b87c-z6zfr"]
Jul 06 23:58:32.002683 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.002638    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-console-config\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.002862 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.002704    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqq9c\" (UniqueName: \"kubernetes.io/projected/727b9b6b-34cc-4255-b3e5-d7638029302a-kube-api-access-qqq9c\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.002862 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.002729    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-service-ca\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.002862 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.002811    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-oauth-serving-cert\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.002862 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.002851    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-trusted-ca-bundle\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.003040 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.002898    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/727b9b6b-34cc-4255-b3e5-d7638029302a-console-oauth-config\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.003040 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.002929    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/727b9b6b-34cc-4255-b3e5-d7638029302a-console-serving-cert\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.103462 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.103423    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqq9c\" (UniqueName: \"kubernetes.io/projected/727b9b6b-34cc-4255-b3e5-d7638029302a-kube-api-access-qqq9c\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.103462 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.103470    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-service-ca\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.103723 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.103522    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-oauth-serving-cert\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.103723 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.103657    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-trusted-ca-bundle\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.103723 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.103712    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/727b9b6b-34cc-4255-b3e5-d7638029302a-console-oauth-config\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.103881 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.103737    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/727b9b6b-34cc-4255-b3e5-d7638029302a-console-serving-cert\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.103881 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.103770    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-console-config\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.104346 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.104295    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-oauth-serving-cert\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.104346 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.104317    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-service-ca\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.104571 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.104535    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-console-config\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.104808 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.104788    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-trusted-ca-bundle\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.106676 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.106652    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/727b9b6b-34cc-4255-b3e5-d7638029302a-console-serving-cert\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.106779 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.106700    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/727b9b6b-34cc-4255-b3e5-d7638029302a-console-oauth-config\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.112490 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.112463    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqq9c\" (UniqueName: \"kubernetes.io/projected/727b9b6b-34cc-4255-b3e5-d7638029302a-kube-api-access-qqq9c\") pod \"console-7d569b87c-z6zfr\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") " pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:32.213616 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:32.213506    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:35.028014 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:35.027893    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sgzpt"
Jul 06 23:58:36.066369 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:36.066261    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-84bwn" event={"ID":"9a2d4701-006a-429f-adad-126f71953faf","Type":"ContainerStarted","Data":"5b98ef1675e59f9cf4cf3cce1f5cf9ed06eb560837d3b174366742468e8d0c0a"}
Jul 06 23:58:36.069479 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:36.068552    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-tkr2w" event={"ID":"a6128722-3c79-444d-8079-27c045ab076f","Type":"ContainerStarted","Data":"b82ecd8d301f5d0b9af6a52a66c9b24ae3c68c3eb4115beb7d4fdb2cc3a9be54"}
Jul 06 23:58:36.069479 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:36.068966    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-tkr2w"
Jul 06 23:58:36.070617 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:36.070587    2551 patch_prober.go:28] interesting pod/downloads-685bfb5f64-tkr2w container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.13:8080/\": dial tcp 10.133.0.13:8080: connect: connection refused" start-of-body=
Jul 06 23:58:36.070728 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:36.070644    2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-685bfb5f64-tkr2w" podUID="a6128722-3c79-444d-8079-27c045ab076f" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.13:8080/\": dial tcp 10.133.0.13:8080: connect: connection refused"
Jul 06 23:58:36.071559 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:36.071500    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg" event={"ID":"0faada77-a5f3-4d39-9cf5-d78cfec24315","Type":"ContainerStarted","Data":"33c6caf2d49b5479b236c176a21bc50637b7a2a572543f00b30b6aa84c5f7d9d"}
Jul 06 23:58:36.087883 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:36.087817    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-tkr2w" podStartSLOduration=1.356885367 podStartE2EDuration="21.087794842s" totalImagesPullingTime="19.730909475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:36.085765813 +0000 UTC m=+84.865160470" watchObservedRunningTime="2026-07-06 23:58:36.087794842 +0000 UTC m=+84.867189500"
Jul 06 23:58:36.090101 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:36.090076    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d569b87c-z6zfr"]
Jul 06 23:58:36.092056 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:58:36.092011    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod727b9b6b_34cc_4255_b3e5_d7638029302a.slice/crio-5d8efd236e1b5db01317a4336695457a8b9242df6b5892b59c56967c2ad32f2c WatchSource:0}: Error finding container 5d8efd236e1b5db01317a4336695457a8b9242df6b5892b59c56967c2ad32f2c: Status 404 returned error can't find the container with id 5d8efd236e1b5db01317a4336695457a8b9242df6b5892b59c56967c2ad32f2c
Jul 06 23:58:37.090545 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:37.090487    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg" event={"ID":"0faada77-a5f3-4d39-9cf5-d78cfec24315","Type":"ContainerStarted","Data":"c60a7aacc88f654e67eb86cf3951fdf9295eaf932dee2815fd11ccd041c26b8b"}
Jul 06 23:58:37.096488 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:37.096445    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d569b87c-z6zfr" event={"ID":"727b9b6b-34cc-4255-b3e5-d7638029302a","Type":"ContainerStarted","Data":"5d8efd236e1b5db01317a4336695457a8b9242df6b5892b59c56967c2ad32f2c"}
Jul 06 23:58:37.100957 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:37.100462    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-84bwn" event={"ID":"9a2d4701-006a-429f-adad-126f71953faf","Type":"ContainerStarted","Data":"2834fa338688326ed4b120dff563cca56202214fb66fd656e25db78094db5578"}
Jul 06 23:58:37.113818 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:37.112584    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-4sqxg" podStartSLOduration=2.511056557 podStartE2EDuration="12.112563897s" totalImagesPullingTime="9.60150734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:37.107901615 +0000 UTC m=+85.887296271" watchObservedRunningTime="2026-07-06 23:58:37.112563897 +0000 UTC m=+85.891958582"
Jul 06 23:58:37.113993 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:37.113867    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-tkr2w"
Jul 06 23:58:38.568294 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.568246    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw"]
Jul 06 23:58:38.604794 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.604764    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw"]
Jul 06 23:58:38.604960 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.604893    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw"
Jul 06 23:58:38.607877 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.607645    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 06 23:58:38.607877 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.607660    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 06 23:58:38.607877 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.607781    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tl8hf\""
Jul 06 23:58:38.615407 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.615381    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jfr6l"]
Jul 06 23:58:38.634223 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.634190    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.636933 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.636906    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 06 23:58:38.637068 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.637019    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r62mn\""
Jul 06 23:58:38.637165 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.637146    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 06 23:58:38.637230 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.637194    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 06 23:58:38.769747 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.769692    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f7f1707-994c-4987-97af-c5e61bf76137-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-bzmbw\" (UID: \"9f7f1707-994c-4987-97af-c5e61bf76137\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw"
Jul 06 23:58:38.769747 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.769754    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba4fb820-75dc-460d-8e4e-1f54f0052e94-root\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.769991 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.769783    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcg7m\" (UniqueName: \"kubernetes.io/projected/ba4fb820-75dc-460d-8e4e-1f54f0052e94-kube-api-access-dcg7m\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.769991 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.769816    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba4fb820-75dc-460d-8e4e-1f54f0052e94-node-exporter-textfile\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.769991 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.769838    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba4fb820-75dc-460d-8e4e-1f54f0052e94-node-exporter-wtmp\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.769991 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.769900    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba4fb820-75dc-460d-8e4e-1f54f0052e94-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.769991 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.769928    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba4fb820-75dc-460d-8e4e-1f54f0052e94-node-exporter-accelerators-collector-config\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.769991 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.769959    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f7f1707-994c-4987-97af-c5e61bf76137-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-bzmbw\" (UID: \"9f7f1707-994c-4987-97af-c5e61bf76137\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw"
Jul 06 23:58:38.769991 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.769985    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p2sc8\" (UniqueName: \"kubernetes.io/projected/9f7f1707-994c-4987-97af-c5e61bf76137-kube-api-access-p2sc8\") pod \"openshift-state-metrics-54cf96dfcf-bzmbw\" (UID: \"9f7f1707-994c-4987-97af-c5e61bf76137\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw"
Jul 06 23:58:38.770329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.770187    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba4fb820-75dc-460d-8e4e-1f54f0052e94-node-exporter-tls\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.770329 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.770235    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba4fb820-75dc-460d-8e4e-1f54f0052e94-metrics-client-ca\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.770421 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.770400    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba4fb820-75dc-460d-8e4e-1f54f0052e94-sys\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.770461 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.770443    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f7f1707-994c-4987-97af-c5e61bf76137-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-bzmbw\" (UID: \"9f7f1707-994c-4987-97af-c5e61bf76137\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw"
Jul 06 23:58:38.871133 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.871046    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba4fb820-75dc-460d-8e4e-1f54f0052e94-node-exporter-tls\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.871133 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.871101    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba4fb820-75dc-460d-8e4e-1f54f0052e94-metrics-client-ca\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.871870 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.871139    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba4fb820-75dc-460d-8e4e-1f54f0052e94-sys\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.871870 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.871171    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f7f1707-994c-4987-97af-c5e61bf76137-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-bzmbw\" (UID: \"9f7f1707-994c-4987-97af-c5e61bf76137\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw"
Jul 06 23:58:38.871870 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.871208    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f7f1707-994c-4987-97af-c5e61bf76137-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-bzmbw\" (UID: \"9f7f1707-994c-4987-97af-c5e61bf76137\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw"
Jul 06 23:58:38.871870 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.871241    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba4fb820-75dc-460d-8e4e-1f54f0052e94-root\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.871870 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:58:38.871244    2551 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 06 23:58:38.871870 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.871271    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcg7m\" (UniqueName: \"kubernetes.io/projected/ba4fb820-75dc-460d-8e4e-1f54f0052e94-kube-api-access-dcg7m\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.871870 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:58:38.871319    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba4fb820-75dc-460d-8e4e-1f54f0052e94-node-exporter-tls podName:ba4fb820-75dc-460d-8e4e-1f54f0052e94 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:39.371298097 +0000 UTC m=+88.150692751 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ba4fb820-75dc-460d-8e4e-1f54f0052e94-node-exporter-tls") pod "node-exporter-jfr6l" (UID: "ba4fb820-75dc-460d-8e4e-1f54f0052e94") : secret "node-exporter-tls" not found
Jul 06 23:58:38.871870 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.871346    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba4fb820-75dc-460d-8e4e-1f54f0052e94-node-exporter-textfile\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.871870 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.871380    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba4fb820-75dc-460d-8e4e-1f54f0052e94-node-exporter-wtmp\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.871870 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.871425    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba4fb820-75dc-460d-8e4e-1f54f0052e94-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.871870 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.871456    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba4fb820-75dc-460d-8e4e-1f54f0052e94-node-exporter-accelerators-collector-config\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.871870 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.871486    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f7f1707-994c-4987-97af-c5e61bf76137-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-bzmbw\" (UID: \"9f7f1707-994c-4987-97af-c5e61bf76137\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw"
Jul 06 23:58:38.871870 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.871530    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p2sc8\" (UniqueName: \"kubernetes.io/projected/9f7f1707-994c-4987-97af-c5e61bf76137-kube-api-access-p2sc8\") pod \"openshift-state-metrics-54cf96dfcf-bzmbw\" (UID: \"9f7f1707-994c-4987-97af-c5e61bf76137\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw"
Jul 06 23:58:38.871870 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.871610    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba4fb820-75dc-460d-8e4e-1f54f0052e94-sys\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.871870 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.871669    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba4fb820-75dc-460d-8e4e-1f54f0052e94-root\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.871870 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:58:38.871700    2551 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 06 23:58:38.872934 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:58:38.871787    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9f7f1707-994c-4987-97af-c5e61bf76137-openshift-state-metrics-tls podName:9f7f1707-994c-4987-97af-c5e61bf76137 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:39.37175882 +0000 UTC m=+88.151153463 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/9f7f1707-994c-4987-97af-c5e61bf76137-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-bzmbw" (UID: "9f7f1707-994c-4987-97af-c5e61bf76137") : secret "openshift-state-metrics-tls" not found
Jul 06 23:58:38.872934 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.871802    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba4fb820-75dc-460d-8e4e-1f54f0052e94-node-exporter-wtmp\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.872934 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.871914    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba4fb820-75dc-460d-8e4e-1f54f0052e94-metrics-client-ca\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.872934 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.872712    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba4fb820-75dc-460d-8e4e-1f54f0052e94-node-exporter-accelerators-collector-config\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.872934 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.872786    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba4fb820-75dc-460d-8e4e-1f54f0052e94-node-exporter-textfile\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.873166 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.872945    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9f7f1707-994c-4987-97af-c5e61bf76137-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-bzmbw\" (UID: \"9f7f1707-994c-4987-97af-c5e61bf76137\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw"
Jul 06 23:58:38.874887 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.874862    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9f7f1707-994c-4987-97af-c5e61bf76137-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-bzmbw\" (UID: \"9f7f1707-994c-4987-97af-c5e61bf76137\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw"
Jul 06 23:58:38.875570 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.875548    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba4fb820-75dc-460d-8e4e-1f54f0052e94-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:38.885432 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.885376    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p2sc8\" (UniqueName: \"kubernetes.io/projected/9f7f1707-994c-4987-97af-c5e61bf76137-kube-api-access-p2sc8\") pod \"openshift-state-metrics-54cf96dfcf-bzmbw\" (UID: \"9f7f1707-994c-4987-97af-c5e61bf76137\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw"
Jul 06 23:58:38.886025 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:38.885998    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcg7m\" (UniqueName: \"kubernetes.io/projected/ba4fb820-75dc-460d-8e4e-1f54f0052e94-kube-api-access-dcg7m\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:39.376089 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.376050    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba4fb820-75dc-460d-8e4e-1f54f0052e94-node-exporter-tls\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:39.376338 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.376124    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f7f1707-994c-4987-97af-c5e61bf76137-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-bzmbw\" (UID: \"9f7f1707-994c-4987-97af-c5e61bf76137\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw"
Jul 06 23:58:39.379361 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.379332    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba4fb820-75dc-460d-8e4e-1f54f0052e94-node-exporter-tls\") pod \"node-exporter-jfr6l\" (UID: \"ba4fb820-75dc-460d-8e4e-1f54f0052e94\") " pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:39.381260 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.381209    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/9f7f1707-994c-4987-97af-c5e61bf76137-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-bzmbw\" (UID: \"9f7f1707-994c-4987-97af-c5e61bf76137\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw"
Jul 06 23:58:39.517493 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.517246    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw"
Jul 06 23:58:39.545311 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.545231    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jfr6l"
Jul 06 23:58:39.675603 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.673663    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 23:58:39.701550 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.700447    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.703859 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.703714    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 06 23:58:39.703982 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.703927    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 06 23:58:39.704413 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.704222    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 06 23:58:39.704413 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.704303    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 06 23:58:39.704618 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.704552    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 06 23:58:39.705002 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.704806    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 06 23:58:39.705002 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.704815    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kv2hm\""
Jul 06 23:58:39.705002 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.704933    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 06 23:58:39.705744 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.705578    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 06 23:58:39.705744 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.705614    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 06 23:58:39.712024 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.711876    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 23:58:39.780200 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.780156    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.780200 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.780197    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b22f1173-9c99-4465-b7b1-b0f998757dc9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.780487 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.780328    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b22f1173-9c99-4465-b7b1-b0f998757dc9-config-out\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.780487 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.780401    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22f1173-9c99-4465-b7b1-b0f998757dc9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.780487 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.780430    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b22f1173-9c99-4465-b7b1-b0f998757dc9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.780487 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.780459    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-web-config\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.780734 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.780497    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-config-volume\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.780734 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.780574    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.780734 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.780635    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.780734 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.780661    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.780734 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.780682    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gd4rm\" (UniqueName: \"kubernetes.io/projected/b22f1173-9c99-4465-b7b1-b0f998757dc9-kube-api-access-gd4rm\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.780734 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.780732    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.781057 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.780779    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b22f1173-9c99-4465-b7b1-b0f998757dc9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.881896 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.881855    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22f1173-9c99-4465-b7b1-b0f998757dc9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.882078 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.881915    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b22f1173-9c99-4465-b7b1-b0f998757dc9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.882078 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.881950    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-web-config\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.882078 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.881974    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-config-volume\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.882078 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.881999    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.882078 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.882045    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.882078 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.882069    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.882340 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.882093    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gd4rm\" (UniqueName: \"kubernetes.io/projected/b22f1173-9c99-4465-b7b1-b0f998757dc9-kube-api-access-gd4rm\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.882340 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.882124    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.882340 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.882163    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b22f1173-9c99-4465-b7b1-b0f998757dc9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.882340 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.882190    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.882340 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.882211    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b22f1173-9c99-4465-b7b1-b0f998757dc9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.882340 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.882240    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b22f1173-9c99-4465-b7b1-b0f998757dc9-config-out\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.883071 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.883039    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b22f1173-9c99-4465-b7b1-b0f998757dc9-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.884232 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:58:39.883793    2551 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 06 23:58:39.884232 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:58:39.883896    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-main-tls podName:b22f1173-9c99-4465-b7b1-b0f998757dc9 nodeName:}" failed. No retries permitted until 2026-07-06 23:58:40.38387409 +0000 UTC m=+89.163268729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "b22f1173-9c99-4465-b7b1-b0f998757dc9") : secret "alertmanager-main-tls" not found
Jul 06 23:58:39.885856 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.885831    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b22f1173-9c99-4465-b7b1-b0f998757dc9-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.886815 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.886789    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22f1173-9c99-4465-b7b1-b0f998757dc9-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.888541 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.888474    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.895065 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.892725    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b22f1173-9c99-4465-b7b1-b0f998757dc9-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.895624 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.895603    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-config-volume\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.896908 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.896867    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b22f1173-9c99-4465-b7b1-b0f998757dc9-config-out\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.897036 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.897012    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-web-config\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.897550 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.897489    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.898699 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.898673    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.898819 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.898751    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:39.899350 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:39.899329    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gd4rm\" (UniqueName: \"kubernetes.io/projected/b22f1173-9c99-4465-b7b1-b0f998757dc9-kube-api-access-gd4rm\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:40.388198 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.388157    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:40.394430 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.391336    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:40.554469 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.554428    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-857d8bbb9f-2chml"]
Jul 06 23:58:40.587589 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.587490    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-857d8bbb9f-2chml"]
Jul 06 23:58:40.587762 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.587647    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.591483 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.590857    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jul 06 23:58:40.591483 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.590901    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jul 06 23:58:40.591483 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.591100    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-4ip4jq2n9lj5p\""
Jul 06 23:58:40.591483 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.591262    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jul 06 23:58:40.591483 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.591374    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jul 06 23:58:40.592245 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.591992    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nz6p4\""
Jul 06 23:58:40.592245 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.591994    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jul 06 23:58:40.615692 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.615642    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 06 23:58:40.692218 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.692139    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e3b9a7f-f18b-4c69-9d81-906803e09b38-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.692218 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.692181    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e3b9a7f-f18b-4c69-9d81-906803e09b38-secret-grpc-tls\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.692218 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.692211    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rsw4\" (UniqueName: \"kubernetes.io/projected/8e3b9a7f-f18b-4c69-9d81-906803e09b38-kube-api-access-8rsw4\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.692855 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.692240    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8e3b9a7f-f18b-4c69-9d81-906803e09b38-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.692855 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.692283    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e3b9a7f-f18b-4c69-9d81-906803e09b38-metrics-client-ca\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.692855 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.692311    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8e3b9a7f-f18b-4c69-9d81-906803e09b38-secret-thanos-querier-tls\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.692855 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.692396    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e3b9a7f-f18b-4c69-9d81-906803e09b38-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.692855 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.692462    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8e3b9a7f-f18b-4c69-9d81-906803e09b38-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.793716 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.793669    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e3b9a7f-f18b-4c69-9d81-906803e09b38-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.794083 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.793731    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e3b9a7f-f18b-4c69-9d81-906803e09b38-secret-grpc-tls\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.794083 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.793763    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8rsw4\" (UniqueName: \"kubernetes.io/projected/8e3b9a7f-f18b-4c69-9d81-906803e09b38-kube-api-access-8rsw4\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.794083 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.793796    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8e3b9a7f-f18b-4c69-9d81-906803e09b38-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.794083 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.793873    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e3b9a7f-f18b-4c69-9d81-906803e09b38-metrics-client-ca\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.794083 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.793925    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8e3b9a7f-f18b-4c69-9d81-906803e09b38-secret-thanos-querier-tls\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.794494 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.794470    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e3b9a7f-f18b-4c69-9d81-906803e09b38-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.794605 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.794560    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8e3b9a7f-f18b-4c69-9d81-906803e09b38-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.795592 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.795228    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8e3b9a7f-f18b-4c69-9d81-906803e09b38-metrics-client-ca\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.798378 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.798003    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8e3b9a7f-f18b-4c69-9d81-906803e09b38-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.798378 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.798003    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8e3b9a7f-f18b-4c69-9d81-906803e09b38-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.798378 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.798326    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/8e3b9a7f-f18b-4c69-9d81-906803e09b38-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.798628 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.798400    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/8e3b9a7f-f18b-4c69-9d81-906803e09b38-secret-thanos-querier-tls\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.806796 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.806744    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/8e3b9a7f-f18b-4c69-9d81-906803e09b38-secret-grpc-tls\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.809699 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.809648    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rsw4\" (UniqueName: \"kubernetes.io/projected/8e3b9a7f-f18b-4c69-9d81-906803e09b38-kube-api-access-8rsw4\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.811202 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.810894    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/8e3b9a7f-f18b-4c69-9d81-906803e09b38-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-857d8bbb9f-2chml\" (UID: \"8e3b9a7f-f18b-4c69-9d81-906803e09b38\") " pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:40.900903 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:40.900862    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:41.708816 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:58:41.708782    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba4fb820_75dc_460d_8e4e_1f54f0052e94.slice/crio-d64c5af4de73a1c76022895932ae27c0de19e4e8c7c753abd2c716f440d9ad00 WatchSource:0}: Error finding container d64c5af4de73a1c76022895932ae27c0de19e4e8c7c753abd2c716f440d9ad00: Status 404 returned error can't find the container with id d64c5af4de73a1c76022895932ae27c0de19e4e8c7c753abd2c716f440d9ad00
Jul 06 23:58:41.927525 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:41.925537    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-857d8bbb9f-2chml"]
Jul 06 23:58:41.927525 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:41.925994    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw"]
Jul 06 23:58:41.953647 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:41.953608    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 23:58:41.960269 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:58:41.960222    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb22f1173_9c99_4465_b7b1_b0f998757dc9.slice/crio-53777bf6f8afb9d0d29e96741fdfba154530576c1dd04264d46c0d0ac781d4af WatchSource:0}: Error finding container 53777bf6f8afb9d0d29e96741fdfba154530576c1dd04264d46c0d0ac781d4af: Status 404 returned error can't find the container with id 53777bf6f8afb9d0d29e96741fdfba154530576c1dd04264d46c0d0ac781d4af
Jul 06 23:58:42.126775 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.126734    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw" event={"ID":"9f7f1707-994c-4987-97af-c5e61bf76137","Type":"ContainerStarted","Data":"453b218a4ac416c56de22f9838d4837ac4c52aee4499682103a714491db0b928"}
Jul 06 23:58:42.126945 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.126850    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw" event={"ID":"9f7f1707-994c-4987-97af-c5e61bf76137","Type":"ContainerStarted","Data":"2283cc6a8b5a9f65487d9f01de8db2d6b64e4ac8c3e511acdcbd7b4e394ae914"}
Jul 06 23:58:42.128421 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.128388    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b22f1173-9c99-4465-b7b1-b0f998757dc9","Type":"ContainerStarted","Data":"53777bf6f8afb9d0d29e96741fdfba154530576c1dd04264d46c0d0ac781d4af"}
Jul 06 23:58:42.129838 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.129764    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jfr6l" event={"ID":"ba4fb820-75dc-460d-8e4e-1f54f0052e94","Type":"ContainerStarted","Data":"d64c5af4de73a1c76022895932ae27c0de19e4e8c7c753abd2c716f440d9ad00"}
Jul 06 23:58:42.132220 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.132147    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d569b87c-z6zfr" event={"ID":"727b9b6b-34cc-4255-b3e5-d7638029302a","Type":"ContainerStarted","Data":"7d21bc74bde4fe583cafbc945ef27e8f51ec8f5dc5db957ae45d7dc71ac7156f"}
Jul 06 23:58:42.135760 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.135300    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-84bwn" event={"ID":"9a2d4701-006a-429f-adad-126f71953faf","Type":"ContainerStarted","Data":"4cc7b4139478afffd2f0d9d4303652a2b2331ed699d7f2e8e1a717950e931a17"}
Jul 06 23:58:42.138188 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.138109    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml" event={"ID":"8e3b9a7f-f18b-4c69-9d81-906803e09b38","Type":"ContainerStarted","Data":"4a238be1dee4c50e89456126c59c18d257c7e4b90835d1796ba3f32fc503f69e"}
Jul 06 23:58:42.151331 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.150847    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d569b87c-z6zfr" podStartSLOduration=5.534392299 podStartE2EDuration="11.150831828s" totalImagesPullingTime="5.616439529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:42.149796959 +0000 UTC m=+90.929191617" watchObservedRunningTime="2026-07-06 23:58:42.150831828 +0000 UTC m=+90.930226484"
Jul 06 23:58:42.184139 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.182447    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-84bwn" podStartSLOduration=35.102772491 podStartE2EDuration="52.182191133s" totalImagesPullingTime="17.079418642s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-06 23:57:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:42.181681862 +0000 UTC m=+90.961076521" watchObservedRunningTime="2026-07-06 23:58:42.182191133 +0000 UTC m=+90.961585791"
Jul 06 23:58:42.214133 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.214088    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:42.214323 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.214172    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:42.221829 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.221776    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:42.879919 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.879861    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"]
Jul 06 23:58:42.904694 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.904664    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"]
Jul 06 23:58:42.904863 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.904788    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:42.909230 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.908262    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 06 23:58:42.910311 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.910291    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-tnp54\""
Jul 06 23:58:42.910423 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.910336    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 06 23:58:42.910869 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.910646    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-18i8qu07ho6uh\""
Jul 06 23:58:42.910869 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.910684    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 06 23:58:42.910869 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:42.910829    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 06 23:58:43.014296 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.014259    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/79c97f9b-b68a-4fe5-bdb7-c386774ec742-audit-log\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.014597 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.014307    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b58g8\" (UniqueName: \"kubernetes.io/projected/79c97f9b-b68a-4fe5-bdb7-c386774ec742-kube-api-access-b58g8\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.014597 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.014344    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79c97f9b-b68a-4fe5-bdb7-c386774ec742-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.014597 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.014459    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79c97f9b-b68a-4fe5-bdb7-c386774ec742-client-ca-bundle\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.014597 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.014529    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/79c97f9b-b68a-4fe5-bdb7-c386774ec742-secret-metrics-server-tls\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.014597 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.014579    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/79c97f9b-b68a-4fe5-bdb7-c386774ec742-metrics-server-audit-profiles\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.014840 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.014648    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/79c97f9b-b68a-4fe5-bdb7-c386774ec742-secret-metrics-server-client-certs\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.115327 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.115286    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/79c97f9b-b68a-4fe5-bdb7-c386774ec742-metrics-server-audit-profiles\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.115604 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.115350    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/79c97f9b-b68a-4fe5-bdb7-c386774ec742-secret-metrics-server-client-certs\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.115604 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.115402    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/79c97f9b-b68a-4fe5-bdb7-c386774ec742-audit-log\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.115604 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.115419    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b58g8\" (UniqueName: \"kubernetes.io/projected/79c97f9b-b68a-4fe5-bdb7-c386774ec742-kube-api-access-b58g8\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.115604 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.115438    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79c97f9b-b68a-4fe5-bdb7-c386774ec742-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.115604 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.115575    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79c97f9b-b68a-4fe5-bdb7-c386774ec742-client-ca-bundle\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.116208 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.115641    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/79c97f9b-b68a-4fe5-bdb7-c386774ec742-secret-metrics-server-tls\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.116208 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.116126    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/79c97f9b-b68a-4fe5-bdb7-c386774ec742-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.116799 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.116458    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/79c97f9b-b68a-4fe5-bdb7-c386774ec742-metrics-server-audit-profiles\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.117204 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.117166    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/79c97f9b-b68a-4fe5-bdb7-c386774ec742-audit-log\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.125481 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.122050    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/79c97f9b-b68a-4fe5-bdb7-c386774ec742-client-ca-bundle\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.125481 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.122792    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/79c97f9b-b68a-4fe5-bdb7-c386774ec742-secret-metrics-server-tls\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.125994 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.125952    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/79c97f9b-b68a-4fe5-bdb7-c386774ec742-secret-metrics-server-client-certs\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.126079 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.126048    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b58g8\" (UniqueName: \"kubernetes.io/projected/79c97f9b-b68a-4fe5-bdb7-c386774ec742-kube-api-access-b58g8\") pod \"metrics-server-58cf5fddfc-xmlrp\" (UID: \"79c97f9b-b68a-4fe5-bdb7-c386774ec742\") " pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.148742 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.148598    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw" event={"ID":"9f7f1707-994c-4987-97af-c5e61bf76137","Type":"ContainerStarted","Data":"3feaef2326a394446bc54324faa88c3e1aa1e7fe28b86ac2260a005ec4f96219"}
Jul 06 23:58:43.155240 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.155120    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:58:43.220473 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.220235    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:58:43.393644 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.393607    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5xgfz"]
Jul 06 23:58:43.408498 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.407610    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5xgfz"]
Jul 06 23:58:43.408498 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.407729    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5xgfz"
Jul 06 23:58:43.410648 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.410614    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 06 23:58:43.410835 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.410815    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-49pfb\""
Jul 06 23:58:43.519092 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.519054    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3f3bb09-40b5-4fce-b5e4-e086fa99167d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5xgfz\" (UID: \"a3f3bb09-40b5-4fce-b5e4-e086fa99167d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5xgfz"
Jul 06 23:58:43.519272 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.519130    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7hk8\" (UniqueName: \"kubernetes.io/projected/a3f3bb09-40b5-4fce-b5e4-e086fa99167d-kube-api-access-z7hk8\") pod \"monitoring-plugin-d5dcff7cf-5xgfz\" (UID: \"a3f3bb09-40b5-4fce-b5e4-e086fa99167d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5xgfz"
Jul 06 23:58:43.620663 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.620619    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7hk8\" (UniqueName: \"kubernetes.io/projected/a3f3bb09-40b5-4fce-b5e4-e086fa99167d-kube-api-access-z7hk8\") pod \"monitoring-plugin-d5dcff7cf-5xgfz\" (UID: \"a3f3bb09-40b5-4fce-b5e4-e086fa99167d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5xgfz"
Jul 06 23:58:43.620870 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.620786    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3f3bb09-40b5-4fce-b5e4-e086fa99167d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5xgfz\" (UID: \"a3f3bb09-40b5-4fce-b5e4-e086fa99167d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5xgfz"
Jul 06 23:58:43.621037 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:58:43.621015    2551 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jul 06 23:58:43.621144 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:58:43.621124    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a3f3bb09-40b5-4fce-b5e4-e086fa99167d-monitoring-plugin-cert podName:a3f3bb09-40b5-4fce-b5e4-e086fa99167d nodeName:}" failed. No retries permitted until 2026-07-06 23:58:44.121069541 +0000 UTC m=+92.900464190 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/a3f3bb09-40b5-4fce-b5e4-e086fa99167d-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-5xgfz" (UID: "a3f3bb09-40b5-4fce-b5e4-e086fa99167d") : secret "monitoring-plugin-cert" not found
Jul 06 23:58:43.633538 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:43.633477    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7hk8\" (UniqueName: \"kubernetes.io/projected/a3f3bb09-40b5-4fce-b5e4-e086fa99167d-kube-api-access-z7hk8\") pod \"monitoring-plugin-d5dcff7cf-5xgfz\" (UID: \"a3f3bb09-40b5-4fce-b5e4-e086fa99167d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5xgfz"
Jul 06 23:58:44.125269 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.125233    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3f3bb09-40b5-4fce-b5e4-e086fa99167d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5xgfz\" (UID: \"a3f3bb09-40b5-4fce-b5e4-e086fa99167d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5xgfz"
Jul 06 23:58:44.128161 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.128135    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a3f3bb09-40b5-4fce-b5e4-e086fa99167d-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-5xgfz\" (UID: \"a3f3bb09-40b5-4fce-b5e4-e086fa99167d\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5xgfz"
Jul 06 23:58:44.326832 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.326749    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5xgfz"
Jul 06 23:58:44.821153 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.821111    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 23:58:44.846725 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.845933    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 23:58:44.846725 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.846109    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:44.850319 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.849365    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 06 23:58:44.850319 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.849602    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 06 23:58:44.850319 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.850005    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 06 23:58:44.850319 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.850189    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 06 23:58:44.850319 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.850253    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 06 23:58:44.851824 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.850788    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 06 23:58:44.851824 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.850908    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 06 23:58:44.851824 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.851082    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jgq88\""
Jul 06 23:58:44.851824 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.851273    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 06 23:58:44.851824 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.851457    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 06 23:58:44.851824 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.851555    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 06 23:58:44.851824 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.851654    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 06 23:58:44.852233 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.851852    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 06 23:58:44.852233 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.852051    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bgb83ahrsqhkp\""
Jul 06 23:58:44.852380 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.852339    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 06 23:58:44.853588 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:44.853182    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 06 23:58:45.033449 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.033408    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.033449 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.033460    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.033712 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.033493    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.033712 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.033544    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.033712 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.033621    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.033712 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.033648    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.033712 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.033673    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-web-config\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.033712 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.033705    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d1d23926-20bb-43d2-b3b8-42246bf1a27e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.034004 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.033728    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.034004 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.033752    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.034004 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.033789    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.034004 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.033829    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.034004 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.033898    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.034004 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.033923    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.034004 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.033957    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.034004 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.033994    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hb72t\" (UniqueName: \"kubernetes.io/projected/d1d23926-20bb-43d2-b3b8-42246bf1a27e-kube-api-access-hb72t\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.034302 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.034021    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-config\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.034302 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.034044    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.034302 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.034075    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.034302 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.034107    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d1d23926-20bb-43d2-b3b8-42246bf1a27e-config-out\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.134942 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.134900    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.135426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.134953    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.135426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.134984    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-web-config\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.135426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.135018    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d1d23926-20bb-43d2-b3b8-42246bf1a27e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.135426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.135043    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.135426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.135067    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.135426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.135107    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.135426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.135144    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.135426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.135196    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.135426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.135220    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.135426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.135251    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.135426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.135279    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hb72t\" (UniqueName: \"kubernetes.io/projected/d1d23926-20bb-43d2-b3b8-42246bf1a27e-kube-api-access-hb72t\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.135426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.135307    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-config\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.135426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.135330    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.135426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.135364    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.135426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.135398    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d1d23926-20bb-43d2-b3b8-42246bf1a27e-config-out\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.135426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.135429    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.136271 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.135460    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.136271 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.135485    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.136271 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.135530    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.136567 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.136540    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.138589 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.137241    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.138589 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.137887    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.138589 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.138438    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.140426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.139424    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.140426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.139456    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.140426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.139664    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d1d23926-20bb-43d2-b3b8-42246bf1a27e-config-out\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.140426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.139700    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.140426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.139899    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.140426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.140095    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.140426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.140200    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d1d23926-20bb-43d2-b3b8-42246bf1a27e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.140426 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.140352    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.143725 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.143681    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.144182 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.144162    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.145500 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.145443    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.145651 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.145618    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.145856 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.145834    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-config\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.146661 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.146630    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-web-config\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.147052 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.147031    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hb72t\" (UniqueName: \"kubernetes.io/projected/d1d23926-20bb-43d2-b3b8-42246bf1a27e-kube-api-access-hb72t\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.147449 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.147410    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.167316 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.167282    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:45.296839 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.296806    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"]
Jul 06 23:58:45.383446 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:58:45.383416    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79c97f9b_b68a_4fe5_bdb7_c386774ec742.slice/crio-91cc2c62ee2a3abf0858db00c1c62eb4daa92ca6487accb3ce70c2d54742525d WatchSource:0}: Error finding container 91cc2c62ee2a3abf0858db00c1c62eb4daa92ca6487accb3ce70c2d54742525d: Status 404 returned error can't find the container with id 91cc2c62ee2a3abf0858db00c1c62eb4daa92ca6487accb3ce70c2d54742525d
Jul 06 23:58:45.569018 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.568978    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-5xgfz"]
Jul 06 23:58:45.573969 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:58:45.573943    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3f3bb09_40b5_4fce_b5e4_e086fa99167d.slice/crio-e617d1ffefd3f610c3acd9702089a6747a9f83ad52b8a4ccc4fe1169bf32b9c4 WatchSource:0}: Error finding container e617d1ffefd3f610c3acd9702089a6747a9f83ad52b8a4ccc4fe1169bf32b9c4: Status 404 returned error can't find the container with id e617d1ffefd3f610c3acd9702089a6747a9f83ad52b8a4ccc4fe1169bf32b9c4
Jul 06 23:58:45.603638 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:45.603611    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 06 23:58:45.604497 ip-10-0-133-139 kubenswrapper[2551]: W0706 23:58:45.604472    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1d23926_20bb_43d2_b3b8_42246bf1a27e.slice/crio-0db3dc33dbbebacbe6e867f1ce4ed8d6273fab898fdc33ef94c9d307b6838c39 WatchSource:0}: Error finding container 0db3dc33dbbebacbe6e867f1ce4ed8d6273fab898fdc33ef94c9d307b6838c39: Status 404 returned error can't find the container with id 0db3dc33dbbebacbe6e867f1ce4ed8d6273fab898fdc33ef94c9d307b6838c39
Jul 06 23:58:46.168610 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:46.168484    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml" event={"ID":"8e3b9a7f-f18b-4c69-9d81-906803e09b38","Type":"ContainerStarted","Data":"94fc7b96049d4ed3fd4b849811bb15794fd308197b352054d0c7ea63704eacc8"}
Jul 06 23:58:46.168610 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:46.168591    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml" event={"ID":"8e3b9a7f-f18b-4c69-9d81-906803e09b38","Type":"ContainerStarted","Data":"e71f5d5b07cc879dd73c813b541462133a76e64d2bf2ff6956a575f78c86decb"}
Jul 06 23:58:46.169094 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:46.168631    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml" event={"ID":"8e3b9a7f-f18b-4c69-9d81-906803e09b38","Type":"ContainerStarted","Data":"03e05c1b49f3429006ddb364d46a31cf8cb76376e587e1d7accdd4ef1eb1f918"}
Jul 06 23:58:46.171985 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:46.171651    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw" event={"ID":"9f7f1707-994c-4987-97af-c5e61bf76137","Type":"ContainerStarted","Data":"66fdd95554564071e7c9b8001f828dfc45fdbf4c84d3a2048616f18c02bdb036"}
Jul 06 23:58:46.173127 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:46.173096    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp" event={"ID":"79c97f9b-b68a-4fe5-bdb7-c386774ec742","Type":"ContainerStarted","Data":"91cc2c62ee2a3abf0858db00c1c62eb4daa92ca6487accb3ce70c2d54742525d"}
Jul 06 23:58:46.175085 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:46.174944    2551 generic.go:356] "Generic (PLEG): container finished" podID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerID="80a022971f2fffb82cdf6e35985239ba6f538cbc416caae5e6d150e55ba126bb" exitCode=0
Jul 06 23:58:46.175085 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:46.175024    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b22f1173-9c99-4465-b7b1-b0f998757dc9","Type":"ContainerDied","Data":"80a022971f2fffb82cdf6e35985239ba6f538cbc416caae5e6d150e55ba126bb"}
Jul 06 23:58:46.177551 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:46.177410    2551 generic.go:356] "Generic (PLEG): container finished" podID="ba4fb820-75dc-460d-8e4e-1f54f0052e94" containerID="402275059cef36b5a397ad906a32041dc7aeca134d1bdf7317a0dbde93a9dabc" exitCode=0
Jul 06 23:58:46.177551 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:46.177495    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jfr6l" event={"ID":"ba4fb820-75dc-460d-8e4e-1f54f0052e94","Type":"ContainerDied","Data":"402275059cef36b5a397ad906a32041dc7aeca134d1bdf7317a0dbde93a9dabc"}
Jul 06 23:58:46.179977 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:46.179876    2551 generic.go:356] "Generic (PLEG): container finished" podID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerID="9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61" exitCode=0
Jul 06 23:58:46.179977 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:46.179942    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d23926-20bb-43d2-b3b8-42246bf1a27e","Type":"ContainerDied","Data":"9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61"}
Jul 06 23:58:46.180328 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:46.180304    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d23926-20bb-43d2-b3b8-42246bf1a27e","Type":"ContainerStarted","Data":"0db3dc33dbbebacbe6e867f1ce4ed8d6273fab898fdc33ef94c9d307b6838c39"}
Jul 06 23:58:46.182116 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:46.182071    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5xgfz" event={"ID":"a3f3bb09-40b5-4fce-b5e4-e086fa99167d","Type":"ContainerStarted","Data":"e617d1ffefd3f610c3acd9702089a6747a9f83ad52b8a4ccc4fe1169bf32b9c4"}
Jul 06 23:58:46.189636 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:46.189584    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-bzmbw" podStartSLOduration=4.915607941 podStartE2EDuration="8.189565323s" totalImagesPullingTime="3.273957382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:46.188597703 +0000 UTC m=+94.967992363" watchObservedRunningTime="2026-07-06 23:58:46.189565323 +0000 UTC m=+94.968959982"
Jul 06 23:58:47.204311 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:47.204270    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jfr6l" event={"ID":"ba4fb820-75dc-460d-8e4e-1f54f0052e94","Type":"ContainerStarted","Data":"37c885579fe104da6786ee14b7047370c005ea7f1d4162c749e1e7c1eba3e71d"}
Jul 06 23:58:47.204788 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:47.204322    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jfr6l" event={"ID":"ba4fb820-75dc-460d-8e4e-1f54f0052e94","Type":"ContainerStarted","Data":"20448ab71fbce6e06e60a98593e9ede7581998c5598a44e683457113815ea9d9"}
Jul 06 23:58:47.229484 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:47.229387    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jfr6l" podStartSLOduration=5.459691318 podStartE2EDuration="9.229362965s" totalImagesPullingTime="3.668880152s" totalInitContainerRuntime="100.791495ms" isStatefulPod=true podCreationTimestamp="2026-07-06 23:58:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:47.228490756 +0000 UTC m=+96.007885413" watchObservedRunningTime="2026-07-06 23:58:47.229362965 +0000 UTC m=+96.008757623"
Jul 06 23:58:50.998118 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:50.998076    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-hrttl"
Jul 06 23:58:51.224573 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:51.224535    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml" event={"ID":"8e3b9a7f-f18b-4c69-9d81-906803e09b38","Type":"ContainerStarted","Data":"22026dfcfa520509d18361b8c75e520496a4829f92ed67c35fd4d68c4659920d"}
Jul 06 23:58:51.224700 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:51.224668    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:51.224760 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:51.224711    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml" event={"ID":"8e3b9a7f-f18b-4c69-9d81-906803e09b38","Type":"ContainerStarted","Data":"f672c4348129b59ad6b1da2fc34c3efe7785ed20413bcaf2a91cb98b4b143d5e"}
Jul 06 23:58:51.224760 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:51.224751    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml" event={"ID":"8e3b9a7f-f18b-4c69-9d81-906803e09b38","Type":"ContainerStarted","Data":"6dc995443223de7a6b8da28e154dc0b06cb2a1a4fb181261bfcce7bbca4245d9"}
Jul 06 23:58:51.226726 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:51.226686    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp" event={"ID":"79c97f9b-b68a-4fe5-bdb7-c386774ec742","Type":"ContainerStarted","Data":"16e66e179f95ee37822b44d514887d21cd7bf9a2b193a4f5e0e19c029b51b1f1"}
Jul 06 23:58:51.238084 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:51.232595    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b22f1173-9c99-4465-b7b1-b0f998757dc9","Type":"ContainerStarted","Data":"c12953d2fe3b1d1a439f28846dabbbad75b2e7da2251700e225deae61daf1d1e"}
Jul 06 23:58:51.238084 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:51.232676    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b22f1173-9c99-4465-b7b1-b0f998757dc9","Type":"ContainerStarted","Data":"0757638206d541d394379b4b7e7e73b3ac0828818e4ce88663393a7feb5fed8a"}
Jul 06 23:58:51.238084 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:51.232719    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b22f1173-9c99-4465-b7b1-b0f998757dc9","Type":"ContainerStarted","Data":"f8110f9aa36826a42ba537066e5480fe3fc70f3740d3d5a6973ab4a70c99621d"}
Jul 06 23:58:51.238084 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:51.232756    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b22f1173-9c99-4465-b7b1-b0f998757dc9","Type":"ContainerStarted","Data":"86f5fa4876d48e6e9f9b972939a1db3c5b91a4b216f81572a10db0d013575abe"}
Jul 06 23:58:51.238084 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:51.233296    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml"
Jul 06 23:58:51.238084 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:51.237327    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d23926-20bb-43d2-b3b8-42246bf1a27e","Type":"ContainerStarted","Data":"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1"}
Jul 06 23:58:51.238084 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:51.237390    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d23926-20bb-43d2-b3b8-42246bf1a27e","Type":"ContainerStarted","Data":"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a"}
Jul 06 23:58:51.238084 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:51.237426    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d23926-20bb-43d2-b3b8-42246bf1a27e","Type":"ContainerStarted","Data":"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de"}
Jul 06 23:58:51.238084 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:51.237460    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d23926-20bb-43d2-b3b8-42246bf1a27e","Type":"ContainerStarted","Data":"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae"}
Jul 06 23:58:51.241378 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:51.241322    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5xgfz" event={"ID":"a3f3bb09-40b5-4fce-b5e4-e086fa99167d","Type":"ContainerStarted","Data":"47dfeda205de352fbcab8ed6d22af5c8ebe9b6bbb500e165c564af2d825d9b0c"}
Jul 06 23:58:51.241660 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:51.241638    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5xgfz"
Jul 06 23:58:51.248167 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:51.248131    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5xgfz"
Jul 06 23:58:51.248668 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:51.248615    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-857d8bbb9f-2chml" podStartSLOduration=3.145088664 podStartE2EDuration="11.248595548s" totalImagesPullingTime="8.103506884s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:51.245911709 +0000 UTC m=+100.025306367" watchObservedRunningTime="2026-07-06 23:58:51.248595548 +0000 UTC m=+100.027990205"
Jul 06 23:58:51.265707 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:51.265666    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp" podStartSLOduration=4.16484892 podStartE2EDuration="9.265647172s" totalImagesPullingTime="5.100798252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:51.264005446 +0000 UTC m=+100.043400107" watchObservedRunningTime="2026-07-06 23:58:51.265647172 +0000 UTC m=+100.045041828"
Jul 06 23:58:51.280385 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:51.280332    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-5xgfz" podStartSLOduration=3.3375052849999998 podStartE2EDuration="8.28031658s" totalImagesPullingTime="4.942811295s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:51.279533777 +0000 UTC m=+100.058928525" watchObservedRunningTime="2026-07-06 23:58:51.28031658 +0000 UTC m=+100.059711236"
Jul 06 23:58:52.249097 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:52.249056    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b22f1173-9c99-4465-b7b1-b0f998757dc9","Type":"ContainerStarted","Data":"541a0df5ffcea6edbb3838352861b495fc393f698d0579039ee190afe9d0b513"}
Jul 06 23:58:52.249677 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:52.249180    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b22f1173-9c99-4465-b7b1-b0f998757dc9","Type":"ContainerStarted","Data":"9c105cebb86002c4fa2ac731cc06058edbc5d244155b80b83baa5cc486c09008"}
Jul 06 23:58:52.252613 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:52.252560    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d23926-20bb-43d2-b3b8-42246bf1a27e","Type":"ContainerStarted","Data":"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15"}
Jul 06 23:58:52.252734 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:52.252649    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d23926-20bb-43d2-b3b8-42246bf1a27e","Type":"ContainerStarted","Data":"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b"}
Jul 06 23:58:52.282644 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:52.282592    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=5.471183859 podStartE2EDuration="13.282575088s" totalImagesPullingTime="7.790996713s" totalInitContainerRuntime="20.394516ms" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:52.280850071 +0000 UTC m=+101.060244759" watchObservedRunningTime="2026-07-06 23:58:52.282575088 +0000 UTC m=+101.061969744"
Jul 06 23:58:52.321422 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:52.321369    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.952335618 podStartE2EDuration="8.321351313s" totalImagesPullingTime="4.347378074s" totalInitContainerRuntime="21.637621ms" isStatefulPod=false podCreationTimestamp="2026-07-06 23:58:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-06 23:58:52.318323808 +0000 UTC m=+101.097718466" watchObservedRunningTime="2026-07-06 23:58:52.321351313 +0000 UTC m=+101.100745969"
Jul 06 23:58:55.168267 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:55.168213    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:58:55.703727 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:58:55.703694    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d569b87c-z6zfr"]
Jul 06 23:59:03.221213 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:03.221182    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:59:03.221679 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:03.221243    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:59:14.350927 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:14.350893    2551 generic.go:356] "Generic (PLEG): container finished" podID="488f9eff-fbd5-4d2d-acf1-0d0a00d19a52" containerID="b4900487e22ca1dfa7913a5703d4008a7f2113e55dbfbe786800d61224a3a21a" exitCode=0
Jul 06 23:59:14.351342 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:14.350958    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tgcp5" event={"ID":"488f9eff-fbd5-4d2d-acf1-0d0a00d19a52","Type":"ContainerDied","Data":"b4900487e22ca1dfa7913a5703d4008a7f2113e55dbfbe786800d61224a3a21a"}
Jul 06 23:59:14.351342 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:14.351262    2551 scope.go:117] "RemoveContainer" containerID="b4900487e22ca1dfa7913a5703d4008a7f2113e55dbfbe786800d61224a3a21a"
Jul 06 23:59:15.356803 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:15.356764    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-tgcp5" event={"ID":"488f9eff-fbd5-4d2d-acf1-0d0a00d19a52","Type":"ContainerStarted","Data":"9f354ea32c547af66953016d7968f9b7b8f5f760fcc8032e2ba3896474f7f151"}
Jul 06 23:59:20.728208 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:20.728136    2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d569b87c-z6zfr" podUID="727b9b6b-34cc-4255-b3e5-d7638029302a" containerName="console" containerID="cri-o://7d21bc74bde4fe583cafbc945ef27e8f51ec8f5dc5db957ae45d7dc71ac7156f" gracePeriod=15
Jul 06 23:59:21.014212 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.014177    2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:59:21.178736 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.178698    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-console-config\") pod \"727b9b6b-34cc-4255-b3e5-d7638029302a\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") "
Jul 06 23:59:21.178929 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.178745    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qqq9c\" (UniqueName: \"kubernetes.io/projected/727b9b6b-34cc-4255-b3e5-d7638029302a-kube-api-access-qqq9c\") pod \"727b9b6b-34cc-4255-b3e5-d7638029302a\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") "
Jul 06 23:59:21.178929 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.178847    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-service-ca\") pod \"727b9b6b-34cc-4255-b3e5-d7638029302a\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") "
Jul 06 23:59:21.178929 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.178889    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/727b9b6b-34cc-4255-b3e5-d7638029302a-console-oauth-config\") pod \"727b9b6b-34cc-4255-b3e5-d7638029302a\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") "
Jul 06 23:59:21.178929 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.178925    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-trusted-ca-bundle\") pod \"727b9b6b-34cc-4255-b3e5-d7638029302a\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") "
Jul 06 23:59:21.179121 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.178952    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-oauth-serving-cert\") pod \"727b9b6b-34cc-4255-b3e5-d7638029302a\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") "
Jul 06 23:59:21.179121 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.178986    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/727b9b6b-34cc-4255-b3e5-d7638029302a-console-serving-cert\") pod \"727b9b6b-34cc-4255-b3e5-d7638029302a\" (UID: \"727b9b6b-34cc-4255-b3e5-d7638029302a\") "
Jul 06 23:59:21.179895 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.179596    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-service-ca" (OuterVolumeSpecName: "service-ca") pod "727b9b6b-34cc-4255-b3e5-d7638029302a" (UID: "727b9b6b-34cc-4255-b3e5-d7638029302a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:59:21.179895 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.179641    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "727b9b6b-34cc-4255-b3e5-d7638029302a" (UID: "727b9b6b-34cc-4255-b3e5-d7638029302a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:59:21.179895 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.179662    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "727b9b6b-34cc-4255-b3e5-d7638029302a" (UID: "727b9b6b-34cc-4255-b3e5-d7638029302a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:59:21.179895 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.179810    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-console-config" (OuterVolumeSpecName: "console-config") pod "727b9b6b-34cc-4255-b3e5-d7638029302a" (UID: "727b9b6b-34cc-4255-b3e5-d7638029302a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 06 23:59:21.179895 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.179887    2551 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-service-ca\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 06 23:59:21.180205 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.179914    2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-trusted-ca-bundle\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 06 23:59:21.180205 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.179929    2551 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-oauth-serving-cert\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 06 23:59:21.182229 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.182189    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/727b9b6b-34cc-4255-b3e5-d7638029302a-kube-api-access-qqq9c" (OuterVolumeSpecName: "kube-api-access-qqq9c") pod "727b9b6b-34cc-4255-b3e5-d7638029302a" (UID: "727b9b6b-34cc-4255-b3e5-d7638029302a"). InnerVolumeSpecName "kube-api-access-qqq9c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 06 23:59:21.185992 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.185961    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/727b9b6b-34cc-4255-b3e5-d7638029302a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "727b9b6b-34cc-4255-b3e5-d7638029302a" (UID: "727b9b6b-34cc-4255-b3e5-d7638029302a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:59:21.186805 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.186781    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/727b9b6b-34cc-4255-b3e5-d7638029302a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "727b9b6b-34cc-4255-b3e5-d7638029302a" (UID: "727b9b6b-34cc-4255-b3e5-d7638029302a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 06 23:59:21.281343 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.281253    2551 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/727b9b6b-34cc-4255-b3e5-d7638029302a-console-serving-cert\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 06 23:59:21.281343 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.281281    2551 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/727b9b6b-34cc-4255-b3e5-d7638029302a-console-config\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 06 23:59:21.281343 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.281296    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qqq9c\" (UniqueName: \"kubernetes.io/projected/727b9b6b-34cc-4255-b3e5-d7638029302a-kube-api-access-qqq9c\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 06 23:59:21.281343 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.281307    2551 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/727b9b6b-34cc-4255-b3e5-d7638029302a-console-oauth-config\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 06 23:59:21.382989 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.382955    2551 generic.go:356] "Generic (PLEG): container finished" podID="727b9b6b-34cc-4255-b3e5-d7638029302a" containerID="7d21bc74bde4fe583cafbc945ef27e8f51ec8f5dc5db957ae45d7dc71ac7156f" exitCode=0
Jul 06 23:59:21.383149 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.383019    2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d569b87c-z6zfr"
Jul 06 23:59:21.383149 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.383030    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d569b87c-z6zfr" event={"ID":"727b9b6b-34cc-4255-b3e5-d7638029302a","Type":"ContainerDied","Data":"7d21bc74bde4fe583cafbc945ef27e8f51ec8f5dc5db957ae45d7dc71ac7156f"}
Jul 06 23:59:21.383149 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.383092    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d569b87c-z6zfr" event={"ID":"727b9b6b-34cc-4255-b3e5-d7638029302a","Type":"ContainerDied","Data":"5d8efd236e1b5db01317a4336695457a8b9242df6b5892b59c56967c2ad32f2c"}
Jul 06 23:59:21.383149 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.383122    2551 scope.go:117] "RemoveContainer" containerID="7d21bc74bde4fe583cafbc945ef27e8f51ec8f5dc5db957ae45d7dc71ac7156f"
Jul 06 23:59:21.391775 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.391753    2551 scope.go:117] "RemoveContainer" containerID="7d21bc74bde4fe583cafbc945ef27e8f51ec8f5dc5db957ae45d7dc71ac7156f"
Jul 06 23:59:21.392043 ip-10-0-133-139 kubenswrapper[2551]: E0706 23:59:21.392026    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7d21bc74bde4fe583cafbc945ef27e8f51ec8f5dc5db957ae45d7dc71ac7156f\": container with ID starting with 7d21bc74bde4fe583cafbc945ef27e8f51ec8f5dc5db957ae45d7dc71ac7156f not found: ID does not exist" containerID="7d21bc74bde4fe583cafbc945ef27e8f51ec8f5dc5db957ae45d7dc71ac7156f"
Jul 06 23:59:21.392112 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.392048    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7d21bc74bde4fe583cafbc945ef27e8f51ec8f5dc5db957ae45d7dc71ac7156f"} err="failed to get container status \"7d21bc74bde4fe583cafbc945ef27e8f51ec8f5dc5db957ae45d7dc71ac7156f\": rpc error: code = NotFound desc = could not find container \"7d21bc74bde4fe583cafbc945ef27e8f51ec8f5dc5db957ae45d7dc71ac7156f\": container with ID starting with 7d21bc74bde4fe583cafbc945ef27e8f51ec8f5dc5db957ae45d7dc71ac7156f not found: ID does not exist"
Jul 06 23:59:21.403708 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.403684    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d569b87c-z6zfr"]
Jul 06 23:59:21.409744 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.409722    2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d569b87c-z6zfr"]
Jul 06 23:59:21.694298 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:21.694263    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="727b9b6b-34cc-4255-b3e5-d7638029302a" path="/var/lib/kubelet/pods/727b9b6b-34cc-4255-b3e5-d7638029302a/volumes"
Jul 06 23:59:23.225641 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:23.225615    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:59:23.229536 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:23.229502    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-58cf5fddfc-xmlrp"
Jul 06 23:59:45.167624 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:45.167584    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:59:45.186340 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:45.186315    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:59:45.501335 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:45.501260    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 06 23:59:58.905069 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:58.905037    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 06 23:59:58.905626 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:58.905331    2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="alertmanager" containerID="cri-o://86f5fa4876d48e6e9f9b972939a1db3c5b91a4b216f81572a10db0d013575abe" gracePeriod=120
Jul 06 23:59:58.905626 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:58.905383    2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="config-reloader" containerID="cri-o://f8110f9aa36826a42ba537066e5480fe3fc70f3740d3d5a6973ab4a70c99621d" gracePeriod=120
Jul 06 23:59:58.905626 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:58.905365    2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="kube-rbac-proxy" containerID="cri-o://c12953d2fe3b1d1a439f28846dabbbad75b2e7da2251700e225deae61daf1d1e" gracePeriod=120
Jul 06 23:59:58.905626 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:58.905423    2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="kube-rbac-proxy-web" containerID="cri-o://0757638206d541d394379b4b7e7e73b3ac0828818e4ce88663393a7feb5fed8a" gracePeriod=120
Jul 06 23:59:58.905626 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:58.905378    2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="kube-rbac-proxy-metric" containerID="cri-o://9c105cebb86002c4fa2ac731cc06058edbc5d244155b80b83baa5cc486c09008" gracePeriod=120
Jul 06 23:59:58.905626 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:58.905355    2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="prom-label-proxy" containerID="cri-o://541a0df5ffcea6edbb3838352861b495fc393f698d0579039ee190afe9d0b513" gracePeriod=120
Jul 06 23:59:59.542206 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:59.542171    2551 generic.go:356] "Generic (PLEG): container finished" podID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerID="541a0df5ffcea6edbb3838352861b495fc393f698d0579039ee190afe9d0b513" exitCode=0
Jul 06 23:59:59.542206 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:59.542197    2551 generic.go:356] "Generic (PLEG): container finished" podID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerID="9c105cebb86002c4fa2ac731cc06058edbc5d244155b80b83baa5cc486c09008" exitCode=0
Jul 06 23:59:59.542206 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:59.542203    2551 generic.go:356] "Generic (PLEG): container finished" podID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerID="c12953d2fe3b1d1a439f28846dabbbad75b2e7da2251700e225deae61daf1d1e" exitCode=0
Jul 06 23:59:59.542206 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:59.542208    2551 generic.go:356] "Generic (PLEG): container finished" podID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerID="f8110f9aa36826a42ba537066e5480fe3fc70f3740d3d5a6973ab4a70c99621d" exitCode=0
Jul 06 23:59:59.542206 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:59.542213    2551 generic.go:356] "Generic (PLEG): container finished" podID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerID="86f5fa4876d48e6e9f9b972939a1db3c5b91a4b216f81572a10db0d013575abe" exitCode=0
Jul 06 23:59:59.542492 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:59.542242    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b22f1173-9c99-4465-b7b1-b0f998757dc9","Type":"ContainerDied","Data":"541a0df5ffcea6edbb3838352861b495fc393f698d0579039ee190afe9d0b513"}
Jul 06 23:59:59.542492 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:59.542330    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b22f1173-9c99-4465-b7b1-b0f998757dc9","Type":"ContainerDied","Data":"9c105cebb86002c4fa2ac731cc06058edbc5d244155b80b83baa5cc486c09008"}
Jul 06 23:59:59.542492 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:59.542358    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b22f1173-9c99-4465-b7b1-b0f998757dc9","Type":"ContainerDied","Data":"c12953d2fe3b1d1a439f28846dabbbad75b2e7da2251700e225deae61daf1d1e"}
Jul 06 23:59:59.542492 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:59.542381    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b22f1173-9c99-4465-b7b1-b0f998757dc9","Type":"ContainerDied","Data":"f8110f9aa36826a42ba537066e5480fe3fc70f3740d3d5a6973ab4a70c99621d"}
Jul 06 23:59:59.542492 ip-10-0-133-139 kubenswrapper[2551]: I0706 23:59:59.542403    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b22f1173-9c99-4465-b7b1-b0f998757dc9","Type":"ContainerDied","Data":"86f5fa4876d48e6e9f9b972939a1db3c5b91a4b216f81572a10db0d013575abe"}
Jul 07 00:00:00.160141 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.160115    2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.224710 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.224625    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b22f1173-9c99-4465-b7b1-b0f998757dc9-metrics-client-ca\") pod \"b22f1173-9c99-4465-b7b1-b0f998757dc9\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") "
Jul 07 00:00:00.224710 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.224670    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-kube-rbac-proxy\") pod \"b22f1173-9c99-4465-b7b1-b0f998757dc9\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") "
Jul 07 00:00:00.224710 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.224699    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b22f1173-9c99-4465-b7b1-b0f998757dc9\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") "
Jul 07 00:00:00.224970 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.224808    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-web-config\") pod \"b22f1173-9c99-4465-b7b1-b0f998757dc9\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") "
Jul 07 00:00:00.224970 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.224868    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gd4rm\" (UniqueName: \"kubernetes.io/projected/b22f1173-9c99-4465-b7b1-b0f998757dc9-kube-api-access-gd4rm\") pod \"b22f1173-9c99-4465-b7b1-b0f998757dc9\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") "
Jul 07 00:00:00.224970 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.224914    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-main-tls\") pod \"b22f1173-9c99-4465-b7b1-b0f998757dc9\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") "
Jul 07 00:00:00.224970 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.224948    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22f1173-9c99-4465-b7b1-b0f998757dc9-alertmanager-trusted-ca-bundle\") pod \"b22f1173-9c99-4465-b7b1-b0f998757dc9\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") "
Jul 07 00:00:00.225169 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.224973    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-kube-rbac-proxy-web\") pod \"b22f1173-9c99-4465-b7b1-b0f998757dc9\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") "
Jul 07 00:00:00.225169 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.225003    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-config-volume\") pod \"b22f1173-9c99-4465-b7b1-b0f998757dc9\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") "
Jul 07 00:00:00.225169 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.225055    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b22f1173-9c99-4465-b7b1-b0f998757dc9-config-out\") pod \"b22f1173-9c99-4465-b7b1-b0f998757dc9\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") "
Jul 07 00:00:00.225169 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.225067    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b22f1173-9c99-4465-b7b1-b0f998757dc9-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b22f1173-9c99-4465-b7b1-b0f998757dc9" (UID: "b22f1173-9c99-4465-b7b1-b0f998757dc9"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:00:00.225169 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.225078    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-cluster-tls-config\") pod \"b22f1173-9c99-4465-b7b1-b0f998757dc9\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") "
Jul 07 00:00:00.225169 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.225166    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b22f1173-9c99-4465-b7b1-b0f998757dc9-alertmanager-main-db\") pod \"b22f1173-9c99-4465-b7b1-b0f998757dc9\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") "
Jul 07 00:00:00.225687 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.225206    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b22f1173-9c99-4465-b7b1-b0f998757dc9-tls-assets\") pod \"b22f1173-9c99-4465-b7b1-b0f998757dc9\" (UID: \"b22f1173-9c99-4465-b7b1-b0f998757dc9\") "
Jul 07 00:00:00.225687 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.225436    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b22f1173-9c99-4465-b7b1-b0f998757dc9-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b22f1173-9c99-4465-b7b1-b0f998757dc9" (UID: "b22f1173-9c99-4465-b7b1-b0f998757dc9"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:00:00.225687 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.225667    2551 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b22f1173-9c99-4465-b7b1-b0f998757dc9-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:00.225687 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.225688    2551 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b22f1173-9c99-4465-b7b1-b0f998757dc9-metrics-client-ca\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:00.226851 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.226824    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b22f1173-9c99-4465-b7b1-b0f998757dc9-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b22f1173-9c99-4465-b7b1-b0f998757dc9" (UID: "b22f1173-9c99-4465-b7b1-b0f998757dc9"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:00:00.229701 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.229644    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-config-volume" (OuterVolumeSpecName: "config-volume") pod "b22f1173-9c99-4465-b7b1-b0f998757dc9" (UID: "b22f1173-9c99-4465-b7b1-b0f998757dc9"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:00:00.229832 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.229792    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b22f1173-9c99-4465-b7b1-b0f998757dc9" (UID: "b22f1173-9c99-4465-b7b1-b0f998757dc9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:00:00.229910 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.229857    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b22f1173-9c99-4465-b7b1-b0f998757dc9" (UID: "b22f1173-9c99-4465-b7b1-b0f998757dc9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:00:00.229910 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.229888    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b22f1173-9c99-4465-b7b1-b0f998757dc9-kube-api-access-gd4rm" (OuterVolumeSpecName: "kube-api-access-gd4rm") pod "b22f1173-9c99-4465-b7b1-b0f998757dc9" (UID: "b22f1173-9c99-4465-b7b1-b0f998757dc9"). InnerVolumeSpecName "kube-api-access-gd4rm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:00:00.230351 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.230314    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b22f1173-9c99-4465-b7b1-b0f998757dc9-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b22f1173-9c99-4465-b7b1-b0f998757dc9" (UID: "b22f1173-9c99-4465-b7b1-b0f998757dc9"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:00:00.230666 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.230641    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b22f1173-9c99-4465-b7b1-b0f998757dc9-config-out" (OuterVolumeSpecName: "config-out") pod "b22f1173-9c99-4465-b7b1-b0f998757dc9" (UID: "b22f1173-9c99-4465-b7b1-b0f998757dc9"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:00:00.231325 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.231272    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b22f1173-9c99-4465-b7b1-b0f998757dc9" (UID: "b22f1173-9c99-4465-b7b1-b0f998757dc9"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:00:00.231416 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.231357    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b22f1173-9c99-4465-b7b1-b0f998757dc9" (UID: "b22f1173-9c99-4465-b7b1-b0f998757dc9"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:00:00.235707 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.234598    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b22f1173-9c99-4465-b7b1-b0f998757dc9" (UID: "b22f1173-9c99-4465-b7b1-b0f998757dc9"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:00:00.243700 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.243665    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-web-config" (OuterVolumeSpecName: "web-config") pod "b22f1173-9c99-4465-b7b1-b0f998757dc9" (UID: "b22f1173-9c99-4465-b7b1-b0f998757dc9"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:00:00.326382 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.326343    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gd4rm\" (UniqueName: \"kubernetes.io/projected/b22f1173-9c99-4465-b7b1-b0f998757dc9-kube-api-access-gd4rm\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:00.326382 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.326376    2551 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-main-tls\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:00.326382 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.326389    2551 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:00.326621 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.326399    2551 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-config-volume\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:00.326621 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.326408    2551 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b22f1173-9c99-4465-b7b1-b0f998757dc9-config-out\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:00.326621 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.326415    2551 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-cluster-tls-config\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:00.326621 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.326425    2551 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b22f1173-9c99-4465-b7b1-b0f998757dc9-alertmanager-main-db\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:00.326621 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.326433    2551 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b22f1173-9c99-4465-b7b1-b0f998757dc9-tls-assets\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:00.326621 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.326442    2551 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:00.326621 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.326451    2551 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:00.326621 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.326481    2551 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b22f1173-9c99-4465-b7b1-b0f998757dc9-web-config\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:00.549113 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.549010    2551 generic.go:356] "Generic (PLEG): container finished" podID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerID="0757638206d541d394379b4b7e7e73b3ac0828818e4ce88663393a7feb5fed8a" exitCode=0
Jul 07 00:00:00.549113 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.549088    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b22f1173-9c99-4465-b7b1-b0f998757dc9","Type":"ContainerDied","Data":"0757638206d541d394379b4b7e7e73b3ac0828818e4ce88663393a7feb5fed8a"}
Jul 07 00:00:00.549113 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.549102    2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.549401 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.549166    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b22f1173-9c99-4465-b7b1-b0f998757dc9","Type":"ContainerDied","Data":"53777bf6f8afb9d0d29e96741fdfba154530576c1dd04264d46c0d0ac781d4af"}
Jul 07 00:00:00.549401 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.549215    2551 scope.go:117] "RemoveContainer" containerID="541a0df5ffcea6edbb3838352861b495fc393f698d0579039ee190afe9d0b513"
Jul 07 00:00:00.556935 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.556847    2551 scope.go:117] "RemoveContainer" containerID="9c105cebb86002c4fa2ac731cc06058edbc5d244155b80b83baa5cc486c09008"
Jul 07 00:00:00.563732 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.563714    2551 scope.go:117] "RemoveContainer" containerID="c12953d2fe3b1d1a439f28846dabbbad75b2e7da2251700e225deae61daf1d1e"
Jul 07 00:00:00.570340 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.570318    2551 scope.go:117] "RemoveContainer" containerID="0757638206d541d394379b4b7e7e73b3ac0828818e4ce88663393a7feb5fed8a"
Jul 07 00:00:00.577132 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.577112    2551 scope.go:117] "RemoveContainer" containerID="f8110f9aa36826a42ba537066e5480fe3fc70f3740d3d5a6973ab4a70c99621d"
Jul 07 00:00:00.579001 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.578983    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 00:00:00.584859 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.584842    2551 scope.go:117] "RemoveContainer" containerID="86f5fa4876d48e6e9f9b972939a1db3c5b91a4b216f81572a10db0d013575abe"
Jul 07 00:00:00.585655 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.585635    2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 00:00:00.591536 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.591499    2551 scope.go:117] "RemoveContainer" containerID="80a022971f2fffb82cdf6e35985239ba6f538cbc416caae5e6d150e55ba126bb"
Jul 07 00:00:00.597961 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.597947    2551 scope.go:117] "RemoveContainer" containerID="541a0df5ffcea6edbb3838352861b495fc393f698d0579039ee190afe9d0b513"
Jul 07 00:00:00.598196 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:00:00.598177    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"541a0df5ffcea6edbb3838352861b495fc393f698d0579039ee190afe9d0b513\": container with ID starting with 541a0df5ffcea6edbb3838352861b495fc393f698d0579039ee190afe9d0b513 not found: ID does not exist" containerID="541a0df5ffcea6edbb3838352861b495fc393f698d0579039ee190afe9d0b513"
Jul 07 00:00:00.598244 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.598205    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"541a0df5ffcea6edbb3838352861b495fc393f698d0579039ee190afe9d0b513"} err="failed to get container status \"541a0df5ffcea6edbb3838352861b495fc393f698d0579039ee190afe9d0b513\": rpc error: code = NotFound desc = could not find container \"541a0df5ffcea6edbb3838352861b495fc393f698d0579039ee190afe9d0b513\": container with ID starting with 541a0df5ffcea6edbb3838352861b495fc393f698d0579039ee190afe9d0b513 not found: ID does not exist"
Jul 07 00:00:00.598244 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.598223    2551 scope.go:117] "RemoveContainer" containerID="9c105cebb86002c4fa2ac731cc06058edbc5d244155b80b83baa5cc486c09008"
Jul 07 00:00:00.598463 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:00:00.598446    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c105cebb86002c4fa2ac731cc06058edbc5d244155b80b83baa5cc486c09008\": container with ID starting with 9c105cebb86002c4fa2ac731cc06058edbc5d244155b80b83baa5cc486c09008 not found: ID does not exist" containerID="9c105cebb86002c4fa2ac731cc06058edbc5d244155b80b83baa5cc486c09008"
Jul 07 00:00:00.598503 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.598469    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c105cebb86002c4fa2ac731cc06058edbc5d244155b80b83baa5cc486c09008"} err="failed to get container status \"9c105cebb86002c4fa2ac731cc06058edbc5d244155b80b83baa5cc486c09008\": rpc error: code = NotFound desc = could not find container \"9c105cebb86002c4fa2ac731cc06058edbc5d244155b80b83baa5cc486c09008\": container with ID starting with 9c105cebb86002c4fa2ac731cc06058edbc5d244155b80b83baa5cc486c09008 not found: ID does not exist"
Jul 07 00:00:00.598503 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.598488    2551 scope.go:117] "RemoveContainer" containerID="c12953d2fe3b1d1a439f28846dabbbad75b2e7da2251700e225deae61daf1d1e"
Jul 07 00:00:00.598700 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:00:00.598685    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c12953d2fe3b1d1a439f28846dabbbad75b2e7da2251700e225deae61daf1d1e\": container with ID starting with c12953d2fe3b1d1a439f28846dabbbad75b2e7da2251700e225deae61daf1d1e not found: ID does not exist" containerID="c12953d2fe3b1d1a439f28846dabbbad75b2e7da2251700e225deae61daf1d1e"
Jul 07 00:00:00.598735 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.598706    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c12953d2fe3b1d1a439f28846dabbbad75b2e7da2251700e225deae61daf1d1e"} err="failed to get container status \"c12953d2fe3b1d1a439f28846dabbbad75b2e7da2251700e225deae61daf1d1e\": rpc error: code = NotFound desc = could not find container \"c12953d2fe3b1d1a439f28846dabbbad75b2e7da2251700e225deae61daf1d1e\": container with ID starting with c12953d2fe3b1d1a439f28846dabbbad75b2e7da2251700e225deae61daf1d1e not found: ID does not exist"
Jul 07 00:00:00.598735 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.598719    2551 scope.go:117] "RemoveContainer" containerID="0757638206d541d394379b4b7e7e73b3ac0828818e4ce88663393a7feb5fed8a"
Jul 07 00:00:00.598981 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:00:00.598963    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0757638206d541d394379b4b7e7e73b3ac0828818e4ce88663393a7feb5fed8a\": container with ID starting with 0757638206d541d394379b4b7e7e73b3ac0828818e4ce88663393a7feb5fed8a not found: ID does not exist" containerID="0757638206d541d394379b4b7e7e73b3ac0828818e4ce88663393a7feb5fed8a"
Jul 07 00:00:00.599054 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.598984    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0757638206d541d394379b4b7e7e73b3ac0828818e4ce88663393a7feb5fed8a"} err="failed to get container status \"0757638206d541d394379b4b7e7e73b3ac0828818e4ce88663393a7feb5fed8a\": rpc error: code = NotFound desc = could not find container \"0757638206d541d394379b4b7e7e73b3ac0828818e4ce88663393a7feb5fed8a\": container with ID starting with 0757638206d541d394379b4b7e7e73b3ac0828818e4ce88663393a7feb5fed8a not found: ID does not exist"
Jul 07 00:00:00.599054 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.598998    2551 scope.go:117] "RemoveContainer" containerID="f8110f9aa36826a42ba537066e5480fe3fc70f3740d3d5a6973ab4a70c99621d"
Jul 07 00:00:00.599215 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:00:00.599199    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f8110f9aa36826a42ba537066e5480fe3fc70f3740d3d5a6973ab4a70c99621d\": container with ID starting with f8110f9aa36826a42ba537066e5480fe3fc70f3740d3d5a6973ab4a70c99621d not found: ID does not exist" containerID="f8110f9aa36826a42ba537066e5480fe3fc70f3740d3d5a6973ab4a70c99621d"
Jul 07 00:00:00.599271 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.599221    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f8110f9aa36826a42ba537066e5480fe3fc70f3740d3d5a6973ab4a70c99621d"} err="failed to get container status \"f8110f9aa36826a42ba537066e5480fe3fc70f3740d3d5a6973ab4a70c99621d\": rpc error: code = NotFound desc = could not find container \"f8110f9aa36826a42ba537066e5480fe3fc70f3740d3d5a6973ab4a70c99621d\": container with ID starting with f8110f9aa36826a42ba537066e5480fe3fc70f3740d3d5a6973ab4a70c99621d not found: ID does not exist"
Jul 07 00:00:00.599271 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.599239    2551 scope.go:117] "RemoveContainer" containerID="86f5fa4876d48e6e9f9b972939a1db3c5b91a4b216f81572a10db0d013575abe"
Jul 07 00:00:00.599445 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:00:00.599430    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"86f5fa4876d48e6e9f9b972939a1db3c5b91a4b216f81572a10db0d013575abe\": container with ID starting with 86f5fa4876d48e6e9f9b972939a1db3c5b91a4b216f81572a10db0d013575abe not found: ID does not exist" containerID="86f5fa4876d48e6e9f9b972939a1db3c5b91a4b216f81572a10db0d013575abe"
Jul 07 00:00:00.599483 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.599451    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"86f5fa4876d48e6e9f9b972939a1db3c5b91a4b216f81572a10db0d013575abe"} err="failed to get container status \"86f5fa4876d48e6e9f9b972939a1db3c5b91a4b216f81572a10db0d013575abe\": rpc error: code = NotFound desc = could not find container \"86f5fa4876d48e6e9f9b972939a1db3c5b91a4b216f81572a10db0d013575abe\": container with ID starting with 86f5fa4876d48e6e9f9b972939a1db3c5b91a4b216f81572a10db0d013575abe not found: ID does not exist"
Jul 07 00:00:00.599483 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.599481    2551 scope.go:117] "RemoveContainer" containerID="80a022971f2fffb82cdf6e35985239ba6f538cbc416caae5e6d150e55ba126bb"
Jul 07 00:00:00.599702 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:00:00.599685    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80a022971f2fffb82cdf6e35985239ba6f538cbc416caae5e6d150e55ba126bb\": container with ID starting with 80a022971f2fffb82cdf6e35985239ba6f538cbc416caae5e6d150e55ba126bb not found: ID does not exist" containerID="80a022971f2fffb82cdf6e35985239ba6f538cbc416caae5e6d150e55ba126bb"
Jul 07 00:00:00.599752 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.599707    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80a022971f2fffb82cdf6e35985239ba6f538cbc416caae5e6d150e55ba126bb"} err="failed to get container status \"80a022971f2fffb82cdf6e35985239ba6f538cbc416caae5e6d150e55ba126bb\": rpc error: code = NotFound desc = could not find container \"80a022971f2fffb82cdf6e35985239ba6f538cbc416caae5e6d150e55ba126bb\": container with ID starting with 80a022971f2fffb82cdf6e35985239ba6f538cbc416caae5e6d150e55ba126bb not found: ID does not exist"
Jul 07 00:00:00.674619 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.674590    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 00:00:00.674892 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.674880    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="727b9b6b-34cc-4255-b3e5-d7638029302a" containerName="console"
Jul 07 00:00:00.674936 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.674893    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="727b9b6b-34cc-4255-b3e5-d7638029302a" containerName="console"
Jul 07 00:00:00.674936 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.674902    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="config-reloader"
Jul 07 00:00:00.674936 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.674907    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="config-reloader"
Jul 07 00:00:00.674936 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.674914    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="kube-rbac-proxy"
Jul 07 00:00:00.674936 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.674920    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="kube-rbac-proxy"
Jul 07 00:00:00.674936 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.674931    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="prom-label-proxy"
Jul 07 00:00:00.674936 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.674937    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="prom-label-proxy"
Jul 07 00:00:00.675132 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.674946    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="kube-rbac-proxy-metric"
Jul 07 00:00:00.675132 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.674951    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="kube-rbac-proxy-metric"
Jul 07 00:00:00.675132 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.674957    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="init-config-reloader"
Jul 07 00:00:00.675132 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.674962    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="init-config-reloader"
Jul 07 00:00:00.675132 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.674974    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="alertmanager"
Jul 07 00:00:00.675132 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.674980    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="alertmanager"
Jul 07 00:00:00.675132 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.674985    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="kube-rbac-proxy-web"
Jul 07 00:00:00.675132 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.674991    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="kube-rbac-proxy-web"
Jul 07 00:00:00.675132 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.675033    2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="prom-label-proxy"
Jul 07 00:00:00.675132 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.675040    2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="727b9b6b-34cc-4255-b3e5-d7638029302a" containerName="console"
Jul 07 00:00:00.675132 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.675047    2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="config-reloader"
Jul 07 00:00:00.675132 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.675052    2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="kube-rbac-proxy-web"
Jul 07 00:00:00.675132 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.675058    2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="kube-rbac-proxy"
Jul 07 00:00:00.675132 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.675064    2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="alertmanager"
Jul 07 00:00:00.675132 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.675070    2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" containerName="kube-rbac-proxy-metric"
Jul 07 00:00:00.680314 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.680296    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.684447 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.684429    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 07 00:00:00.684745 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.684726    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 07 00:00:00.684834 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.684779    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-kv2hm\""
Jul 07 00:00:00.684957 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.684942    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 07 00:00:00.685028 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.685012    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 07 00:00:00.685080 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.685019    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 07 00:00:00.685137 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.685101    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 07 00:00:00.685248 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.685228    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 07 00:00:00.685993 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.685975    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 07 00:00:00.692427 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.692404    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 07 00:00:00.716298 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.716272    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 00:00:00.830102 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.830006    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsctx\" (UniqueName: \"kubernetes.io/projected/9274e8df-1603-4119-8864-a4744ea6eae2-kube-api-access-bsctx\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.830102 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.830064    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9274e8df-1603-4119-8864-a4744ea6eae2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.830325 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.830119    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-web-config\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.830325 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.830159    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.830325 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.830189    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9274e8df-1603-4119-8864-a4744ea6eae2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.830325 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.830223    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9274e8df-1603-4119-8864-a4744ea6eae2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.830325 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.830278    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-config-volume\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.830325 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.830319    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9274e8df-1603-4119-8864-a4744ea6eae2-config-out\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.830605 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.830355    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.830605 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.830423    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.830605 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.830461    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9274e8df-1603-4119-8864-a4744ea6eae2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.830605 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.830490    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.830605 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.830576    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.931456 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.931417    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9274e8df-1603-4119-8864-a4744ea6eae2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.931456 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.931455    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-web-config\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.931727 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.931472    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.931727 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.931489    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9274e8df-1603-4119-8864-a4744ea6eae2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.931727 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.931534    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9274e8df-1603-4119-8864-a4744ea6eae2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.931727 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.931559    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-config-volume\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.931727 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.931580    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9274e8df-1603-4119-8864-a4744ea6eae2-config-out\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.931727 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.931607    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.931727 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.931643    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.931727 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.931676    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9274e8df-1603-4119-8864-a4744ea6eae2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.931727 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.931705    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.932205 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.931753    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.932205 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.931837    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsctx\" (UniqueName: \"kubernetes.io/projected/9274e8df-1603-4119-8864-a4744ea6eae2-kube-api-access-bsctx\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.932205 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.932144    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9274e8df-1603-4119-8864-a4744ea6eae2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.933032 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.932723    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9274e8df-1603-4119-8864-a4744ea6eae2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.933556 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.933201    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9274e8df-1603-4119-8864-a4744ea6eae2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.934573 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.934540    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9274e8df-1603-4119-8864-a4744ea6eae2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.934701 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.934678    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.934770 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.934753    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-web-config\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.934849 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.934826    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.934899 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.934846    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-config-volume\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.935245 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.935223    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9274e8df-1603-4119-8864-a4744ea6eae2-config-out\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.935410 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.935392    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.935680 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.935661    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.936522 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.936490    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9274e8df-1603-4119-8864-a4744ea6eae2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.942279 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.942257    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsctx\" (UniqueName: \"kubernetes.io/projected/9274e8df-1603-4119-8864-a4744ea6eae2-kube-api-access-bsctx\") pod \"alertmanager-main-0\" (UID: \"9274e8df-1603-4119-8864-a4744ea6eae2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:00.989366 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:00.989340    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 00:00:01.147926 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:01.147699    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 00:00:01.150342 ip-10-0-133-139 kubenswrapper[2551]: W0707 00:00:01.150313    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9274e8df_1603_4119_8864_a4744ea6eae2.slice/crio-fbac20893e6499f9e983d3072b01c5010c929f32e94b6e02a1f8158386b0af41 WatchSource:0}: Error finding container fbac20893e6499f9e983d3072b01c5010c929f32e94b6e02a1f8158386b0af41: Status 404 returned error can't find the container with id fbac20893e6499f9e983d3072b01c5010c929f32e94b6e02a1f8158386b0af41
Jul 07 00:00:01.553984 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:01.553894    2551 generic.go:356] "Generic (PLEG): container finished" podID="9274e8df-1603-4119-8864-a4744ea6eae2" containerID="f0f472352cd69c91722aecd480a6c75f98ade845a9c971c28c3098bb840cb2e6" exitCode=0
Jul 07 00:00:01.554378 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:01.553974    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9274e8df-1603-4119-8864-a4744ea6eae2","Type":"ContainerDied","Data":"f0f472352cd69c91722aecd480a6c75f98ade845a9c971c28c3098bb840cb2e6"}
Jul 07 00:00:01.554378 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:01.554037    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9274e8df-1603-4119-8864-a4744ea6eae2","Type":"ContainerStarted","Data":"fbac20893e6499f9e983d3072b01c5010c929f32e94b6e02a1f8158386b0af41"}
Jul 07 00:00:01.694705 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:01.694667    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b22f1173-9c99-4465-b7b1-b0f998757dc9" path="/var/lib/kubelet/pods/b22f1173-9c99-4465-b7b1-b0f998757dc9/volumes"
Jul 07 00:00:02.562236 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:02.562204    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9274e8df-1603-4119-8864-a4744ea6eae2","Type":"ContainerStarted","Data":"15a4e0328b1c165d1c2a53ce727c700dbc2d937405cf10f5cba5957bb31c09a8"}
Jul 07 00:00:02.562624 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:02.562266    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9274e8df-1603-4119-8864-a4744ea6eae2","Type":"ContainerStarted","Data":"130fc9c75aeeb07d4f43724f751aa78e8edc61c7df1aaac43366e7db55055112"}
Jul 07 00:00:02.562624 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:02.562294    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9274e8df-1603-4119-8864-a4744ea6eae2","Type":"ContainerStarted","Data":"ae5211d1cf1358f778e07eef51c611c27792f3ecbea674dc3cdc9ec8b28c9614"}
Jul 07 00:00:02.562624 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:02.562317    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9274e8df-1603-4119-8864-a4744ea6eae2","Type":"ContainerStarted","Data":"9835eab8a052fd4604391033092d6add52017e9ac27e46eea738329a0f5d1411"}
Jul 07 00:00:02.562624 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:02.562340    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9274e8df-1603-4119-8864-a4744ea6eae2","Type":"ContainerStarted","Data":"b6f857e3671324f29faafd4a019bbff75d6dbd3095ae732bb72a0ebb3d0d8374"}
Jul 07 00:00:02.562624 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:02.562362    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9274e8df-1603-4119-8864-a4744ea6eae2","Type":"ContainerStarted","Data":"88ae030d4c8f26bd51b8fda8639b4653551eded6e54b2a2cb46a10f36be8ba84"}
Jul 07 00:00:02.593298 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:02.593233    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.577750484 podStartE2EDuration="2.593213246s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.462762ms" isStatefulPod=false podCreationTimestamp="2026-07-07 00:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:00:02.591474752 +0000 UTC m=+171.370869409" watchObservedRunningTime="2026-07-07 00:00:02.593213246 +0000 UTC m=+171.372607904"
Jul 07 00:00:03.309103 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.309006    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 00:00:03.310077 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.309432    2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15" gracePeriod=600
Jul 07 00:00:03.310077 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.309849    2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="kube-rbac-proxy-web" containerID="cri-o://c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1" gracePeriod=600
Jul 07 00:00:03.310077 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.309969    2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="kube-rbac-proxy" containerID="cri-o://8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b" gracePeriod=600
Jul 07 00:00:03.310077 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.310062    2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="thanos-sidecar" containerID="cri-o://774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a" gracePeriod=600
Jul 07 00:00:03.310375 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.310046    2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="prometheus" containerID="cri-o://569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae" gracePeriod=600
Jul 07 00:00:03.310375 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.310107    2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="config-reloader" containerID="cri-o://d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de" gracePeriod=600
Jul 07 00:00:03.562558 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.562452    2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:03.569401 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.569368    2551 generic.go:356] "Generic (PLEG): container finished" podID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerID="4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15" exitCode=0
Jul 07 00:00:03.569401 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.569397    2551 generic.go:356] "Generic (PLEG): container finished" podID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerID="8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b" exitCode=0
Jul 07 00:00:03.569637 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.569408    2551 generic.go:356] "Generic (PLEG): container finished" podID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerID="c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1" exitCode=0
Jul 07 00:00:03.569637 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.569417    2551 generic.go:356] "Generic (PLEG): container finished" podID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerID="774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a" exitCode=0
Jul 07 00:00:03.569637 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.569425    2551 generic.go:356] "Generic (PLEG): container finished" podID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerID="d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de" exitCode=0
Jul 07 00:00:03.569637 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.569432    2551 generic.go:356] "Generic (PLEG): container finished" podID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerID="569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae" exitCode=0
Jul 07 00:00:03.569935 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.569902    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d23926-20bb-43d2-b3b8-42246bf1a27e","Type":"ContainerDied","Data":"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15"}
Jul 07 00:00:03.570004 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.569977    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d23926-20bb-43d2-b3b8-42246bf1a27e","Type":"ContainerDied","Data":"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b"}
Jul 07 00:00:03.570047 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.570011    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d23926-20bb-43d2-b3b8-42246bf1a27e","Type":"ContainerDied","Data":"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1"}
Jul 07 00:00:03.570085 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.570053    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d23926-20bb-43d2-b3b8-42246bf1a27e","Type":"ContainerDied","Data":"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a"}
Jul 07 00:00:03.570085 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.570070    2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:03.570150 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.570094    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d23926-20bb-43d2-b3b8-42246bf1a27e","Type":"ContainerDied","Data":"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de"}
Jul 07 00:00:03.570150 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.570130    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d23926-20bb-43d2-b3b8-42246bf1a27e","Type":"ContainerDied","Data":"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae"}
Jul 07 00:00:03.570245 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.570169    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d1d23926-20bb-43d2-b3b8-42246bf1a27e","Type":"ContainerDied","Data":"0db3dc33dbbebacbe6e867f1ce4ed8d6273fab898fdc33ef94c9d307b6838c39"}
Jul 07 00:00:03.570245 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.570056    2551 scope.go:117] "RemoveContainer" containerID="4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15"
Jul 07 00:00:03.579471 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.579454    2551 scope.go:117] "RemoveContainer" containerID="8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b"
Jul 07 00:00:03.587978 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.587958    2551 scope.go:117] "RemoveContainer" containerID="c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1"
Jul 07 00:00:03.595621 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.595602    2551 scope.go:117] "RemoveContainer" containerID="774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a"
Jul 07 00:00:03.605480 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.605448    2551 scope.go:117] "RemoveContainer" containerID="d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de"
Jul 07 00:00:03.625669 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.625644    2551 scope.go:117] "RemoveContainer" containerID="569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae"
Jul 07 00:00:03.639315 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.638668    2551 scope.go:117] "RemoveContainer" containerID="9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61"
Jul 07 00:00:03.647938 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.647916    2551 scope.go:117] "RemoveContainer" containerID="4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15"
Jul 07 00:00:03.648591 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:00:03.648566    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15\": container with ID starting with 4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15 not found: ID does not exist" containerID="4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15"
Jul 07 00:00:03.648692 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.648598    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15"} err="failed to get container status \"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15\": rpc error: code = NotFound desc = could not find container \"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15\": container with ID starting with 4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15 not found: ID does not exist"
Jul 07 00:00:03.648692 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.648618    2551 scope.go:117] "RemoveContainer" containerID="8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b"
Jul 07 00:00:03.648924 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:00:03.648896    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b\": container with ID starting with 8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b not found: ID does not exist" containerID="8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b"
Jul 07 00:00:03.649002 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.648924    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b"} err="failed to get container status \"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b\": rpc error: code = NotFound desc = could not find container \"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b\": container with ID starting with 8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b not found: ID does not exist"
Jul 07 00:00:03.649002 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.648942    2551 scope.go:117] "RemoveContainer" containerID="c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1"
Jul 07 00:00:03.649217 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:00:03.649194    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1\": container with ID starting with c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1 not found: ID does not exist" containerID="c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1"
Jul 07 00:00:03.649289 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.649224    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1"} err="failed to get container status \"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1\": rpc error: code = NotFound desc = could not find container \"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1\": container with ID starting with c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1 not found: ID does not exist"
Jul 07 00:00:03.649289 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.649244    2551 scope.go:117] "RemoveContainer" containerID="774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a"
Jul 07 00:00:03.649472 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:00:03.649454    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a\": container with ID starting with 774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a not found: ID does not exist" containerID="774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a"
Jul 07 00:00:03.649628 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.649485    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a"} err="failed to get container status \"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a\": rpc error: code = NotFound desc = could not find container \"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a\": container with ID starting with 774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a not found: ID does not exist"
Jul 07 00:00:03.649628 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.649499    2551 scope.go:117] "RemoveContainer" containerID="d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de"
Jul 07 00:00:03.649776 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:00:03.649755    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de\": container with ID starting with d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de not found: ID does not exist" containerID="d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de"
Jul 07 00:00:03.649836 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.649782    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de"} err="failed to get container status \"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de\": rpc error: code = NotFound desc = could not find container \"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de\": container with ID starting with d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de not found: ID does not exist"
Jul 07 00:00:03.649836 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.649799    2551 scope.go:117] "RemoveContainer" containerID="569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae"
Jul 07 00:00:03.650066 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:00:03.650046    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae\": container with ID starting with 569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae not found: ID does not exist" containerID="569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae"
Jul 07 00:00:03.650115 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.650079    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae"} err="failed to get container status \"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae\": rpc error: code = NotFound desc = could not find container \"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae\": container with ID starting with 569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae not found: ID does not exist"
Jul 07 00:00:03.650115 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.650101    2551 scope.go:117] "RemoveContainer" containerID="9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61"
Jul 07 00:00:03.650331 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:00:03.650315    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61\": container with ID starting with 9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61 not found: ID does not exist" containerID="9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61"
Jul 07 00:00:03.650376 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.650334    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61"} err="failed to get container status \"9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61\": rpc error: code = NotFound desc = could not find container \"9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61\": container with ID starting with 9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61 not found: ID does not exist"
Jul 07 00:00:03.650376 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.650347    2551 scope.go:117] "RemoveContainer" containerID="4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15"
Jul 07 00:00:03.650649 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.650627    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15"} err="failed to get container status \"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15\": rpc error: code = NotFound desc = could not find container \"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15\": container with ID starting with 4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15 not found: ID does not exist"
Jul 07 00:00:03.650649 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.650647    2551 scope.go:117] "RemoveContainer" containerID="8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b"
Jul 07 00:00:03.650881 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.650861    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b"} err="failed to get container status \"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b\": rpc error: code = NotFound desc = could not find container \"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b\": container with ID starting with 8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b not found: ID does not exist"
Jul 07 00:00:03.650967 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.650885    2551 scope.go:117] "RemoveContainer" containerID="c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1"
Jul 07 00:00:03.651154 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.651138    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1"} err="failed to get container status \"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1\": rpc error: code = NotFound desc = could not find container \"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1\": container with ID starting with c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1 not found: ID does not exist"
Jul 07 00:00:03.651222 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.651155    2551 scope.go:117] "RemoveContainer" containerID="774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a"
Jul 07 00:00:03.651364 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.651346    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a"} err="failed to get container status \"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a\": rpc error: code = NotFound desc = could not find container \"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a\": container with ID starting with 774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a not found: ID does not exist"
Jul 07 00:00:03.651405 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.651366    2551 scope.go:117] "RemoveContainer" containerID="d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de"
Jul 07 00:00:03.651641 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.651616    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de"} err="failed to get container status \"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de\": rpc error: code = NotFound desc = could not find container \"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de\": container with ID starting with d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de not found: ID does not exist"
Jul 07 00:00:03.651686 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.651644    2551 scope.go:117] "RemoveContainer" containerID="569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae"
Jul 07 00:00:03.651868 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.651845    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae"} err="failed to get container status \"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae\": rpc error: code = NotFound desc = could not find container \"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae\": container with ID starting with 569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae not found: ID does not exist"
Jul 07 00:00:03.651868 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.651866    2551 scope.go:117] "RemoveContainer" containerID="9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61"
Jul 07 00:00:03.652116 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.652100    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61"} err="failed to get container status \"9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61\": rpc error: code = NotFound desc = could not find container \"9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61\": container with ID starting with 9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61 not found: ID does not exist"
Jul 07 00:00:03.652156 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.652116    2551 scope.go:117] "RemoveContainer" containerID="4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15"
Jul 07 00:00:03.652329 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.652311    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15"} err="failed to get container status \"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15\": rpc error: code = NotFound desc = could not find container \"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15\": container with ID starting with 4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15 not found: ID does not exist"
Jul 07 00:00:03.652403 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.652332    2551 scope.go:117] "RemoveContainer" containerID="8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b"
Jul 07 00:00:03.652646 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.652629    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b"} err="failed to get container status \"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b\": rpc error: code = NotFound desc = could not find container \"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b\": container with ID starting with 8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b not found: ID does not exist"
Jul 07 00:00:03.652698 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.652647    2551 scope.go:117] "RemoveContainer" containerID="c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1"
Jul 07 00:00:03.652864 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.652847    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1"} err="failed to get container status \"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1\": rpc error: code = NotFound desc = could not find container \"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1\": container with ID starting with c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1 not found: ID does not exist"
Jul 07 00:00:03.652931 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.652865    2551 scope.go:117] "RemoveContainer" containerID="774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a"
Jul 07 00:00:03.653101 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.653084    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a"} err="failed to get container status \"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a\": rpc error: code = NotFound desc = could not find container \"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a\": container with ID starting with 774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a not found: ID does not exist"
Jul 07 00:00:03.653144 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.653102    2551 scope.go:117] "RemoveContainer" containerID="d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de"
Jul 07 00:00:03.653313 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.653298    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de"} err="failed to get container status \"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de\": rpc error: code = NotFound desc = could not find container \"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de\": container with ID starting with d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de not found: ID does not exist"
Jul 07 00:00:03.653379 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.653315    2551 scope.go:117] "RemoveContainer" containerID="569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae"
Jul 07 00:00:03.653588 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.653570    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae"} err="failed to get container status \"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae\": rpc error: code = NotFound desc = could not find container \"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae\": container with ID starting with 569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae not found: ID does not exist"
Jul 07 00:00:03.653648 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.653588    2551 scope.go:117] "RemoveContainer" containerID="9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61"
Jul 07 00:00:03.653837 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.653815    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61"} err="failed to get container status \"9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61\": rpc error: code = NotFound desc = could not find container \"9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61\": container with ID starting with 9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61 not found: ID does not exist"
Jul 07 00:00:03.653910 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.653838    2551 scope.go:117] "RemoveContainer" containerID="4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15"
Jul 07 00:00:03.654035 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.654017    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15"} err="failed to get container status \"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15\": rpc error: code = NotFound desc = could not find container \"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15\": container with ID starting with 4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15 not found: ID does not exist"
Jul 07 00:00:03.654119 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.654035    2551 scope.go:117] "RemoveContainer" containerID="8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b"
Jul 07 00:00:03.654233 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.654214    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b"} err="failed to get container status \"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b\": rpc error: code = NotFound desc = could not find container \"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b\": container with ID starting with 8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b not found: ID does not exist"
Jul 07 00:00:03.654293 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.654234    2551 scope.go:117] "RemoveContainer" containerID="c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1"
Jul 07 00:00:03.654484 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.654460    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1"} err="failed to get container status \"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1\": rpc error: code = NotFound desc = could not find container \"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1\": container with ID starting with c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1 not found: ID does not exist"
Jul 07 00:00:03.654561 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.654486    2551 scope.go:117] "RemoveContainer" containerID="774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a"
Jul 07 00:00:03.654753 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.654733    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a"} err="failed to get container status \"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a\": rpc error: code = NotFound desc = could not find container \"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a\": container with ID starting with 774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a not found: ID does not exist"
Jul 07 00:00:03.654818 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.654756    2551 scope.go:117] "RemoveContainer" containerID="d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de"
Jul 07 00:00:03.654997 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.654981    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de"} err="failed to get container status \"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de\": rpc error: code = NotFound desc = could not find container \"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de\": container with ID starting with d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de not found: ID does not exist"
Jul 07 00:00:03.655073 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.654998    2551 scope.go:117] "RemoveContainer" containerID="569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae"
Jul 07 00:00:03.655294 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.655270    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae"} err="failed to get container status \"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae\": rpc error: code = NotFound desc = could not find container \"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae\": container with ID starting with 569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae not found: ID does not exist"
Jul 07 00:00:03.655364 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.655296    2551 scope.go:117] "RemoveContainer" containerID="9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61"
Jul 07 00:00:03.655589 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.655560    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61"} err="failed to get container status \"9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61\": rpc error: code = NotFound desc = could not find container \"9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61\": container with ID starting with 9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61 not found: ID does not exist"
Jul 07 00:00:03.655589 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.655589    2551 scope.go:117] "RemoveContainer" containerID="4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15"
Jul 07 00:00:03.657609 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.655848    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-trusted-ca-bundle\") pod \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") "
Jul 07 00:00:03.657609 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.655897    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") "
Jul 07 00:00:03.657609 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.655930    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-prometheus-k8s-tls\") pod \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") "
Jul 07 00:00:03.657609 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.655961    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") "
Jul 07 00:00:03.657609 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.655986    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-thanos-prometheus-http-client-file\") pod \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") "
Jul 07 00:00:03.657609 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.656062    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-metrics-client-certs\") pod \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") "
Jul 07 00:00:03.657609 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.656091    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-configmap-serving-certs-ca-bundle\") pod \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") "
Jul 07 00:00:03.657609 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.656126    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hb72t\" (UniqueName: \"kubernetes.io/projected/d1d23926-20bb-43d2-b3b8-42246bf1a27e-kube-api-access-hb72t\") pod \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") "
Jul 07 00:00:03.657609 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.656162    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-grpc-tls\") pod \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") "
Jul 07 00:00:03.657609 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.656194    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d1d23926-20bb-43d2-b3b8-42246bf1a27e-config-out\") pod \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") "
Jul 07 00:00:03.657609 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.656225    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d1d23926-20bb-43d2-b3b8-42246bf1a27e-tls-assets\") pod \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") "
Jul 07 00:00:03.657609 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.656248    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-config\") pod \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") "
Jul 07 00:00:03.657609 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.656282    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-rulefiles-1\") pod \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") "
Jul 07 00:00:03.657609 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.656319    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-rulefiles-0\") pod \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") "
Jul 07 00:00:03.657609 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.656349    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-rulefiles-2\") pod \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") "
Jul 07 00:00:03.657609 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.656376    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-configmap-kubelet-serving-ca-bundle\") pod \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") "
Jul 07 00:00:03.657609 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.656421    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-configmap-metrics-client-ca\") pod \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") "
Jul 07 00:00:03.657609 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.656453    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-kube-rbac-proxy\") pod \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") "
Jul 07 00:00:03.658444 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.656492    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-db\") pod \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") "
Jul 07 00:00:03.658444 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.656534    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-web-config\") pod \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\" (UID: \"d1d23926-20bb-43d2-b3b8-42246bf1a27e\") "
Jul 07 00:00:03.658444 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.657659    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "d1d23926-20bb-43d2-b3b8-42246bf1a27e" (UID: "d1d23926-20bb-43d2-b3b8-42246bf1a27e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:00:03.658444 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.658059    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "d1d23926-20bb-43d2-b3b8-42246bf1a27e" (UID: "d1d23926-20bb-43d2-b3b8-42246bf1a27e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:00:03.658444 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.658057    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "d1d23926-20bb-43d2-b3b8-42246bf1a27e" (UID: "d1d23926-20bb-43d2-b3b8-42246bf1a27e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:00:03.658444 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.658098    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15"} err="failed to get container status \"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15\": rpc error: code = NotFound desc = could not find container \"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15\": container with ID starting with 4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15 not found: ID does not exist"
Jul 07 00:00:03.658444 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.658121    2551 scope.go:117] "RemoveContainer" containerID="8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b"
Jul 07 00:00:03.659274 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.659111    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "d1d23926-20bb-43d2-b3b8-42246bf1a27e" (UID: "d1d23926-20bb-43d2-b3b8-42246bf1a27e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:00:03.659656 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.659625    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b"} err="failed to get container status \"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b\": rpc error: code = NotFound desc = could not find container \"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b\": container with ID starting with 8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b not found: ID does not exist"
Jul 07 00:00:03.659792 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.659657    2551 scope.go:117] "RemoveContainer" containerID="c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1"
Jul 07 00:00:03.659888 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.659859    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "d1d23926-20bb-43d2-b3b8-42246bf1a27e" (UID: "d1d23926-20bb-43d2-b3b8-42246bf1a27e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:00:03.660648 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.660623    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "d1d23926-20bb-43d2-b3b8-42246bf1a27e" (UID: "d1d23926-20bb-43d2-b3b8-42246bf1a27e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:00:03.661166 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.660877    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1"} err="failed to get container status \"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1\": rpc error: code = NotFound desc = could not find container \"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1\": container with ID starting with c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1 not found: ID does not exist"
Jul 07 00:00:03.661166 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.660903    2551 scope.go:117] "RemoveContainer" containerID="774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a"
Jul 07 00:00:03.661166 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.661011    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "d1d23926-20bb-43d2-b3b8-42246bf1a27e" (UID: "d1d23926-20bb-43d2-b3b8-42246bf1a27e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:00:03.661385 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.661280    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "d1d23926-20bb-43d2-b3b8-42246bf1a27e" (UID: "d1d23926-20bb-43d2-b3b8-42246bf1a27e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 00:00:03.661802 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.661605    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "d1d23926-20bb-43d2-b3b8-42246bf1a27e" (UID: "d1d23926-20bb-43d2-b3b8-42246bf1a27e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:00:03.661802 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.661645    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a"} err="failed to get container status \"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a\": rpc error: code = NotFound desc = could not find container \"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a\": container with ID starting with 774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a not found: ID does not exist"
Jul 07 00:00:03.661802 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.661677    2551 scope.go:117] "RemoveContainer" containerID="d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de"
Jul 07 00:00:03.662271 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.662234    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de"} err="failed to get container status \"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de\": rpc error: code = NotFound desc = could not find container \"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de\": container with ID starting with d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de not found: ID does not exist"
Jul 07 00:00:03.662271 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.662260    2551 scope.go:117] "RemoveContainer" containerID="569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae"
Jul 07 00:00:03.662598 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.662559    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae"} err="failed to get container status \"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae\": rpc error: code = NotFound desc = could not find container \"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae\": container with ID starting with 569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae not found: ID does not exist"
Jul 07 00:00:03.662598 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.662585    2551 scope.go:117] "RemoveContainer" containerID="9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61"
Jul 07 00:00:03.662964 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.662839    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61"} err="failed to get container status \"9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61\": rpc error: code = NotFound desc = could not find container \"9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61\": container with ID starting with 9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61 not found: ID does not exist"
Jul 07 00:00:03.662964 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.662867    2551 scope.go:117] "RemoveContainer" containerID="4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15"
Jul 07 00:00:03.663162 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.663126    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15"} err="failed to get container status \"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15\": rpc error: code = NotFound desc = could not find container \"4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15\": container with ID starting with 4e1c2683c0abed87fb6f17c0fbb32074159a8bbf70d7cf3c13ce2ade4ba7dc15 not found: ID does not exist"
Jul 07 00:00:03.663227 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.663164    2551 scope.go:117] "RemoveContainer" containerID="8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b"
Jul 07 00:00:03.663453 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.663419    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b"} err="failed to get container status \"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b\": rpc error: code = NotFound desc = could not find container \"8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b\": container with ID starting with 8956c5f515739284f3b18ed4e71f13c8d27c62a4231d4488c47edb2cef04936b not found: ID does not exist"
Jul 07 00:00:03.663547 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.663454    2551 scope.go:117] "RemoveContainer" containerID="c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1"
Jul 07 00:00:03.663788 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.663754    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1"} err="failed to get container status \"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1\": rpc error: code = NotFound desc = could not find container \"c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1\": container with ID starting with c968f527f0ec982a5f26383b8937266e0b8b61eae7d5775441b0f130f936bac1 not found: ID does not exist"
Jul 07 00:00:03.663875 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.663791    2551 scope.go:117] "RemoveContainer" containerID="774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a"
Jul 07 00:00:03.663875 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.663841    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "d1d23926-20bb-43d2-b3b8-42246bf1a27e" (UID: "d1d23926-20bb-43d2-b3b8-42246bf1a27e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:00:03.664003 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.663903    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "d1d23926-20bb-43d2-b3b8-42246bf1a27e" (UID: "d1d23926-20bb-43d2-b3b8-42246bf1a27e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:00:03.664003 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.663905    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1d23926-20bb-43d2-b3b8-42246bf1a27e-kube-api-access-hb72t" (OuterVolumeSpecName: "kube-api-access-hb72t") pod "d1d23926-20bb-43d2-b3b8-42246bf1a27e" (UID: "d1d23926-20bb-43d2-b3b8-42246bf1a27e"). InnerVolumeSpecName "kube-api-access-hb72t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:00:03.664203 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.664149    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a"} err="failed to get container status \"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a\": rpc error: code = NotFound desc = could not find container \"774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a\": container with ID starting with 774e6329a3bd25f8bb87b6469f662bd9dcb2dcac1dd1ec1b82cdc82965dc443a not found: ID does not exist"
Jul 07 00:00:03.664203 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.664187    2551 scope.go:117] "RemoveContainer" containerID="d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de"
Jul 07 00:00:03.664549 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.664427    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de"} err="failed to get container status \"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de\": rpc error: code = NotFound desc = could not find container \"d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de\": container with ID starting with d0e871f211cdab5e560aa321cba4d6a7a20ce143f5336db7cfdb6739bd51d4de not found: ID does not exist"
Jul 07 00:00:03.664549 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.664465    2551 scope.go:117] "RemoveContainer" containerID="569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae"
Jul 07 00:00:03.664549 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.664494    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d1d23926-20bb-43d2-b3b8-42246bf1a27e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d1d23926-20bb-43d2-b3b8-42246bf1a27e" (UID: "d1d23926-20bb-43d2-b3b8-42246bf1a27e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:00:03.664758 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.664722    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae"} err="failed to get container status \"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae\": rpc error: code = NotFound desc = could not find container \"569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae\": container with ID starting with 569ecc9994f3509ddf8e911050a2610a24a7ce353f602ded1ff54e881e377aae not found: ID does not exist"
Jul 07 00:00:03.664758 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.664756    2551 scope.go:117] "RemoveContainer" containerID="9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61"
Jul 07 00:00:03.665052 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.665022    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61"} err="failed to get container status \"9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61\": rpc error: code = NotFound desc = could not find container \"9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61\": container with ID starting with 9ce79b834bcf0b0849e2a46f6f211331c698a5446289abe595b59a80245e5c61 not found: ID does not exist"
Jul 07 00:00:03.665550 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.665498    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d1d23926-20bb-43d2-b3b8-42246bf1a27e-config-out" (OuterVolumeSpecName: "config-out") pod "d1d23926-20bb-43d2-b3b8-42246bf1a27e" (UID: "d1d23926-20bb-43d2-b3b8-42246bf1a27e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:00:03.665626 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.665546    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "d1d23926-20bb-43d2-b3b8-42246bf1a27e" (UID: "d1d23926-20bb-43d2-b3b8-42246bf1a27e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:00:03.665674 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.665623    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-config" (OuterVolumeSpecName: "config") pod "d1d23926-20bb-43d2-b3b8-42246bf1a27e" (UID: "d1d23926-20bb-43d2-b3b8-42246bf1a27e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:00:03.665751 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.665721    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "d1d23926-20bb-43d2-b3b8-42246bf1a27e" (UID: "d1d23926-20bb-43d2-b3b8-42246bf1a27e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:00:03.665820 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.665799    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "d1d23926-20bb-43d2-b3b8-42246bf1a27e" (UID: "d1d23926-20bb-43d2-b3b8-42246bf1a27e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:00:03.665820 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.665812    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "d1d23926-20bb-43d2-b3b8-42246bf1a27e" (UID: "d1d23926-20bb-43d2-b3b8-42246bf1a27e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:00:03.676119 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.676087    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-web-config" (OuterVolumeSpecName: "web-config") pod "d1d23926-20bb-43d2-b3b8-42246bf1a27e" (UID: "d1d23926-20bb-43d2-b3b8-42246bf1a27e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:00:03.757936 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.757898    2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.757936 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.757944    2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.758111 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.757962    2551 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.758111 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.757975    2551 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-configmap-metrics-client-ca\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.758111 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.757990    2551 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-kube-rbac-proxy\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.758111 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.758003    2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-db\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.758111 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.758014    2551 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-web-config\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.758111 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.758027    2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.758111 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.758039    2551 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.758111 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.758053    2551 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.758111 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.758066    2551 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.758111 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.758079    2551 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.758111 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.758092    2551 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-metrics-client-certs\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.758111 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.758105    2551 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.758468 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.758119    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hb72t\" (UniqueName: \"kubernetes.io/projected/d1d23926-20bb-43d2-b3b8-42246bf1a27e-kube-api-access-hb72t\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.758468 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.758132    2551 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-secret-grpc-tls\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.758468 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.758145    2551 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d1d23926-20bb-43d2-b3b8-42246bf1a27e-config-out\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.758468 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.758158    2551 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d1d23926-20bb-43d2-b3b8-42246bf1a27e-tls-assets\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.758468 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.758170    2551 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/d1d23926-20bb-43d2-b3b8-42246bf1a27e-config\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.758468 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.758187    2551 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d1d23926-20bb-43d2-b3b8-42246bf1a27e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:00:03.892569 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.892538    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 00:00:03.897595 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.897570    2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 00:00:03.932499 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.932464    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 00:00:03.932869 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.932850    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="init-config-reloader"
Jul 07 00:00:03.932920 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.932871    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="init-config-reloader"
Jul 07 00:00:03.932920 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.932880    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="prometheus"
Jul 07 00:00:03.932920 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.932887    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="prometheus"
Jul 07 00:00:03.932920 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.932894    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="config-reloader"
Jul 07 00:00:03.932920 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.932900    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="config-reloader"
Jul 07 00:00:03.933127 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.932928    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="kube-rbac-proxy-thanos"
Jul 07 00:00:03.933127 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.932934    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="kube-rbac-proxy-thanos"
Jul 07 00:00:03.933127 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.932943    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="thanos-sidecar"
Jul 07 00:00:03.933127 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.932948    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="thanos-sidecar"
Jul 07 00:00:03.933127 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.932957    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="kube-rbac-proxy"
Jul 07 00:00:03.933127 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.932962    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="kube-rbac-proxy"
Jul 07 00:00:03.933127 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.932972    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="kube-rbac-proxy-web"
Jul 07 00:00:03.933127 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.932977    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="kube-rbac-proxy-web"
Jul 07 00:00:03.933127 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.933027    2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="kube-rbac-proxy-web"
Jul 07 00:00:03.933127 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.933035    2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="config-reloader"
Jul 07 00:00:03.933127 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.933042    2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="thanos-sidecar"
Jul 07 00:00:03.933127 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.933049    2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="kube-rbac-proxy-thanos"
Jul 07 00:00:03.933127 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.933054    2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="kube-rbac-proxy"
Jul 07 00:00:03.933127 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.933060    2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" containerName="prometheus"
Jul 07 00:00:03.938626 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.938606    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:03.943643 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.943619    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 07 00:00:03.943643 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.943701    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 07 00:00:03.943643 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.943736    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 07 00:00:03.944527 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.944440    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 07 00:00:03.944635 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.944615    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 07 00:00:03.945222 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.945081    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 07 00:00:03.945222 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.945165    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-bgb83ahrsqhkp\""
Jul 07 00:00:03.945814 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.945497    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 07 00:00:03.945814 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.945732    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 07 00:00:03.945814 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.945802    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 07 00:00:03.946023 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.945968    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 07 00:00:03.946078 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.946027    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 07 00:00:03.946119 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.946043    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 07 00:00:03.946454 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.946379    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-jgq88\""
Jul 07 00:00:03.947461 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.947441    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 07 00:00:03.950916 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.950900    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 07 00:00:03.955345 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:03.955327    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 00:00:04.061537 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.061481    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.061537 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.061541    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.061838 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.061590    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf5vx\" (UniqueName: \"kubernetes.io/projected/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-kube-api-access-kf5vx\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.061838 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.061615    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.061838 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.061654    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.061838 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.061669    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.061838 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.061685    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.061838 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.061704    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.061838 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.061723    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.061838 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.061747    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.061838 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.061776    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.061838 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.061797    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-web-config\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.061838 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.061823    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.061838 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.061841    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.062189 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.061883    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.062189 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.061904    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-config-out\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.062189 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.061924    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-config\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.062189 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.061941    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.062189 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.061962    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.062189 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.061978    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.162400 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.162301    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.162400 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.162352    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.162400 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.162372    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.162654 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.162484    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.162654 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.162548    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.162654 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.162575    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.162654 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.162612    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.162654 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.162639    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-web-config\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.163266 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.163172    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.163266 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.163201    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.163266 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.163234    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.163266 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.163267    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.163587 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.163310    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.163587 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.163328    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.163587 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.163335    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-config-out\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.163587 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.163400    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-config\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.163587 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.163430    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.163587 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.163458    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.163587 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.163482    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.163587 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.163547    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.163587 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.163584    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.164042 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.163618    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf5vx\" (UniqueName: \"kubernetes.io/projected/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-kube-api-access-kf5vx\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.164042 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.163650    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.164561 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.164178    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.165661 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.165481    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.165661 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.165481    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.165661 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.165609    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-web-config\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.165661 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.165628    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.165946 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.165836    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-config-out\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.166323 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.166025    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.166438 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.166418    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.166563 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.166536    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.166671 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.166640    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.166741 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.166710    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-config\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.167400 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.167376    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.167814 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.167795    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.168160 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.168141    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.168412 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.168396    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.168625 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.168608    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.175429 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.175411    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf5vx\" (UniqueName: \"kubernetes.io/projected/d52ad5e3-1c73-4e3f-bec6-78cc29459b99-kube-api-access-kf5vx\") pod \"prometheus-k8s-0\" (UID: \"d52ad5e3-1c73-4e3f-bec6-78cc29459b99\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.249029 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.248995    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:00:04.395612 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.395563    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 07 00:00:04.399392 ip-10-0-133-139 kubenswrapper[2551]: W0707 00:00:04.399364    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd52ad5e3_1c73_4e3f_bec6_78cc29459b99.slice/crio-3a88faef388901b6d6c76e7903969c064071ec62b28ce6164033b4404d86cd29 WatchSource:0}: Error finding container 3a88faef388901b6d6c76e7903969c064071ec62b28ce6164033b4404d86cd29: Status 404 returned error can't find the container with id 3a88faef388901b6d6c76e7903969c064071ec62b28ce6164033b4404d86cd29
Jul 07 00:00:04.576878 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.576844    2551 generic.go:356] "Generic (PLEG): container finished" podID="d52ad5e3-1c73-4e3f-bec6-78cc29459b99" containerID="8c90b475bd65af4e7d27d1561d37a311964415aaee2916e38e23e9dc70c53d7f" exitCode=0
Jul 07 00:00:04.577255 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.576901    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52ad5e3-1c73-4e3f-bec6-78cc29459b99","Type":"ContainerDied","Data":"8c90b475bd65af4e7d27d1561d37a311964415aaee2916e38e23e9dc70c53d7f"}
Jul 07 00:00:04.577255 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:04.576957    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52ad5e3-1c73-4e3f-bec6-78cc29459b99","Type":"ContainerStarted","Data":"3a88faef388901b6d6c76e7903969c064071ec62b28ce6164033b4404d86cd29"}
Jul 07 00:00:05.585448 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:05.585367    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52ad5e3-1c73-4e3f-bec6-78cc29459b99","Type":"ContainerStarted","Data":"df2655e8f701d803e3363c437e205bb023cac7f9eb6389fc14e3236cda0b7694"}
Jul 07 00:00:05.585826 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:05.585453    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52ad5e3-1c73-4e3f-bec6-78cc29459b99","Type":"ContainerStarted","Data":"206b4a4e458e8302926669087ac17a1ff03aabf46dd4b37b0cf342e7dd4026f9"}
Jul 07 00:00:05.585826 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:05.585481    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52ad5e3-1c73-4e3f-bec6-78cc29459b99","Type":"ContainerStarted","Data":"113106aee8d10ad33b5187daf62c9a0c516d36ea36b1e951f8247fc2d217ecca"}
Jul 07 00:00:05.585826 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:05.585521    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52ad5e3-1c73-4e3f-bec6-78cc29459b99","Type":"ContainerStarted","Data":"9ac7ab1a4d7ee7204e041a42e67945dbf93778069871f852a79e431ff7d0b6a9"}
Jul 07 00:00:05.585826 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:05.585544    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52ad5e3-1c73-4e3f-bec6-78cc29459b99","Type":"ContainerStarted","Data":"2b4a3f2067485ca8bdc34fb4c6d4d7b185a59e4fe3c3cacdf7ac9fe97f2a8bfd"}
Jul 07 00:00:05.585826 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:05.585566    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d52ad5e3-1c73-4e3f-bec6-78cc29459b99","Type":"ContainerStarted","Data":"959179a84f3df764ee16279978a231526dd81136ee19dbddd7e7909376bf6300"}
Jul 07 00:00:05.626073 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:05.626015    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.604171687 podStartE2EDuration="2.625993021s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.821334ms" isStatefulPod=false podCreationTimestamp="2026-07-07 00:00:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:00:05.625338853 +0000 UTC m=+174.404733510" watchObservedRunningTime="2026-07-07 00:00:05.625993021 +0000 UTC m=+174.405387679"
Jul 07 00:00:05.692972 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:05.692939    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d1d23926-20bb-43d2-b3b8-42246bf1a27e" path="/var/lib/kubelet/pods/d1d23926-20bb-43d2-b3b8-42246bf1a27e/volumes"
Jul 07 00:00:09.250174 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:00:09.250123    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:01:04.249847 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:01:04.249807    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:01:04.265088 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:01:04.265063    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:01:04.837820 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:01:04.837794    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 07 00:02:11.584829 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:02:11.584792    2551 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 00:03:00.310823 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:00.310788    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-p6rfw"]
Jul 07 00:03:00.313961 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:00.313945    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p6rfw"
Jul 07 00:03:00.318128 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:00.318099    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4j2cp\""
Jul 07 00:03:00.318128 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:00.318100    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 00:03:00.319293 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:00.319276    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 00:03:00.327843 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:00.327820    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-p6rfw"]
Jul 07 00:03:00.380851 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:00.380812    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qqgq\" (UniqueName: \"kubernetes.io/projected/9850c4db-1145-47e8-bd6a-5130aa87b62d-kube-api-access-8qqgq\") pod \"cert-manager-cainjector-559cdd8c87-p6rfw\" (UID: \"9850c4db-1145-47e8-bd6a-5130aa87b62d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p6rfw"
Jul 07 00:03:00.381039 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:00.380904    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9850c4db-1145-47e8-bd6a-5130aa87b62d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-p6rfw\" (UID: \"9850c4db-1145-47e8-bd6a-5130aa87b62d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p6rfw"
Jul 07 00:03:00.481783 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:00.481746    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qqgq\" (UniqueName: \"kubernetes.io/projected/9850c4db-1145-47e8-bd6a-5130aa87b62d-kube-api-access-8qqgq\") pod \"cert-manager-cainjector-559cdd8c87-p6rfw\" (UID: \"9850c4db-1145-47e8-bd6a-5130aa87b62d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p6rfw"
Jul 07 00:03:00.481939 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:00.481823    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9850c4db-1145-47e8-bd6a-5130aa87b62d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-p6rfw\" (UID: \"9850c4db-1145-47e8-bd6a-5130aa87b62d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p6rfw"
Jul 07 00:03:00.491529 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:00.491487    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9850c4db-1145-47e8-bd6a-5130aa87b62d-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-p6rfw\" (UID: \"9850c4db-1145-47e8-bd6a-5130aa87b62d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p6rfw"
Jul 07 00:03:00.491645 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:00.491570    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qqgq\" (UniqueName: \"kubernetes.io/projected/9850c4db-1145-47e8-bd6a-5130aa87b62d-kube-api-access-8qqgq\") pod \"cert-manager-cainjector-559cdd8c87-p6rfw\" (UID: \"9850c4db-1145-47e8-bd6a-5130aa87b62d\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-p6rfw"
Jul 07 00:03:00.638024 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:00.637982    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p6rfw"
Jul 07 00:03:00.773533 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:00.773493    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-p6rfw"]
Jul 07 00:03:00.776178 ip-10-0-133-139 kubenswrapper[2551]: W0707 00:03:00.776150    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9850c4db_1145_47e8_bd6a_5130aa87b62d.slice/crio-cc3893e2ec150de81479963c04f8ead3f51e2dd4200f38d512c397b74329dfd4 WatchSource:0}: Error finding container cc3893e2ec150de81479963c04f8ead3f51e2dd4200f38d512c397b74329dfd4: Status 404 returned error can't find the container with id cc3893e2ec150de81479963c04f8ead3f51e2dd4200f38d512c397b74329dfd4
Jul 07 00:03:00.778197 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:00.778177    2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 00:03:01.279340 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:01.279308    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p6rfw" event={"ID":"9850c4db-1145-47e8-bd6a-5130aa87b62d","Type":"ContainerStarted","Data":"cc3893e2ec150de81479963c04f8ead3f51e2dd4200f38d512c397b74329dfd4"}
Jul 07 00:03:04.295787 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:04.295690    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p6rfw" event={"ID":"9850c4db-1145-47e8-bd6a-5130aa87b62d","Type":"ContainerStarted","Data":"7c8904528ee2fd368db1d6743f19232fc0bdbe78c9f822d597110226f4122aba"}
Jul 07 00:03:04.330958 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:04.330906    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-p6rfw" podStartSLOduration=1.089088552 podStartE2EDuration="4.33088905s" totalImagesPullingTime="3.241800498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:03:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:04.329588848 +0000 UTC m=+353.108983506" watchObservedRunningTime="2026-07-07 00:03:04.33088905 +0000 UTC m=+353.110283708"
Jul 07 00:03:17.509402 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:17.509367    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-glz4t"]
Jul 07 00:03:17.517938 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:17.517906    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-glz4t"
Jul 07 00:03:17.521958 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:17.521932    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 00:03:17.524230 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:17.524208    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-7dwmc\""
Jul 07 00:03:17.525829 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:17.525807    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 00:03:17.543379 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:17.543346    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-glz4t"]
Jul 07 00:03:17.630083 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:17.630044    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/236e6a9c-85a8-4af9-a6b0-b84774427c1f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-glz4t\" (UID: \"236e6a9c-85a8-4af9-a6b0-b84774427c1f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-glz4t"
Jul 07 00:03:17.630284 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:17.630101    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwz9t\" (UniqueName: \"kubernetes.io/projected/236e6a9c-85a8-4af9-a6b0-b84774427c1f-kube-api-access-hwz9t\") pod \"openshift-lws-operator-fd8ccff4c-glz4t\" (UID: \"236e6a9c-85a8-4af9-a6b0-b84774427c1f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-glz4t"
Jul 07 00:03:17.731301 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:17.731263    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/236e6a9c-85a8-4af9-a6b0-b84774427c1f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-glz4t\" (UID: \"236e6a9c-85a8-4af9-a6b0-b84774427c1f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-glz4t"
Jul 07 00:03:17.731483 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:17.731315    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwz9t\" (UniqueName: \"kubernetes.io/projected/236e6a9c-85a8-4af9-a6b0-b84774427c1f-kube-api-access-hwz9t\") pod \"openshift-lws-operator-fd8ccff4c-glz4t\" (UID: \"236e6a9c-85a8-4af9-a6b0-b84774427c1f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-glz4t"
Jul 07 00:03:17.731751 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:17.731725    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/236e6a9c-85a8-4af9-a6b0-b84774427c1f-tmp\") pod \"openshift-lws-operator-fd8ccff4c-glz4t\" (UID: \"236e6a9c-85a8-4af9-a6b0-b84774427c1f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-glz4t"
Jul 07 00:03:17.742100 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:17.742074    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwz9t\" (UniqueName: \"kubernetes.io/projected/236e6a9c-85a8-4af9-a6b0-b84774427c1f-kube-api-access-hwz9t\") pod \"openshift-lws-operator-fd8ccff4c-glz4t\" (UID: \"236e6a9c-85a8-4af9-a6b0-b84774427c1f\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-glz4t"
Jul 07 00:03:17.827258 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:17.827164    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-glz4t"
Jul 07 00:03:17.965943 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:17.965836    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-glz4t"]
Jul 07 00:03:17.968177 ip-10-0-133-139 kubenswrapper[2551]: W0707 00:03:17.968150    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod236e6a9c_85a8_4af9_a6b0_b84774427c1f.slice/crio-1e6685496a20852977661c71512762dbb9ef5195f3e1be7f6fa2199b88491d78 WatchSource:0}: Error finding container 1e6685496a20852977661c71512762dbb9ef5195f3e1be7f6fa2199b88491d78: Status 404 returned error can't find the container with id 1e6685496a20852977661c71512762dbb9ef5195f3e1be7f6fa2199b88491d78
Jul 07 00:03:18.354745 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:18.354709    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-glz4t" event={"ID":"236e6a9c-85a8-4af9-a6b0-b84774427c1f","Type":"ContainerStarted","Data":"1e6685496a20852977661c71512762dbb9ef5195f3e1be7f6fa2199b88491d78"}
Jul 07 00:03:21.369299 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:21.369259    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-glz4t" event={"ID":"236e6a9c-85a8-4af9-a6b0-b84774427c1f","Type":"ContainerStarted","Data":"6dbe1afbf2c615710a893179432d258b556c901ef8af5259594ac08d18780558"}
Jul 07 00:03:28.740074 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:28.740019    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-glz4t" podStartSLOduration=9.384609073 podStartE2EDuration="11.740002421s" totalImagesPullingTime="2.355393348s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:21.412477409 +0000 UTC m=+370.191872066" watchObservedRunningTime="2026-07-07 00:03:28.740002421 +0000 UTC m=+377.519397077"
Jul 07 00:03:28.740602 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:28.740132    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc"]
Jul 07 00:03:28.744285 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:28.744265    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc"
Jul 07 00:03:28.749241 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:28.749220    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 00:03:28.749366 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:28.749334    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 00:03:28.749366 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:28.749343    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 00:03:28.749466 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:28.749419    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-255ns\""
Jul 07 00:03:28.770441 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:28.770410    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc"]
Jul 07 00:03:28.830042 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:28.830013    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0a982f58-f4fc-46cb-ac80-6bb9f1625380-manager-config\") pod \"lws-controller-manager-5df8c9476f-w7btc\" (UID: \"0a982f58-f4fc-46cb-ac80-6bb9f1625380\") " pod="openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc"
Jul 07 00:03:28.830214 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:28.830055    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0a982f58-f4fc-46cb-ac80-6bb9f1625380-metrics-cert\") pod \"lws-controller-manager-5df8c9476f-w7btc\" (UID: \"0a982f58-f4fc-46cb-ac80-6bb9f1625380\") " pod="openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc"
Jul 07 00:03:28.830214 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:28.830089    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a982f58-f4fc-46cb-ac80-6bb9f1625380-cert\") pod \"lws-controller-manager-5df8c9476f-w7btc\" (UID: \"0a982f58-f4fc-46cb-ac80-6bb9f1625380\") " pod="openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc"
Jul 07 00:03:28.830214 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:28.830167    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l66cl\" (UniqueName: \"kubernetes.io/projected/0a982f58-f4fc-46cb-ac80-6bb9f1625380-kube-api-access-l66cl\") pod \"lws-controller-manager-5df8c9476f-w7btc\" (UID: \"0a982f58-f4fc-46cb-ac80-6bb9f1625380\") " pod="openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc"
Jul 07 00:03:28.931115 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:28.931075    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l66cl\" (UniqueName: \"kubernetes.io/projected/0a982f58-f4fc-46cb-ac80-6bb9f1625380-kube-api-access-l66cl\") pod \"lws-controller-manager-5df8c9476f-w7btc\" (UID: \"0a982f58-f4fc-46cb-ac80-6bb9f1625380\") " pod="openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc"
Jul 07 00:03:28.931291 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:28.931130    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0a982f58-f4fc-46cb-ac80-6bb9f1625380-manager-config\") pod \"lws-controller-manager-5df8c9476f-w7btc\" (UID: \"0a982f58-f4fc-46cb-ac80-6bb9f1625380\") " pod="openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc"
Jul 07 00:03:28.931291 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:28.931159    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0a982f58-f4fc-46cb-ac80-6bb9f1625380-metrics-cert\") pod \"lws-controller-manager-5df8c9476f-w7btc\" (UID: \"0a982f58-f4fc-46cb-ac80-6bb9f1625380\") " pod="openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc"
Jul 07 00:03:28.931291 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:28.931191    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a982f58-f4fc-46cb-ac80-6bb9f1625380-cert\") pod \"lws-controller-manager-5df8c9476f-w7btc\" (UID: \"0a982f58-f4fc-46cb-ac80-6bb9f1625380\") " pod="openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc"
Jul 07 00:03:28.931889 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:28.931864    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/0a982f58-f4fc-46cb-ac80-6bb9f1625380-manager-config\") pod \"lws-controller-manager-5df8c9476f-w7btc\" (UID: \"0a982f58-f4fc-46cb-ac80-6bb9f1625380\") " pod="openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc"
Jul 07 00:03:28.933698 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:28.933675    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/0a982f58-f4fc-46cb-ac80-6bb9f1625380-cert\") pod \"lws-controller-manager-5df8c9476f-w7btc\" (UID: \"0a982f58-f4fc-46cb-ac80-6bb9f1625380\") " pod="openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc"
Jul 07 00:03:28.933698 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:28.933690    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/0a982f58-f4fc-46cb-ac80-6bb9f1625380-metrics-cert\") pod \"lws-controller-manager-5df8c9476f-w7btc\" (UID: \"0a982f58-f4fc-46cb-ac80-6bb9f1625380\") " pod="openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc"
Jul 07 00:03:28.948163 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:28.948140    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l66cl\" (UniqueName: \"kubernetes.io/projected/0a982f58-f4fc-46cb-ac80-6bb9f1625380-kube-api-access-l66cl\") pod \"lws-controller-manager-5df8c9476f-w7btc\" (UID: \"0a982f58-f4fc-46cb-ac80-6bb9f1625380\") " pod="openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc"
Jul 07 00:03:29.054748 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:29.054660    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc"
Jul 07 00:03:29.205537 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:29.205499    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc"]
Jul 07 00:03:29.207390 ip-10-0-133-139 kubenswrapper[2551]: W0707 00:03:29.207359    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a982f58_f4fc_46cb_ac80_6bb9f1625380.slice/crio-a911fae872c8b4022103d8224dc3cf049265ed51495c02cc69d0375a37a9bdc4 WatchSource:0}: Error finding container a911fae872c8b4022103d8224dc3cf049265ed51495c02cc69d0375a37a9bdc4: Status 404 returned error can't find the container with id a911fae872c8b4022103d8224dc3cf049265ed51495c02cc69d0375a37a9bdc4
Jul 07 00:03:29.403878 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:29.403844    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc" event={"ID":"0a982f58-f4fc-46cb-ac80-6bb9f1625380","Type":"ContainerStarted","Data":"a911fae872c8b4022103d8224dc3cf049265ed51495c02cc69d0375a37a9bdc4"}
Jul 07 00:03:31.414906 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:31.414873    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc" event={"ID":"0a982f58-f4fc-46cb-ac80-6bb9f1625380","Type":"ContainerStarted","Data":"2266c39d445bb9e941e3de53d8292ebd077f49022eb877d80f105252ddbaa8ff"}
Jul 07 00:03:31.415367 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:31.414948    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc"
Jul 07 00:03:31.449633 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:31.449579    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc" podStartSLOduration=1.707789908 podStartE2EDuration="3.449562923s" totalImagesPullingTime="1.741773015s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:03:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:31.448115295 +0000 UTC m=+380.227509953" watchObservedRunningTime="2026-07-07 00:03:31.449562923 +0000 UTC m=+380.228957581"
Jul 07 00:03:42.006730 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.006694    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"]
Jul 07 00:03:42.010124 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.010108    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"
Jul 07 00:03:42.014952 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.014926    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 00:03:42.015293 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.015275    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 00:03:42.015353 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.015326    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 00:03:42.022583 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.022563    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 00:03:42.022702 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.022589    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dmrqj\""
Jul 07 00:03:42.036091 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.036063    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"]
Jul 07 00:03:42.042708 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.042678    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/555433b7-7deb-4cba-8b14-f1953ef775dd-tmp\") pod \"opendatahub-operator-controller-manager-6b6d6b477c-qswqn\" (UID: \"555433b7-7deb-4cba-8b14-f1953ef775dd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"
Jul 07 00:03:42.042862 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.042841    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/555433b7-7deb-4cba-8b14-f1953ef775dd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b6d6b477c-qswqn\" (UID: \"555433b7-7deb-4cba-8b14-f1953ef775dd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"
Jul 07 00:03:42.042907 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.042877    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqglj\" (UniqueName: \"kubernetes.io/projected/555433b7-7deb-4cba-8b14-f1953ef775dd-kube-api-access-tqglj\") pod \"opendatahub-operator-controller-manager-6b6d6b477c-qswqn\" (UID: \"555433b7-7deb-4cba-8b14-f1953ef775dd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"
Jul 07 00:03:42.042952 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.042903    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/555433b7-7deb-4cba-8b14-f1953ef775dd-manifests\") pod \"opendatahub-operator-controller-manager-6b6d6b477c-qswqn\" (UID: \"555433b7-7deb-4cba-8b14-f1953ef775dd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"
Jul 07 00:03:42.042952 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.042937    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/555433b7-7deb-4cba-8b14-f1953ef775dd-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b6d6b477c-qswqn\" (UID: \"555433b7-7deb-4cba-8b14-f1953ef775dd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"
Jul 07 00:03:42.143964 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.143935    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/555433b7-7deb-4cba-8b14-f1953ef775dd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b6d6b477c-qswqn\" (UID: \"555433b7-7deb-4cba-8b14-f1953ef775dd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"
Jul 07 00:03:42.144141 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.143969    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqglj\" (UniqueName: \"kubernetes.io/projected/555433b7-7deb-4cba-8b14-f1953ef775dd-kube-api-access-tqglj\") pod \"opendatahub-operator-controller-manager-6b6d6b477c-qswqn\" (UID: \"555433b7-7deb-4cba-8b14-f1953ef775dd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"
Jul 07 00:03:42.144141 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.143996    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/555433b7-7deb-4cba-8b14-f1953ef775dd-manifests\") pod \"opendatahub-operator-controller-manager-6b6d6b477c-qswqn\" (UID: \"555433b7-7deb-4cba-8b14-f1953ef775dd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"
Jul 07 00:03:42.144141 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.144018    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/555433b7-7deb-4cba-8b14-f1953ef775dd-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b6d6b477c-qswqn\" (UID: \"555433b7-7deb-4cba-8b14-f1953ef775dd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"
Jul 07 00:03:42.144141 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.144038    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/555433b7-7deb-4cba-8b14-f1953ef775dd-tmp\") pod \"opendatahub-operator-controller-manager-6b6d6b477c-qswqn\" (UID: \"555433b7-7deb-4cba-8b14-f1953ef775dd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"
Jul 07 00:03:42.144476 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.144449    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/555433b7-7deb-4cba-8b14-f1953ef775dd-manifests\") pod \"opendatahub-operator-controller-manager-6b6d6b477c-qswqn\" (UID: \"555433b7-7deb-4cba-8b14-f1953ef775dd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"
Jul 07 00:03:42.146373 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.146351    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/555433b7-7deb-4cba-8b14-f1953ef775dd-tmp\") pod \"opendatahub-operator-controller-manager-6b6d6b477c-qswqn\" (UID: \"555433b7-7deb-4cba-8b14-f1953ef775dd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"
Jul 07 00:03:42.146561 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.146543    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/555433b7-7deb-4cba-8b14-f1953ef775dd-webhook-cert\") pod \"opendatahub-operator-controller-manager-6b6d6b477c-qswqn\" (UID: \"555433b7-7deb-4cba-8b14-f1953ef775dd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"
Jul 07 00:03:42.146617 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.146564    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/555433b7-7deb-4cba-8b14-f1953ef775dd-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6b6d6b477c-qswqn\" (UID: \"555433b7-7deb-4cba-8b14-f1953ef775dd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"
Jul 07 00:03:42.161925 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.161899    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqglj\" (UniqueName: \"kubernetes.io/projected/555433b7-7deb-4cba-8b14-f1953ef775dd-kube-api-access-tqglj\") pod \"opendatahub-operator-controller-manager-6b6d6b477c-qswqn\" (UID: \"555433b7-7deb-4cba-8b14-f1953ef775dd\") " pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"
Jul 07 00:03:42.320532 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.320421    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"
Jul 07 00:03:42.421650 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.421616    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5df8c9476f-w7btc"
Jul 07 00:03:42.518079 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:42.518043    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"]
Jul 07 00:03:42.521767 ip-10-0-133-139 kubenswrapper[2551]: W0707 00:03:42.521736    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod555433b7_7deb_4cba_8b14_f1953ef775dd.slice/crio-32982e7996c25e7fd08867084fa4a56cbf420287d53477cb55dab92e0778b886 WatchSource:0}: Error finding container 32982e7996c25e7fd08867084fa4a56cbf420287d53477cb55dab92e0778b886: Status 404 returned error can't find the container with id 32982e7996c25e7fd08867084fa4a56cbf420287d53477cb55dab92e0778b886
Jul 07 00:03:43.472898 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:43.472809    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn" event={"ID":"555433b7-7deb-4cba-8b14-f1953ef775dd","Type":"ContainerStarted","Data":"32982e7996c25e7fd08867084fa4a56cbf420287d53477cb55dab92e0778b886"}
Jul 07 00:03:45.485878 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:45.485853    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn" event={"ID":"555433b7-7deb-4cba-8b14-f1953ef775dd","Type":"ContainerStarted","Data":"71680f4d1783b71a6700733dc712dce6a23578eccaff262d12c64c6c36c6ea73"}
Jul 07 00:03:47.497781 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:47.497747    2551 generic.go:356] "Generic (PLEG): container finished" podID="555433b7-7deb-4cba-8b14-f1953ef775dd" containerID="71680f4d1783b71a6700733dc712dce6a23578eccaff262d12c64c6c36c6ea73" exitCode=0
Jul 07 00:03:47.497781 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:47.497786    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn" event={"ID":"555433b7-7deb-4cba-8b14-f1953ef775dd","Type":"ContainerDied","Data":"71680f4d1783b71a6700733dc712dce6a23578eccaff262d12c64c6c36c6ea73"}
Jul 07 00:03:48.504453 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:48.504417    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn" event={"ID":"555433b7-7deb-4cba-8b14-f1953ef775dd","Type":"ContainerStarted","Data":"6d0e85c4d30ff0ec670e5927a29ee312f58afc5b6dd19edc2e9af5c69f165c21"}
Jul 07 00:03:48.504855 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:48.504652    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"
Jul 07 00:03:48.530300 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:48.530247    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn" podStartSLOduration=3.257050767 podStartE2EDuration="7.530229934s" totalImagesPullingTime="3.163553428s" totalInitContainerRuntime="1.109625739s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:03:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:03:48.528760553 +0000 UTC m=+397.308155247" watchObservedRunningTime="2026-07-07 00:03:48.530229934 +0000 UTC m=+397.309624627"
Jul 07 00:03:59.510414 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:03:59.510379    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6b6d6b477c-qswqn"
Jul 07 00:04:07.997333 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:07.997295    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-568f9c9968-8779k"]
Jul 07 00:04:08.001091 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:08.001070    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-568f9c9968-8779k"
Jul 07 00:04:08.004483 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:08.004461    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 00:04:08.004664 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:08.004648    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 00:04:08.004800 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:08.004784    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-tdzqc\""
Jul 07 00:04:08.005876 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:08.005863    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 00:04:08.005928 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:08.005872    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 00:04:08.018836 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:08.018813    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-568f9c9968-8779k"]
Jul 07 00:04:08.077002 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:08.076963    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjkqx\" (UniqueName: \"kubernetes.io/projected/6c281e96-9b52-43c8-95c2-2cdb8a80c9c3-kube-api-access-zjkqx\") pod \"kube-auth-proxy-568f9c9968-8779k\" (UID: \"6c281e96-9b52-43c8-95c2-2cdb8a80c9c3\") " pod="openshift-ingress/kube-auth-proxy-568f9c9968-8779k"
Jul 07 00:04:08.077002 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:08.077004    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c281e96-9b52-43c8-95c2-2cdb8a80c9c3-tmp\") pod \"kube-auth-proxy-568f9c9968-8779k\" (UID: \"6c281e96-9b52-43c8-95c2-2cdb8a80c9c3\") " pod="openshift-ingress/kube-auth-proxy-568f9c9968-8779k"
Jul 07 00:04:08.077210 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:08.077045    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c281e96-9b52-43c8-95c2-2cdb8a80c9c3-tls-certs\") pod \"kube-auth-proxy-568f9c9968-8779k\" (UID: \"6c281e96-9b52-43c8-95c2-2cdb8a80c9c3\") " pod="openshift-ingress/kube-auth-proxy-568f9c9968-8779k"
Jul 07 00:04:08.178249 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:08.178211    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c281e96-9b52-43c8-95c2-2cdb8a80c9c3-tls-certs\") pod \"kube-auth-proxy-568f9c9968-8779k\" (UID: \"6c281e96-9b52-43c8-95c2-2cdb8a80c9c3\") " pod="openshift-ingress/kube-auth-proxy-568f9c9968-8779k"
Jul 07 00:04:08.178395 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:08.178305    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjkqx\" (UniqueName: \"kubernetes.io/projected/6c281e96-9b52-43c8-95c2-2cdb8a80c9c3-kube-api-access-zjkqx\") pod \"kube-auth-proxy-568f9c9968-8779k\" (UID: \"6c281e96-9b52-43c8-95c2-2cdb8a80c9c3\") " pod="openshift-ingress/kube-auth-proxy-568f9c9968-8779k"
Jul 07 00:04:08.178395 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:08.178327    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c281e96-9b52-43c8-95c2-2cdb8a80c9c3-tmp\") pod \"kube-auth-proxy-568f9c9968-8779k\" (UID: \"6c281e96-9b52-43c8-95c2-2cdb8a80c9c3\") " pod="openshift-ingress/kube-auth-proxy-568f9c9968-8779k"
Jul 07 00:04:08.178395 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:04:08.178369    2551 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 07 00:04:08.178496 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:04:08.178436    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c281e96-9b52-43c8-95c2-2cdb8a80c9c3-tls-certs podName:6c281e96-9b52-43c8-95c2-2cdb8a80c9c3 nodeName:}" failed. No retries permitted until 2026-07-07 00:04:08.678418213 +0000 UTC m=+417.457812849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6c281e96-9b52-43c8-95c2-2cdb8a80c9c3-tls-certs") pod "kube-auth-proxy-568f9c9968-8779k" (UID: "6c281e96-9b52-43c8-95c2-2cdb8a80c9c3") : secret "kube-auth-proxy-tls" not found
Jul 07 00:04:08.180573 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:08.180553    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c281e96-9b52-43c8-95c2-2cdb8a80c9c3-tmp\") pod \"kube-auth-proxy-568f9c9968-8779k\" (UID: \"6c281e96-9b52-43c8-95c2-2cdb8a80c9c3\") " pod="openshift-ingress/kube-auth-proxy-568f9c9968-8779k"
Jul 07 00:04:08.189784 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:08.189754    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjkqx\" (UniqueName: \"kubernetes.io/projected/6c281e96-9b52-43c8-95c2-2cdb8a80c9c3-kube-api-access-zjkqx\") pod \"kube-auth-proxy-568f9c9968-8779k\" (UID: \"6c281e96-9b52-43c8-95c2-2cdb8a80c9c3\") " pod="openshift-ingress/kube-auth-proxy-568f9c9968-8779k"
Jul 07 00:04:08.684188 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:08.684148    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c281e96-9b52-43c8-95c2-2cdb8a80c9c3-tls-certs\") pod \"kube-auth-proxy-568f9c9968-8779k\" (UID: \"6c281e96-9b52-43c8-95c2-2cdb8a80c9c3\") " pod="openshift-ingress/kube-auth-proxy-568f9c9968-8779k"
Jul 07 00:04:08.686669 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:08.686642    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6c281e96-9b52-43c8-95c2-2cdb8a80c9c3-tls-certs\") pod \"kube-auth-proxy-568f9c9968-8779k\" (UID: \"6c281e96-9b52-43c8-95c2-2cdb8a80c9c3\") " pod="openshift-ingress/kube-auth-proxy-568f9c9968-8779k"
Jul 07 00:04:08.914759 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:08.914722    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-568f9c9968-8779k"
Jul 07 00:04:09.050119 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:09.050088    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-568f9c9968-8779k"]
Jul 07 00:04:09.052063 ip-10-0-133-139 kubenswrapper[2551]: W0707 00:04:09.052036    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c281e96_9b52_43c8_95c2_2cdb8a80c9c3.slice/crio-9cbb00e195862c231fb638061ee0de533a12602f80432ff76c764a7e4b8d0174 WatchSource:0}: Error finding container 9cbb00e195862c231fb638061ee0de533a12602f80432ff76c764a7e4b8d0174: Status 404 returned error can't find the container with id 9cbb00e195862c231fb638061ee0de533a12602f80432ff76c764a7e4b8d0174
Jul 07 00:04:09.605503 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:09.605470    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-568f9c9968-8779k" event={"ID":"6c281e96-9b52-43c8-95c2-2cdb8a80c9c3","Type":"ContainerStarted","Data":"9cbb00e195862c231fb638061ee0de533a12602f80432ff76c764a7e4b8d0174"}
Jul 07 00:04:11.852470 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:11.852442    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 00:04:12.622294 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:12.622264    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-568f9c9968-8779k" event={"ID":"6c281e96-9b52-43c8-95c2-2cdb8a80c9c3","Type":"ContainerStarted","Data":"03c21e2382f1cc961dde2cf5507c25ca842caaf39e8a54c28978a4f1e23574ee"}
Jul 07 00:04:12.640382 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:04:12.640330    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-568f9c9968-8779k" podStartSLOduration=2.856322467 podStartE2EDuration="5.640314956s" totalImagesPullingTime="2.783992489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:04:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:04:12.638603365 +0000 UTC m=+421.417998022" watchObservedRunningTime="2026-07-07 00:04:12.640314956 +0000 UTC m=+421.419709613"
Jul 07 00:05:54.248114 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:54.248073    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-985gm"]
Jul 07 00:05:54.251737 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:54.251714    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-985gm"
Jul 07 00:05:54.255844 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:54.255824    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 00:05:54.257029 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:54.257005    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 07 00:05:54.257029 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:54.257019    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 07 00:05:54.257201 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:54.257006    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-v659t\""
Jul 07 00:05:54.257201 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:54.257026    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 00:05:54.263981 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:54.263945    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-985gm"]
Jul 07 00:05:54.324938 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:54.324895    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ad06ca8-bef5-4391-8da6-1931e6e7428b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-985gm\" (UID: \"9ad06ca8-bef5-4391-8da6-1931e6e7428b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-985gm"
Jul 07 00:05:54.324938 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:54.324945    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9ad06ca8-bef5-4391-8da6-1931e6e7428b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-985gm\" (UID: \"9ad06ca8-bef5-4391-8da6-1931e6e7428b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-985gm"
Jul 07 00:05:54.325168 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:54.324991    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6l4s8\" (UniqueName: \"kubernetes.io/projected/9ad06ca8-bef5-4391-8da6-1931e6e7428b-kube-api-access-6l4s8\") pod \"kuadrant-console-plugin-66b5774985-985gm\" (UID: \"9ad06ca8-bef5-4391-8da6-1931e6e7428b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-985gm"
Jul 07 00:05:54.425604 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:54.425552    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6l4s8\" (UniqueName: \"kubernetes.io/projected/9ad06ca8-bef5-4391-8da6-1931e6e7428b-kube-api-access-6l4s8\") pod \"kuadrant-console-plugin-66b5774985-985gm\" (UID: \"9ad06ca8-bef5-4391-8da6-1931e6e7428b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-985gm"
Jul 07 00:05:54.425781 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:54.425641    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ad06ca8-bef5-4391-8da6-1931e6e7428b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-985gm\" (UID: \"9ad06ca8-bef5-4391-8da6-1931e6e7428b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-985gm"
Jul 07 00:05:54.425781 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:54.425670    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9ad06ca8-bef5-4391-8da6-1931e6e7428b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-985gm\" (UID: \"9ad06ca8-bef5-4391-8da6-1931e6e7428b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-985gm"
Jul 07 00:05:54.425851 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:05:54.425778    2551 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Jul 07 00:05:54.425885 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:05:54.425851    2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9ad06ca8-bef5-4391-8da6-1931e6e7428b-plugin-serving-cert podName:9ad06ca8-bef5-4391-8da6-1931e6e7428b nodeName:}" failed. No retries permitted until 2026-07-07 00:05:54.925833937 +0000 UTC m=+523.705228572 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/9ad06ca8-bef5-4391-8da6-1931e6e7428b-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-985gm" (UID: "9ad06ca8-bef5-4391-8da6-1931e6e7428b") : secret "plugin-serving-cert" not found
Jul 07 00:05:54.426245 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:54.426228    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9ad06ca8-bef5-4391-8da6-1931e6e7428b-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-985gm\" (UID: \"9ad06ca8-bef5-4391-8da6-1931e6e7428b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-985gm"
Jul 07 00:05:54.434930 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:54.434908    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6l4s8\" (UniqueName: \"kubernetes.io/projected/9ad06ca8-bef5-4391-8da6-1931e6e7428b-kube-api-access-6l4s8\") pod \"kuadrant-console-plugin-66b5774985-985gm\" (UID: \"9ad06ca8-bef5-4391-8da6-1931e6e7428b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-985gm"
Jul 07 00:05:54.931493 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:54.931454    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ad06ca8-bef5-4391-8da6-1931e6e7428b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-985gm\" (UID: \"9ad06ca8-bef5-4391-8da6-1931e6e7428b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-985gm"
Jul 07 00:05:54.933863 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:54.933833    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ad06ca8-bef5-4391-8da6-1931e6e7428b-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-985gm\" (UID: \"9ad06ca8-bef5-4391-8da6-1931e6e7428b\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-985gm"
Jul 07 00:05:55.161364 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:55.161330    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-985gm"
Jul 07 00:05:55.308600 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:55.308575    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-985gm"]
Jul 07 00:05:55.310649 ip-10-0-133-139 kubenswrapper[2551]: W0707 00:05:55.310626    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ad06ca8_bef5_4391_8da6_1931e6e7428b.slice/crio-49225499997d9ac089ab9786d08bb1d1acf546c699bc9b62da0e4bb2ae65694a WatchSource:0}: Error finding container 49225499997d9ac089ab9786d08bb1d1acf546c699bc9b62da0e4bb2ae65694a: Status 404 returned error can't find the container with id 49225499997d9ac089ab9786d08bb1d1acf546c699bc9b62da0e4bb2ae65694a
Jul 07 00:05:56.081925 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:05:56.081894    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-985gm" event={"ID":"9ad06ca8-bef5-4391-8da6-1931e6e7428b","Type":"ContainerStarted","Data":"49225499997d9ac089ab9786d08bb1d1acf546c699bc9b62da0e4bb2ae65694a"}
Jul 07 00:06:17.198740 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:06:17.198703    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-985gm" event={"ID":"9ad06ca8-bef5-4391-8da6-1931e6e7428b","Type":"ContainerStarted","Data":"d65d17a199495f0ae992affebb199032cf940854fdf12fa1e4b69be6318b5bfe"}
Jul 07 00:06:17.216531 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:06:17.216467    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-985gm" podStartSLOduration=1.779178113 podStartE2EDuration="23.216448369s" totalImagesPullingTime="21.437270256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:05:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:06:17.21492317 +0000 UTC m=+545.994317828" watchObservedRunningTime="2026-07-07 00:06:17.216448369 +0000 UTC m=+545.995843025"
Jul 07 00:06:53.244429 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:06:53.244381    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:06:53.316652 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:06:53.316610    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:06:53.316652 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:06:53.316657    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:06:53.316860 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:06:53.316730    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"
Jul 07 00:06:53.319434 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:06:53.319415    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 00:06:53.374181 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:06:53.374145    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghnhc\" (UniqueName: \"kubernetes.io/projected/89d6108f-ed8f-4d7b-8a27-504283f55272-kube-api-access-ghnhc\") pod \"limitador-limitador-54d6d988d5-mn2rf\" (UID: \"89d6108f-ed8f-4d7b-8a27-504283f55272\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"
Jul 07 00:06:53.374373 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:06:53.374240    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/89d6108f-ed8f-4d7b-8a27-504283f55272-config-file\") pod \"limitador-limitador-54d6d988d5-mn2rf\" (UID: \"89d6108f-ed8f-4d7b-8a27-504283f55272\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"
Jul 07 00:06:53.475342 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:06:53.475301    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/89d6108f-ed8f-4d7b-8a27-504283f55272-config-file\") pod \"limitador-limitador-54d6d988d5-mn2rf\" (UID: \"89d6108f-ed8f-4d7b-8a27-504283f55272\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"
Jul 07 00:06:53.475545 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:06:53.475404    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghnhc\" (UniqueName: \"kubernetes.io/projected/89d6108f-ed8f-4d7b-8a27-504283f55272-kube-api-access-ghnhc\") pod \"limitador-limitador-54d6d988d5-mn2rf\" (UID: \"89d6108f-ed8f-4d7b-8a27-504283f55272\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"
Jul 07 00:06:53.475923 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:06:53.475905    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/89d6108f-ed8f-4d7b-8a27-504283f55272-config-file\") pod \"limitador-limitador-54d6d988d5-mn2rf\" (UID: \"89d6108f-ed8f-4d7b-8a27-504283f55272\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"
Jul 07 00:06:53.483636 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:06:53.483603    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghnhc\" (UniqueName: \"kubernetes.io/projected/89d6108f-ed8f-4d7b-8a27-504283f55272-kube-api-access-ghnhc\") pod \"limitador-limitador-54d6d988d5-mn2rf\" (UID: \"89d6108f-ed8f-4d7b-8a27-504283f55272\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"
Jul 07 00:06:53.626951 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:06:53.626917    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"
Jul 07 00:06:53.758123 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:06:53.758054    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:06:53.760486 ip-10-0-133-139 kubenswrapper[2551]: W0707 00:06:53.760448    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89d6108f_ed8f_4d7b_8a27_504283f55272.slice/crio-88505b574d1f91241b6195669c85bad1855412c58fdcad0adff600e19e3077a2 WatchSource:0}: Error finding container 88505b574d1f91241b6195669c85bad1855412c58fdcad0adff600e19e3077a2: Status 404 returned error can't find the container with id 88505b574d1f91241b6195669c85bad1855412c58fdcad0adff600e19e3077a2
Jul 07 00:06:54.386580 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:06:54.386476    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mn2rf" event={"ID":"89d6108f-ed8f-4d7b-8a27-504283f55272","Type":"ContainerStarted","Data":"88505b574d1f91241b6195669c85bad1855412c58fdcad0adff600e19e3077a2"}
Jul 07 00:06:56.399148 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:06:56.399112    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mn2rf" event={"ID":"89d6108f-ed8f-4d7b-8a27-504283f55272","Type":"ContainerStarted","Data":"c342e16ef95d194549908fac62bb7de58020c700453e678f6e6700e19deddc34"}
Jul 07 00:06:56.399640 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:06:56.399221    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"
Jul 07 00:06:56.420401 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:06:56.420354    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-mn2rf" podStartSLOduration=0.97798463 podStartE2EDuration="3.420338093s" totalImagesPullingTime="2.442353463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:06:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:06:56.417938982 +0000 UTC m=+585.197333634" watchObservedRunningTime="2026-07-07 00:06:56.420338093 +0000 UTC m=+585.199732815"
Jul 07 00:07:07.404565 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:07.404534    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"
Jul 07 00:07:23.766549 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:23.766502    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2nbjz"]
Jul 07 00:07:23.770056 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:23.770035    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2nbjz"
Jul 07 00:07:23.773184 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:23.773160    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hw4v9\""
Jul 07 00:07:23.774902 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:23.774868    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2nbjz"]
Jul 07 00:07:23.847005 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:23.846964    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rckcv\" (UniqueName: \"kubernetes.io/projected/dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0-kube-api-access-rckcv\") pod \"authorino-5d4b67c446-2nbjz\" (UID: \"dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0\") " pod="kuadrant-system/authorino-5d4b67c446-2nbjz"
Jul 07 00:07:23.947530 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:23.947478    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rckcv\" (UniqueName: \"kubernetes.io/projected/dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0-kube-api-access-rckcv\") pod \"authorino-5d4b67c446-2nbjz\" (UID: \"dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0\") " pod="kuadrant-system/authorino-5d4b67c446-2nbjz"
Jul 07 00:07:23.957989 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:23.957954    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rckcv\" (UniqueName: \"kubernetes.io/projected/dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0-kube-api-access-rckcv\") pod \"authorino-5d4b67c446-2nbjz\" (UID: \"dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0\") " pod="kuadrant-system/authorino-5d4b67c446-2nbjz"
Jul 07 00:07:24.012902 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:24.012869    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2nbjz"]
Jul 07 00:07:24.013148 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:24.013135    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2nbjz"
Jul 07 00:07:24.146176 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:24.146097    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2nbjz"]
Jul 07 00:07:24.148935 ip-10-0-133-139 kubenswrapper[2551]: W0707 00:07:24.148897    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddfe97c41_c1f5_4b42_b97d_0c3e1d4878f0.slice/crio-0c3ec560a4398320879df848b943fb291bdfa78e5b04beeda6ba3eade7a1f6b9 WatchSource:0}: Error finding container 0c3ec560a4398320879df848b943fb291bdfa78e5b04beeda6ba3eade7a1f6b9: Status 404 returned error can't find the container with id 0c3ec560a4398320879df848b943fb291bdfa78e5b04beeda6ba3eade7a1f6b9
Jul 07 00:07:24.528905 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:24.528867    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2nbjz" event={"ID":"dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0","Type":"ContainerStarted","Data":"0c3ec560a4398320879df848b943fb291bdfa78e5b04beeda6ba3eade7a1f6b9"}
Jul 07 00:07:27.546453 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:27.546358    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2nbjz" event={"ID":"dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0","Type":"ContainerStarted","Data":"71e9f077dd7f612c0ac896a558ae19220913e612207580a85c07c564a60e52c0"}
Jul 07 00:07:27.546453 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:27.546382    2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-2nbjz" podUID="dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0" containerName="authorino" containerID="cri-o://71e9f077dd7f612c0ac896a558ae19220913e612207580a85c07c564a60e52c0" gracePeriod=30
Jul 07 00:07:27.563966 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:27.563913    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-2nbjz" podStartSLOduration=1.557202512 podStartE2EDuration="4.563897766s" totalImagesPullingTime="3.006695254s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:07:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:07:27.562064946 +0000 UTC m=+616.341459605" watchObservedRunningTime="2026-07-07 00:07:27.563897766 +0000 UTC m=+616.343292423"
Jul 07 00:07:27.796669 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:27.796617    2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2nbjz"
Jul 07 00:07:27.884016 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:27.883977    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rckcv\" (UniqueName: \"kubernetes.io/projected/dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0-kube-api-access-rckcv\") pod \"dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0\" (UID: \"dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0\") "
Jul 07 00:07:27.886170 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:27.886142    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0-kube-api-access-rckcv" (OuterVolumeSpecName: "kube-api-access-rckcv") pod "dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0" (UID: "dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0"). InnerVolumeSpecName "kube-api-access-rckcv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:07:27.985707 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:27.985675    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rckcv\" (UniqueName: \"kubernetes.io/projected/dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0-kube-api-access-rckcv\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:07:28.552128 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:28.552087    2551 generic.go:356] "Generic (PLEG): container finished" podID="dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0" containerID="71e9f077dd7f612c0ac896a558ae19220913e612207580a85c07c564a60e52c0" exitCode=0
Jul 07 00:07:28.552573 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:28.552149    2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-2nbjz"
Jul 07 00:07:28.552573 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:28.552172    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2nbjz" event={"ID":"dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0","Type":"ContainerDied","Data":"71e9f077dd7f612c0ac896a558ae19220913e612207580a85c07c564a60e52c0"}
Jul 07 00:07:28.552573 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:28.552220    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-2nbjz" event={"ID":"dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0","Type":"ContainerDied","Data":"0c3ec560a4398320879df848b943fb291bdfa78e5b04beeda6ba3eade7a1f6b9"}
Jul 07 00:07:28.552573 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:28.552239    2551 scope.go:117] "RemoveContainer" containerID="71e9f077dd7f612c0ac896a558ae19220913e612207580a85c07c564a60e52c0"
Jul 07 00:07:28.561289 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:28.561267    2551 scope.go:117] "RemoveContainer" containerID="71e9f077dd7f612c0ac896a558ae19220913e612207580a85c07c564a60e52c0"
Jul 07 00:07:28.561594 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:07:28.561569    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71e9f077dd7f612c0ac896a558ae19220913e612207580a85c07c564a60e52c0\": container with ID starting with 71e9f077dd7f612c0ac896a558ae19220913e612207580a85c07c564a60e52c0 not found: ID does not exist" containerID="71e9f077dd7f612c0ac896a558ae19220913e612207580a85c07c564a60e52c0"
Jul 07 00:07:28.561671 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:28.561606    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71e9f077dd7f612c0ac896a558ae19220913e612207580a85c07c564a60e52c0"} err="failed to get container status \"71e9f077dd7f612c0ac896a558ae19220913e612207580a85c07c564a60e52c0\": rpc error: code = NotFound desc = could not find container \"71e9f077dd7f612c0ac896a558ae19220913e612207580a85c07c564a60e52c0\": container with ID starting with 71e9f077dd7f612c0ac896a558ae19220913e612207580a85c07c564a60e52c0 not found: ID does not exist"
Jul 07 00:07:28.572896 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:28.572867    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2nbjz"]
Jul 07 00:07:28.574630 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:28.574611    2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-2nbjz"]
Jul 07 00:07:29.694132 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:07:29.694098    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0" path="/var/lib/kubelet/pods/dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0/volumes"
Jul 07 00:08:02.538731 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:02.538689    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:08:30.899087 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:30.899046    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:08:45.792751 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:45.792712    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:08:53.381082 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.381050    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"]
Jul 07 00:08:53.381474 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.381406    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0" containerName="authorino"
Jul 07 00:08:53.381474 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.381417    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0" containerName="authorino"
Jul 07 00:08:53.381605 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.381490    2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="dfe97c41-c1f5-4b42-b97d-0c3e1d4878f0" containerName="authorino"
Jul 07 00:08:53.384654 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.384638    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:08:53.388578 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.388555    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-kvp5g\""
Jul 07 00:08:53.388715 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.388562    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 00:08:53.388715 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.388607    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 07 00:08:53.388715 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.388688    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 00:08:53.394718 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.394695    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"]
Jul 07 00:08:53.445074 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.445037    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l5ft\" (UniqueName: \"kubernetes.io/projected/7c7864c3-0a97-40bd-b60b-ec312cd68053-kube-api-access-9l5ft\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gph59\" (UID: \"7c7864c3-0a97-40bd-b60b-ec312cd68053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:08:53.445268 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.445095    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c7864c3-0a97-40bd-b60b-ec312cd68053-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gph59\" (UID: \"7c7864c3-0a97-40bd-b60b-ec312cd68053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:08:53.445268 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.445139    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c7864c3-0a97-40bd-b60b-ec312cd68053-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gph59\" (UID: \"7c7864c3-0a97-40bd-b60b-ec312cd68053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:08:53.445268 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.445184    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c7864c3-0a97-40bd-b60b-ec312cd68053-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gph59\" (UID: \"7c7864c3-0a97-40bd-b60b-ec312cd68053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:08:53.445268 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.445252    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c7864c3-0a97-40bd-b60b-ec312cd68053-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gph59\" (UID: \"7c7864c3-0a97-40bd-b60b-ec312cd68053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:08:53.445418 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.445282    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c7864c3-0a97-40bd-b60b-ec312cd68053-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gph59\" (UID: \"7c7864c3-0a97-40bd-b60b-ec312cd68053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:08:53.545842 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.545800    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c7864c3-0a97-40bd-b60b-ec312cd68053-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gph59\" (UID: \"7c7864c3-0a97-40bd-b60b-ec312cd68053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:08:53.545842 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.545847    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c7864c3-0a97-40bd-b60b-ec312cd68053-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gph59\" (UID: \"7c7864c3-0a97-40bd-b60b-ec312cd68053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:08:53.546100 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.545893    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l5ft\" (UniqueName: \"kubernetes.io/projected/7c7864c3-0a97-40bd-b60b-ec312cd68053-kube-api-access-9l5ft\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gph59\" (UID: \"7c7864c3-0a97-40bd-b60b-ec312cd68053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:08:53.546100 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.545937    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c7864c3-0a97-40bd-b60b-ec312cd68053-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gph59\" (UID: \"7c7864c3-0a97-40bd-b60b-ec312cd68053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:08:53.546100 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.546074    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c7864c3-0a97-40bd-b60b-ec312cd68053-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gph59\" (UID: \"7c7864c3-0a97-40bd-b60b-ec312cd68053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:08:53.546258 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.546128    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c7864c3-0a97-40bd-b60b-ec312cd68053-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gph59\" (UID: \"7c7864c3-0a97-40bd-b60b-ec312cd68053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:08:53.546258 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.546214    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7c7864c3-0a97-40bd-b60b-ec312cd68053-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gph59\" (UID: \"7c7864c3-0a97-40bd-b60b-ec312cd68053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:08:53.546364 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.546330    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7c7864c3-0a97-40bd-b60b-ec312cd68053-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gph59\" (UID: \"7c7864c3-0a97-40bd-b60b-ec312cd68053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:08:53.546364 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.546352    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7c7864c3-0a97-40bd-b60b-ec312cd68053-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gph59\" (UID: \"7c7864c3-0a97-40bd-b60b-ec312cd68053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:08:53.548206 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.548188    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7c7864c3-0a97-40bd-b60b-ec312cd68053-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gph59\" (UID: \"7c7864c3-0a97-40bd-b60b-ec312cd68053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:08:53.548387 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.548372    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7c7864c3-0a97-40bd-b60b-ec312cd68053-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gph59\" (UID: \"7c7864c3-0a97-40bd-b60b-ec312cd68053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:08:53.553503 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.553486    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l5ft\" (UniqueName: \"kubernetes.io/projected/7c7864c3-0a97-40bd-b60b-ec312cd68053-kube-api-access-9l5ft\") pod \"e2e-trlp-test-simulated-kserve-598466548d-gph59\" (UID: \"7c7864c3-0a97-40bd-b60b-ec312cd68053\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:08:53.695041 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.694962    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:08:53.823996 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.823963    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"]
Jul 07 00:08:53.826911 ip-10-0-133-139 kubenswrapper[2551]: W0707 00:08:53.826873    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c7864c3_0a97_40bd_b60b_ec312cd68053.slice/crio-0a1d40a459898ee124a8651ad09bbf29de4942abe3719a94044f14be9731cb9e WatchSource:0}: Error finding container 0a1d40a459898ee124a8651ad09bbf29de4942abe3719a94044f14be9731cb9e: Status 404 returned error can't find the container with id 0a1d40a459898ee124a8651ad09bbf29de4942abe3719a94044f14be9731cb9e
Jul 07 00:08:53.828365 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.828346    2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 00:08:53.953503 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:53.953423    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59" event={"ID":"7c7864c3-0a97-40bd-b60b-ec312cd68053","Type":"ContainerStarted","Data":"0a1d40a459898ee124a8651ad09bbf29de4942abe3719a94044f14be9731cb9e"}
Jul 07 00:08:54.684633 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:54.684600    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:08:54.959500 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:54.959419    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59" event={"ID":"7c7864c3-0a97-40bd-b60b-ec312cd68053","Type":"ContainerStarted","Data":"ba884ba8e33ee8896ff301d6bea24496f266e3fc5f2196c7a7a2f422af2ffa94"}
Jul 07 00:08:54.991980 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:08:54.991926    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59" podStartSLOduration=0.962083502 podStartE2EDuration="1.991910544s" totalImagesPullingTime="1.029827042s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:08:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:08:54.989491668 +0000 UTC m=+703.768886316" watchObservedRunningTime="2026-07-07 00:08:54.991910544 +0000 UTC m=+703.771305198"
Jul 07 00:09:03.695232 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:03.695161    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:09:03.695232 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:03.695209    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:09:03.707719 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:03.707694    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:09:04.012478 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:04.012398    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-gph59"
Jul 07 00:09:05.085625 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:05.085594    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:09:12.302388 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:12.302352    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:09:29.179952 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.179920    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"]
Jul 07 00:09:29.186341 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.186321    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:29.189201 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.189173    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 07 00:09:29.194481 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.194456    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"]
Jul 07 00:09:29.277611 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.277579    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cecaabf-afa5-4ec4-9ca2-366f2b19d32f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh\" (UID: \"4cecaabf-afa5-4ec4-9ca2-366f2b19d32f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:29.277611 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.277616    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cecaabf-afa5-4ec4-9ca2-366f2b19d32f-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh\" (UID: \"4cecaabf-afa5-4ec4-9ca2-366f2b19d32f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:29.277814 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.277641    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cecaabf-afa5-4ec4-9ca2-366f2b19d32f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh\" (UID: \"4cecaabf-afa5-4ec4-9ca2-366f2b19d32f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:29.277814 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.277706    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cecaabf-afa5-4ec4-9ca2-366f2b19d32f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh\" (UID: \"4cecaabf-afa5-4ec4-9ca2-366f2b19d32f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:29.277814 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.277751    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cecaabf-afa5-4ec4-9ca2-366f2b19d32f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh\" (UID: \"4cecaabf-afa5-4ec4-9ca2-366f2b19d32f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:29.277814 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.277788    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncr7l\" (UniqueName: \"kubernetes.io/projected/4cecaabf-afa5-4ec4-9ca2-366f2b19d32f-kube-api-access-ncr7l\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh\" (UID: \"4cecaabf-afa5-4ec4-9ca2-366f2b19d32f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:29.379085 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.379043    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cecaabf-afa5-4ec4-9ca2-366f2b19d32f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh\" (UID: \"4cecaabf-afa5-4ec4-9ca2-366f2b19d32f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:29.379085 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.379100    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cecaabf-afa5-4ec4-9ca2-366f2b19d32f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh\" (UID: \"4cecaabf-afa5-4ec4-9ca2-366f2b19d32f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:29.379320 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.379130    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncr7l\" (UniqueName: \"kubernetes.io/projected/4cecaabf-afa5-4ec4-9ca2-366f2b19d32f-kube-api-access-ncr7l\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh\" (UID: \"4cecaabf-afa5-4ec4-9ca2-366f2b19d32f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:29.379320 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.379165    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cecaabf-afa5-4ec4-9ca2-366f2b19d32f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh\" (UID: \"4cecaabf-afa5-4ec4-9ca2-366f2b19d32f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:29.379320 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.379188    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cecaabf-afa5-4ec4-9ca2-366f2b19d32f-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh\" (UID: \"4cecaabf-afa5-4ec4-9ca2-366f2b19d32f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:29.379320 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.379217    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cecaabf-afa5-4ec4-9ca2-366f2b19d32f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh\" (UID: \"4cecaabf-afa5-4ec4-9ca2-366f2b19d32f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:29.379552 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.379531    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4cecaabf-afa5-4ec4-9ca2-366f2b19d32f-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh\" (UID: \"4cecaabf-afa5-4ec4-9ca2-366f2b19d32f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:29.379618 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.379587    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4cecaabf-afa5-4ec4-9ca2-366f2b19d32f-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh\" (UID: \"4cecaabf-afa5-4ec4-9ca2-366f2b19d32f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:29.379674 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.379643    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4cecaabf-afa5-4ec4-9ca2-366f2b19d32f-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh\" (UID: \"4cecaabf-afa5-4ec4-9ca2-366f2b19d32f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:29.381376 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.381356    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4cecaabf-afa5-4ec4-9ca2-366f2b19d32f-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh\" (UID: \"4cecaabf-afa5-4ec4-9ca2-366f2b19d32f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:29.381664 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.381644    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4cecaabf-afa5-4ec4-9ca2-366f2b19d32f-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh\" (UID: \"4cecaabf-afa5-4ec4-9ca2-366f2b19d32f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:29.387271 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.387250    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncr7l\" (UniqueName: \"kubernetes.io/projected/4cecaabf-afa5-4ec4-9ca2-366f2b19d32f-kube-api-access-ncr7l\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh\" (UID: \"4cecaabf-afa5-4ec4-9ca2-366f2b19d32f\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:29.495585 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.495495    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:29.621966 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:29.621890    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"]
Jul 07 00:09:29.624253 ip-10-0-133-139 kubenswrapper[2551]: W0707 00:09:29.624227    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4cecaabf_afa5_4ec4_9ca2_366f2b19d32f.slice/crio-bd85f8985d0481c650dcbe30c066a93b6ce08bec9e9505fcaeff35196c93d1b1 WatchSource:0}: Error finding container bd85f8985d0481c650dcbe30c066a93b6ce08bec9e9505fcaeff35196c93d1b1: Status 404 returned error can't find the container with id bd85f8985d0481c650dcbe30c066a93b6ce08bec9e9505fcaeff35196c93d1b1
Jul 07 00:09:30.126793 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:30.126759    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh" event={"ID":"4cecaabf-afa5-4ec4-9ca2-366f2b19d32f","Type":"ContainerStarted","Data":"bd85032eb07cc52b818eff6ee7aa32dad3ba1ba4ab0636b3f8183f299de80422"}
Jul 07 00:09:30.126793 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:30.126799    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh" event={"ID":"4cecaabf-afa5-4ec4-9ca2-366f2b19d32f","Type":"ContainerStarted","Data":"bd85f8985d0481c650dcbe30c066a93b6ce08bec9e9505fcaeff35196c93d1b1"}
Jul 07 00:09:30.145036 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:30.144989    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh" podStartSLOduration=0.952198983 podStartE2EDuration="1.144974513s" totalImagesPullingTime="192.77553ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:09:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:09:30.143745808 +0000 UTC m=+738.923140479" watchObservedRunningTime="2026-07-07 00:09:30.144974513 +0000 UTC m=+738.924369169"
Jul 07 00:09:31.789667 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:31.789640    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:09:39.495866 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:39.495832    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:39.496318 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:39.496030    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:39.508143 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:39.508112    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:09:40.185421 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:09:40.185393    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh"
Jul 07 00:10:26.147810 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:10:26.147777    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-66f4c4b6b-p62fz"]
Jul 07 00:10:26.151212 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:10:26.151196    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66f4c4b6b-p62fz"
Jul 07 00:10:26.153969 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:10:26.153948    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hw4v9\""
Jul 07 00:10:26.155078 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:10:26.155062    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 07 00:10:26.159358 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:10:26.159333    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66f4c4b6b-p62fz"]
Jul 07 00:10:26.214156 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:10:26.214116    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/61bcf6d1-9ae7-496d-9415-a25b10317f10-tls-cert\") pod \"authorino-66f4c4b6b-p62fz\" (UID: \"61bcf6d1-9ae7-496d-9415-a25b10317f10\") " pod="kuadrant-system/authorino-66f4c4b6b-p62fz"
Jul 07 00:10:26.214156 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:10:26.214161    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4llxb\" (UniqueName: \"kubernetes.io/projected/61bcf6d1-9ae7-496d-9415-a25b10317f10-kube-api-access-4llxb\") pod \"authorino-66f4c4b6b-p62fz\" (UID: \"61bcf6d1-9ae7-496d-9415-a25b10317f10\") " pod="kuadrant-system/authorino-66f4c4b6b-p62fz"
Jul 07 00:10:26.314892 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:10:26.314852    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/61bcf6d1-9ae7-496d-9415-a25b10317f10-tls-cert\") pod \"authorino-66f4c4b6b-p62fz\" (UID: \"61bcf6d1-9ae7-496d-9415-a25b10317f10\") " pod="kuadrant-system/authorino-66f4c4b6b-p62fz"
Jul 07 00:10:26.314892 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:10:26.314898    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4llxb\" (UniqueName: \"kubernetes.io/projected/61bcf6d1-9ae7-496d-9415-a25b10317f10-kube-api-access-4llxb\") pod \"authorino-66f4c4b6b-p62fz\" (UID: \"61bcf6d1-9ae7-496d-9415-a25b10317f10\") " pod="kuadrant-system/authorino-66f4c4b6b-p62fz"
Jul 07 00:10:26.317319 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:10:26.317293    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/61bcf6d1-9ae7-496d-9415-a25b10317f10-tls-cert\") pod \"authorino-66f4c4b6b-p62fz\" (UID: \"61bcf6d1-9ae7-496d-9415-a25b10317f10\") " pod="kuadrant-system/authorino-66f4c4b6b-p62fz"
Jul 07 00:10:26.322716 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:10:26.322695    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4llxb\" (UniqueName: \"kubernetes.io/projected/61bcf6d1-9ae7-496d-9415-a25b10317f10-kube-api-access-4llxb\") pod \"authorino-66f4c4b6b-p62fz\" (UID: \"61bcf6d1-9ae7-496d-9415-a25b10317f10\") " pod="kuadrant-system/authorino-66f4c4b6b-p62fz"
Jul 07 00:10:26.460774 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:10:26.460676    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-66f4c4b6b-p62fz"
Jul 07 00:10:26.594386 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:10:26.594361    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-66f4c4b6b-p62fz"]
Jul 07 00:10:26.596147 ip-10-0-133-139 kubenswrapper[2551]: W0707 00:10:26.596121    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61bcf6d1_9ae7_496d_9415_a25b10317f10.slice/crio-f2463acf4b17cb9c143da144598cd47a742ace3ae674f45eda7eee4b5ffefaf8 WatchSource:0}: Error finding container f2463acf4b17cb9c143da144598cd47a742ace3ae674f45eda7eee4b5ffefaf8: Status 404 returned error can't find the container with id f2463acf4b17cb9c143da144598cd47a742ace3ae674f45eda7eee4b5ffefaf8
Jul 07 00:10:27.401386 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:10:27.401349    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66f4c4b6b-p62fz" event={"ID":"61bcf6d1-9ae7-496d-9415-a25b10317f10","Type":"ContainerStarted","Data":"2abdb2d85979e3e6974a3bec0f35396612a730044b24599ab93d2e4f3839c7ee"}
Jul 07 00:10:27.401386 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:10:27.401391    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-66f4c4b6b-p62fz" event={"ID":"61bcf6d1-9ae7-496d-9415-a25b10317f10","Type":"ContainerStarted","Data":"f2463acf4b17cb9c143da144598cd47a742ace3ae674f45eda7eee4b5ffefaf8"}
Jul 07 00:10:27.421609 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:10:27.421555    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-66f4c4b6b-p62fz" podStartSLOduration=1.052101086 podStartE2EDuration="1.421532075s" totalImagesPullingTime="369.430989ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:10:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:10:27.420065163 +0000 UTC m=+796.199459820" watchObservedRunningTime="2026-07-07 00:10:27.421532075 +0000 UTC m=+796.200926735"
Jul 07 00:10:56.692377 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:10:56.692340    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:11:06.683336 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:11:06.683295    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:11:18.281120 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:11:18.281083    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:11:26.681678 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:11:26.681637    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:11:37.184406 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:11:37.184369    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:12:03.296942 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:12:03.296865    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:12:15.694771 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:12:15.694741    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:12:50.986060 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:12:50.986019    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:13:00.486015 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:13:00.485981    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:13:08.691682 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:13:08.691649    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:13:18.182242 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:13:18.182208    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:13:28.084072 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:13:28.084042    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:13:38.202750 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:13:38.202660    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:13:50.490231 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:13:50.490196    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:13:59.887052 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:13:59.887014    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:14:22.087626 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:14:22.087594    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:14:34.389776 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:14:34.389742    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:14:56.985536 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:14:56.985494    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:15:08.986412 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:15:08.986329    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:15:23.894254 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:15:23.894217    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:15:32.788049 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:15:32.788014    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:15:45.086208 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:15:45.086165    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:15:54.191478 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:15:54.191442    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:16:03.187011 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:16:03.186972    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:17:49.984370 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:17:49.984324    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:18:01.592443 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:18:01.592402    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:18:10.084021 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:18:10.083980    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:18:19.083061 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:18:19.083024    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:18:27.694756 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:18:27.694724    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:18:36.983570 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:18:36.983529    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:18:48.185793 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:18:48.185762    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:18:58.437545 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:18:58.437500    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:19:08.390638 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:19:08.390604    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:19:20.283840 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:19:20.283805    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:19:30.188768 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:19:30.188736    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:19:37.592630 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:19:37.592542    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:19:56.894073 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:19:56.894037    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:20:06.404106 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:20:06.404069    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:20:15.694712 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:20:15.694681    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:20:27.397618 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:20:27.397560    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:20:34.988547 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:20:34.988492    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:20:46.897671 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:20:46.897635    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:20:57.585589 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:20:57.585555    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:21:06.395337 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:21:06.395259    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:21:16.393683 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:21:16.393648    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:21:24.891989 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:21:24.891952    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:21:35.584905 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:21:35.584871    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:21:49.090165 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:21:49.090124    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:21:58.187230 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:21:58.187193    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:22:07.288242 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:22:07.288205    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:22:18.429467 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:22:18.429418    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:22:30.691747 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:22:30.691710    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:22:38.093393 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:22:38.093314    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:22:47.021385 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:22:47.021347    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:23:02.310944 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:23:02.310905    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:23:15.082307 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:23:15.082269    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:23:27.699299 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:23:27.699266    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:23:37.996632 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:23:37.996599    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:23:47.092910 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:23:47.092873    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:24:05.184782 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:24:05.184750    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:24:16.294583 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:24:16.294548    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:24:23.080785 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:24:23.080749    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:24:35.083256 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:24:35.083209    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:25:53.485168 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:25:53.485126    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:26:00.789766 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:26:00.789732    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:26:09.684642 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:26:09.684608    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:26:20.693391 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:26:20.693358    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:26:29.089961 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:26:29.089926    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:26:57.384618 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:26:57.384580    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:27:18.191002 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:27:18.190968    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:27:36.192918 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:27:36.192881    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:27:48.791769 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:27:48.791735    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:28:24.588616 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:28:24.588579    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:28:37.504436 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:28:37.504358    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:28:51.594815 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:28:51.594774    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:29:40.284731 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:29:40.284697    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:29:54.392459 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:29:54.392428    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:30:00.135134 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:00.135098    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9"]
Jul 07 00:30:00.138666 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:00.138649    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9"
Jul 07 00:30:00.144747 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:00.144722    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29723070-7s2z7"]
Jul 07 00:30:00.145707 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:00.145653    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lq9jt\""
Jul 07 00:30:00.145784 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:00.145705    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 07 00:30:00.146922 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:00.146903    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 07 00:30:00.148203 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:00.148189    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29723070-7s2z7"
Jul 07 00:30:00.154290 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:00.154258    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9"]
Jul 07 00:30:00.167534 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:00.167483    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29723070-7s2z7"]
Jul 07 00:30:00.307529 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:00.307470    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6scb\" (UniqueName: \"kubernetes.io/projected/51a52d91-943f-4d43-8c2b-2934777d4531-kube-api-access-g6scb\") pod \"maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9\" (UID: \"51a52d91-943f-4d43-8c2b-2934777d4531\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9"
Jul 07 00:30:00.307736 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:00.307579    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-59sfb\" (UniqueName: \"kubernetes.io/projected/16dfc8da-6c00-4002-8d44-a4bcfd8a7b98-kube-api-access-59sfb\") pod \"maas-api-key-cleanup-29723070-7s2z7\" (UID: \"16dfc8da-6c00-4002-8d44-a4bcfd8a7b98\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29723070-7s2z7"
Jul 07 00:30:00.408665 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:00.408558    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6scb\" (UniqueName: \"kubernetes.io/projected/51a52d91-943f-4d43-8c2b-2934777d4531-kube-api-access-g6scb\") pod \"maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9\" (UID: \"51a52d91-943f-4d43-8c2b-2934777d4531\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9"
Jul 07 00:30:00.408665 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:00.408613    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-59sfb\" (UniqueName: \"kubernetes.io/projected/16dfc8da-6c00-4002-8d44-a4bcfd8a7b98-kube-api-access-59sfb\") pod \"maas-api-key-cleanup-29723070-7s2z7\" (UID: \"16dfc8da-6c00-4002-8d44-a4bcfd8a7b98\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29723070-7s2z7"
Jul 07 00:30:00.418082 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:00.418053    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6scb\" (UniqueName: \"kubernetes.io/projected/51a52d91-943f-4d43-8c2b-2934777d4531-kube-api-access-g6scb\") pod \"maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9\" (UID: \"51a52d91-943f-4d43-8c2b-2934777d4531\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9"
Jul 07 00:30:00.418082 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:00.418074    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-59sfb\" (UniqueName: \"kubernetes.io/projected/16dfc8da-6c00-4002-8d44-a4bcfd8a7b98-kube-api-access-59sfb\") pod \"maas-api-key-cleanup-29723070-7s2z7\" (UID: \"16dfc8da-6c00-4002-8d44-a4bcfd8a7b98\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29723070-7s2z7"
Jul 07 00:30:00.449600 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:00.449569    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9"
Jul 07 00:30:00.458800 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:00.458778    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29723070-7s2z7"
Jul 07 00:30:00.600186 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:00.600160    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9"]
Jul 07 00:30:00.602149 ip-10-0-133-139 kubenswrapper[2551]: W0707 00:30:00.602122    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51a52d91_943f_4d43_8c2b_2934777d4531.slice/crio-eda1ddf62b2785efa8e14429020ba6fee4e4ef3cb163443773076303c3ff46e4 WatchSource:0}: Error finding container eda1ddf62b2785efa8e14429020ba6fee4e4ef3cb163443773076303c3ff46e4: Status 404 returned error can't find the container with id eda1ddf62b2785efa8e14429020ba6fee4e4ef3cb163443773076303c3ff46e4
Jul 07 00:30:00.604233 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:00.604211    2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 00:30:00.625499 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:00.625476    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29723070-7s2z7"]
Jul 07 00:30:00.627566 ip-10-0-133-139 kubenswrapper[2551]: W0707 00:30:00.627540    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16dfc8da_6c00_4002_8d44_a4bcfd8a7b98.slice/crio-878bfb7f89ea5c9ca2d1d7383aed4557e3cfcd3b61f71d18f1d4c1a94d0c3a3e WatchSource:0}: Error finding container 878bfb7f89ea5c9ca2d1d7383aed4557e3cfcd3b61f71d18f1d4c1a94d0c3a3e: Status 404 returned error can't find the container with id 878bfb7f89ea5c9ca2d1d7383aed4557e3cfcd3b61f71d18f1d4c1a94d0c3a3e
Jul 07 00:30:01.045134 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:01.045087    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9" event={"ID":"51a52d91-943f-4d43-8c2b-2934777d4531","Type":"ContainerStarted","Data":"eda1ddf62b2785efa8e14429020ba6fee4e4ef3cb163443773076303c3ff46e4"}
Jul 07 00:30:01.046240 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:01.046216    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29723070-7s2z7" event={"ID":"16dfc8da-6c00-4002-8d44-a4bcfd8a7b98","Type":"ContainerStarted","Data":"878bfb7f89ea5c9ca2d1d7383aed4557e3cfcd3b61f71d18f1d4c1a94d0c3a3e"}
Jul 07 00:30:04.062523 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:04.062463    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9" event={"ID":"51a52d91-943f-4d43-8c2b-2934777d4531","Type":"ContainerStarted","Data":"eb9e01491fa35677e747fc9dd5d02e8553377035796fc6d27e078a56dbb2d234"}
Jul 07 00:30:04.063909 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:04.063881    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29723070-7s2z7" event={"ID":"16dfc8da-6c00-4002-8d44-a4bcfd8a7b98","Type":"ContainerStarted","Data":"f53b0877a46dabde4085e22b298f9f4f094b13f9e4a5e52c0fe19376cd6a9555"}
Jul 07 00:30:04.080027 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:04.079985    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9" podStartSLOduration=1.877130042 podStartE2EDuration="4.079971037s" totalImagesPullingTime="2.202840995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:30:04.078644076 +0000 UTC m=+1972.858038747" watchObservedRunningTime="2026-07-07 00:30:04.079971037 +0000 UTC m=+1972.859365693"
Jul 07 00:30:04.094992 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:04.094944    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29723070-7s2z7" podStartSLOduration=1.916347265 podStartE2EDuration="4.094927597s" totalImagesPullingTime="2.178580332s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:30:04.093820299 +0000 UTC m=+1972.873214951" watchObservedRunningTime="2026-07-07 00:30:04.094927597 +0000 UTC m=+1972.874322254"
Jul 07 00:30:19.086176 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:19.086140    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:30:49.391801 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.391759    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"]
Jul 07 00:30:49.395418 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.395397    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:49.399386 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.399357    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-dd30cd\"/\"kube-root-ca.crt\""
Jul 07 00:30:49.399541 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.399393    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-dd30cd\"/\"openshift-service-ca.crt\""
Jul 07 00:30:49.399541 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.399443    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-dd30cd\"/\"test-model-dd30cd-kserve-self-signed-certs\""
Jul 07 00:30:49.399541 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.399530    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-dd30cd\"/\"default-dockercfg-l4wnd\""
Jul 07 00:30:49.412852 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.412826    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"]
Jul 07 00:30:49.456064 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.456030    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-tmp-dir\") pod \"test-model-dd30cd-kserve-77d796cbf-cvrwg\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") " pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:49.456236 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.456081    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-dshm\") pod \"test-model-dd30cd-kserve-77d796cbf-cvrwg\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") " pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:49.456236 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.456127    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-home\") pod \"test-model-dd30cd-kserve-77d796cbf-cvrwg\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") " pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:49.456236 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.456190    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8342f0c7-e254-416a-8a67-b2a346953f05-tls-certs\") pod \"test-model-dd30cd-kserve-77d796cbf-cvrwg\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") " pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:49.456236 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.456228    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-model-cache\") pod \"test-model-dd30cd-kserve-77d796cbf-cvrwg\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") " pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:49.456400 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.456258    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5frb\" (UniqueName: \"kubernetes.io/projected/8342f0c7-e254-416a-8a67-b2a346953f05-kube-api-access-f5frb\") pod \"test-model-dd30cd-kserve-77d796cbf-cvrwg\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") " pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:49.556677 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.556643    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-dshm\") pod \"test-model-dd30cd-kserve-77d796cbf-cvrwg\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") " pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:49.556677 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.556679    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-home\") pod \"test-model-dd30cd-kserve-77d796cbf-cvrwg\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") " pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:49.556942 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.556705    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8342f0c7-e254-416a-8a67-b2a346953f05-tls-certs\") pod \"test-model-dd30cd-kserve-77d796cbf-cvrwg\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") " pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:49.556942 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.556748    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-model-cache\") pod \"test-model-dd30cd-kserve-77d796cbf-cvrwg\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") " pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:49.556942 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.556786    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5frb\" (UniqueName: \"kubernetes.io/projected/8342f0c7-e254-416a-8a67-b2a346953f05-kube-api-access-f5frb\") pod \"test-model-dd30cd-kserve-77d796cbf-cvrwg\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") " pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:49.556942 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.556846    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-tmp-dir\") pod \"test-model-dd30cd-kserve-77d796cbf-cvrwg\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") " pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:49.557211 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.557162    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-home\") pod \"test-model-dd30cd-kserve-77d796cbf-cvrwg\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") " pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:49.557283 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.557210    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-model-cache\") pod \"test-model-dd30cd-kserve-77d796cbf-cvrwg\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") " pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:49.557283 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.557259    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-tmp-dir\") pod \"test-model-dd30cd-kserve-77d796cbf-cvrwg\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") " pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:49.559062 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.559038    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-dshm\") pod \"test-model-dd30cd-kserve-77d796cbf-cvrwg\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") " pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:49.559198 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.559180    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8342f0c7-e254-416a-8a67-b2a346953f05-tls-certs\") pod \"test-model-dd30cd-kserve-77d796cbf-cvrwg\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") " pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:49.564778 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.564757    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5frb\" (UniqueName: \"kubernetes.io/projected/8342f0c7-e254-416a-8a67-b2a346953f05-kube-api-access-f5frb\") pod \"test-model-dd30cd-kserve-77d796cbf-cvrwg\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") " pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:49.705100 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.705016    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:49.841770 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:49.841707    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"]
Jul 07 00:30:49.844107 ip-10-0-133-139 kubenswrapper[2551]: W0707 00:30:49.844080    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8342f0c7_e254_416a_8a67_b2a346953f05.slice/crio-3ad655b5c2462bab4a9d16cec68fde9aab0524e36766ae6cbbc16d4385da5e62 WatchSource:0}: Error finding container 3ad655b5c2462bab4a9d16cec68fde9aab0524e36766ae6cbbc16d4385da5e62: Status 404 returned error can't find the container with id 3ad655b5c2462bab4a9d16cec68fde9aab0524e36766ae6cbbc16d4385da5e62
Jul 07 00:30:50.301053 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:50.301018    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg" event={"ID":"8342f0c7-e254-416a-8a67-b2a346953f05","Type":"ContainerStarted","Data":"458689f5a018910f8ab42c1cd3d274338ece5e1e07ba6ff65f18af43a19f682a"}
Jul 07 00:30:50.301254 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:50.301063    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg" event={"ID":"8342f0c7-e254-416a-8a67-b2a346953f05","Type":"ContainerStarted","Data":"3ad655b5c2462bab4a9d16cec68fde9aab0524e36766ae6cbbc16d4385da5e62"}
Jul 07 00:30:50.320529 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:50.320466    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg" podStartSLOduration=1.320450857 podStartE2EDuration="1.320450857s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:30:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:30:50.318355085 +0000 UTC m=+2019.097749743" watchObservedRunningTime="2026-07-07 00:30:50.320450857 +0000 UTC m=+2019.099845513"
Jul 07 00:30:53.588640 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:53.588605    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:30:59.705494 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:59.705444    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:59.705927 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:59.705507    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:30:59.718525 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:30:59.718473    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:31:00.014014 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:00.013915    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29723070-7s2z7"]
Jul 07 00:31:00.017624 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:00.017594    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9"]
Jul 07 00:31:00.017910 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:00.017876    2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29723070-7s2z7" podUID="16dfc8da-6c00-4002-8d44-a4bcfd8a7b98" containerName="cleanup" containerID="cri-o://f53b0877a46dabde4085e22b298f9f4f094b13f9e4a5e52c0fe19376cd6a9555" gracePeriod=30
Jul 07 00:31:00.018262 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:00.017976    2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9" podUID="51a52d91-943f-4d43-8c2b-2934777d4531" containerName="cleanup" containerID="cri-o://eb9e01491fa35677e747fc9dd5d02e8553377035796fc6d27e078a56dbb2d234" gracePeriod=30
Jul 07 00:31:00.363705 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:00.363610    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:31:06.590460 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:06.590423    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:31:10.389833 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:10.389801    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"]
Jul 07 00:31:23.087550 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:23.087498    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:31:25.411423 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:25.411358    2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg" podUID="8342f0c7-e254-416a-8a67-b2a346953f05" containerName="main" containerID="cri-o://458689f5a018910f8ab42c1cd3d274338ece5e1e07ba6ff65f18af43a19f682a" gracePeriod=45
Jul 07 00:31:25.668349 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:25.668280    2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:31:25.787932 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:25.787899    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-dshm\") pod \"8342f0c7-e254-416a-8a67-b2a346953f05\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") "
Jul 07 00:31:25.788137 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:25.788029    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-home\") pod \"8342f0c7-e254-416a-8a67-b2a346953f05\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") "
Jul 07 00:31:25.788137 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:25.788052    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-model-cache\") pod \"8342f0c7-e254-416a-8a67-b2a346953f05\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") "
Jul 07 00:31:25.788137 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:25.788090    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-tmp-dir\") pod \"8342f0c7-e254-416a-8a67-b2a346953f05\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") "
Jul 07 00:31:25.788137 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:25.788110    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8342f0c7-e254-416a-8a67-b2a346953f05-tls-certs\") pod \"8342f0c7-e254-416a-8a67-b2a346953f05\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") "
Jul 07 00:31:25.788137 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:25.788133    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5frb\" (UniqueName: \"kubernetes.io/projected/8342f0c7-e254-416a-8a67-b2a346953f05-kube-api-access-f5frb\") pod \"8342f0c7-e254-416a-8a67-b2a346953f05\" (UID: \"8342f0c7-e254-416a-8a67-b2a346953f05\") "
Jul 07 00:31:25.788420 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:25.788355    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-model-cache" (OuterVolumeSpecName: "model-cache") pod "8342f0c7-e254-416a-8a67-b2a346953f05" (UID: "8342f0c7-e254-416a-8a67-b2a346953f05"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:31:25.788484 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:25.788422    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8342f0c7-e254-416a-8a67-b2a346953f05" (UID: "8342f0c7-e254-416a-8a67-b2a346953f05"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:31:25.788484 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:25.788468    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-home" (OuterVolumeSpecName: "home") pod "8342f0c7-e254-416a-8a67-b2a346953f05" (UID: "8342f0c7-e254-416a-8a67-b2a346953f05"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:31:25.790317 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:25.790287    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-dshm" (OuterVolumeSpecName: "dshm") pod "8342f0c7-e254-416a-8a67-b2a346953f05" (UID: "8342f0c7-e254-416a-8a67-b2a346953f05"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:31:25.790434 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:25.790377    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8342f0c7-e254-416a-8a67-b2a346953f05-kube-api-access-f5frb" (OuterVolumeSpecName: "kube-api-access-f5frb") pod "8342f0c7-e254-416a-8a67-b2a346953f05" (UID: "8342f0c7-e254-416a-8a67-b2a346953f05"). InnerVolumeSpecName "kube-api-access-f5frb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:31:25.790434 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:25.790424    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8342f0c7-e254-416a-8a67-b2a346953f05-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8342f0c7-e254-416a-8a67-b2a346953f05" (UID: "8342f0c7-e254-416a-8a67-b2a346953f05"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:31:25.889918 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:25.889866    2551 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-home\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:31:25.889918 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:25.889911    2551 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-model-cache\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:31:25.889918 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:25.889921    2551 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-tmp-dir\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:31:25.889918 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:25.889929    2551 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8342f0c7-e254-416a-8a67-b2a346953f05-tls-certs\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:31:25.889918 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:25.889938    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5frb\" (UniqueName: \"kubernetes.io/projected/8342f0c7-e254-416a-8a67-b2a346953f05-kube-api-access-f5frb\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:31:25.890230 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:25.889946    2551 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8342f0c7-e254-416a-8a67-b2a346953f05-dshm\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:31:26.483167 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:26.483135    2551 generic.go:356] "Generic (PLEG): container finished" podID="8342f0c7-e254-416a-8a67-b2a346953f05" containerID="458689f5a018910f8ab42c1cd3d274338ece5e1e07ba6ff65f18af43a19f682a" exitCode=0
Jul 07 00:31:26.483670 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:26.483182    2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"
Jul 07 00:31:26.483670 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:26.483229    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg" event={"ID":"8342f0c7-e254-416a-8a67-b2a346953f05","Type":"ContainerDied","Data":"458689f5a018910f8ab42c1cd3d274338ece5e1e07ba6ff65f18af43a19f682a"}
Jul 07 00:31:26.483670 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:26.483281    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg" event={"ID":"8342f0c7-e254-416a-8a67-b2a346953f05","Type":"ContainerDied","Data":"3ad655b5c2462bab4a9d16cec68fde9aab0524e36766ae6cbbc16d4385da5e62"}
Jul 07 00:31:26.483670 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:26.483304    2551 scope.go:117] "RemoveContainer" containerID="458689f5a018910f8ab42c1cd3d274338ece5e1e07ba6ff65f18af43a19f682a"
Jul 07 00:31:26.493058 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:26.493042    2551 scope.go:117] "RemoveContainer" containerID="458689f5a018910f8ab42c1cd3d274338ece5e1e07ba6ff65f18af43a19f682a"
Jul 07 00:31:26.493340 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:31:26.493322    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"458689f5a018910f8ab42c1cd3d274338ece5e1e07ba6ff65f18af43a19f682a\": container with ID starting with 458689f5a018910f8ab42c1cd3d274338ece5e1e07ba6ff65f18af43a19f682a not found: ID does not exist" containerID="458689f5a018910f8ab42c1cd3d274338ece5e1e07ba6ff65f18af43a19f682a"
Jul 07 00:31:26.493398 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:26.493349    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"458689f5a018910f8ab42c1cd3d274338ece5e1e07ba6ff65f18af43a19f682a"} err="failed to get container status \"458689f5a018910f8ab42c1cd3d274338ece5e1e07ba6ff65f18af43a19f682a\": rpc error: code = NotFound desc = could not find container \"458689f5a018910f8ab42c1cd3d274338ece5e1e07ba6ff65f18af43a19f682a\": container with ID starting with 458689f5a018910f8ab42c1cd3d274338ece5e1e07ba6ff65f18af43a19f682a not found: ID does not exist"
Jul 07 00:31:26.505211 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:26.505183    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"]
Jul 07 00:31:26.511621 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:26.511601    2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-dd30cd/test-model-dd30cd-kserve-77d796cbf-cvrwg"]
Jul 07 00:31:27.693833 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:27.693800    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8342f0c7-e254-416a-8a67-b2a346953f05" path="/var/lib/kubelet/pods/8342f0c7-e254-416a-8a67-b2a346953f05/volumes"
Jul 07 00:31:30.220886 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.220861    2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9"
Jul 07 00:31:30.234478 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.234452    2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29723070-7s2z7"
Jul 07 00:31:30.332709 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.332619    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g6scb\" (UniqueName: \"kubernetes.io/projected/51a52d91-943f-4d43-8c2b-2934777d4531-kube-api-access-g6scb\") pod \"51a52d91-943f-4d43-8c2b-2934777d4531\" (UID: \"51a52d91-943f-4d43-8c2b-2934777d4531\") "
Jul 07 00:31:30.334771 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.334750    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51a52d91-943f-4d43-8c2b-2934777d4531-kube-api-access-g6scb" (OuterVolumeSpecName: "kube-api-access-g6scb") pod "51a52d91-943f-4d43-8c2b-2934777d4531" (UID: "51a52d91-943f-4d43-8c2b-2934777d4531"). InnerVolumeSpecName "kube-api-access-g6scb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:31:30.434188 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.434144    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-59sfb\" (UniqueName: \"kubernetes.io/projected/16dfc8da-6c00-4002-8d44-a4bcfd8a7b98-kube-api-access-59sfb\") pod \"16dfc8da-6c00-4002-8d44-a4bcfd8a7b98\" (UID: \"16dfc8da-6c00-4002-8d44-a4bcfd8a7b98\") "
Jul 07 00:31:30.434476 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.434453    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g6scb\" (UniqueName: \"kubernetes.io/projected/51a52d91-943f-4d43-8c2b-2934777d4531-kube-api-access-g6scb\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:31:30.436210 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.436189    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16dfc8da-6c00-4002-8d44-a4bcfd8a7b98-kube-api-access-59sfb" (OuterVolumeSpecName: "kube-api-access-59sfb") pod "16dfc8da-6c00-4002-8d44-a4bcfd8a7b98" (UID: "16dfc8da-6c00-4002-8d44-a4bcfd8a7b98"). InnerVolumeSpecName "kube-api-access-59sfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:31:30.509004 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.508971    2551 generic.go:356] "Generic (PLEG): container finished" podID="51a52d91-943f-4d43-8c2b-2934777d4531" containerID="eb9e01491fa35677e747fc9dd5d02e8553377035796fc6d27e078a56dbb2d234" exitCode=137
Jul 07 00:31:30.509170 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.509017    2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9"
Jul 07 00:31:30.509170 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.509056    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9" event={"ID":"51a52d91-943f-4d43-8c2b-2934777d4531","Type":"ContainerDied","Data":"eb9e01491fa35677e747fc9dd5d02e8553377035796fc6d27e078a56dbb2d234"}
Jul 07 00:31:30.509170 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.509104    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9" event={"ID":"51a52d91-943f-4d43-8c2b-2934777d4531","Type":"ContainerDied","Data":"eda1ddf62b2785efa8e14429020ba6fee4e4ef3cb163443773076303c3ff46e4"}
Jul 07 00:31:30.509170 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.509132    2551 scope.go:117] "RemoveContainer" containerID="eb9e01491fa35677e747fc9dd5d02e8553377035796fc6d27e078a56dbb2d234"
Jul 07 00:31:30.510366 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.510344    2551 generic.go:356] "Generic (PLEG): container finished" podID="16dfc8da-6c00-4002-8d44-a4bcfd8a7b98" containerID="f53b0877a46dabde4085e22b298f9f4f094b13f9e4a5e52c0fe19376cd6a9555" exitCode=137
Jul 07 00:31:30.510495 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.510373    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29723070-7s2z7" event={"ID":"16dfc8da-6c00-4002-8d44-a4bcfd8a7b98","Type":"ContainerDied","Data":"f53b0877a46dabde4085e22b298f9f4f094b13f9e4a5e52c0fe19376cd6a9555"}
Jul 07 00:31:30.510578 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.510384    2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29723070-7s2z7"
Jul 07 00:31:30.510633 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.510534    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29723070-7s2z7" event={"ID":"16dfc8da-6c00-4002-8d44-a4bcfd8a7b98","Type":"ContainerDied","Data":"878bfb7f89ea5c9ca2d1d7383aed4557e3cfcd3b61f71d18f1d4c1a94d0c3a3e"}
Jul 07 00:31:30.517933 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.517909    2551 scope.go:117] "RemoveContainer" containerID="eb9e01491fa35677e747fc9dd5d02e8553377035796fc6d27e078a56dbb2d234"
Jul 07 00:31:30.518233 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:31:30.518211    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eb9e01491fa35677e747fc9dd5d02e8553377035796fc6d27e078a56dbb2d234\": container with ID starting with eb9e01491fa35677e747fc9dd5d02e8553377035796fc6d27e078a56dbb2d234 not found: ID does not exist" containerID="eb9e01491fa35677e747fc9dd5d02e8553377035796fc6d27e078a56dbb2d234"
Jul 07 00:31:30.518319 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.518242    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eb9e01491fa35677e747fc9dd5d02e8553377035796fc6d27e078a56dbb2d234"} err="failed to get container status \"eb9e01491fa35677e747fc9dd5d02e8553377035796fc6d27e078a56dbb2d234\": rpc error: code = NotFound desc = could not find container \"eb9e01491fa35677e747fc9dd5d02e8553377035796fc6d27e078a56dbb2d234\": container with ID starting with eb9e01491fa35677e747fc9dd5d02e8553377035796fc6d27e078a56dbb2d234 not found: ID does not exist"
Jul 07 00:31:30.518319 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.518265    2551 scope.go:117] "RemoveContainer" containerID="f53b0877a46dabde4085e22b298f9f4f094b13f9e4a5e52c0fe19376cd6a9555"
Jul 07 00:31:30.526314 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.526296    2551 scope.go:117] "RemoveContainer" containerID="f53b0877a46dabde4085e22b298f9f4f094b13f9e4a5e52c0fe19376cd6a9555"
Jul 07 00:31:30.526578 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:31:30.526561    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f53b0877a46dabde4085e22b298f9f4f094b13f9e4a5e52c0fe19376cd6a9555\": container with ID starting with f53b0877a46dabde4085e22b298f9f4f094b13f9e4a5e52c0fe19376cd6a9555 not found: ID does not exist" containerID="f53b0877a46dabde4085e22b298f9f4f094b13f9e4a5e52c0fe19376cd6a9555"
Jul 07 00:31:30.526631 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.526585    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f53b0877a46dabde4085e22b298f9f4f094b13f9e4a5e52c0fe19376cd6a9555"} err="failed to get container status \"f53b0877a46dabde4085e22b298f9f4f094b13f9e4a5e52c0fe19376cd6a9555\": rpc error: code = NotFound desc = could not find container \"f53b0877a46dabde4085e22b298f9f4f094b13f9e4a5e52c0fe19376cd6a9555\": container with ID starting with f53b0877a46dabde4085e22b298f9f4f094b13f9e4a5e52c0fe19376cd6a9555 not found: ID does not exist"
Jul 07 00:31:30.534506 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.534482    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9"]
Jul 07 00:31:30.534905 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.534887    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-59sfb\" (UniqueName: \"kubernetes.io/projected/16dfc8da-6c00-4002-8d44-a4bcfd8a7b98-kube-api-access-59sfb\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:31:30.538098 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.538078    2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-dd30cd-29723070-rvjt9"]
Jul 07 00:31:30.548940 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.548919    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29723070-7s2z7"]
Jul 07 00:31:30.552775 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:30.552756    2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29723070-7s2z7"]
Jul 07 00:31:31.694816 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:31.694788    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16dfc8da-6c00-4002-8d44-a4bcfd8a7b98" path="/var/lib/kubelet/pods/16dfc8da-6c00-4002-8d44-a4bcfd8a7b98/volumes"
Jul 07 00:31:31.695175 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:31.695094    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51a52d91-943f-4d43-8c2b-2934777d4531" path="/var/lib/kubelet/pods/51a52d91-943f-4d43-8c2b-2934777d4531/volumes"
Jul 07 00:31:57.379251 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:31:57.379215    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:32:11.694637 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:32:11.694609    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:32:28.492690 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:32:28.492655    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:32:42.449498 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:32:42.449466    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:32:55.390810 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:32:55.390770    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:33:07.114254 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.114165    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"]
Jul 07 00:33:07.114812 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.114792    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8342f0c7-e254-416a-8a67-b2a346953f05" containerName="main"
Jul 07 00:33:07.114896 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.114814    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="8342f0c7-e254-416a-8a67-b2a346953f05" containerName="main"
Jul 07 00:33:07.114896 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.114832    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16dfc8da-6c00-4002-8d44-a4bcfd8a7b98" containerName="cleanup"
Jul 07 00:33:07.114896 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.114840    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="16dfc8da-6c00-4002-8d44-a4bcfd8a7b98" containerName="cleanup"
Jul 07 00:33:07.114896 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.114871    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51a52d91-943f-4d43-8c2b-2934777d4531" containerName="cleanup"
Jul 07 00:33:07.114896 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.114881    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="51a52d91-943f-4d43-8c2b-2934777d4531" containerName="cleanup"
Jul 07 00:33:07.115142 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.114993    2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="16dfc8da-6c00-4002-8d44-a4bcfd8a7b98" containerName="cleanup"
Jul 07 00:33:07.115142 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.115008    2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="51a52d91-943f-4d43-8c2b-2934777d4531" containerName="cleanup"
Jul 07 00:33:07.115142 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.115019    2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="8342f0c7-e254-416a-8a67-b2a346953f05" containerName="main"
Jul 07 00:33:07.118240 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.118218    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:07.122750 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.122728    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a8caec\"/\"auth-test-model-a8caec-kserve-self-signed-certs\""
Jul 07 00:33:07.122872 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.122728    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a8caec\"/\"openshift-service-ca.crt\""
Jul 07 00:33:07.122872 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.122768    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a8caec\"/\"default-dockercfg-j8tdd\""
Jul 07 00:33:07.122872 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.122828    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-a8caec\"/\"kube-root-ca.crt\""
Jul 07 00:33:07.126137 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.126117    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"]
Jul 07 00:33:07.214719 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.214688    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhrr5\" (UniqueName: \"kubernetes.io/projected/c3f22962-101b-4248-a45f-7a7fe7623358-kube-api-access-bhrr5\") pod \"auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") " pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:07.214917 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.214756    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-dshm\") pod \"auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") " pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:07.214917 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.214784    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-tmp-dir\") pod \"auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") " pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:07.214917 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.214826    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3f22962-101b-4248-a45f-7a7fe7623358-tls-certs\") pod \"auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") " pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:07.214917 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.214877    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-home\") pod \"auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") " pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:07.214917 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.214915    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-model-cache\") pod \"auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") " pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:07.316080 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.316026    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-dshm\") pod \"auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") " pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:07.316080 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.316083    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-tmp-dir\") pod \"auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") " pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:07.316340 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.316127    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3f22962-101b-4248-a45f-7a7fe7623358-tls-certs\") pod \"auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") " pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:07.316340 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.316146    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-home\") pod \"auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") " pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:07.316340 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.316163    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-model-cache\") pod \"auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") " pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:07.316340 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.316218    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhrr5\" (UniqueName: \"kubernetes.io/projected/c3f22962-101b-4248-a45f-7a7fe7623358-kube-api-access-bhrr5\") pod \"auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") " pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:07.316606 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.316579    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-tmp-dir\") pod \"auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") " pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:07.316748 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.316699    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-home\") pod \"auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") " pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:07.316748 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.316713    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-model-cache\") pod \"auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") " pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:07.318405 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.318383    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-dshm\") pod \"auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") " pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:07.318691 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.318673    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3f22962-101b-4248-a45f-7a7fe7623358-tls-certs\") pod \"auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") " pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:07.325426 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.325409    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhrr5\" (UniqueName: \"kubernetes.io/projected/c3f22962-101b-4248-a45f-7a7fe7623358-kube-api-access-bhrr5\") pod \"auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") " pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:07.427830 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.427793    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:07.564642 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.564618    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"]
Jul 07 00:33:07.567083 ip-10-0-133-139 kubenswrapper[2551]: W0707 00:33:07.567058    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc3f22962_101b_4248_a45f_7a7fe7623358.slice/crio-e0da0238a0112285e411d1e95e6ea80199ed314f41a1a9b1a867a174135e0ef3 WatchSource:0}: Error finding container e0da0238a0112285e411d1e95e6ea80199ed314f41a1a9b1a867a174135e0ef3: Status 404 returned error can't find the container with id e0da0238a0112285e411d1e95e6ea80199ed314f41a1a9b1a867a174135e0ef3
Jul 07 00:33:07.992923 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.992888    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2" event={"ID":"c3f22962-101b-4248-a45f-7a7fe7623358","Type":"ContainerStarted","Data":"aa883428ae4cd5567d74de584e0484b3005016f02811adf2dd09210e40df0ebb"}
Jul 07 00:33:07.992923 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:07.992930    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2" event={"ID":"c3f22962-101b-4248-a45f-7a7fe7623358","Type":"ContainerStarted","Data":"e0da0238a0112285e411d1e95e6ea80199ed314f41a1a9b1a867a174135e0ef3"}
Jul 07 00:33:08.010805 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:08.010748    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2" podStartSLOduration=1.010727747 podStartE2EDuration="1.010727747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:33:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:33:08.010263629 +0000 UTC m=+2156.789658276" watchObservedRunningTime="2026-07-07 00:33:08.010727747 +0000 UTC m=+2156.790122404"
Jul 07 00:33:12.986177 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:12.986140    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:33:17.428851 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:17.428814    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:17.429317 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:17.428878    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:17.441545 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:17.441520    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:18.053242 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:18.053213    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:33:29.994660 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:29.994627    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:33:45.188178 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:33:45.188145    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:34:00.886106 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:34:00.886073    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:34:15.588165 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:34:15.588130    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:34:30.991657 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:34:30.991621    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:34:45.896129 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:34:45.896043    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:35:03.382173 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:03.382137    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:35:16.986556 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:16.986506    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"]
Jul 07 00:35:20.283070 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:20.283030    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:35:22.399291 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.399254    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"]
Jul 07 00:35:22.402784 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.402767    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:22.405887 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.405857    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a8caec\"/\"sub-test-model-a8caec-kserve-self-signed-certs\""
Jul 07 00:35:22.422577 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.422554    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"]
Jul 07 00:35:22.511991 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.511955    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-dshm\") pod \"sub-test-model-a8caec-kserve-65766874bf-45nkz\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") " pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:22.511991 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.511994    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-model-cache\") pod \"sub-test-model-a8caec-kserve-65766874bf-45nkz\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") " pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:22.512247 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.512127    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-tmp-dir\") pod \"sub-test-model-a8caec-kserve-65766874bf-45nkz\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") " pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:22.512247 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.512175    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfmnt\" (UniqueName: \"kubernetes.io/projected/8e0ff062-08d1-443a-aa54-face15ebf94c-kube-api-access-jfmnt\") pod \"sub-test-model-a8caec-kserve-65766874bf-45nkz\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") " pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:22.512337 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.512282    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e0ff062-08d1-443a-aa54-face15ebf94c-tls-certs\") pod \"sub-test-model-a8caec-kserve-65766874bf-45nkz\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") " pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:22.512337 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.512308    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-home\") pod \"sub-test-model-a8caec-kserve-65766874bf-45nkz\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") " pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:22.613262 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.613204    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-dshm\") pod \"sub-test-model-a8caec-kserve-65766874bf-45nkz\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") " pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:22.613262 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.613263    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-model-cache\") pod \"sub-test-model-a8caec-kserve-65766874bf-45nkz\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") " pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:22.613493 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.613328    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-tmp-dir\") pod \"sub-test-model-a8caec-kserve-65766874bf-45nkz\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") " pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:22.613493 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.613360    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfmnt\" (UniqueName: \"kubernetes.io/projected/8e0ff062-08d1-443a-aa54-face15ebf94c-kube-api-access-jfmnt\") pod \"sub-test-model-a8caec-kserve-65766874bf-45nkz\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") " pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:22.613493 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.613461    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e0ff062-08d1-443a-aa54-face15ebf94c-tls-certs\") pod \"sub-test-model-a8caec-kserve-65766874bf-45nkz\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") " pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:22.613694 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.613490    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-home\") pod \"sub-test-model-a8caec-kserve-65766874bf-45nkz\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") " pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:22.613810 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.613783    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-model-cache\") pod \"sub-test-model-a8caec-kserve-65766874bf-45nkz\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") " pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:22.613878 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.613813    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-tmp-dir\") pod \"sub-test-model-a8caec-kserve-65766874bf-45nkz\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") " pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:22.613878 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.613860    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-home\") pod \"sub-test-model-a8caec-kserve-65766874bf-45nkz\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") " pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:22.615545 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.615525    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-dshm\") pod \"sub-test-model-a8caec-kserve-65766874bf-45nkz\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") " pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:22.615892 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.615872    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e0ff062-08d1-443a-aa54-face15ebf94c-tls-certs\") pod \"sub-test-model-a8caec-kserve-65766874bf-45nkz\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") " pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:22.622319 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.622299    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfmnt\" (UniqueName: \"kubernetes.io/projected/8e0ff062-08d1-443a-aa54-face15ebf94c-kube-api-access-jfmnt\") pod \"sub-test-model-a8caec-kserve-65766874bf-45nkz\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") " pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:22.711944 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.711844    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:22.849445 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:22.849421    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"]
Jul 07 00:35:22.851670 ip-10-0-133-139 kubenswrapper[2551]: W0707 00:35:22.851639    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8e0ff062_08d1_443a_aa54_face15ebf94c.slice/crio-cf901818f4df73777dfea3d7f62074b8a9411d0117a18b5d0250d6c69a052505 WatchSource:0}: Error finding container cf901818f4df73777dfea3d7f62074b8a9411d0117a18b5d0250d6c69a052505: Status 404 returned error can't find the container with id cf901818f4df73777dfea3d7f62074b8a9411d0117a18b5d0250d6c69a052505
Jul 07 00:35:23.652413 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:23.652380    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz" event={"ID":"8e0ff062-08d1-443a-aa54-face15ebf94c","Type":"ContainerStarted","Data":"e444a77383d9d83cd20d3e5a72e1ea3270a59da175ba9fa9251dc1a3782c5231"}
Jul 07 00:35:23.652807 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:23.652423    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz" event={"ID":"8e0ff062-08d1-443a-aa54-face15ebf94c","Type":"ContainerStarted","Data":"cf901818f4df73777dfea3d7f62074b8a9411d0117a18b5d0250d6c69a052505"}
Jul 07 00:35:23.674384 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:23.674333    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz" podStartSLOduration=1.674314179 podStartE2EDuration="1.674314179s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:35:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:35:23.672002501 +0000 UTC m=+2292.451397159" watchObservedRunningTime="2026-07-07 00:35:23.674314179 +0000 UTC m=+2292.453708835"
Jul 07 00:35:32.008154 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.008107    2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2" podUID="c3f22962-101b-4248-a45f-7a7fe7623358" containerName="main" containerID="cri-o://aa883428ae4cd5567d74de584e0484b3005016f02811adf2dd09210e40df0ebb" gracePeriod=45
Jul 07 00:35:32.268006 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.267937    2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:35:32.302159 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.302130    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-home\") pod \"c3f22962-101b-4248-a45f-7a7fe7623358\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") "
Jul 07 00:35:32.302355 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.302188    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bhrr5\" (UniqueName: \"kubernetes.io/projected/c3f22962-101b-4248-a45f-7a7fe7623358-kube-api-access-bhrr5\") pod \"c3f22962-101b-4248-a45f-7a7fe7623358\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") "
Jul 07 00:35:32.302355 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.302241    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-tmp-dir\") pod \"c3f22962-101b-4248-a45f-7a7fe7623358\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") "
Jul 07 00:35:32.302355 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.302262    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-model-cache\") pod \"c3f22962-101b-4248-a45f-7a7fe7623358\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") "
Jul 07 00:35:32.302355 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.302296    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-dshm\") pod \"c3f22962-101b-4248-a45f-7a7fe7623358\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") "
Jul 07 00:35:32.302355 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.302319    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3f22962-101b-4248-a45f-7a7fe7623358-tls-certs\") pod \"c3f22962-101b-4248-a45f-7a7fe7623358\" (UID: \"c3f22962-101b-4248-a45f-7a7fe7623358\") "
Jul 07 00:35:32.302640 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.302404    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-home" (OuterVolumeSpecName: "home") pod "c3f22962-101b-4248-a45f-7a7fe7623358" (UID: "c3f22962-101b-4248-a45f-7a7fe7623358"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:35:32.302640 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.302495    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c3f22962-101b-4248-a45f-7a7fe7623358" (UID: "c3f22962-101b-4248-a45f-7a7fe7623358"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:35:32.302735 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.302649    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-model-cache" (OuterVolumeSpecName: "model-cache") pod "c3f22962-101b-4248-a45f-7a7fe7623358" (UID: "c3f22962-101b-4248-a45f-7a7fe7623358"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:35:32.302777 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.302746    2551 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-home\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:35:32.302777 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.302762    2551 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-tmp-dir\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:35:32.302877 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.302777    2551 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-model-cache\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:35:32.304612 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.304577    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-dshm" (OuterVolumeSpecName: "dshm") pod "c3f22962-101b-4248-a45f-7a7fe7623358" (UID: "c3f22962-101b-4248-a45f-7a7fe7623358"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:35:32.304738 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.304638    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3f22962-101b-4248-a45f-7a7fe7623358-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c3f22962-101b-4248-a45f-7a7fe7623358" (UID: "c3f22962-101b-4248-a45f-7a7fe7623358"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:35:32.304738 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.304680    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3f22962-101b-4248-a45f-7a7fe7623358-kube-api-access-bhrr5" (OuterVolumeSpecName: "kube-api-access-bhrr5") pod "c3f22962-101b-4248-a45f-7a7fe7623358" (UID: "c3f22962-101b-4248-a45f-7a7fe7623358"). InnerVolumeSpecName "kube-api-access-bhrr5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:35:32.404032 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.403990    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bhrr5\" (UniqueName: \"kubernetes.io/projected/c3f22962-101b-4248-a45f-7a7fe7623358-kube-api-access-bhrr5\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:35:32.404032 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.404024    2551 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c3f22962-101b-4248-a45f-7a7fe7623358-dshm\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:35:32.404032 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.404038    2551 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c3f22962-101b-4248-a45f-7a7fe7623358-tls-certs\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:35:32.694867 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.694832    2551 generic.go:356] "Generic (PLEG): container finished" podID="c3f22962-101b-4248-a45f-7a7fe7623358" containerID="aa883428ae4cd5567d74de584e0484b3005016f02811adf2dd09210e40df0ebb" exitCode=0
Jul 07 00:35:32.694867 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.694870    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2" event={"ID":"c3f22962-101b-4248-a45f-7a7fe7623358","Type":"ContainerDied","Data":"aa883428ae4cd5567d74de584e0484b3005016f02811adf2dd09210e40df0ebb"}
Jul 07 00:35:32.695101 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.694873    2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"
Jul 07 00:35:32.695101 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.694894    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2" event={"ID":"c3f22962-101b-4248-a45f-7a7fe7623358","Type":"ContainerDied","Data":"e0da0238a0112285e411d1e95e6ea80199ed314f41a1a9b1a867a174135e0ef3"}
Jul 07 00:35:32.695101 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.694910    2551 scope.go:117] "RemoveContainer" containerID="aa883428ae4cd5567d74de584e0484b3005016f02811adf2dd09210e40df0ebb"
Jul 07 00:35:32.710741 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.710719    2551 scope.go:117] "RemoveContainer" containerID="aa883428ae4cd5567d74de584e0484b3005016f02811adf2dd09210e40df0ebb"
Jul 07 00:35:32.711039 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:35:32.711017    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa883428ae4cd5567d74de584e0484b3005016f02811adf2dd09210e40df0ebb\": container with ID starting with aa883428ae4cd5567d74de584e0484b3005016f02811adf2dd09210e40df0ebb not found: ID does not exist" containerID="aa883428ae4cd5567d74de584e0484b3005016f02811adf2dd09210e40df0ebb"
Jul 07 00:35:32.711124 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.711048    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa883428ae4cd5567d74de584e0484b3005016f02811adf2dd09210e40df0ebb"} err="failed to get container status \"aa883428ae4cd5567d74de584e0484b3005016f02811adf2dd09210e40df0ebb\": rpc error: code = NotFound desc = could not find container \"aa883428ae4cd5567d74de584e0484b3005016f02811adf2dd09210e40df0ebb\": container with ID starting with aa883428ae4cd5567d74de584e0484b3005016f02811adf2dd09210e40df0ebb not found: ID does not exist"
Jul 07 00:35:32.712429 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.712412    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:32.712502 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.712448    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:32.721953 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.721927    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"]
Jul 07 00:35:32.725711 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.725688    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:32.726056 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:32.726037    2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a8caec/auth-test-model-a8caec-kserve-56b6d5fb7f-sgkv2"]
Jul 07 00:35:33.694656 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:33.694621    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3f22962-101b-4248-a45f-7a7fe7623358" path="/var/lib/kubelet/pods/c3f22962-101b-4248-a45f-7a7fe7623358/volumes"
Jul 07 00:35:33.711762 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:33.711735    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:35:36.587930 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:36.587893    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:35:46.984358 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:35:46.984326    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:36:00.092197 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:00.092160    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:36:14.627961 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:14.627921    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"]
Jul 07 00:36:18.790782 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:18.790746    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:36:24.587681 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.587643    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"]
Jul 07 00:36:24.588218 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.588202    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f22962-101b-4248-a45f-7a7fe7623358" containerName="main"
Jul 07 00:36:24.588265 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.588221    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f22962-101b-4248-a45f-7a7fe7623358" containerName="main"
Jul 07 00:36:24.588358 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.588347    2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3f22962-101b-4248-a45f-7a7fe7623358" containerName="main"
Jul 07 00:36:24.591868 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.591850    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:24.594388 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.594368    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-a8caec\"/\"rate-test-model-a8caec-kserve-self-signed-certs\""
Jul 07 00:36:24.601720 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.601697    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"]
Jul 07 00:36:24.701610 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.701572    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-model-cache\") pod \"rate-test-model-a8caec-kserve-86db9c5d67-lp4sz\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") " pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:24.701610 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.701619    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-dshm\") pod \"rate-test-model-a8caec-kserve-86db9c5d67-lp4sz\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") " pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:24.701883 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.701703    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-home\") pod \"rate-test-model-a8caec-kserve-86db9c5d67-lp4sz\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") " pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:24.701883 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.701747    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-tmp-dir\") pod \"rate-test-model-a8caec-kserve-86db9c5d67-lp4sz\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") " pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:24.701883 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.701831    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5643f1ad-eb23-4ddb-883f-c0acd5366298-tls-certs\") pod \"rate-test-model-a8caec-kserve-86db9c5d67-lp4sz\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") " pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:24.702005 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.701905    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hdb4\" (UniqueName: \"kubernetes.io/projected/5643f1ad-eb23-4ddb-883f-c0acd5366298-kube-api-access-7hdb4\") pod \"rate-test-model-a8caec-kserve-86db9c5d67-lp4sz\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") " pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:24.803138 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.803095    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-home\") pod \"rate-test-model-a8caec-kserve-86db9c5d67-lp4sz\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") " pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:24.803138 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.803141    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-tmp-dir\") pod \"rate-test-model-a8caec-kserve-86db9c5d67-lp4sz\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") " pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:24.803386 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.803181    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5643f1ad-eb23-4ddb-883f-c0acd5366298-tls-certs\") pod \"rate-test-model-a8caec-kserve-86db9c5d67-lp4sz\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") " pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:24.803386 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.803254    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hdb4\" (UniqueName: \"kubernetes.io/projected/5643f1ad-eb23-4ddb-883f-c0acd5366298-kube-api-access-7hdb4\") pod \"rate-test-model-a8caec-kserve-86db9c5d67-lp4sz\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") " pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:24.803386 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.803277    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-model-cache\") pod \"rate-test-model-a8caec-kserve-86db9c5d67-lp4sz\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") " pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:24.803386 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.803303    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-dshm\") pod \"rate-test-model-a8caec-kserve-86db9c5d67-lp4sz\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") " pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:24.803647 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.803605    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-home\") pod \"rate-test-model-a8caec-kserve-86db9c5d67-lp4sz\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") " pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:24.803647 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.803635    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-tmp-dir\") pod \"rate-test-model-a8caec-kserve-86db9c5d67-lp4sz\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") " pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:24.803832 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.803809    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-model-cache\") pod \"rate-test-model-a8caec-kserve-86db9c5d67-lp4sz\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") " pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:24.805609 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.805581    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-dshm\") pod \"rate-test-model-a8caec-kserve-86db9c5d67-lp4sz\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") " pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:24.805856 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.805838    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5643f1ad-eb23-4ddb-883f-c0acd5366298-tls-certs\") pod \"rate-test-model-a8caec-kserve-86db9c5d67-lp4sz\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") " pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:24.811469 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.811449    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hdb4\" (UniqueName: \"kubernetes.io/projected/5643f1ad-eb23-4ddb-883f-c0acd5366298-kube-api-access-7hdb4\") pod \"rate-test-model-a8caec-kserve-86db9c5d67-lp4sz\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") " pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:24.902157 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:24.902125    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:25.038141 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:25.038109    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"]
Jul 07 00:36:25.041218 ip-10-0-133-139 kubenswrapper[2551]: W0707 00:36:25.041195    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5643f1ad_eb23_4ddb_883f_c0acd5366298.slice/crio-988fbbcf38db6e366f76f3ea96c8711672c9570f09c5253f6ab1500233c52bf3 WatchSource:0}: Error finding container 988fbbcf38db6e366f76f3ea96c8711672c9570f09c5253f6ab1500233c52bf3: Status 404 returned error can't find the container with id 988fbbcf38db6e366f76f3ea96c8711672c9570f09c5253f6ab1500233c52bf3
Jul 07 00:36:25.966320 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:25.966285    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz" event={"ID":"5643f1ad-eb23-4ddb-883f-c0acd5366298","Type":"ContainerStarted","Data":"6f6454d6b4f28f0b00999616bea394841f6f84164936406b00c4c78101c910ab"}
Jul 07 00:36:25.966320 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:25.966325    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz" event={"ID":"5643f1ad-eb23-4ddb-883f-c0acd5366298","Type":"ContainerStarted","Data":"988fbbcf38db6e366f76f3ea96c8711672c9570f09c5253f6ab1500233c52bf3"}
Jul 07 00:36:25.985061 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:25.985012    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz" podStartSLOduration=1.984998106 podStartE2EDuration="1.984998106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 00:36:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:36:25.983293208 +0000 UTC m=+2354.762687864" watchObservedRunningTime="2026-07-07 00:36:25.984998106 +0000 UTC m=+2354.764392763"
Jul 07 00:36:29.648390 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:29.648347    2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz" podUID="8e0ff062-08d1-443a-aa54-face15ebf94c" containerName="main" containerID="cri-o://e444a77383d9d83cd20d3e5a72e1ea3270a59da175ba9fa9251dc1a3782c5231" gracePeriod=45
Jul 07 00:36:29.908446 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:29.908385    2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:36:29.985550 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:29.985501    2551 generic.go:356] "Generic (PLEG): container finished" podID="8e0ff062-08d1-443a-aa54-face15ebf94c" containerID="e444a77383d9d83cd20d3e5a72e1ea3270a59da175ba9fa9251dc1a3782c5231" exitCode=0
Jul 07 00:36:29.985745 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:29.985576    2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"
Jul 07 00:36:29.985745 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:29.985583    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz" event={"ID":"8e0ff062-08d1-443a-aa54-face15ebf94c","Type":"ContainerDied","Data":"e444a77383d9d83cd20d3e5a72e1ea3270a59da175ba9fa9251dc1a3782c5231"}
Jul 07 00:36:29.985745 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:29.985625    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz" event={"ID":"8e0ff062-08d1-443a-aa54-face15ebf94c","Type":"ContainerDied","Data":"cf901818f4df73777dfea3d7f62074b8a9411d0117a18b5d0250d6c69a052505"}
Jul 07 00:36:29.985745 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:29.985642    2551 scope.go:117] "RemoveContainer" containerID="e444a77383d9d83cd20d3e5a72e1ea3270a59da175ba9fa9251dc1a3782c5231"
Jul 07 00:36:29.994092 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:29.994076    2551 scope.go:117] "RemoveContainer" containerID="e444a77383d9d83cd20d3e5a72e1ea3270a59da175ba9fa9251dc1a3782c5231"
Jul 07 00:36:29.994369 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:36:29.994339    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e444a77383d9d83cd20d3e5a72e1ea3270a59da175ba9fa9251dc1a3782c5231\": container with ID starting with e444a77383d9d83cd20d3e5a72e1ea3270a59da175ba9fa9251dc1a3782c5231 not found: ID does not exist" containerID="e444a77383d9d83cd20d3e5a72e1ea3270a59da175ba9fa9251dc1a3782c5231"
Jul 07 00:36:29.994474 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:29.994374    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e444a77383d9d83cd20d3e5a72e1ea3270a59da175ba9fa9251dc1a3782c5231"} err="failed to get container status \"e444a77383d9d83cd20d3e5a72e1ea3270a59da175ba9fa9251dc1a3782c5231\": rpc error: code = NotFound desc = could not find container \"e444a77383d9d83cd20d3e5a72e1ea3270a59da175ba9fa9251dc1a3782c5231\": container with ID starting with e444a77383d9d83cd20d3e5a72e1ea3270a59da175ba9fa9251dc1a3782c5231 not found: ID does not exist"
Jul 07 00:36:30.054949 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:30.054923    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfmnt\" (UniqueName: \"kubernetes.io/projected/8e0ff062-08d1-443a-aa54-face15ebf94c-kube-api-access-jfmnt\") pod \"8e0ff062-08d1-443a-aa54-face15ebf94c\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") "
Jul 07 00:36:30.055120 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:30.054962    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-home\") pod \"8e0ff062-08d1-443a-aa54-face15ebf94c\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") "
Jul 07 00:36:30.055120 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:30.054990    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e0ff062-08d1-443a-aa54-face15ebf94c-tls-certs\") pod \"8e0ff062-08d1-443a-aa54-face15ebf94c\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") "
Jul 07 00:36:30.055247 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:30.055113    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-tmp-dir\") pod \"8e0ff062-08d1-443a-aa54-face15ebf94c\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") "
Jul 07 00:36:30.055247 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:30.055181    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-dshm\") pod \"8e0ff062-08d1-443a-aa54-face15ebf94c\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") "
Jul 07 00:36:30.055247 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:30.055195    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-home" (OuterVolumeSpecName: "home") pod "8e0ff062-08d1-443a-aa54-face15ebf94c" (UID: "8e0ff062-08d1-443a-aa54-face15ebf94c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:36:30.055407 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:30.055257    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-model-cache\") pod \"8e0ff062-08d1-443a-aa54-face15ebf94c\" (UID: \"8e0ff062-08d1-443a-aa54-face15ebf94c\") "
Jul 07 00:36:30.055407 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:30.055339    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "8e0ff062-08d1-443a-aa54-face15ebf94c" (UID: "8e0ff062-08d1-443a-aa54-face15ebf94c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:36:30.055548 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:30.055526    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-model-cache" (OuterVolumeSpecName: "model-cache") pod "8e0ff062-08d1-443a-aa54-face15ebf94c" (UID: "8e0ff062-08d1-443a-aa54-face15ebf94c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:36:30.055705 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:30.055688    2551 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-home\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:36:30.055756 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:30.055736    2551 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-tmp-dir\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:36:30.055756 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:30.055751    2551 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-model-cache\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:36:30.057192 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:30.057161    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-dshm" (OuterVolumeSpecName: "dshm") pod "8e0ff062-08d1-443a-aa54-face15ebf94c" (UID: "8e0ff062-08d1-443a-aa54-face15ebf94c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:36:30.057302 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:30.057196    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e0ff062-08d1-443a-aa54-face15ebf94c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "8e0ff062-08d1-443a-aa54-face15ebf94c" (UID: "8e0ff062-08d1-443a-aa54-face15ebf94c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:36:30.057302 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:30.057201    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e0ff062-08d1-443a-aa54-face15ebf94c-kube-api-access-jfmnt" (OuterVolumeSpecName: "kube-api-access-jfmnt") pod "8e0ff062-08d1-443a-aa54-face15ebf94c" (UID: "8e0ff062-08d1-443a-aa54-face15ebf94c"). InnerVolumeSpecName "kube-api-access-jfmnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:36:30.156786 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:30.156752    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfmnt\" (UniqueName: \"kubernetes.io/projected/8e0ff062-08d1-443a-aa54-face15ebf94c-kube-api-access-jfmnt\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:36:30.156786 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:30.156781    2551 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8e0ff062-08d1-443a-aa54-face15ebf94c-tls-certs\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:36:30.156786 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:30.156793    2551 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8e0ff062-08d1-443a-aa54-face15ebf94c-dshm\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:36:30.306948 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:30.306916    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"]
Jul 07 00:36:30.313410 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:30.313386    2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a8caec/sub-test-model-a8caec-kserve-65766874bf-45nkz"]
Jul 07 00:36:31.694199 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:31.694161    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e0ff062-08d1-443a-aa54-face15ebf94c" path="/var/lib/kubelet/pods/8e0ff062-08d1-443a-aa54-face15ebf94c/volumes"
Jul 07 00:36:34.902675 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:34.902639    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:34.903068 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:34.902689    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:34.915368 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:34.915344    2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:35.022423 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:35.022395    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:36:36.486729 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:36:36.486685    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:37:19.492556 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:37:19.492503    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:37:33.185527 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:37:33.185430    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:37:47.794951 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:37:47.794918    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:37:53.508694 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:37:53.508659    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"]
Jul 07 00:38:05.592909 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:05.592874    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:38:08.529123 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:08.529076    2551 kuberuntime_container.go:872] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz" podUID="5643f1ad-eb23-4ddb-883f-c0acd5366298" containerName="main" containerID="cri-o://6f6454d6b4f28f0b00999616bea394841f6f84164936406b00c4c78101c910ab" gracePeriod=45
Jul 07 00:38:08.788967 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:08.788911    2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:38:08.881079 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:08.881043    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-dshm\") pod \"5643f1ad-eb23-4ddb-883f-c0acd5366298\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") "
Jul 07 00:38:08.881275 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:08.881106    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-model-cache\") pod \"5643f1ad-eb23-4ddb-883f-c0acd5366298\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") "
Jul 07 00:38:08.881275 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:08.881129    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-home\") pod \"5643f1ad-eb23-4ddb-883f-c0acd5366298\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") "
Jul 07 00:38:08.881275 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:08.881158    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-tmp-dir\") pod \"5643f1ad-eb23-4ddb-883f-c0acd5366298\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") "
Jul 07 00:38:08.881275 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:08.881235    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5643f1ad-eb23-4ddb-883f-c0acd5366298-tls-certs\") pod \"5643f1ad-eb23-4ddb-883f-c0acd5366298\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") "
Jul 07 00:38:08.881275 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:08.881261    2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hdb4\" (UniqueName: \"kubernetes.io/projected/5643f1ad-eb23-4ddb-883f-c0acd5366298-kube-api-access-7hdb4\") pod \"5643f1ad-eb23-4ddb-883f-c0acd5366298\" (UID: \"5643f1ad-eb23-4ddb-883f-c0acd5366298\") "
Jul 07 00:38:08.881600 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:08.881453    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-home" (OuterVolumeSpecName: "home") pod "5643f1ad-eb23-4ddb-883f-c0acd5366298" (UID: "5643f1ad-eb23-4ddb-883f-c0acd5366298"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:38:08.881600 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:08.881453    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-model-cache" (OuterVolumeSpecName: "model-cache") pod "5643f1ad-eb23-4ddb-883f-c0acd5366298" (UID: "5643f1ad-eb23-4ddb-883f-c0acd5366298"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:38:08.881600 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:08.881502    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5643f1ad-eb23-4ddb-883f-c0acd5366298" (UID: "5643f1ad-eb23-4ddb-883f-c0acd5366298"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:38:08.881773 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:08.881713    2551 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-model-cache\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:38:08.881773 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:08.881727    2551 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-home\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:38:08.881773 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:08.881734    2551 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-tmp-dir\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:38:08.883382 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:08.883357    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-dshm" (OuterVolumeSpecName: "dshm") pod "5643f1ad-eb23-4ddb-883f-c0acd5366298" (UID: "5643f1ad-eb23-4ddb-883f-c0acd5366298"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 00:38:08.883382 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:08.883364    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5643f1ad-eb23-4ddb-883f-c0acd5366298-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5643f1ad-eb23-4ddb-883f-c0acd5366298" (UID: "5643f1ad-eb23-4ddb-883f-c0acd5366298"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 00:38:08.883554 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:08.883360    2551 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5643f1ad-eb23-4ddb-883f-c0acd5366298-kube-api-access-7hdb4" (OuterVolumeSpecName: "kube-api-access-7hdb4") pod "5643f1ad-eb23-4ddb-883f-c0acd5366298" (UID: "5643f1ad-eb23-4ddb-883f-c0acd5366298"). InnerVolumeSpecName "kube-api-access-7hdb4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 00:38:08.983064 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:08.983027    2551 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5643f1ad-eb23-4ddb-883f-c0acd5366298-dshm\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:38:08.983064 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:08.983058    2551 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5643f1ad-eb23-4ddb-883f-c0acd5366298-tls-certs\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:38:08.983064 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:08.983070    2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hdb4\" (UniqueName: \"kubernetes.io/projected/5643f1ad-eb23-4ddb-883f-c0acd5366298-kube-api-access-7hdb4\") on node \"ip-10-0-133-139.ec2.internal\" DevicePath \"\""
Jul 07 00:38:09.466768 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:09.466735    2551 generic.go:356] "Generic (PLEG): container finished" podID="5643f1ad-eb23-4ddb-883f-c0acd5366298" containerID="6f6454d6b4f28f0b00999616bea394841f6f84164936406b00c4c78101c910ab" exitCode=0
Jul 07 00:38:09.466966 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:09.466777    2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"
Jul 07 00:38:09.466966 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:09.466801    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz" event={"ID":"5643f1ad-eb23-4ddb-883f-c0acd5366298","Type":"ContainerDied","Data":"6f6454d6b4f28f0b00999616bea394841f6f84164936406b00c4c78101c910ab"}
Jul 07 00:38:09.466966 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:09.466832    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz" event={"ID":"5643f1ad-eb23-4ddb-883f-c0acd5366298","Type":"ContainerDied","Data":"988fbbcf38db6e366f76f3ea96c8711672c9570f09c5253f6ab1500233c52bf3"}
Jul 07 00:38:09.466966 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:09.466850    2551 scope.go:117] "RemoveContainer" containerID="6f6454d6b4f28f0b00999616bea394841f6f84164936406b00c4c78101c910ab"
Jul 07 00:38:09.476323 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:09.476306    2551 scope.go:117] "RemoveContainer" containerID="6f6454d6b4f28f0b00999616bea394841f6f84164936406b00c4c78101c910ab"
Jul 07 00:38:09.476602 ip-10-0-133-139 kubenswrapper[2551]: E0707 00:38:09.476582    2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f6454d6b4f28f0b00999616bea394841f6f84164936406b00c4c78101c910ab\": container with ID starting with 6f6454d6b4f28f0b00999616bea394841f6f84164936406b00c4c78101c910ab not found: ID does not exist" containerID="6f6454d6b4f28f0b00999616bea394841f6f84164936406b00c4c78101c910ab"
Jul 07 00:38:09.476668 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:09.476610    2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f6454d6b4f28f0b00999616bea394841f6f84164936406b00c4c78101c910ab"} err="failed to get container status \"6f6454d6b4f28f0b00999616bea394841f6f84164936406b00c4c78101c910ab\": rpc error: code = NotFound desc = could not find container \"6f6454d6b4f28f0b00999616bea394841f6f84164936406b00c4c78101c910ab\": container with ID starting with 6f6454d6b4f28f0b00999616bea394841f6f84164936406b00c4c78101c910ab not found: ID does not exist"
Jul 07 00:38:09.488929 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:09.488908    2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"]
Jul 07 00:38:09.492142 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:09.492122    2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-a8caec/rate-test-model-a8caec-kserve-86db9c5d67-lp4sz"]
Jul 07 00:38:09.695039 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:09.695011    2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5643f1ad-eb23-4ddb-883f-c0acd5366298" path="/var/lib/kubelet/pods/5643f1ad-eb23-4ddb-883f-c0acd5366298/volumes"
Jul 07 00:38:24.394258 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:24.394226    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mn2rf"]
Jul 07 00:38:29.310066 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:29.310036    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66f4c4b6b-p62fz_61bcf6d1-9ae7-496d-9415-a25b10317f10/authorino/0.log"
Jul 07 00:38:34.916125 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:34.916094    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b6d6b477c-qswqn_555433b7-7deb-4cba-8b14-f1953ef775dd/copy-manifests/0.log"
Jul 07 00:38:34.922790 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:34.922759    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b6d6b477c-qswqn_555433b7-7deb-4cba-8b14-f1953ef775dd/manager/0.log"
Jul 07 00:38:36.431760 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:36.431730    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66f4c4b6b-p62fz_61bcf6d1-9ae7-496d-9415-a25b10317f10/authorino/0.log"
Jul 07 00:38:36.801035 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:36.800945    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-985gm_9ad06ca8-bef5-4391-8da6-1931e6e7428b/kuadrant-console-plugin/0.log"
Jul 07 00:38:37.194959 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:37.194928    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mn2rf_89d6108f-ed8f-4d7b-8a27-504283f55272/limitador/0.log"
Jul 07 00:38:37.942040 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:37.942013    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-568f9c9968-8779k_6c281e96-9b52-43c8-95c2-2cdb8a80c9c3/kube-auth-proxy/0.log"
Jul 07 00:38:39.168600 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:39.168569    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-gph59_7c7864c3-0a97-40bd-b60b-ec312cd68053/main/0.log"
Jul 07 00:38:39.525780 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:39.525694    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-lcmxh_4cecaabf-afa5-4ec4-9ca2-366f2b19d32f/main/0.log"
Jul 07 00:38:47.236432 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:47.236398    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jbkpl_cce87a14-ec61-4e46-b630-4488f0c25032/global-pull-secret-syncer/0.log"
Jul 07 00:38:47.382973 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:47.382920    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xwsf4_884a13e6-5634-47f4-9644-ec00e1dc9150/konnectivity-agent/0.log"
Jul 07 00:38:47.440867 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:47.440830    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-139.ec2.internal_098c8f1e1bab8bfb614b320b9ae089b4/haproxy/0.log"
Jul 07 00:38:52.354687 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:52.354652    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-66f4c4b6b-p62fz_61bcf6d1-9ae7-496d-9415-a25b10317f10/authorino/0.log"
Jul 07 00:38:52.456372 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:52.456350    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-985gm_9ad06ca8-bef5-4391-8da6-1931e6e7428b/kuadrant-console-plugin/0.log"
Jul 07 00:38:52.704651 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:52.704613    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mn2rf_89d6108f-ed8f-4d7b-8a27-504283f55272/limitador/0.log"
Jul 07 00:38:54.381639 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:54.381616    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9274e8df-1603-4119-8864-a4744ea6eae2/alertmanager/0.log"
Jul 07 00:38:54.408319 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:54.408295    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9274e8df-1603-4119-8864-a4744ea6eae2/config-reloader/0.log"
Jul 07 00:38:54.439053 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:54.439029    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9274e8df-1603-4119-8864-a4744ea6eae2/kube-rbac-proxy-web/0.log"
Jul 07 00:38:54.465937 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:54.465911    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9274e8df-1603-4119-8864-a4744ea6eae2/kube-rbac-proxy/0.log"
Jul 07 00:38:54.494555 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:54.494527    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9274e8df-1603-4119-8864-a4744ea6eae2/kube-rbac-proxy-metric/0.log"
Jul 07 00:38:54.528328 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:54.528287    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9274e8df-1603-4119-8864-a4744ea6eae2/prom-label-proxy/0.log"
Jul 07 00:38:54.556256 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:54.556234    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9274e8df-1603-4119-8864-a4744ea6eae2/init-config-reloader/0.log"
Jul 07 00:38:54.712378 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:54.712355    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-58cf5fddfc-xmlrp_79c97f9b-b68a-4fe5-bdb7-c386774ec742/metrics-server/0.log"
Jul 07 00:38:54.745060 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:54.745029    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-5xgfz_a3f3bb09-40b5-4fce-b5e4-e086fa99167d/monitoring-plugin/0.log"
Jul 07 00:38:54.775588 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:54.775560    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jfr6l_ba4fb820-75dc-460d-8e4e-1f54f0052e94/node-exporter/0.log"
Jul 07 00:38:54.797013 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:54.796981    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jfr6l_ba4fb820-75dc-460d-8e4e-1f54f0052e94/kube-rbac-proxy/0.log"
Jul 07 00:38:54.820585 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:54.820559    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jfr6l_ba4fb820-75dc-460d-8e4e-1f54f0052e94/init-textfile/0.log"
Jul 07 00:38:55.003562 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:55.003532    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-bzmbw_9f7f1707-994c-4987-97af-c5e61bf76137/kube-rbac-proxy-main/0.log"
Jul 07 00:38:55.029730 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:55.029702    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-bzmbw_9f7f1707-994c-4987-97af-c5e61bf76137/kube-rbac-proxy-self/0.log"
Jul 07 00:38:55.052747 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:55.052724    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-bzmbw_9f7f1707-994c-4987-97af-c5e61bf76137/openshift-state-metrics/0.log"
Jul 07 00:38:55.102656 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:55.102620    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d52ad5e3-1c73-4e3f-bec6-78cc29459b99/prometheus/0.log"
Jul 07 00:38:55.125765 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:55.125740    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d52ad5e3-1c73-4e3f-bec6-78cc29459b99/config-reloader/0.log"
Jul 07 00:38:55.148319 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:55.148295    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d52ad5e3-1c73-4e3f-bec6-78cc29459b99/thanos-sidecar/0.log"
Jul 07 00:38:55.172268 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:55.172249    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d52ad5e3-1c73-4e3f-bec6-78cc29459b99/kube-rbac-proxy-web/0.log"
Jul 07 00:38:55.195352 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:55.195331    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d52ad5e3-1c73-4e3f-bec6-78cc29459b99/kube-rbac-proxy/0.log"
Jul 07 00:38:55.216452 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:55.216434    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d52ad5e3-1c73-4e3f-bec6-78cc29459b99/kube-rbac-proxy-thanos/0.log"
Jul 07 00:38:55.237115 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:55.237063    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d52ad5e3-1c73-4e3f-bec6-78cc29459b99/init-config-reloader/0.log"
Jul 07 00:38:55.268248 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:55.268227    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-4sqxg_0faada77-a5f3-4d39-9cf5-d78cfec24315/prometheus-operator/0.log"
Jul 07 00:38:55.288652 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:55.288634    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-4sqxg_0faada77-a5f3-4d39-9cf5-d78cfec24315/kube-rbac-proxy/0.log"
Jul 07 00:38:55.314029 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:55.314010    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-82hxp_a8f5a672-6d6a-47ed-9b24-99f3165bcf66/prometheus-operator-admission-webhook/0.log"
Jul 07 00:38:55.417809 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:55.417783    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-857d8bbb9f-2chml_8e3b9a7f-f18b-4c69-9d81-906803e09b38/thanos-query/0.log"
Jul 07 00:38:55.438299 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:55.438275    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-857d8bbb9f-2chml_8e3b9a7f-f18b-4c69-9d81-906803e09b38/kube-rbac-proxy-web/0.log"
Jul 07 00:38:55.470239 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:55.470215    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-857d8bbb9f-2chml_8e3b9a7f-f18b-4c69-9d81-906803e09b38/kube-rbac-proxy/0.log"
Jul 07 00:38:55.495088 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:55.495019    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-857d8bbb9f-2chml_8e3b9a7f-f18b-4c69-9d81-906803e09b38/prom-label-proxy/0.log"
Jul 07 00:38:55.517774 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:55.517751    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-857d8bbb9f-2chml_8e3b9a7f-f18b-4c69-9d81-906803e09b38/kube-rbac-proxy-rules/0.log"
Jul 07 00:38:55.539202 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:55.539178    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-857d8bbb9f-2chml_8e3b9a7f-f18b-4c69-9d81-906803e09b38/kube-rbac-proxy-metrics/0.log"
Jul 07 00:38:56.719109 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:56.719078    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-jfrqt_78d2e680-f53b-4237-b8e6-6c57c3f1a977/networking-console-plugin/0.log"
Jul 07 00:38:57.250939 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.250904    2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"]
Jul 07 00:38:57.251349 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.251331    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e0ff062-08d1-443a-aa54-face15ebf94c" containerName="main"
Jul 07 00:38:57.251436 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.251351    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e0ff062-08d1-443a-aa54-face15ebf94c" containerName="main"
Jul 07 00:38:57.251436 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.251390    2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5643f1ad-eb23-4ddb-883f-c0acd5366298" containerName="main"
Jul 07 00:38:57.251436 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.251400    2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="5643f1ad-eb23-4ddb-883f-c0acd5366298" containerName="main"
Jul 07 00:38:57.251619 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.251486    2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="5643f1ad-eb23-4ddb-883f-c0acd5366298" containerName="main"
Jul 07 00:38:57.251619 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.251502    2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e0ff062-08d1-443a-aa54-face15ebf94c" containerName="main"
Jul 07 00:38:57.254808 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.254786    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"
Jul 07 00:38:57.257859 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.257832    2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7rzff\"/\"default-dockercfg-h4m67\""
Jul 07 00:38:57.257859 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.257854    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7rzff\"/\"kube-root-ca.crt\""
Jul 07 00:38:57.259855 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.259826    2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7rzff\"/\"openshift-service-ca.crt\""
Jul 07 00:38:57.262630 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.262608    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"]
Jul 07 00:38:57.335839 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.335809    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af55b4b4-c936-486a-83a4-fe4a9a4bed64-sys\") pod \"perf-node-gather-daemonset-rdklb\" (UID: \"af55b4b4-c936-486a-83a4-fe4a9a4bed64\") " pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"
Jul 07 00:38:57.336004 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.335881    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrbn5\" (UniqueName: \"kubernetes.io/projected/af55b4b4-c936-486a-83a4-fe4a9a4bed64-kube-api-access-zrbn5\") pod \"perf-node-gather-daemonset-rdklb\" (UID: \"af55b4b4-c936-486a-83a4-fe4a9a4bed64\") " pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"
Jul 07 00:38:57.336004 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.335917    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/af55b4b4-c936-486a-83a4-fe4a9a4bed64-podres\") pod \"perf-node-gather-daemonset-rdklb\" (UID: \"af55b4b4-c936-486a-83a4-fe4a9a4bed64\") " pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"
Jul 07 00:38:57.336079 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.336011    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af55b4b4-c936-486a-83a4-fe4a9a4bed64-lib-modules\") pod \"perf-node-gather-daemonset-rdklb\" (UID: \"af55b4b4-c936-486a-83a4-fe4a9a4bed64\") " pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"
Jul 07 00:38:57.336079 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.336041    2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/af55b4b4-c936-486a-83a4-fe4a9a4bed64-proc\") pod \"perf-node-gather-daemonset-rdklb\" (UID: \"af55b4b4-c936-486a-83a4-fe4a9a4bed64\") " pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"
Jul 07 00:38:57.437443 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.437407    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrbn5\" (UniqueName: \"kubernetes.io/projected/af55b4b4-c936-486a-83a4-fe4a9a4bed64-kube-api-access-zrbn5\") pod \"perf-node-gather-daemonset-rdklb\" (UID: \"af55b4b4-c936-486a-83a4-fe4a9a4bed64\") " pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"
Jul 07 00:38:57.437443 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.437450    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/af55b4b4-c936-486a-83a4-fe4a9a4bed64-podres\") pod \"perf-node-gather-daemonset-rdklb\" (UID: \"af55b4b4-c936-486a-83a4-fe4a9a4bed64\") " pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"
Jul 07 00:38:57.437731 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.437535    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af55b4b4-c936-486a-83a4-fe4a9a4bed64-lib-modules\") pod \"perf-node-gather-daemonset-rdklb\" (UID: \"af55b4b4-c936-486a-83a4-fe4a9a4bed64\") " pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"
Jul 07 00:38:57.437731 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.437554    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/af55b4b4-c936-486a-83a4-fe4a9a4bed64-proc\") pod \"perf-node-gather-daemonset-rdklb\" (UID: \"af55b4b4-c936-486a-83a4-fe4a9a4bed64\") " pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"
Jul 07 00:38:57.437731 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.437587    2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af55b4b4-c936-486a-83a4-fe4a9a4bed64-sys\") pod \"perf-node-gather-daemonset-rdklb\" (UID: \"af55b4b4-c936-486a-83a4-fe4a9a4bed64\") " pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"
Jul 07 00:38:57.437731 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.437640    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/af55b4b4-c936-486a-83a4-fe4a9a4bed64-podres\") pod \"perf-node-gather-daemonset-rdklb\" (UID: \"af55b4b4-c936-486a-83a4-fe4a9a4bed64\") " pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"
Jul 07 00:38:57.437731 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.437667    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/af55b4b4-c936-486a-83a4-fe4a9a4bed64-lib-modules\") pod \"perf-node-gather-daemonset-rdklb\" (UID: \"af55b4b4-c936-486a-83a4-fe4a9a4bed64\") " pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"
Jul 07 00:38:57.437731 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.437693    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/af55b4b4-c936-486a-83a4-fe4a9a4bed64-proc\") pod \"perf-node-gather-daemonset-rdklb\" (UID: \"af55b4b4-c936-486a-83a4-fe4a9a4bed64\") " pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"
Jul 07 00:38:57.437731 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.437693    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/af55b4b4-c936-486a-83a4-fe4a9a4bed64-sys\") pod \"perf-node-gather-daemonset-rdklb\" (UID: \"af55b4b4-c936-486a-83a4-fe4a9a4bed64\") " pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"
Jul 07 00:38:57.445982 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.445946    2551 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrbn5\" (UniqueName: \"kubernetes.io/projected/af55b4b4-c936-486a-83a4-fe4a9a4bed64-kube-api-access-zrbn5\") pod \"perf-node-gather-daemonset-rdklb\" (UID: \"af55b4b4-c936-486a-83a4-fe4a9a4bed64\") " pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"
Jul 07 00:38:57.565646 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.565554    2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"
Jul 07 00:38:57.696045 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.696020    2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"]
Jul 07 00:38:57.698247 ip-10-0-133-139 kubenswrapper[2551]: W0707 00:38:57.698218    2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podaf55b4b4_c936_486a_83a4_fe4a9a4bed64.slice/crio-1a8068f3bcb3268c193bbd3f333112e30917c384cd5cd5c6d3dc41adbb0a85c5 WatchSource:0}: Error finding container 1a8068f3bcb3268c193bbd3f333112e30917c384cd5cd5c6d3dc41adbb0a85c5: Status 404 returned error can't find the container with id 1a8068f3bcb3268c193bbd3f333112e30917c384cd5cd5c6d3dc41adbb0a85c5
Jul 07 00:38:57.976328 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:57.976294    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-tkr2w_a6128722-3c79-444d-8079-27c045ab076f/download-server/0.log"
Jul 07 00:38:58.704605 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:58.704573    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb" event={"ID":"af55b4b4-c936-486a-83a4-fe4a9a4bed64","Type":"ContainerStarted","Data":"744eadd493f5e1589ad7beaba78feb26fab636f82d31c0d3836a2e061c27cdc5"}
Jul 07 00:38:58.704855 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:58.704623    2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb" event={"ID":"af55b4b4-c936-486a-83a4-fe4a9a4bed64","Type":"ContainerStarted","Data":"1a8068f3bcb3268c193bbd3f333112e30917c384cd5cd5c6d3dc41adbb0a85c5"}
Jul 07 00:38:58.704855 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:58.704643    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"
Jul 07 00:38:58.723490 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:58.723441    2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb" podStartSLOduration=1.723426693 podStartE2EDuration="1.723426693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 00:38:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 00:38:58.722011262 +0000 UTC m=+2507.501405933" watchObservedRunningTime="2026-07-07 00:38:58.723426693 +0000 UTC m=+2507.502821396"
Jul 07 00:38:59.691094 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:59.691061    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sgzpt_262963f5-50b1-4f77-88ea-7f92a44fa4c7/dns/0.log"
Jul 07 00:38:59.712592 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:59.712548    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sgzpt_262963f5-50b1-4f77-88ea-7f92a44fa4c7/kube-rbac-proxy/0.log"
Jul 07 00:38:59.782436 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:38:59.782409    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zpbjs_ad267d1f-91ae-433d-a788-f628363570e0/dns-node-resolver/0.log"
Jul 07 00:39:00.353839 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:00.353814    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-94sl8_628c1362-ba80-4198-b958-90631d8c4f8a/node-ca/0.log"
Jul 07 00:39:01.563971 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:01.563944    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-568f9c9968-8779k_6c281e96-9b52-43c8-95c2-2cdb8a80c9c3/kube-auth-proxy/0.log"
Jul 07 00:39:02.480441 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:02.480413    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2z2qv_5de2afde-897e-4f5b-a5b6-9154ac1943cd/serve-healthcheck-canary/0.log"
Jul 07 00:39:03.017073 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:03.017048    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-84bwn_9a2d4701-006a-429f-adad-126f71953faf/kube-rbac-proxy/0.log"
Jul 07 00:39:03.039099 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:03.039073    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-84bwn_9a2d4701-006a-429f-adad-126f71953faf/exporter/0.log"
Jul 07 00:39:03.061362 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:03.061340    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-84bwn_9a2d4701-006a-429f-adad-126f71953faf/extractor/0.log"
Jul 07 00:39:04.719614 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:04.719575    2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7rzff/perf-node-gather-daemonset-rdklb"
Jul 07 00:39:05.800104 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:05.800075    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b6d6b477c-qswqn_555433b7-7deb-4cba-8b14-f1953ef775dd/manager/0.log"
Jul 07 00:39:05.821128 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:05.821097    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6b6d6b477c-qswqn_555433b7-7deb-4cba-8b14-f1953ef775dd/copy-manifests/0.log"
Jul 07 00:39:07.370347 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:07.370317    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5df8c9476f-w7btc_0a982f58-f4fc-46cb-ac80-6bb9f1625380/manager/0.log"
Jul 07 00:39:07.396475 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:07.396450    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-glz4t_236e6a9c-85a8-4af9-a6b0-b84774427c1f/openshift-lws-operator/0.log"
Jul 07 00:39:08.083502 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:08.083472    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-568f9c9968-8779k_6c281e96-9b52-43c8-95c2-2cdb8a80c9c3/kube-auth-proxy/0.log"
Jul 07 00:39:09.716697 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:09.716665    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-568f9c9968-8779k_6c281e96-9b52-43c8-95c2-2cdb8a80c9c3/kube-auth-proxy/0.log"
Jul 07 00:39:13.979869 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:13.979843    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-58shk_2081578e-abe2-40a8-ab5b-a430646f0e38/kube-multus/0.log"
Jul 07 00:39:14.325426 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:14.325344    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtq89_981c6f6b-7c41-45aa-9721-f90eee6b57ff/kube-multus-additional-cni-plugins/0.log"
Jul 07 00:39:14.347531 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:14.347485    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtq89_981c6f6b-7c41-45aa-9721-f90eee6b57ff/egress-router-binary-copy/0.log"
Jul 07 00:39:14.370038 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:14.370006    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtq89_981c6f6b-7c41-45aa-9721-f90eee6b57ff/cni-plugins/0.log"
Jul 07 00:39:14.390168 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:14.390144    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtq89_981c6f6b-7c41-45aa-9721-f90eee6b57ff/bond-cni-plugin/0.log"
Jul 07 00:39:14.411386 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:14.411363    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtq89_981c6f6b-7c41-45aa-9721-f90eee6b57ff/routeoverride-cni/0.log"
Jul 07 00:39:14.434103 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:14.434070    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtq89_981c6f6b-7c41-45aa-9721-f90eee6b57ff/whereabouts-cni-bincopy/0.log"
Jul 07 00:39:14.456740 ip-10-0-133-139 kubenswrapper[2551]: I0707 00:39:14.456712    2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-rtq89_981c6f6b-7c41-45aa-9721-f90eee6b57ff/whereabouts-cni/0.log"