May 26 19:38:10.746855 ip-10-0-140-142 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 26 19:38:10.746865 ip-10-0-140-142 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 26 19:38:10.746872 ip-10-0-140-142 systemd[1]: kubelet.service: Failed with result 'resources'.
May 26 19:38:10.747107 ip-10-0-140-142 systemd[1]: Failed to start Kubernetes Kubelet.
May 26 19:38:20.795460 ip-10-0-140-142 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
May 26 19:38:20.795475 ip-10-0-140-142 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 135dd9c89b9f4259b27d8946ac5e839e --
May 26 19:40:38.597085 ip-10-0-140-142 systemd[1]: Starting Kubernetes Kubelet...
May 26 19:40:39.114004 ip-10-0-140-142 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 19:40:39.114004 ip-10-0-140-142 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 26 19:40:39.114004 ip-10-0-140-142 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 19:40:39.114004 ip-10-0-140-142 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 26 19:40:39.114004 ip-10-0-140-142 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 26 19:40:39.115945 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.115828    2565 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 26 19:40:39.119832 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119816    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 19:40:39.119877 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119834    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 19:40:39.119877 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119838    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 19:40:39.119877 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119841    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 19:40:39.119877 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119844    2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 19:40:39.119877 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119847    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 19:40:39.119877 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119850    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 19:40:39.119877 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119853    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 19:40:39.119877 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119856    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 19:40:39.119877 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119859    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 19:40:39.119877 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119861    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 19:40:39.119877 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119864    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 19:40:39.119877 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119869    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 19:40:39.119877 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119873    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 19:40:39.119877 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119876    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 19:40:39.119877 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119879    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 19:40:39.119877 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119881    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 19:40:39.119877 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119885    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 19:40:39.120313 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119889    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 19:40:39.120313 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119892    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 19:40:39.120313 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119894    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 19:40:39.120313 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119897    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 19:40:39.120313 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119899    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 19:40:39.120313 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119902    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 19:40:39.120313 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119904    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 19:40:39.120313 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119907    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 19:40:39.120313 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119909    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 19:40:39.120313 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119912    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 19:40:39.120313 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119914    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 19:40:39.120313 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119918    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 19:40:39.120313 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119922    2565 feature_gate.go:328] unrecognized feature gate: Example
May 26 19:40:39.120313 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119926    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 19:40:39.120313 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119928    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 19:40:39.120313 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119931    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 19:40:39.120313 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119933    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 19:40:39.120313 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119936    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 19:40:39.120313 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119939    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 19:40:39.120313 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119941    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 19:40:39.120798 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119944    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 19:40:39.120798 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119946    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 19:40:39.120798 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119949    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 19:40:39.120798 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119952    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 19:40:39.120798 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119954    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 19:40:39.120798 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119957    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 19:40:39.120798 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119960    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 19:40:39.120798 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119963    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 19:40:39.120798 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119965    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 19:40:39.120798 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119968    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 19:40:39.120798 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119971    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 19:40:39.120798 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119974    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 19:40:39.120798 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119976    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 19:40:39.120798 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119979    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 19:40:39.120798 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119982    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 19:40:39.120798 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119984    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 19:40:39.120798 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119987    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 19:40:39.120798 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119990    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 19:40:39.120798 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119992    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 19:40:39.120798 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119995    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 19:40:39.121297 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.119997    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 19:40:39.121297 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120000    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 19:40:39.121297 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120002    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 19:40:39.121297 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120005    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 19:40:39.121297 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120008    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 19:40:39.121297 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120010    2565 feature_gate.go:328] unrecognized feature gate: Example2
May 26 19:40:39.121297 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120012    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 19:40:39.121297 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120015    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 19:40:39.121297 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120019    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 19:40:39.121297 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120021    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 19:40:39.121297 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120024    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 19:40:39.121297 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120027    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 19:40:39.121297 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120029    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 19:40:39.121297 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120032    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 19:40:39.121297 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120034    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 19:40:39.121297 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120039    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 19:40:39.121297 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120043    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 19:40:39.121297 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120046    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 19:40:39.121297 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120049    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 19:40:39.121760 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120052    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 19:40:39.121760 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120055    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 19:40:39.121760 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120058    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 19:40:39.121760 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120060    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 19:40:39.121760 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120063    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 19:40:39.121760 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120065    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 19:40:39.121760 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120068    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 19:40:39.121760 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120070    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 19:40:39.121760 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120073    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 19:40:39.121760 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120471    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 19:40:39.121760 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120475    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 19:40:39.121760 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120478    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 19:40:39.121760 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120481    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 19:40:39.121760 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120484    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 19:40:39.121760 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120487    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 19:40:39.121760 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120489    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 19:40:39.121760 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120492    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 19:40:39.121760 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120495    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 19:40:39.121760 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120497    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 19:40:39.121760 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120501    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 19:40:39.122252 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120503    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 19:40:39.122252 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120507    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 19:40:39.122252 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120509    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 19:40:39.122252 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120512    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 19:40:39.122252 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120515    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 19:40:39.122252 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120517    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 19:40:39.122252 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120520    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 19:40:39.122252 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120522    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 19:40:39.122252 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120525    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 19:40:39.122252 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120528    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 19:40:39.122252 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120531    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 19:40:39.122252 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120533    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 19:40:39.122252 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120536    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 19:40:39.122252 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120539    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 19:40:39.122252 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120541    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 19:40:39.122252 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120544    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 19:40:39.122252 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120547    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 19:40:39.122252 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120551    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 19:40:39.122252 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120554    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 19:40:39.122252 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120557    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 19:40:39.122830 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120560    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 19:40:39.122830 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120563    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 19:40:39.122830 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120566    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 19:40:39.122830 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120569    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 19:40:39.122830 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120571    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 19:40:39.122830 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120574    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 19:40:39.122830 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120576    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 19:40:39.122830 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120579    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 19:40:39.122830 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120581    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 19:40:39.122830 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120584    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 19:40:39.122830 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120586    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 19:40:39.122830 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120589    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 19:40:39.122830 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120591    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 19:40:39.122830 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120594    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 19:40:39.122830 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120597    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 19:40:39.122830 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120600    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 19:40:39.122830 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120602    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 19:40:39.122830 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120605    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 19:40:39.122830 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120607    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 19:40:39.122830 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120609    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 19:40:39.123329 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120612    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 19:40:39.123329 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120616    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 19:40:39.123329 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120618    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 19:40:39.123329 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120621    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 19:40:39.123329 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120624    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 19:40:39.123329 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120627    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 19:40:39.123329 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120629    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 19:40:39.123329 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120631    2565 feature_gate.go:328] unrecognized feature gate: Example
May 26 19:40:39.123329 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120634    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 19:40:39.123329 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120636    2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 19:40:39.123329 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120640    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 19:40:39.123329 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120644    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 19:40:39.123329 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120648    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 19:40:39.123329 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120651    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 19:40:39.123329 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120653    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 19:40:39.123329 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120656    2565 feature_gate.go:328] unrecognized feature gate: Example2
May 26 19:40:39.123329 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120659    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 19:40:39.123329 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120662    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 19:40:39.123329 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120664    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 19:40:39.123329 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120667    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120670    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120672    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120674    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120677    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120679    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120682    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120685    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120688    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120690    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120693    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120696    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120698    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120701    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120704    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.120706    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120793    2565 flags.go:64] FLAG: --address="0.0.0.0"
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120803    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120813    2565 flags.go:64] FLAG: --anonymous-auth="true"
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120820    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120825    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
May 26 19:40:39.123842 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120829    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120833    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120838    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120841    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120844    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120848    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120851    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120855    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120858    2565 flags.go:64] FLAG: --cgroup-root=""
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120860    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120863    2565 flags.go:64] FLAG: --client-ca-file=""
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120867    2565 flags.go:64] FLAG: --cloud-config=""
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120870    2565 flags.go:64] FLAG: --cloud-provider="external"
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120873    2565 flags.go:64] FLAG: --cluster-dns="[]"
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120877    2565 flags.go:64] FLAG: --cluster-domain=""
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120880    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120883    2565 flags.go:64] FLAG: --config-dir=""
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120885    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120889    2565 flags.go:64] FLAG: --container-log-max-files="5"
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120893    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120897    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120900    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120904    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120907    2565 flags.go:64] FLAG: --contention-profiling="false"
May 26 19:40:39.124347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120910    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120913    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120917    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120921    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120925    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120928    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120932    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120934    2565 flags.go:64] FLAG: --enable-load-reader="false"
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120938    2565 flags.go:64] FLAG: --enable-server="true"
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120941    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120947    2565 flags.go:64] FLAG: --event-burst="100"
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120951    2565 flags.go:64] FLAG: --event-qps="50"
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120954    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120957    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120960    2565 flags.go:64] FLAG: --eviction-hard=""
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120971    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120975    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120979    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120982    2565 flags.go:64] FLAG: --eviction-soft=""
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120985    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120988    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120991    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120994    2565 flags.go:64] FLAG: --experimental-mounter-path=""
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.120997    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121000    2565 flags.go:64] FLAG: --fail-swap-on="true"
May 26 19:40:39.124946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121003    2565 flags.go:64] FLAG: --feature-gates=""
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121006    2565 flags.go:64] FLAG: --file-check-frequency="20s"
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121010    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121012    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121016    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121020    2565 flags.go:64] FLAG: --healthz-port="10248"
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121023    2565 flags.go:64] FLAG: --help="false"
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121025    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-140-142.ec2.internal"
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121029    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121032    2565 flags.go:64] FLAG: --http-check-frequency="20s"
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121035    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121039    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121043    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121046    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121048    2565 flags.go:64] FLAG: --image-service-endpoint=""
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121051    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121054    2565 flags.go:64] FLAG: --kube-api-burst="100"
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121057    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121060    2565 flags.go:64] FLAG: --kube-api-qps="50"
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121063    2565 flags.go:64] FLAG: --kube-reserved=""
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121066    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121069    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121072    2565 flags.go:64] FLAG: --kubelet-cgroups=""
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121075    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 26 19:40:39.125572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121078    2565 flags.go:64] FLAG: --lock-file=""
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121081    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121084    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121087    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121092    2565 flags.go:64] FLAG: --log-json-split-stream="false"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121095    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121098    2565 flags.go:64] FLAG: --log-text-split-stream="false"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121101    2565 flags.go:64] FLAG: --logging-format="text"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121104    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121108    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121110    2565 flags.go:64] FLAG: --manifest-url=""
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121113    2565 flags.go:64] FLAG: --manifest-url-header=""
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121118    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121121    2565 flags.go:64] FLAG: --max-open-files="1000000"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121125    2565 flags.go:64] FLAG: --max-pods="110"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121129    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121132    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121136    2565 flags.go:64] FLAG: --memory-manager-policy="None"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121139    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121142    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121145    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121148    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121156    2565 flags.go:64] FLAG: --node-status-max-images="50"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121159    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121162    2565 flags.go:64] FLAG: --oom-score-adj="-999"
May 26 19:40:39.126162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121165    2565 flags.go:64] FLAG: --pod-cidr=""
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121167    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121952    2565 flags.go:64] FLAG: --pod-manifest-path=""
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121956    2565 flags.go:64] FLAG: --pod-max-pids="-1"
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121960    2565 flags.go:64] FLAG: --pods-per-core="0"
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121963    2565 flags.go:64] FLAG: --port="10250"
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121967    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121970    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-030113f1638116a9f"
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121973    2565 flags.go:64] FLAG: --qos-reserved=""
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121976    2565 flags.go:64] FLAG: --read-only-port="10255"
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121979    2565 flags.go:64] FLAG: --register-node="true"
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121982    2565 flags.go:64] FLAG: --register-schedulable="true"
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121985    2565 flags.go:64] FLAG: --register-with-taints=""
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121989    2565 flags.go:64] FLAG: --registry-burst="10"
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121992    2565 flags.go:64] FLAG: --registry-qps="5"
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121995    2565 flags.go:64] FLAG: --reserved-cpus=""
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.121998    2565 flags.go:64] FLAG: --reserved-memory=""
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122002    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122005    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122008    2565 flags.go:64] FLAG: --rotate-certificates="false"
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122010    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122014    2565 flags.go:64] FLAG: --runonce="false"
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122017    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122023    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122026    2565 flags.go:64] FLAG: --seccomp-default="false"
May 26 19:40:39.126762 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122030    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122033    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122037    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122040    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122044    2565 flags.go:64] FLAG: --storage-driver-password="root"
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122047    2565 flags.go:64] FLAG: --storage-driver-secure="false"
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122050    2565 flags.go:64] FLAG: --storage-driver-table="stats"
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122053    2565 flags.go:64] FLAG: --storage-driver-user="root"
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122056    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122059    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122062    2565 flags.go:64] FLAG: --system-cgroups=""
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122064    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122070    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122073    2565 flags.go:64] FLAG: --tls-cert-file=""
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122076    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122080    2565 flags.go:64] FLAG: --tls-min-version=""
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122083    2565 flags.go:64] FLAG: --tls-private-key-file=""
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122086    2565 flags.go:64] FLAG: --topology-manager-policy="none"
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122089    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122092    2565 flags.go:64] FLAG: --topology-manager-scope="container"
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122095    2565 flags.go:64] FLAG: --v="2"
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122099    2565 flags.go:64] FLAG: --version="false"
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122104    2565 flags.go:64] FLAG: --vmodule=""
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122108    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.122111    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 26 19:40:39.127386 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122216    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 19:40:39.127996 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122220    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 19:40:39.127996 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122224    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 19:40:39.127996 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122226    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 19:40:39.127996 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122232    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 19:40:39.127996 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122237    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 19:40:39.127996 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122240    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 19:40:39.127996 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122242    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 19:40:39.127996 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122245    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 19:40:39.127996 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122248    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 19:40:39.127996 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122250    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 19:40:39.127996 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122253    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 19:40:39.127996 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122256    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 19:40:39.127996 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122258    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 19:40:39.127996 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122261    2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 19:40:39.127996 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122264    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 19:40:39.127996 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122266    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 19:40:39.127996 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122269    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 19:40:39.127996 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122271    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 19:40:39.127996 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122274    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 19:40:39.127996 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122276    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 19:40:39.128521 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122279    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 19:40:39.128521 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122281    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 19:40:39.128521 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122284    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 19:40:39.128521 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122286    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 19:40:39.128521 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122289    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 19:40:39.128521 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122291    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 19:40:39.128521 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122294    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 19:40:39.128521 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122297    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 19:40:39.128521 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122299    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 19:40:39.128521 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122302    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 19:40:39.128521 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122304    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 19:40:39.128521 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122307    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 19:40:39.128521 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122309    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 19:40:39.128521 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122312    2565 feature_gate.go:328] unrecognized feature gate: Example2
May 26 19:40:39.128521 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122314    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 19:40:39.128521 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122317    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 19:40:39.128521 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122323    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 19:40:39.128521 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122325    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 19:40:39.128521 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122328    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 19:40:39.128521 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122330    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 19:40:39.129038 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122333    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 19:40:39.129038 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122335    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 19:40:39.129038 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122338    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 19:40:39.129038 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122341    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 19:40:39.129038 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122344    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 19:40:39.129038 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122346    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 19:40:39.129038 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122349    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 19:40:39.129038 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122351    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 19:40:39.129038 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122354    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 19:40:39.129038 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122356    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 19:40:39.129038 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122359    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 19:40:39.129038 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122363    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 19:40:39.129038 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122366    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 19:40:39.129038 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122369    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 19:40:39.129038 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122372    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 19:40:39.129038 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122375    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 19:40:39.129038 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122378    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 19:40:39.129038 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122380    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 19:40:39.129038 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122382    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 19:40:39.129558 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122385    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 19:40:39.129558 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122388    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 19:40:39.129558 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122390    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 19:40:39.129558 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122393    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 19:40:39.129558 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122395    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 19:40:39.129558 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122398    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 19:40:39.129558 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122400    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 19:40:39.129558 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122403    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 19:40:39.129558 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122405    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 19:40:39.129558 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122412    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 19:40:39.129558 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122415    2565 feature_gate.go:328] unrecognized feature gate: Example
May 26 19:40:39.129558 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122418    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 19:40:39.129558 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122421    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 19:40:39.129558 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122423    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 19:40:39.129558 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122426    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 19:40:39.129558 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122428    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 19:40:39.129558 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122431    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 19:40:39.129558 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122434    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 19:40:39.129558 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122438    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 19:40:39.130057 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122441    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 19:40:39.130057 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122445    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 19:40:39.130057 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122447    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 19:40:39.130057 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122450    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 19:40:39.130057 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122453    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 19:40:39.130057 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122455    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 19:40:39.130057 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.122458    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 19:40:39.130057 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.123139    2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 19:40:39.131158 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.131136    2565 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 26 19:40:39.131201 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.131158    2565 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 26 19:40:39.131232 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131221    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 19:40:39.131232 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131228    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 19:40:39.131232 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131231    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 19:40:39.131309 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131235    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 19:40:39.131309 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131238    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 19:40:39.131309 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131241    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 19:40:39.131309 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131244    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 19:40:39.131309 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131247    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 19:40:39.131309 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131250    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 19:40:39.131309 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131253    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 19:40:39.131309 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131255    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 19:40:39.131309 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131258    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 19:40:39.131309 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131260    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 19:40:39.131309 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131263    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 19:40:39.131309 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131265    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 19:40:39.131309 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131268    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 19:40:39.131309 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131271    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 19:40:39.131309 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131274    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 19:40:39.131309 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131278    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 19:40:39.131309 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131283    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 19:40:39.131309 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131286    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 19:40:39.131309 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131289    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 19:40:39.131780 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131292    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 19:40:39.131780 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131295    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 19:40:39.131780 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131298    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 19:40:39.131780 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131301    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 19:40:39.131780 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131304    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 19:40:39.131780 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131306    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 19:40:39.131780 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131309    2565 feature_gate.go:328] unrecognized feature gate: Example
May 26 19:40:39.131780 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131312    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 19:40:39.131780 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131315    2565 feature_gate.go:328] unrecognized feature gate: Example2
May 26 19:40:39.131780 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131319    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 19:40:39.131780 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131322    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 19:40:39.131780 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131324    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 19:40:39.131780 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131327    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 19:40:39.131780 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131330    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 19:40:39.131780 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131333    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 19:40:39.131780 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131335    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 19:40:39.131780 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131338    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 19:40:39.131780 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131340    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 19:40:39.131780 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131343    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 19:40:39.131780 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131345    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 19:40:39.132270 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131348    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 19:40:39.132270 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131350    2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 19:40:39.132270 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131353    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 19:40:39.132270 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131355    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 19:40:39.132270 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131358    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 19:40:39.132270 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131360    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 19:40:39.132270 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131363    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 19:40:39.132270 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131365    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 19:40:39.132270 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131368    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 19:40:39.132270 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131370    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 19:40:39.132270 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131373    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 19:40:39.132270 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131375    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 19:40:39.132270 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131378    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 19:40:39.132270 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131381    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 19:40:39.132270 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131384    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 19:40:39.132270 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131387    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 19:40:39.132270 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131389    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 19:40:39.132270 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131392    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 19:40:39.132270 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131394    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 19:40:39.132270 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131397    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 19:40:39.132812 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131400    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 19:40:39.132812 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131402    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 19:40:39.132812 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131406    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 19:40:39.132812 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131408    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 19:40:39.132812 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131411    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 19:40:39.132812 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131414    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 19:40:39.132812 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131416    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 19:40:39.132812 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131418    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 19:40:39.132812 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131422    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 19:40:39.132812 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131425    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 19:40:39.132812 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131428    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 19:40:39.132812 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131430    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 19:40:39.132812 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131433    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 19:40:39.132812 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131435    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 19:40:39.132812 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131438    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 19:40:39.132812 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131440    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 19:40:39.132812 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131443    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 19:40:39.132812 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131445    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 19:40:39.132812 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131447    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 19:40:39.132812 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131450    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 19:40:39.133304 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131452    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 19:40:39.133304 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131455    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 19:40:39.133304 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131457    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 19:40:39.133304 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131460    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 19:40:39.133304 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.131465    2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 19:40:39.133304 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131579    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 26 19:40:39.133304 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131584    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 26 19:40:39.133304 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131587    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 26 19:40:39.133304 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131590    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 26 19:40:39.133304 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131593    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 26 19:40:39.133304 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131596    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 26 19:40:39.133304 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131599    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 26 19:40:39.133304 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131602    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 26 19:40:39.133304 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131604    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 26 19:40:39.133304 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131607    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 26 19:40:39.133674 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131610    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 26 19:40:39.133674 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131612    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 26 19:40:39.133674 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131615    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 26 19:40:39.133674 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131617    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 26 19:40:39.133674 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131620    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 26 19:40:39.133674 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131623    2565 feature_gate.go:328] unrecognized feature gate: Example
May 26 19:40:39.133674 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131626    2565 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 26 19:40:39.133674 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131628    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 26 19:40:39.133674 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131631    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 26 19:40:39.133674 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131633    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 26 19:40:39.133674 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131636    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 26 19:40:39.133674 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131639    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 26 19:40:39.133674 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131642    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 26 19:40:39.133674 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131644    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 26 19:40:39.133674 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131647    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 26 19:40:39.133674 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131649    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 26 19:40:39.133674 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131652    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 26 19:40:39.133674 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131654    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 26 19:40:39.133674 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131657    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131659    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131662    2565 feature_gate.go:328] unrecognized feature gate: Example2
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131664    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131667    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131670    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131672    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131675    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131677    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131680    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131682    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131685    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131687    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131690    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131693    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131696    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131699    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131701    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131703    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131706    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131708    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 26 19:40:39.134158 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131711    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 26 19:40:39.134677 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131714    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 26 19:40:39.134677 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131716    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 26 19:40:39.134677 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131718    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 26 19:40:39.134677 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131721    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 26 19:40:39.134677 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131723    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 26 19:40:39.134677 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131726    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 26 19:40:39.134677 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131729    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 26 19:40:39.134677 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131731    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 26 19:40:39.134677 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131734    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 26 19:40:39.134677 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131736    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 26 19:40:39.134677 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131738    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 26 19:40:39.134677 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131741    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 26 19:40:39.134677 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131743    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 26 19:40:39.134677 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131746    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 26 19:40:39.134677 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131748    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 26 19:40:39.134677 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131751    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 26 19:40:39.134677 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131753    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 26 19:40:39.134677 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131757    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 26 19:40:39.134677 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131760    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 26 19:40:39.134677 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131778    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 26 19:40:39.135186 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131781    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 26 19:40:39.135186 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131784    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 26 19:40:39.135186 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131787    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 26 19:40:39.135186 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131790    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 26 19:40:39.135186 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131793    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 26 19:40:39.135186 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131795    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 26 19:40:39.135186 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131798    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 26 19:40:39.135186 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131801    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 26 19:40:39.135186 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131804    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 26 19:40:39.135186 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131806    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 26 19:40:39.135186 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131809    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 26 19:40:39.135186 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131811    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 26 19:40:39.135186 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131814    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 26 19:40:39.135186 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131818    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 26 19:40:39.135186 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131821    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 26 19:40:39.135186 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:39.131824    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 26 19:40:39.135581 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.131829    2565 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 26 19:40:39.135581 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.132664    2565 server.go:962] "Client rotation is on, will bootstrap in background"
May 26 19:40:39.139304 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.139287    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 26 19:40:39.140259 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.140248    2565 server.go:1019] "Starting client certificate rotation"
May 26 19:40:39.140362 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.140344    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 19:40:39.141044 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.141032    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 26 19:40:39.172079 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.172046    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 19:40:39.176886 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.176857    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 26 19:40:39.196795 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.196762    2565 log.go:25] "Validated CRI v1 runtime API"
May 26 19:40:39.197805 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.197786    2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 19:40:39.202421 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.202408    2565 log.go:25] "Validated CRI v1 image API"
May 26 19:40:39.203733 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.203717    2565 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 26 19:40:39.208134 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.208108    2565 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 afa995d2-c29f-4ab4-998e-37451307034b:/dev/nvme0n1p3 c39367db-7b37-4942-b6ce-02a19ce7f0d5:/dev/nvme0n1p4]
May 26 19:40:39.208207 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.208133    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 26 19:40:39.212891 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.212787    2565 manager.go:217] Machine: {Timestamp:2026-05-26 19:40:39.212284101 +0000 UTC m=+0.478620424 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099107 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2a67b632469feb4efc7503c89b1f43 SystemUUID:ec2a67b6-3246-9feb-4efc-7503c89b1f43 BootID:135dd9c8-9b9f-4259-b27d-8946ac5e839e Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:26:63:b8:4b:3d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:26:63:b8:4b:3d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9a:05:c6:8e:82:f1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 26 19:40:39.213735 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.213723    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 26 19:40:39.213881 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.213868    2565 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 26 19:40:39.216079 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.216056    2565 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 26 19:40:39.216228 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.216082    2565 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-142.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 26 19:40:39.216274 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.216239    2565 topology_manager.go:138] "Creating topology manager with none policy"
May 26 19:40:39.216274 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.216248    2565 container_manager_linux.go:306] "Creating device plugin manager"
May 26 19:40:39.216274 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.216256    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 19:40:39.217046 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.217036    2565 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 26 19:40:39.219322 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.219312    2565 state_mem.go:36] "Initialized new in-memory state store"
May 26 19:40:39.219441 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.219433    2565 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 26 19:40:39.219825 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.219810    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zkvkz"
May 26 19:40:39.222001 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.221990    2565 kubelet.go:491] "Attempting to sync node with API server"
May 26 19:40:39.222046 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.222011    2565 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 26 19:40:39.222046 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.222025    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 26 19:40:39.222046 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.222038    2565 kubelet.go:397] "Adding apiserver pod source"
May 26 19:40:39.222128 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.222048    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 26 19:40:39.223357 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.223344    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 19:40:39.223395 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.223372    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 26 19:40:39.227405 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.227383    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-zkvkz"
May 26 19:40:39.230482 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.230462    2565 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 26 19:40:39.232997 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.232981    2565 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 26 19:40:39.234110 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.234083    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 26 19:40:39.234110 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.234100    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 26 19:40:39.234222 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.234107    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 26 19:40:39.234222 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.234121    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 26 19:40:39.234222 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.234129    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 26 19:40:39.234222 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.234135    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 26 19:40:39.234222 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.234141    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 26 19:40:39.234222 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.234147    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 26 19:40:39.234222 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.234154    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 26 19:40:39.234222 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.234160    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 26 19:40:39.234222 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.234169    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 26 19:40:39.234630 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.234619    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 26 19:40:39.236656 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.236642    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 26 19:40:39.236656 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.236658    2565 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 26 19:40:39.237968 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.237949    2565 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:40:39.239030 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.239011    2565 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:40:39.239806 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.239793    2565 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 26 19:40:39.239871 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.239831    2565 server.go:1295] "Started kubelet"
May 26 19:40:39.239926 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.239897    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 26 19:40:39.240042 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.239961    2565 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 26 19:40:39.240113 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.240063    2565 server_v1.go:47] "podresources" method="list" useActivePods=true
May 26 19:40:39.240533 ip-10-0-140-142 systemd[1]: Started Kubernetes Kubelet.
May 26 19:40:39.241210 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.241198    2565 server.go:317] "Adding debug handlers to kubelet server"
May 26 19:40:39.242117 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.242097    2565 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 26 19:40:39.243906 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.243879    2565 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-140-142.ec2.internal" not found
May 26 19:40:39.248316 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.248289    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 26 19:40:39.248983 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.248949    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 26 19:40:39.249052 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:39.249006    2565 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 26 19:40:39.249154 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.249137    2565 volume_manager.go:295] "The desired_state_of_world populator starts"
May 26 19:40:39.249212 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.249156    2565 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 26 19:40:39.249260 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.249240    2565 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 26 19:40:39.249306 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.249282    2565 reconstruct.go:97] "Volume reconstruction finished"
May 26 19:40:39.249306 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.249291    2565 reconciler.go:26] "Reconciler: start to sync state"
May 26 19:40:39.249640 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.249622    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 26 19:40:39.249640 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.249639    2565 factory.go:55] Registering systemd factory
May 26 19:40:39.249742 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.249647    2565 factory.go:223] Registration of the systemd container factory successfully
May 26 19:40:39.249884 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:39.249865    2565 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-142.ec2.internal\" not found"
May 26 19:40:39.249884 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.249881    2565 factory.go:153] Registering CRI-O factory
May 26 19:40:39.250062 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.249895    2565 factory.go:223] Registration of the crio container factory successfully
May 26 19:40:39.250062 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.249913    2565 factory.go:103] Registering Raw factory
May 26 19:40:39.250062 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.249925    2565 manager.go:1196] Started watching for new ooms in manager
May 26 19:40:39.251017 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.251003    2565 manager.go:319] Starting recovery of all containers
May 26 19:40:39.251891 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.251871    2565 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:40:39.263392 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.263373    2565 manager.go:324] Recovery completed
May 26 19:40:39.264823 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:39.264790    2565 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
May 26 19:40:39.265998 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:39.265977    2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-142.ec2.internal\" not found" node="ip-10-0-140-142.ec2.internal"
May 26 19:40:39.266176 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.266163    2565 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-140-142.ec2.internal" not found
May 26 19:40:39.267718 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.267707    2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 19:40:39.269545 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.269528    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-142.ec2.internal" event="NodeHasSufficientMemory"
May 26 19:40:39.269617 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.269559    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-142.ec2.internal" event="NodeHasNoDiskPressure"
May 26 19:40:39.269617 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.269571    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-142.ec2.internal" event="NodeHasSufficientPID"
May 26 19:40:39.270085 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.270073    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 26 19:40:39.270085 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.270083    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 26 19:40:39.270187 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.270099    2565 state_mem.go:36] "Initialized new in-memory state store"
May 26 19:40:39.273288 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.273276    2565 policy_none.go:49] "None policy: Start"
May 26 19:40:39.273323 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.273293    2565 memory_manager.go:186] "Starting memorymanager" policy="None"
May 26 19:40:39.273323 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.273305    2565 state_mem.go:35] "Initializing new in-memory state store"
May 26 19:40:39.308539 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.308330    2565 manager.go:341] "Starting Device Plugin manager"
May 26 19:40:39.327545 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:39.308559    2565 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 26 19:40:39.327545 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.308570    2565 server.go:85] "Starting device plugin registration server"
May 26 19:40:39.327545 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.308846    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
May 26 19:40:39.327545 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.308858    2565 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 26 19:40:39.327545 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.308962    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 26 19:40:39.327545 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.309036    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 26 19:40:39.327545 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.309042    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 26 19:40:39.327545 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:39.309588    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 26 19:40:39.327545 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:39.309627    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-142.ec2.internal\" not found"
May 26 19:40:39.327545 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.322361    2565 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-140-142.ec2.internal" not found
May 26 19:40:39.346395 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.346365    2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 26 19:40:39.347551 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.347533    2565 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 26 19:40:39.347551 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.347553    2565 status_manager.go:230] "Starting to sync pod status with apiserver"
May 26 19:40:39.347677 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.347570    2565 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 26 19:40:39.347677 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.347579    2565 kubelet.go:2451] "Starting kubelet main sync loop"
May 26 19:40:39.347677 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:39.347623    2565 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 26 19:40:39.349216 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.349196    2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:40:39.409331 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.409256    2565 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 26 19:40:39.410214 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.410199    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-142.ec2.internal" event="NodeHasSufficientMemory"
May 26 19:40:39.410274 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.410231    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-142.ec2.internal" event="NodeHasNoDiskPressure"
May 26 19:40:39.410274 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.410245    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-142.ec2.internal" event="NodeHasSufficientPID"
May 26 19:40:39.410274 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.410270    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-142.ec2.internal"
May 26 19:40:39.418121 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.418108    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-142.ec2.internal"
May 26 19:40:39.418168 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:39.418138    2565 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-142.ec2.internal\": node \"ip-10-0-140-142.ec2.internal\" not found"
May 26 19:40:39.447998 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.447965    2565 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-142.ec2.internal"]
May 26 19:40:39.449214 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.449198    2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal"
May 26 19:40:39.449981 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.449966    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-142.ec2.internal"
May 26 19:40:39.449981 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.449975    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal"
May 26 19:40:39.468251 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.468232    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 19:40:39.468340 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.468330    2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-142.ec2.internal"
May 26 19:40:39.477422 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.477406    2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-142.ec2.internal"
May 26 19:40:39.481936 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.481923    2565 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal"
May 26 19:40:39.487670 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.487655    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 19:40:39.495952 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.495934    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 19:40:39.496026 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:39.495980    2565 kubelet.go:3342] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-140-142.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-142.ec2.internal"
May 26 19:40:39.508882 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.508859    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 26 19:40:39.508986 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:39.508900    2565 kubelet.go:3342] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal"
May 26 19:40:39.550013 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.549983    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d2076f4d741d61d5b76bd318158f3c0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal\" (UID: \"8d2076f4d741d61d5b76bd318158f3c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal"
May 26 19:40:39.550013 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.550013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d2076f4d741d61d5b76bd318158f3c0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal\" (UID: \"8d2076f4d741d61d5b76bd318158f3c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal"
May 26 19:40:39.550161 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.550034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/82baf510049493772726052266fb60af-config\") pod \"kube-apiserver-proxy-ip-10-0-140-142.ec2.internal\" (UID: \"82baf510049493772726052266fb60af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-142.ec2.internal"
May 26 19:40:39.651168 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.651140    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d2076f4d741d61d5b76bd318158f3c0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal\" (UID: \"8d2076f4d741d61d5b76bd318158f3c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal"
May 26 19:40:39.651168 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.651169    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/82baf510049493772726052266fb60af-config\") pod \"kube-apiserver-proxy-ip-10-0-140-142.ec2.internal\" (UID: \"82baf510049493772726052266fb60af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-142.ec2.internal"
May 26 19:40:39.651316 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.651184    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d2076f4d741d61d5b76bd318158f3c0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal\" (UID: \"8d2076f4d741d61d5b76bd318158f3c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal"
May 26 19:40:39.651316 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.651226    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/8d2076f4d741d61d5b76bd318158f3c0-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal\" (UID: \"8d2076f4d741d61d5b76bd318158f3c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal"
May 26 19:40:39.651316 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.651242    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8d2076f4d741d61d5b76bd318158f3c0-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal\" (UID: \"8d2076f4d741d61d5b76bd318158f3c0\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal"
May 26 19:40:39.651316 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.651243    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/82baf510049493772726052266fb60af-config\") pod \"kube-apiserver-proxy-ip-10-0-140-142.ec2.internal\" (UID: \"82baf510049493772726052266fb60af\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-142.ec2.internal"
May 26 19:40:39.798505 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.798457    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-142.ec2.internal"
May 26 19:40:39.812154 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:39.812124    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal"
May 26 19:40:40.139978 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.139896    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 26 19:40:40.140394 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.140029    2565 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 19:40:40.140394 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.140061    2565 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 19:40:40.140394 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.140061    2565 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 26 19:40:40.222482 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.222449    2565 apiserver.go:52] "Watching apiserver"
May 26 19:40:40.229436 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.229404    2565 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 26 19:40:40.229583 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.229514    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-25 19:35:39 +0000 UTC" deadline="2027-10-20 13:08:56.667974423 +0000 UTC"
May 26 19:40:40.229583 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.229553    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12281h28m16.438425129s"
May 26 19:40:40.229812 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.229794    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-142.ec2.internal","openshift-cluster-node-tuning-operator/tuned-x9qhz","openshift-dns/node-resolver-bm27c","openshift-image-registry/node-ca-mf2pb","openshift-network-diagnostics/network-check-target-dbnpx","openshift-network-operator/iptables-alerter-n2sz2","openshift-ovn-kubernetes/ovnkube-node-w942w","kube-system/konnectivity-agent-9chd6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal","openshift-multus/multus-additional-cni-plugins-qv6dg","openshift-multus/multus-wvhzl","openshift-multus/network-metrics-daemon-twnct"]
May 26 19:40:40.232276 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.232259    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.233165 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.233143    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bm27c"
May 26 19:40:40.234089 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.234063    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mf2pb"
May 26 19:40:40.234490 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.234475    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 26 19:40:40.234566 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.234475    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 26 19:40:40.234656 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.234638    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7hx42\""
May 26 19:40:40.235164 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.235149    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:40:40.235236 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:40.235210    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbnpx" podUID="c9b9e277-d07d-4630-9d88-f2fad67bc7e9"
May 26 19:40:40.235345 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.235330    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 26 19:40:40.235404 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.235346    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 26 19:40:40.235469 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.235451    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-zpr6g\""
May 26 19:40:40.236128 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.236114    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 26 19:40:40.236213 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.236164    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 26 19:40:40.236213 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.236169    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n2sz2"
May 26 19:40:40.236309 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.236218    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 26 19:40:40.236309 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.236257    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kq5pj\""
May 26 19:40:40.236403 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.236308    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.237374 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.237356    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9chd6"
May 26 19:40:40.238446 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.238423    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.238577 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.238458    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 26 19:40:40.238577 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.238473    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 26 19:40:40.238716 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.238699    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 26 19:40:40.241054 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.241032    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 26 19:40:40.241146 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.241097    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.241146 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.241106    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 26 19:40:40.241266 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.241190    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 26 19:40:40.241457 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.241438    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 26 19:40:40.241590 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.241566    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 26 19:40:40.241900 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.241881    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 26 19:40:40.241900 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.241566    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 26 19:40:40.242241 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.242223    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 26 19:40:40.242380 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.242289    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-97bsm\""
May 26 19:40:40.242380 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.242238    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-6x9qs\""
May 26 19:40:40.242380 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.242315    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-xmslq\""
May 26 19:40:40.242380 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.242246    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 26 19:40:40.242380 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.242271    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 26 19:40:40.242380 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.242272    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 26 19:40:40.242632 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.242255    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6txgs\""
May 26 19:40:40.242632 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.242537    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.243730 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.243711    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:40:40.243831 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.243716    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 26 19:40:40.243831 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:40.243790    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twnct" podUID="5b513a26-7609-4fa6-b6ac-ae939b6d6436"
May 26 19:40:40.243929 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.243863    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 26 19:40:40.244591 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.244574    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 26 19:40:40.244591 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.244590    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 26 19:40:40.244710 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.244696    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-w62ql\""
May 26 19:40:40.244868 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.244853    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 26 19:40:40.244918 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.244895    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 26 19:40:40.245053 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.245041    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-8q4cz\""
May 26 19:40:40.248422 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.248403    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 26 19:40:40.250353 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.250201    2565 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 26 19:40:40.254626 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.254611    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f7d1ae5-9411-4022-96af-9385481515b5-host-slash\") pod \"iptables-alerter-n2sz2\" (UID: \"8f7d1ae5-9411-4022-96af-9385481515b5\") " pod="openshift-network-operator/iptables-alerter-n2sz2"
May 26 19:40:40.254703 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.254632    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-cnibin\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.254703 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.254648    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-etc-openvswitch\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.254703 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.254663    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hqth\" (UniqueName: \"kubernetes.io/projected/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-kube-api-access-6hqth\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.254703 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.254684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fac17afd-7b7a-40b3-87cf-cf4177b5eac9-konnectivity-ca\") pod \"konnectivity-agent-9chd6\" (UID: \"fac17afd-7b7a-40b3-87cf-cf4177b5eac9\") " pod="kube-system/konnectivity-agent-9chd6"
May 26 19:40:40.254849 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.254719    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32a4562d-8bef-44cb-8028-3cb8087dbe94-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.254849 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.254740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-multus-conf-dir\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.254849 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.254756    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-host-run-multus-certs\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.254849 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.254796    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8czvc\" (UniqueName: \"kubernetes.io/projected/8f7d1ae5-9411-4022-96af-9385481515b5-kube-api-access-8czvc\") pod \"iptables-alerter-n2sz2\" (UID: \"8f7d1ae5-9411-4022-96af-9385481515b5\") " pod="openshift-network-operator/iptables-alerter-n2sz2"
May 26 19:40:40.254849 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.254824    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32a4562d-8bef-44cb-8028-3cb8087dbe94-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.254849 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.254845    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ccf28885-6179-40dc-8642-69a8d03a5476-sys-fs\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.255040 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.254863    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-os-release\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.255040 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.254878    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmj2b\" (UniqueName: \"kubernetes.io/projected/22348da8-918f-4a01-99e8-2423faf20c80-kube-api-access-jmj2b\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.255040 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.254913    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prqqm\" (UniqueName: \"kubernetes.io/projected/5b513a26-7609-4fa6-b6ac-ae939b6d6436-kube-api-access-prqqm\") pod \"network-metrics-daemon-twnct\" (UID: \"5b513a26-7609-4fa6-b6ac-ae939b6d6436\") " pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:40:40.255040 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.254943    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcc59\" (UniqueName: \"kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59\") pod \"network-check-target-dbnpx\" (UID: \"c9b9e277-d07d-4630-9d88-f2fad67bc7e9\") " pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:40:40.255040 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.254965    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f7d1ae5-9411-4022-96af-9385481515b5-iptables-alerter-script\") pod \"iptables-alerter-n2sz2\" (UID: \"8f7d1ae5-9411-4022-96af-9385481515b5\") " pod="openshift-network-operator/iptables-alerter-n2sz2"
May 26 19:40:40.255040 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.254986    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-cni-netd\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.255040 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255009    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-ovnkube-config\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.255040 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255026    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-sysconfig\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.255337 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255045    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ccf28885-6179-40dc-8642-69a8d03a5476-socket-dir\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.255337 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255060    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7xkn\" (UniqueName: \"kubernetes.io/projected/ccf28885-6179-40dc-8642-69a8d03a5476-kube-api-access-h7xkn\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.255337 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255083    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-host-var-lib-cni-multus\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.255337 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255129    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-etc-kubernetes\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.255337 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255174    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-ovn-node-metrics-cert\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.255337 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255198    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32a4562d-8bef-44cb-8028-3cb8087dbe94-cni-binary-copy\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.255337 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255220    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-systemd\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.255337 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w876k\" (UniqueName: \"kubernetes.io/projected/e3c2e921-2ac0-4eb4-a114-cfc760676be0-kube-api-access-w876k\") pod \"node-ca-mf2pb\" (UID: \"e3c2e921-2ac0-4eb4-a114-cfc760676be0\") " pod="openshift-image-registry/node-ca-mf2pb"
May 26 19:40:40.255337 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255250    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22348da8-918f-4a01-99e8-2423faf20c80-cni-binary-copy\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.255337 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255263    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-env-overrides\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.255337 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255277    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-host\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.255337 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255290    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-tmp\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.255337 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255304    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-multus-socket-dir-parent\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.255337 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255334    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-var-lib-openvswitch\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.255714 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fac17afd-7b7a-40b3-87cf-cf4177b5eac9-agent-certs\") pod \"konnectivity-agent-9chd6\" (UID: \"fac17afd-7b7a-40b3-87cf-cf4177b5eac9\") " pod="kube-system/konnectivity-agent-9chd6"
May 26 19:40:40.255714 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255361    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32a4562d-8bef-44cb-8028-3cb8087dbe94-os-release\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.255714 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255376    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ccf28885-6179-40dc-8642-69a8d03a5476-registration-dir\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.255714 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255392    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.255714 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255409    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.255714 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255424    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-var-lib-kubelet\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.255714 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255436    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-tuned\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.255714 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255450    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99700566-adbe-45d2-b160-8bf4530daeb3-tmp-dir\") pod \"node-resolver-bm27c\" (UID: \"99700566-adbe-45d2-b160-8bf4530daeb3\") " pod="openshift-dns/node-resolver-bm27c"
May 26 19:40:40.255714 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255476    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ccf28885-6179-40dc-8642-69a8d03a5476-device-dir\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.255714 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-hostroot\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.255714 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255515    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-log-socket\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.255714 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32a4562d-8bef-44cb-8028-3cb8087dbe94-system-cni-dir\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.255714 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255547    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32a4562d-8bef-44cb-8028-3cb8087dbe94-cnibin\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.255714 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255565    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-modprobe-d\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.255714 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255584    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-sysctl-d\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.255714 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255603    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-slash\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.256185 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255625    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-lib-modules\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.256185 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255642    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99700566-adbe-45d2-b160-8bf4530daeb3-hosts-file\") pod \"node-resolver-bm27c\" (UID: \"99700566-adbe-45d2-b160-8bf4530daeb3\") " pod="openshift-dns/node-resolver-bm27c"
May 26 19:40:40.256185 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255659    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ccf28885-6179-40dc-8642-69a8d03a5476-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.256185 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255676    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-multus-cni-dir\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.256185 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255710    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-host-var-lib-cni-bin\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.256185 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255726    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32a4562d-8bef-44cb-8028-3cb8087dbe94-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.256185 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255743    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-kubernetes\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.256185 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3c2e921-2ac0-4eb4-a114-cfc760676be0-host\") pod \"node-ca-mf2pb\" (UID: \"e3c2e921-2ac0-4eb4-a114-cfc760676be0\") " pod="openshift-image-registry/node-ca-mf2pb"
May 26 19:40:40.256185 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255799    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-kubelet\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.256185 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255813    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-node-log\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.256185 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255826    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtfh4\" (UniqueName: \"kubernetes.io/projected/99700566-adbe-45d2-b160-8bf4530daeb3-kube-api-access-qtfh4\") pod \"node-resolver-bm27c\" (UID: \"99700566-adbe-45d2-b160-8bf4530daeb3\") " pod="openshift-dns/node-resolver-bm27c"
May 26 19:40:40.256185 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs\") pod \"network-metrics-daemon-twnct\" (UID: \"5b513a26-7609-4fa6-b6ac-ae939b6d6436\") " pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:40:40.256185 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255865    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-systemd-units\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.256185 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255883    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-run-ovn\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.256185 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255896    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-cni-bin\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.256185 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255921    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-sysctl-conf\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.256185 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255942    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-run\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.256633 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.255968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3c2e921-2ac0-4eb4-a114-cfc760676be0-serviceca\") pod \"node-ca-mf2pb\" (UID: \"e3c2e921-2ac0-4eb4-a114-cfc760676be0\") " pod="openshift-image-registry/node-ca-mf2pb"
May 26 19:40:40.256633 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.256022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-host-run-k8s-cni-cncf-io\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.256633 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.256043    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-ovnkube-script-lib\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.256633 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.256057    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-system-cni-dir\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.256633 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.256073    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-host-run-netns\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.256633 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.256086    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-run-openvswitch\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.256633 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.256102    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8grkd\" (UniqueName: \"kubernetes.io/projected/32a4562d-8bef-44cb-8028-3cb8087dbe94-kube-api-access-8grkd\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.256633 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.256138    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-sys\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.256633 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.256161    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv8b2\" (UniqueName: \"kubernetes.io/projected/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-kube-api-access-vv8b2\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.256633 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.256178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ccf28885-6179-40dc-8642-69a8d03a5476-etc-selinux\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.256633 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.256199    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-host-var-lib-kubelet\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.256633 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.256213    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/22348da8-918f-4a01-99e8-2423faf20c80-multus-daemon-config\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.256633 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.256234    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-run-netns\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.256633 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.256249    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-run-systemd\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.261209 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.261191    2565 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 26 19:40:40.283311 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.283290    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-j298k"
May 26 19:40:40.291961 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.291938    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-j298k"
May 26 19:40:40.357449 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357412    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.357638 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357457    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.357638 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357481    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-var-lib-kubelet\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.357638 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357521    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-run-ovn-kubernetes\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.357638 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357528    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.357638 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357543    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-var-lib-kubelet\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.357638 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357562    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-tuned\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.357638 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357588    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99700566-adbe-45d2-b160-8bf4530daeb3-tmp-dir\") pod \"node-resolver-bm27c\" (UID: \"99700566-adbe-45d2-b160-8bf4530daeb3\") " pod="openshift-dns/node-resolver-bm27c"
May 26 19:40:40.357638 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357606    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ccf28885-6179-40dc-8642-69a8d03a5476-device-dir\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.358045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357655    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/ccf28885-6179-40dc-8642-69a8d03a5476-device-dir\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.358045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357697    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-hostroot\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.358045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357728    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-log-socket\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.358045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357752    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32a4562d-8bef-44cb-8028-3cb8087dbe94-system-cni-dir\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.358045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357786    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-hostroot\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.358045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357793    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32a4562d-8bef-44cb-8028-3cb8087dbe94-cnibin\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.358045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357801    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-log-socket\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.358045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357844    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/32a4562d-8bef-44cb-8028-3cb8087dbe94-cnibin\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.358045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357847    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/32a4562d-8bef-44cb-8028-3cb8087dbe94-system-cni-dir\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.358045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357878    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-modprobe-d\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.358045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357895    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 26 19:40:40.358045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357905    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-sysctl-d\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.358045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357930    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-slash\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.358045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357939    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99700566-adbe-45d2-b160-8bf4530daeb3-tmp-dir\") pod \"node-resolver-bm27c\" (UID: \"99700566-adbe-45d2-b160-8bf4530daeb3\") " pod="openshift-dns/node-resolver-bm27c"
May 26 19:40:40.358045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357952    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-lib-modules\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.358045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357962    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-modprobe-d\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.358045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.357978    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99700566-adbe-45d2-b160-8bf4530daeb3-hosts-file\") pod \"node-resolver-bm27c\" (UID: \"99700566-adbe-45d2-b160-8bf4530daeb3\") " pod="openshift-dns/node-resolver-bm27c"
May 26 19:40:40.358045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358005    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-slash\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.358867 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358005    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ccf28885-6179-40dc-8642-69a8d03a5476-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.358867 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358038    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-multus-cni-dir\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.358867 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358055    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/ccf28885-6179-40dc-8642-69a8d03a5476-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.358867 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358099    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-host-var-lib-cni-bin\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.358867 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358059    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-host-var-lib-cni-bin\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.358867 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358100    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-lib-modules\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.358867 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358131    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32a4562d-8bef-44cb-8028-3cb8087dbe94-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.358867 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358154    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99700566-adbe-45d2-b160-8bf4530daeb3-hosts-file\") pod \"node-resolver-bm27c\" (UID: \"99700566-adbe-45d2-b160-8bf4530daeb3\") " pod="openshift-dns/node-resolver-bm27c"
May 26 19:40:40.358867 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358157    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-kubernetes\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.358867 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358193    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3c2e921-2ac0-4eb4-a114-cfc760676be0-host\") pod \"node-ca-mf2pb\" (UID: \"e3c2e921-2ac0-4eb4-a114-cfc760676be0\") " pod="openshift-image-registry/node-ca-mf2pb"
May 26 19:40:40.358867 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358209    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-kubelet\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.358867 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358221    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3c2e921-2ac0-4eb4-a114-cfc760676be0-host\") pod \"node-ca-mf2pb\" (UID: \"e3c2e921-2ac0-4eb4-a114-cfc760676be0\") " pod="openshift-image-registry/node-ca-mf2pb"
May 26 19:40:40.358867 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358225    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-node-log\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.358867 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358250    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-node-log\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.358867 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358256    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-sysctl-d\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.358867 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358192    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-kubernetes\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.358867 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358255    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qtfh4\" (UniqueName: \"kubernetes.io/projected/99700566-adbe-45d2-b160-8bf4530daeb3-kube-api-access-qtfh4\") pod \"node-resolver-bm27c\" (UID: \"99700566-adbe-45d2-b160-8bf4530daeb3\") " pod="openshift-dns/node-resolver-bm27c"
May 26 19:40:40.358867 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358294    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs\") pod \"network-metrics-daemon-twnct\" (UID: \"5b513a26-7609-4fa6-b6ac-ae939b6d6436\") " pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:40:40.359754 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358316    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-systemd-units\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.359754 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358338    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-run-ovn\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.359754 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358348    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-kubelet\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.359754 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358361    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-cni-bin\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.359754 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358385    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-sysctl-conf\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.359754 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358408    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-run\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.359754 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:40.358421    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:40.359754 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358429    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3c2e921-2ac0-4eb4-a114-cfc760676be0-serviceca\") pod \"node-ca-mf2pb\" (UID: \"e3c2e921-2ac0-4eb4-a114-cfc760676be0\") " pod="openshift-image-registry/node-ca-mf2pb"
May 26 19:40:40.359754 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358455    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-host-run-k8s-cni-cncf-io\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.359754 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358480    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-ovnkube-script-lib\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.359754 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358503    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-system-cni-dir\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.359754 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358527    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-host-run-netns\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.359754 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358552    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-run-openvswitch\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.359754 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358566    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-run\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.359754 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358585    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8grkd\" (UniqueName: \"kubernetes.io/projected/32a4562d-8bef-44cb-8028-3cb8087dbe94-kube-api-access-8grkd\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.359754 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358607    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-systemd-units\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.359754 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358610    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-sys\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.359754 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358191    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-multus-cni-dir\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.360573 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358646    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vv8b2\" (UniqueName: \"kubernetes.io/projected/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-kube-api-access-vv8b2\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.360573 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358652    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-sys\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.360573 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358671    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ccf28885-6179-40dc-8642-69a8d03a5476-etc-selinux\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.360573 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358686    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-cni-bin\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.360573 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358696    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-host-var-lib-kubelet\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.360573 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358724    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/22348da8-918f-4a01-99e8-2423faf20c80-multus-daemon-config\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.360573 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358739    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/32a4562d-8bef-44cb-8028-3cb8087dbe94-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.360573 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358751    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-run-netns\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.360573 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358792    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-run-systemd\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.360573 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358817    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f7d1ae5-9411-4022-96af-9385481515b5-host-slash\") pod \"iptables-alerter-n2sz2\" (UID: \"8f7d1ae5-9411-4022-96af-9385481515b5\") " pod="openshift-network-operator/iptables-alerter-n2sz2"
May 26 19:40:40.360573 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358843    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-cnibin\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.360573 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358842    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-sysctl-conf\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.360573 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358869    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-etc-openvswitch\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.360573 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358914    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-system-cni-dir\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.360573 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358915    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-etc-openvswitch\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.360573 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358724    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-run-ovn\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.360573 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.358971    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-host-run-k8s-cni-cncf-io\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.360573 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359056    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3c2e921-2ac0-4eb4-a114-cfc760676be0-serviceca\") pod \"node-ca-mf2pb\" (UID: \"e3c2e921-2ac0-4eb4-a114-cfc760676be0\") " pod="openshift-image-registry/node-ca-mf2pb"
May 26 19:40:40.361416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359112    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-host-run-netns\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.361416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359122    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-run-netns\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.361416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359159    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-run-openvswitch\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.361416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359197    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-run-systemd\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.361416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359236    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8f7d1ae5-9411-4022-96af-9385481515b5-host-slash\") pod \"iptables-alerter-n2sz2\" (UID: \"8f7d1ae5-9411-4022-96af-9385481515b5\") " pod="openshift-network-operator/iptables-alerter-n2sz2"
May 26 19:40:40.361416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359286    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-cnibin\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.361416 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:40.359345    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs podName:5b513a26-7609-4fa6-b6ac-ae939b6d6436 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:40.859302563 +0000 UTC m=+2.125638873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs") pod "network-metrics-daemon-twnct" (UID: "5b513a26-7609-4fa6-b6ac-ae939b6d6436") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:40.361416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359347    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/22348da8-918f-4a01-99e8-2423faf20c80-multus-daemon-config\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.361416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359363    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6hqth\" (UniqueName: \"kubernetes.io/projected/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-kube-api-access-6hqth\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.361416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359392    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/ccf28885-6179-40dc-8642-69a8d03a5476-etc-selinux\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.361416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359405    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-host-var-lib-kubelet\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.361416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359392    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fac17afd-7b7a-40b3-87cf-cf4177b5eac9-konnectivity-ca\") pod \"konnectivity-agent-9chd6\" (UID: \"fac17afd-7b7a-40b3-87cf-cf4177b5eac9\") " pod="kube-system/konnectivity-agent-9chd6"
May 26 19:40:40.361416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359464    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32a4562d-8bef-44cb-8028-3cb8087dbe94-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.361416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359494    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-ovnkube-script-lib\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.361416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359570    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-multus-conf-dir\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.361416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359597    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-host-run-multus-certs\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.361416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359615    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8czvc\" (UniqueName: \"kubernetes.io/projected/8f7d1ae5-9411-4022-96af-9385481515b5-kube-api-access-8czvc\") pod \"iptables-alerter-n2sz2\" (UID: \"8f7d1ae5-9411-4022-96af-9385481515b5\") " pod="openshift-network-operator/iptables-alerter-n2sz2"
May 26 19:40:40.362243 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359654    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-host-run-multus-certs\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.362243 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359675    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32a4562d-8bef-44cb-8028-3cb8087dbe94-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.362243 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359693    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ccf28885-6179-40dc-8642-69a8d03a5476-sys-fs\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.362243 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359708    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-os-release\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.362243 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359745    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jmj2b\" (UniqueName: \"kubernetes.io/projected/22348da8-918f-4a01-99e8-2423faf20c80-kube-api-access-jmj2b\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.362243 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.359783    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-prqqm\" (UniqueName: \"kubernetes.io/projected/5b513a26-7609-4fa6-b6ac-ae939b6d6436-kube-api-access-prqqm\") pod \"network-metrics-daemon-twnct\" (UID: \"5b513a26-7609-4fa6-b6ac-ae939b6d6436\") " pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:40:40.362243 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360041    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcc59\" (UniqueName: \"kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59\") pod \"network-check-target-dbnpx\" (UID: \"c9b9e277-d07d-4630-9d88-f2fad67bc7e9\") " pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:40:40.362243 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360043    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-multus-conf-dir\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.362243 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360065    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f7d1ae5-9411-4022-96af-9385481515b5-iptables-alerter-script\") pod \"iptables-alerter-n2sz2\" (UID: \"8f7d1ae5-9411-4022-96af-9385481515b5\") " pod="openshift-network-operator/iptables-alerter-n2sz2"
May 26 19:40:40.362243 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360085    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-cni-netd\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.362243 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360101    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-ovnkube-config\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.362243 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360122    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-sysconfig\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.362243 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360140    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ccf28885-6179-40dc-8642-69a8d03a5476-socket-dir\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.362243 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360159    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h7xkn\" (UniqueName: \"kubernetes.io/projected/ccf28885-6179-40dc-8642-69a8d03a5476-kube-api-access-h7xkn\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.362243 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360175    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-host-var-lib-cni-multus\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.362243 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360199    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-etc-kubernetes\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.362243 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360245    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-ovn-node-metrics-cert\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.363005 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360270    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32a4562d-8bef-44cb-8028-3cb8087dbe94-cni-binary-copy\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.363005 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360296    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-systemd\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.363005 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360319    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w876k\" (UniqueName: \"kubernetes.io/projected/e3c2e921-2ac0-4eb4-a114-cfc760676be0-kube-api-access-w876k\") pod \"node-ca-mf2pb\" (UID: \"e3c2e921-2ac0-4eb4-a114-cfc760676be0\") " pod="openshift-image-registry/node-ca-mf2pb"
May 26 19:40:40.363005 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360320    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fac17afd-7b7a-40b3-87cf-cf4177b5eac9-konnectivity-ca\") pod \"konnectivity-agent-9chd6\" (UID: \"fac17afd-7b7a-40b3-87cf-cf4177b5eac9\") " pod="kube-system/konnectivity-agent-9chd6"
May 26 19:40:40.363005 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360344    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22348da8-918f-4a01-99e8-2423faf20c80-cni-binary-copy\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.363005 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360349    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/32a4562d-8bef-44cb-8028-3cb8087dbe94-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.363005 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360368    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-env-overrides\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.363005 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360448    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-sysconfig\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.363005 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360474    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/32a4562d-8bef-44cb-8028-3cb8087dbe94-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.363005 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360483    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-host\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.363005 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360511    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-tmp\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.363005 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360524    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/ccf28885-6179-40dc-8642-69a8d03a5476-sys-fs\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.363005 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360537    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-multus-socket-dir-parent\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.363005 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360565    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-var-lib-openvswitch\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.363005 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360574    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-os-release\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.363005 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360612    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-var-lib-openvswitch\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.363005 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360617    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-systemd\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.363720 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360673    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/ccf28885-6179-40dc-8642-69a8d03a5476-socket-dir\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.363720 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360709    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fac17afd-7b7a-40b3-87cf-cf4177b5eac9-agent-certs\") pod \"konnectivity-agent-9chd6\" (UID: \"fac17afd-7b7a-40b3-87cf-cf4177b5eac9\") " pod="kube-system/konnectivity-agent-9chd6"
May 26 19:40:40.363720 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360742    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32a4562d-8bef-44cb-8028-3cb8087dbe94-os-release\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.363720 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360789    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ccf28885-6179-40dc-8642-69a8d03a5476-registration-dir\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.363720 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360860    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/32a4562d-8bef-44cb-8028-3cb8087dbe94-cni-binary-copy\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.363720 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.360867    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/ccf28885-6179-40dc-8642-69a8d03a5476-registration-dir\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.363720 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.361002    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-env-overrides\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.363720 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.361137    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-host-var-lib-cni-multus\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.363720 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.361186    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-host\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.363720 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.361225    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-etc-kubernetes\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.363720 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.361284    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-host-cni-netd\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.363720 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.361290    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/22348da8-918f-4a01-99e8-2423faf20c80-multus-socket-dir-parent\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.363720 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.361339    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/32a4562d-8bef-44cb-8028-3cb8087dbe94-os-release\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.363720 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.361560    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-ovnkube-config\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.363720 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.361811    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-etc-tuned\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.363720 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.361902    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22348da8-918f-4a01-99e8-2423faf20c80-cni-binary-copy\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.363720 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.362079    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8f7d1ae5-9411-4022-96af-9385481515b5-iptables-alerter-script\") pod \"iptables-alerter-n2sz2\" (UID: \"8f7d1ae5-9411-4022-96af-9385481515b5\") " pod="openshift-network-operator/iptables-alerter-n2sz2"
May 26 19:40:40.364240 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.363307    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fac17afd-7b7a-40b3-87cf-cf4177b5eac9-agent-certs\") pod \"konnectivity-agent-9chd6\" (UID: \"fac17afd-7b7a-40b3-87cf-cf4177b5eac9\") " pod="kube-system/konnectivity-agent-9chd6"
May 26 19:40:40.364240 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.363457    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-tmp\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.364240 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.363815    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-ovn-node-metrics-cert\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.369215 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.368997    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv8b2\" (UniqueName: \"kubernetes.io/projected/bd0d829d-b321-4fe5-9d7e-7709cc9c08fb-kube-api-access-vv8b2\") pod \"tuned-x9qhz\" (UID: \"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb\") " pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.369215 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:40.369130    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:40:40.369215 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:40.369151    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:40:40.369215 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:40.369162    2565 projected.go:194] Error preparing data for projected volume kube-api-access-pcc59 for pod openshift-network-diagnostics/network-check-target-dbnpx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:40.369479 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:40.369229    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59 podName:c9b9e277-d07d-4630-9d88-f2fad67bc7e9 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:40.869211274 +0000 UTC m=+2.135547609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pcc59" (UniqueName: "kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59") pod "network-check-target-dbnpx" (UID: "c9b9e277-d07d-4630-9d88-f2fad67bc7e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:40.369479 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.369363    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtfh4\" (UniqueName: \"kubernetes.io/projected/99700566-adbe-45d2-b160-8bf4530daeb3-kube-api-access-qtfh4\") pod \"node-resolver-bm27c\" (UID: \"99700566-adbe-45d2-b160-8bf4530daeb3\") " pod="openshift-dns/node-resolver-bm27c"
May 26 19:40:40.370634 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.370571    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmj2b\" (UniqueName: \"kubernetes.io/projected/22348da8-918f-4a01-99e8-2423faf20c80-kube-api-access-jmj2b\") pod \"multus-wvhzl\" (UID: \"22348da8-918f-4a01-99e8-2423faf20c80\") " pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.370634 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.370572    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prqqm\" (UniqueName: \"kubernetes.io/projected/5b513a26-7609-4fa6-b6ac-ae939b6d6436-kube-api-access-prqqm\") pod \"network-metrics-daemon-twnct\" (UID: \"5b513a26-7609-4fa6-b6ac-ae939b6d6436\") " pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:40:40.371112 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.371090    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w876k\" (UniqueName: \"kubernetes.io/projected/e3c2e921-2ac0-4eb4-a114-cfc760676be0-kube-api-access-w876k\") pod \"node-ca-mf2pb\" (UID: \"e3c2e921-2ac0-4eb4-a114-cfc760676be0\") " pod="openshift-image-registry/node-ca-mf2pb"
May 26 19:40:40.371214 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.371131    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hqth\" (UniqueName: \"kubernetes.io/projected/fb90f68b-f7c0-4406-a24f-4387c42ac7b8-kube-api-access-6hqth\") pod \"ovnkube-node-w942w\" (UID: \"fb90f68b-f7c0-4406-a24f-4387c42ac7b8\") " pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.371730 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.371711    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8czvc\" (UniqueName: \"kubernetes.io/projected/8f7d1ae5-9411-4022-96af-9385481515b5-kube-api-access-8czvc\") pod \"iptables-alerter-n2sz2\" (UID: \"8f7d1ae5-9411-4022-96af-9385481515b5\") " pod="openshift-network-operator/iptables-alerter-n2sz2"
May 26 19:40:40.371958 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.371941    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7xkn\" (UniqueName: \"kubernetes.io/projected/ccf28885-6179-40dc-8642-69a8d03a5476-kube-api-access-h7xkn\") pod \"aws-ebs-csi-driver-node-9njpm\" (UID: \"ccf28885-6179-40dc-8642-69a8d03a5476\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.372250 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.372235    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8grkd\" (UniqueName: \"kubernetes.io/projected/32a4562d-8bef-44cb-8028-3cb8087dbe94-kube-api-access-8grkd\") pod \"multus-additional-cni-plugins-qv6dg\" (UID: \"32a4562d-8bef-44cb-8028-3cb8087dbe94\") " pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.387507 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.387489    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm"
May 26 19:40:40.404386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.404368    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qv6dg"
May 26 19:40:40.409732 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.409713    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wvhzl"
May 26 19:40:40.470779 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:40.470718    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d2076f4d741d61d5b76bd318158f3c0.slice/crio-c69c395ecf09764c4b9ae234e3c3ce593fba3f2755aabe7f235056aa65fb2b3f WatchSource:0}: Error finding container c69c395ecf09764c4b9ae234e3c3ce593fba3f2755aabe7f235056aa65fb2b3f: Status 404 returned error can't find the container with id c69c395ecf09764c4b9ae234e3c3ce593fba3f2755aabe7f235056aa65fb2b3f
May 26 19:40:40.470982 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:40.470962    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82baf510049493772726052266fb60af.slice/crio-7ad706fe1f52bd11db47d6712c1f23653eb8bea94e21553fca3e1d82aee50203 WatchSource:0}: Error finding container 7ad706fe1f52bd11db47d6712c1f23653eb8bea94e21553fca3e1d82aee50203: Status 404 returned error can't find the container with id 7ad706fe1f52bd11db47d6712c1f23653eb8bea94e21553fca3e1d82aee50203
May 26 19:40:40.473863 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.473848    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 19:40:40.569301 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.569266    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x9qhz"
May 26 19:40:40.576057 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:40.576034    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd0d829d_b321_4fe5_9d7e_7709cc9c08fb.slice/crio-4e414a08810cdf2f20888c78e9cac5c41828789d40937b3f23184528f4524c1f WatchSource:0}: Error finding container 4e414a08810cdf2f20888c78e9cac5c41828789d40937b3f23184528f4524c1f: Status 404 returned error can't find the container with id 4e414a08810cdf2f20888c78e9cac5c41828789d40937b3f23184528f4524c1f
May 26 19:40:40.592179 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.592149    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-bm27c"
May 26 19:40:40.597662 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:40.597632    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99700566_adbe_45d2_b160_8bf4530daeb3.slice/crio-c7cc03fa706a59e92f44504a178e0d532b41de218e80340ca3b3e51e2b8b7d24 WatchSource:0}: Error finding container c7cc03fa706a59e92f44504a178e0d532b41de218e80340ca3b3e51e2b8b7d24: Status 404 returned error can't find the container with id c7cc03fa706a59e92f44504a178e0d532b41de218e80340ca3b3e51e2b8b7d24
May 26 19:40:40.614552 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.614528    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-mf2pb"
May 26 19:40:40.620456 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:40.620428    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c2e921_2ac0_4eb4_a114_cfc760676be0.slice/crio-90d6c9a151049a95b687e619818d3f3bcd2d7e82985575058e84616d9a2db746 WatchSource:0}: Error finding container 90d6c9a151049a95b687e619818d3f3bcd2d7e82985575058e84616d9a2db746: Status 404 returned error can't find the container with id 90d6c9a151049a95b687e619818d3f3bcd2d7e82985575058e84616d9a2db746
May 26 19:40:40.631795 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.631759    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n2sz2"
May 26 19:40:40.637856 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:40.637831    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f7d1ae5_9411_4022_96af_9385481515b5.slice/crio-0b56145d5118dded18f616e3621d8da0d2166070f663f1fe2bce08281c16f70c WatchSource:0}: Error finding container 0b56145d5118dded18f616e3621d8da0d2166070f663f1fe2bce08281c16f70c: Status 404 returned error can't find the container with id 0b56145d5118dded18f616e3621d8da0d2166070f663f1fe2bce08281c16f70c
May 26 19:40:40.639862 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.639843    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:40:40.647620 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:40.647596    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb90f68b_f7c0_4406_a24f_4387c42ac7b8.slice/crio-158bf04bb971592b5db9eb359c31fdb762dfde4635ed0be9fb78143989a16e9d WatchSource:0}: Error finding container 158bf04bb971592b5db9eb359c31fdb762dfde4635ed0be9fb78143989a16e9d: Status 404 returned error can't find the container with id 158bf04bb971592b5db9eb359c31fdb762dfde4635ed0be9fb78143989a16e9d
May 26 19:40:40.658463 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.658444    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9chd6"
May 26 19:40:40.664052 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:40.664025    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfac17afd_7b7a_40b3_87cf_cf4177b5eac9.slice/crio-1f9095113c7b6b9e90e48865d6b15f78ff0d627cc610b9bacd0692e5f38c662d WatchSource:0}: Error finding container 1f9095113c7b6b9e90e48865d6b15f78ff0d627cc610b9bacd0692e5f38c662d: Status 404 returned error can't find the container with id 1f9095113c7b6b9e90e48865d6b15f78ff0d627cc610b9bacd0692e5f38c662d
May 26 19:40:40.694983 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:40.694958    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccf28885_6179_40dc_8642_69a8d03a5476.slice/crio-2814665ac5ca38e8c9bc4d274d0059743105bc916092d8805a8a22ffc479821d WatchSource:0}: Error finding container 2814665ac5ca38e8c9bc4d274d0059743105bc916092d8805a8a22ffc479821d: Status 404 returned error can't find the container with id 2814665ac5ca38e8c9bc4d274d0059743105bc916092d8805a8a22ffc479821d
May 26 19:40:40.745191 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:40.745159    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32a4562d_8bef_44cb_8028_3cb8087dbe94.slice/crio-95c74a82f05663f60e51c4190ba4314c602b4967595954ae1330dd7cd66575bf WatchSource:0}: Error finding container 95c74a82f05663f60e51c4190ba4314c602b4967595954ae1330dd7cd66575bf: Status 404 returned error can't find the container with id 95c74a82f05663f60e51c4190ba4314c602b4967595954ae1330dd7cd66575bf
May 26 19:40:40.812425 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:40:40.812389    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22348da8_918f_4a01_99e8_2423faf20c80.slice/crio-b09b087f1f2eb1a8c2ef078418508c28da4b9d27eb46ac0c9ca1592100ab6601 WatchSource:0}: Error finding container b09b087f1f2eb1a8c2ef078418508c28da4b9d27eb46ac0c9ca1592100ab6601: Status 404 returned error can't find the container with id b09b087f1f2eb1a8c2ef078418508c28da4b9d27eb46ac0c9ca1592100ab6601
May 26 19:40:40.866379 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.866350    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs\") pod \"network-metrics-daemon-twnct\" (UID: \"5b513a26-7609-4fa6-b6ac-ae939b6d6436\") " pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:40:40.866555 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:40.866470    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:40.866555 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:40.866533    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs podName:5b513a26-7609-4fa6-b6ac-ae939b6d6436 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:41.866515614 +0000 UTC m=+3.132851939 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs") pod "network-metrics-daemon-twnct" (UID: "5b513a26-7609-4fa6-b6ac-ae939b6d6436") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:40.967610 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:40.967573    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcc59\" (UniqueName: \"kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59\") pod \"network-check-target-dbnpx\" (UID: \"c9b9e277-d07d-4630-9d88-f2fad67bc7e9\") " pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:40:40.967799 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:40.967753    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:40:40.967799 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:40.967789    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:40:40.967902 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:40.967803    2565 projected.go:194] Error preparing data for projected volume kube-api-access-pcc59 for pod openshift-network-diagnostics/network-check-target-dbnpx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:40.967902 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:40.967867    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59 podName:c9b9e277-d07d-4630-9d88-f2fad67bc7e9 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:41.967846036 +0000 UTC m=+3.234182365 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcc59" (UniqueName: "kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59") pod "network-check-target-dbnpx" (UID: "c9b9e277-d07d-4630-9d88-f2fad67bc7e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:41.029469 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:41.029247    2565 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:40:41.088379 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:41.088148    2565 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:40:41.143623 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:41.143593    2565 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 26 19:40:41.293343 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:41.293252    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 19:35:40 +0000 UTC" deadline="2027-10-29 23:27:28.401996922 +0000 UTC"
May 26 19:40:41.293343 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:41.293285    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12507h46m47.108715262s"
May 26 19:40:41.349632 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:41.349006    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:40:41.349632 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:41.349144    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbnpx" podUID="c9b9e277-d07d-4630-9d88-f2fad67bc7e9"
May 26 19:40:41.368345 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:41.368283    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm" event={"ID":"ccf28885-6179-40dc-8642-69a8d03a5476","Type":"ContainerStarted","Data":"2814665ac5ca38e8c9bc4d274d0059743105bc916092d8805a8a22ffc479821d"}
May 26 19:40:41.374872 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:41.374811    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9chd6" event={"ID":"fac17afd-7b7a-40b3-87cf-cf4177b5eac9","Type":"ContainerStarted","Data":"1f9095113c7b6b9e90e48865d6b15f78ff0d627cc610b9bacd0692e5f38c662d"}
May 26 19:40:41.378977 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:41.378890    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w942w" event={"ID":"fb90f68b-f7c0-4406-a24f-4387c42ac7b8","Type":"ContainerStarted","Data":"158bf04bb971592b5db9eb359c31fdb762dfde4635ed0be9fb78143989a16e9d"}
May 26 19:40:41.380470 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:41.380425    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mf2pb" event={"ID":"e3c2e921-2ac0-4eb4-a114-cfc760676be0","Type":"ContainerStarted","Data":"90d6c9a151049a95b687e619818d3f3bcd2d7e82985575058e84616d9a2db746"}
May 26 19:40:41.384107 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:41.384077    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bm27c" event={"ID":"99700566-adbe-45d2-b160-8bf4530daeb3","Type":"ContainerStarted","Data":"c7cc03fa706a59e92f44504a178e0d532b41de218e80340ca3b3e51e2b8b7d24"}
May 26 19:40:41.391482 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:41.391415    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qv6dg" event={"ID":"32a4562d-8bef-44cb-8028-3cb8087dbe94","Type":"ContainerStarted","Data":"95c74a82f05663f60e51c4190ba4314c602b4967595954ae1330dd7cd66575bf"}
May 26 19:40:41.400602 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:41.400524    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n2sz2" event={"ID":"8f7d1ae5-9411-4022-96af-9385481515b5","Type":"ContainerStarted","Data":"0b56145d5118dded18f616e3621d8da0d2166070f663f1fe2bce08281c16f70c"}
May 26 19:40:41.408493 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:41.408432    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x9qhz" event={"ID":"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb","Type":"ContainerStarted","Data":"4e414a08810cdf2f20888c78e9cac5c41828789d40937b3f23184528f4524c1f"}
May 26 19:40:41.418673 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:41.418636    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal" event={"ID":"8d2076f4d741d61d5b76bd318158f3c0","Type":"ContainerStarted","Data":"c69c395ecf09764c4b9ae234e3c3ce593fba3f2755aabe7f235056aa65fb2b3f"}
May 26 19:40:41.426204 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:41.426164    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-142.ec2.internal" event={"ID":"82baf510049493772726052266fb60af","Type":"ContainerStarted","Data":"7ad706fe1f52bd11db47d6712c1f23653eb8bea94e21553fca3e1d82aee50203"}
May 26 19:40:41.431549 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:41.431490    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wvhzl" event={"ID":"22348da8-918f-4a01-99e8-2423faf20c80","Type":"ContainerStarted","Data":"b09b087f1f2eb1a8c2ef078418508c28da4b9d27eb46ac0c9ca1592100ab6601"}
May 26 19:40:41.874445 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:41.874407    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs\") pod \"network-metrics-daemon-twnct\" (UID: \"5b513a26-7609-4fa6-b6ac-ae939b6d6436\") " pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:40:41.874643 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:41.874554    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:41.874643 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:41.874622    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs podName:5b513a26-7609-4fa6-b6ac-ae939b6d6436 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:43.874602328 +0000 UTC m=+5.140938644 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs") pod "network-metrics-daemon-twnct" (UID: "5b513a26-7609-4fa6-b6ac-ae939b6d6436") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:41.975341 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:41.975220    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcc59\" (UniqueName: \"kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59\") pod \"network-check-target-dbnpx\" (UID: \"c9b9e277-d07d-4630-9d88-f2fad67bc7e9\") " pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:40:41.975495 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:41.975394    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:40:41.975495 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:41.975415    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:40:41.975495 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:41.975427    2565 projected.go:194] Error preparing data for projected volume kube-api-access-pcc59 for pod openshift-network-diagnostics/network-check-target-dbnpx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:41.975495 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:41.975487    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59 podName:c9b9e277-d07d-4630-9d88-f2fad67bc7e9 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:43.975466362 +0000 UTC m=+5.241802680 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcc59" (UniqueName: "kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59") pod "network-check-target-dbnpx" (UID: "c9b9e277-d07d-4630-9d88-f2fad67bc7e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:42.293942 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:42.293895    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-25 19:35:40 +0000 UTC" deadline="2027-10-26 11:23:18.371719136 +0000 UTC"
May 26 19:40:42.293942 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:42.293939    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12423h42m36.077784255s"
May 26 19:40:42.348624 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:42.348582    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:40:42.348806 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:42.348745    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twnct" podUID="5b513a26-7609-4fa6-b6ac-ae939b6d6436"
May 26 19:40:43.349367 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:43.348874    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:40:43.349367 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:43.349005    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbnpx" podUID="c9b9e277-d07d-4630-9d88-f2fad67bc7e9"
May 26 19:40:43.891809 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:43.891758    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs\") pod \"network-metrics-daemon-twnct\" (UID: \"5b513a26-7609-4fa6-b6ac-ae939b6d6436\") " pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:40:43.892045 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:43.891934    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:43.892045 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:43.892004    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs podName:5b513a26-7609-4fa6-b6ac-ae939b6d6436 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:47.891980491 +0000 UTC m=+9.158316809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs") pod "network-metrics-daemon-twnct" (UID: "5b513a26-7609-4fa6-b6ac-ae939b6d6436") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:43.992647 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:43.992125    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcc59\" (UniqueName: \"kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59\") pod \"network-check-target-dbnpx\" (UID: \"c9b9e277-d07d-4630-9d88-f2fad67bc7e9\") " pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:40:43.992647 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:43.992290    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:40:43.992647 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:43.992304    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:40:43.992647 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:43.992313    2565 projected.go:194] Error preparing data for projected volume kube-api-access-pcc59 for pod openshift-network-diagnostics/network-check-target-dbnpx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:43.992647 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:43.992374    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59 podName:c9b9e277-d07d-4630-9d88-f2fad67bc7e9 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:47.992356315 +0000 UTC m=+9.258692627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcc59" (UniqueName: "kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59") pod "network-check-target-dbnpx" (UID: "c9b9e277-d07d-4630-9d88-f2fad67bc7e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:44.348684 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:44.348189    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:40:44.348684 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:44.348337    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twnct" podUID="5b513a26-7609-4fa6-b6ac-ae939b6d6436"
May 26 19:40:45.348660 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:45.348446    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:40:45.348660 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:45.348589    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbnpx" podUID="c9b9e277-d07d-4630-9d88-f2fad67bc7e9"
May 26 19:40:46.348635 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:46.348592    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:40:46.348820 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:46.348730    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twnct" podUID="5b513a26-7609-4fa6-b6ac-ae939b6d6436"
May 26 19:40:47.348414 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:47.348373    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:40:47.348610 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:47.348512    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbnpx" podUID="c9b9e277-d07d-4630-9d88-f2fad67bc7e9"
May 26 19:40:47.924854 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:47.924810    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs\") pod \"network-metrics-daemon-twnct\" (UID: \"5b513a26-7609-4fa6-b6ac-ae939b6d6436\") " pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:40:47.925309 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:47.925032    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:47.925309 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:47.925106    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs podName:5b513a26-7609-4fa6-b6ac-ae939b6d6436 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:55.925086014 +0000 UTC m=+17.191422342 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs") pod "network-metrics-daemon-twnct" (UID: "5b513a26-7609-4fa6-b6ac-ae939b6d6436") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:48.025581 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:48.025399    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcc59\" (UniqueName: \"kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59\") pod \"network-check-target-dbnpx\" (UID: \"c9b9e277-d07d-4630-9d88-f2fad67bc7e9\") " pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:40:48.025581 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:48.025562    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:40:48.025581 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:48.025582    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:40:48.025898 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:48.025597    2565 projected.go:194] Error preparing data for projected volume kube-api-access-pcc59 for pod openshift-network-diagnostics/network-check-target-dbnpx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:48.025898 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:48.025662    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59 podName:c9b9e277-d07d-4630-9d88-f2fad67bc7e9 nodeName:}" failed. No retries permitted until 2026-05-26 19:40:56.02564389 +0000 UTC m=+17.291980219 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcc59" (UniqueName: "kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59") pod "network-check-target-dbnpx" (UID: "c9b9e277-d07d-4630-9d88-f2fad67bc7e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:48.348423 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:48.348372    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:40:48.348603 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:48.348523    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twnct" podUID="5b513a26-7609-4fa6-b6ac-ae939b6d6436"
May 26 19:40:49.351358 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:49.351290    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:40:49.351853 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:49.351402    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbnpx" podUID="c9b9e277-d07d-4630-9d88-f2fad67bc7e9"
May 26 19:40:50.348371 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:50.348331    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:40:50.348525 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:50.348463    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twnct" podUID="5b513a26-7609-4fa6-b6ac-ae939b6d6436"
May 26 19:40:51.348301 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:51.348259    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:40:51.348788 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:51.348399    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbnpx" podUID="c9b9e277-d07d-4630-9d88-f2fad67bc7e9"
May 26 19:40:52.348472 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:52.348435    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:40:52.348935 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:52.348568    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twnct" podUID="5b513a26-7609-4fa6-b6ac-ae939b6d6436"
May 26 19:40:53.348749 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:53.348702    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:40:53.349196 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:53.348861    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbnpx" podUID="c9b9e277-d07d-4630-9d88-f2fad67bc7e9"
May 26 19:40:54.348128 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:54.348085    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:40:54.348321 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:54.348208    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twnct" podUID="5b513a26-7609-4fa6-b6ac-ae939b6d6436"
May 26 19:40:55.347850 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:55.347811    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:40:55.348327 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:55.347947    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbnpx" podUID="c9b9e277-d07d-4630-9d88-f2fad67bc7e9"
May 26 19:40:55.985809 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:55.985760    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs\") pod \"network-metrics-daemon-twnct\" (UID: \"5b513a26-7609-4fa6-b6ac-ae939b6d6436\") " pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:40:55.986019 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:55.985924    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:55.986019 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:55.986006    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs podName:5b513a26-7609-4fa6-b6ac-ae939b6d6436 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:11.985983795 +0000 UTC m=+33.252320119 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs") pod "network-metrics-daemon-twnct" (UID: "5b513a26-7609-4fa6-b6ac-ae939b6d6436") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:40:56.086977 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:56.086940    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcc59\" (UniqueName: \"kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59\") pod \"network-check-target-dbnpx\" (UID: \"c9b9e277-d07d-4630-9d88-f2fad67bc7e9\") " pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:40:56.087154 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:56.087067    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:40:56.087154 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:56.087082    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:40:56.087154 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:56.087090    2565 projected.go:194] Error preparing data for projected volume kube-api-access-pcc59 for pod openshift-network-diagnostics/network-check-target-dbnpx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:56.087154 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:56.087140    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59 podName:c9b9e277-d07d-4630-9d88-f2fad67bc7e9 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:12.087127466 +0000 UTC m=+33.353463775 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcc59" (UniqueName: "kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59") pod "network-check-target-dbnpx" (UID: "c9b9e277-d07d-4630-9d88-f2fad67bc7e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:40:56.348073 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:56.347982    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:40:56.348439 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:56.348121    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twnct" podUID="5b513a26-7609-4fa6-b6ac-ae939b6d6436"
May 26 19:40:57.348555 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:57.348524    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:40:57.349030 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:57.348653    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbnpx" podUID="c9b9e277-d07d-4630-9d88-f2fad67bc7e9"
May 26 19:40:58.348601 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:58.348569    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:40:58.349072 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:58.348698    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twnct" podUID="5b513a26-7609-4fa6-b6ac-ae939b6d6436"
May 26 19:40:59.348915 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:40:59.348890    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:40:59.349232 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:40:59.348986    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbnpx" podUID="c9b9e277-d07d-4630-9d88-f2fad67bc7e9"
May 26 19:41:00.348230 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.347881    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:41:00.348367 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:00.348272    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twnct" podUID="5b513a26-7609-4fa6-b6ac-ae939b6d6436"
May 26 19:41:00.464249 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.464214    2565 generic.go:358] "Generic (PLEG): container finished" podID="32a4562d-8bef-44cb-8028-3cb8087dbe94" containerID="76f45a0d7824d5a0c94f332b44f03971ae6bb58ef2c08d4a62d8cc453f40c802" exitCode=0
May 26 19:41:00.465105 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.464283    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qv6dg" event={"ID":"32a4562d-8bef-44cb-8028-3cb8087dbe94","Type":"ContainerDied","Data":"76f45a0d7824d5a0c94f332b44f03971ae6bb58ef2c08d4a62d8cc453f40c802"}
May 26 19:41:00.466478 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.466068    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x9qhz" event={"ID":"bd0d829d-b321-4fe5-9d7e-7709cc9c08fb","Type":"ContainerStarted","Data":"7b6e65e35cae6649e661f1a0f89b2ce817caaf8ade40e02425eee5d66d03ece2"}
May 26 19:41:00.467415 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.467390    2565 generic.go:358] "Generic (PLEG): container finished" podID="8d2076f4d741d61d5b76bd318158f3c0" containerID="c19ea3ef3165d5a1d24388f2ef3fc432239749976be6157f350d7bf64cc3f839" exitCode=0
May 26 19:41:00.467501 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.467466    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal" event={"ID":"8d2076f4d741d61d5b76bd318158f3c0","Type":"ContainerDied","Data":"c19ea3ef3165d5a1d24388f2ef3fc432239749976be6157f350d7bf64cc3f839"}
May 26 19:41:00.469608 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.469404    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-142.ec2.internal" event={"ID":"82baf510049493772726052266fb60af","Type":"ContainerStarted","Data":"0d2f77e00ea57a87861b1f018976a91e41b220e992ea5fd029196c647db3e08e"}
May 26 19:41:00.471201 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.471176    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wvhzl" event={"ID":"22348da8-918f-4a01-99e8-2423faf20c80","Type":"ContainerStarted","Data":"4a82e04d1bef2fb648d55442c93835314200e349948d9bda602bec79a67eed39"}
May 26 19:41:00.473056 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.473033    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm" event={"ID":"ccf28885-6179-40dc-8642-69a8d03a5476","Type":"ContainerStarted","Data":"f8de5f94a5d1d73f50d2ea7c10bbb7258fba620d087cdd2775586f0edb47cf9d"}
May 26 19:41:00.474302 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.474282    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9chd6" event={"ID":"fac17afd-7b7a-40b3-87cf-cf4177b5eac9","Type":"ContainerStarted","Data":"23a0a1af60b94465deb3722a185737c392440ee0e2566f5b35bd2c4a14a08a50"}
May 26 19:41:00.479567 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.479544    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/ovn-acl-logging/0.log"
May 26 19:41:00.480038 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.480018    2565 generic.go:358] "Generic (PLEG): container finished" podID="fb90f68b-f7c0-4406-a24f-4387c42ac7b8" containerID="93775ac176660a84c50a7b822283360e990548c4ad15cd86a318b5dde0b0827e" exitCode=1
May 26 19:41:00.480124 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.480072    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w942w" event={"ID":"fb90f68b-f7c0-4406-a24f-4387c42ac7b8","Type":"ContainerStarted","Data":"a64ee068411c8b09f2ad8b123bc96d643796131af37f2d9303da06b0f0b606ec"}
May 26 19:41:00.480124 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.480101    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w942w" event={"ID":"fb90f68b-f7c0-4406-a24f-4387c42ac7b8","Type":"ContainerStarted","Data":"445be553021d07804449e950eb3f8eb01dceecc427fe150b7abef50fcc2497b1"}
May 26 19:41:00.480212 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.480115    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w942w" event={"ID":"fb90f68b-f7c0-4406-a24f-4387c42ac7b8","Type":"ContainerStarted","Data":"8fb57b5b804ab473de5b6b6afc2a6c10bce8ed1c8a5660bfe2258123bb8e0621"}
May 26 19:41:00.480212 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.480138    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w942w" event={"ID":"fb90f68b-f7c0-4406-a24f-4387c42ac7b8","Type":"ContainerStarted","Data":"0e895b136b0ed24002f5f75851898282c7bf374e3508887afc3178d3f536de89"}
May 26 19:41:00.480212 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.480150    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w942w" event={"ID":"fb90f68b-f7c0-4406-a24f-4387c42ac7b8","Type":"ContainerDied","Data":"93775ac176660a84c50a7b822283360e990548c4ad15cd86a318b5dde0b0827e"}
May 26 19:41:00.480212 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.480166    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w942w" event={"ID":"fb90f68b-f7c0-4406-a24f-4387c42ac7b8","Type":"ContainerStarted","Data":"029d0fc51156ded49c1ebfe56271ff8aa379799217cf7750a3938eaa45e724b2"}
May 26 19:41:00.481544 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.481512    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-mf2pb" event={"ID":"e3c2e921-2ac0-4eb4-a114-cfc760676be0","Type":"ContainerStarted","Data":"8d9642fda40bde6557efd4a4a143fffeabf51ea1d815568b0c80f3303d32d753"}
May 26 19:41:00.482987 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.482962    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-bm27c" event={"ID":"99700566-adbe-45d2-b160-8bf4530daeb3","Type":"ContainerStarted","Data":"c443a19ef02699517e7b958b71e9f039b11edd5725eaf3543543563edb7e8561"}
May 26 19:41:00.498443 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.498384    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-bm27c" podStartSLOduration=2.9134708959999998 podStartE2EDuration="21.498364938s" podCreationTimestamp="2026-05-26 19:40:39 +0000 UTC" firstStartedPulling="2026-05-26 19:40:40.600413273 +0000 UTC m=+1.866749583" lastFinishedPulling="2026-05-26 19:40:59.185307316 +0000 UTC m=+20.451643625" observedRunningTime="2026-05-26 19:41:00.498315013 +0000 UTC m=+21.764651347" watchObservedRunningTime="2026-05-26 19:41:00.498364938 +0000 UTC m=+21.764701271"
May 26 19:41:00.511898 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.511843    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9chd6" podStartSLOduration=2.851438028 podStartE2EDuration="21.511825103s" podCreationTimestamp="2026-05-26 19:40:39 +0000 UTC" firstStartedPulling="2026-05-26 19:40:40.665595298 +0000 UTC m=+1.931931608" lastFinishedPulling="2026-05-26 19:40:59.325982354 +0000 UTC m=+20.592318683" observedRunningTime="2026-05-26 19:41:00.511338647 +0000 UTC m=+21.777674979" watchObservedRunningTime="2026-05-26 19:41:00.511825103 +0000 UTC m=+21.778161437"
May 26 19:41:00.528045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.527989    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-wvhzl" podStartSLOduration=2.712418212 podStartE2EDuration="21.527968421s" podCreationTimestamp="2026-05-26 19:40:39 +0000 UTC" firstStartedPulling="2026-05-26 19:40:40.813827879 +0000 UTC m=+2.080164192" lastFinishedPulling="2026-05-26 19:40:59.629378076 +0000 UTC m=+20.895714401" observedRunningTime="2026-05-26 19:41:00.527393961 +0000 UTC m=+21.793749353" watchObservedRunningTime="2026-05-26 19:41:00.527968421 +0000 UTC m=+21.794304755"
May 26 19:41:00.540151 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.540108    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-142.ec2.internal" podStartSLOduration=21.54009411 podStartE2EDuration="21.54009411s" podCreationTimestamp="2026-05-26 19:40:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:41:00.539741918 +0000 UTC m=+21.806078251" watchObservedRunningTime="2026-05-26 19:41:00.54009411 +0000 UTC m=+21.806430441"
May 26 19:41:00.569920 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.569850    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x9qhz" podStartSLOduration=2.7863016590000003 podStartE2EDuration="21.569835022s" podCreationTimestamp="2026-05-26 19:40:39 +0000 UTC" firstStartedPulling="2026-05-26 19:40:40.577654774 +0000 UTC m=+1.843991085" lastFinishedPulling="2026-05-26 19:40:59.361188131 +0000 UTC m=+20.627524448" observedRunningTime="2026-05-26 19:41:00.569267804 +0000 UTC m=+21.835604137" watchObservedRunningTime="2026-05-26 19:41:00.569835022 +0000 UTC m=+21.836171354"
May 26 19:41:00.583565 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.583519    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-mf2pb" podStartSLOduration=10.907611592 podStartE2EDuration="21.583501053s" podCreationTimestamp="2026-05-26 19:40:39 +0000 UTC" firstStartedPulling="2026-05-26 19:40:40.621989438 +0000 UTC m=+1.888325748" lastFinishedPulling="2026-05-26 19:40:51.297878885 +0000 UTC m=+12.564215209" observedRunningTime="2026-05-26 19:41:00.58308875 +0000 UTC m=+21.849425083" watchObservedRunningTime="2026-05-26 19:41:00.583501053 +0000 UTC m=+21.849837424"
May 26 19:41:00.952431 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:00.952409    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 26 19:41:01.323938 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:01.323809    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-26T19:41:00.952427168Z","UUID":"29d2c9f5-46fb-405a-a5d8-940d00f5ae87","Handler":null,"Name":"","Endpoint":""}
May 26 19:41:01.325360 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:01.325336    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 26 19:41:01.325360 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:01.325360    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 26 19:41:01.348842 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:01.348814    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:41:01.348999 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:01.348915    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbnpx" podUID="c9b9e277-d07d-4630-9d88-f2fad67bc7e9"
May 26 19:41:01.486577 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:01.486539    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm" event={"ID":"ccf28885-6179-40dc-8642-69a8d03a5476","Type":"ContainerStarted","Data":"40961d6a0e66161209a2f953eac9deaa65388ddb90d6a07cbd70dd0417a77a16"}
May 26 19:41:01.489163 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:01.489046    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n2sz2" event={"ID":"8f7d1ae5-9411-4022-96af-9385481515b5","Type":"ContainerStarted","Data":"ce6fd4c4509135230cf3bcfb59bd36b824c9c6315289d301c0d894749a289354"}
May 26 19:41:01.490754 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:01.490715    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal" event={"ID":"8d2076f4d741d61d5b76bd318158f3c0","Type":"ContainerStarted","Data":"cb9b91d72fab55a02761bddea1c7dd801c29db5cfb0d6bc04313b813509ac465"}
May 26 19:41:01.504676 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:01.504624    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n2sz2" podStartSLOduration=11.846089541 podStartE2EDuration="22.504606005s" podCreationTimestamp="2026-05-26 19:40:39 +0000 UTC" firstStartedPulling="2026-05-26 19:40:40.639347207 +0000 UTC m=+1.905683516" lastFinishedPulling="2026-05-26 19:40:51.297863653 +0000 UTC m=+12.564199980" observedRunningTime="2026-05-26 19:41:01.503974425 +0000 UTC m=+22.770310758" watchObservedRunningTime="2026-05-26 19:41:01.504606005 +0000 UTC m=+22.770942338"
May 26 19:41:01.517701 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:01.517653    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-142.ec2.internal" podStartSLOduration=22.517640248 podStartE2EDuration="22.517640248s" podCreationTimestamp="2026-05-26 19:40:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:41:01.517449124 +0000 UTC m=+22.783785456" watchObservedRunningTime="2026-05-26 19:41:01.517640248 +0000 UTC m=+22.783976581"
May 26 19:41:02.348862 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:02.348761    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:41:02.349013 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:02.348896    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twnct" podUID="5b513a26-7609-4fa6-b6ac-ae939b6d6436"
May 26 19:41:02.498132 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:02.498100    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/ovn-acl-logging/0.log"
May 26 19:41:02.498742 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:02.498444    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w942w" event={"ID":"fb90f68b-f7c0-4406-a24f-4387c42ac7b8","Type":"ContainerStarted","Data":"dcd21d8de778c2dbbf228b47587cd4cb289847243d80e9c1cf239dcda7e927d4"}
May 26 19:41:02.500378 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:02.500350    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm" event={"ID":"ccf28885-6179-40dc-8642-69a8d03a5476","Type":"ContainerStarted","Data":"4f07e4cca4125859d324ff2716a3aa1cadefcfb6cef27d22a34877aaf81ebba6"}
May 26 19:41:02.518124 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:02.518078    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9njpm" podStartSLOduration=2.424398937 podStartE2EDuration="23.518064668s" podCreationTimestamp="2026-05-26 19:40:39 +0000 UTC" firstStartedPulling="2026-05-26 19:40:40.696418256 +0000 UTC m=+1.962754565" lastFinishedPulling="2026-05-26 19:41:01.790083973 +0000 UTC m=+23.056420296" observedRunningTime="2026-05-26 19:41:02.517783102 +0000 UTC m=+23.784119428" watchObservedRunningTime="2026-05-26 19:41:02.518064668 +0000 UTC m=+23.784400999"
May 26 19:41:03.348001 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:03.347965    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:41:03.348218 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:03.348096    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbnpx" podUID="c9b9e277-d07d-4630-9d88-f2fad67bc7e9"
May 26 19:41:03.932619 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:03.932585    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-b9j9q"]
May 26 19:41:03.936630 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:03.936607    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:03.936749 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:03.936686    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b9j9q" podUID="8733236d-623f-4def-9571-6a9484c3d756"
May 26 19:41:04.044506 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:04.044474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8733236d-623f-4def-9571-6a9484c3d756-dbus\") pod \"global-pull-secret-syncer-b9j9q\" (UID: \"8733236d-623f-4def-9571-6a9484c3d756\") " pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:04.044506 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:04.044510    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8733236d-623f-4def-9571-6a9484c3d756-original-pull-secret\") pod \"global-pull-secret-syncer-b9j9q\" (UID: \"8733236d-623f-4def-9571-6a9484c3d756\") " pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:04.044733 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:04.044598    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8733236d-623f-4def-9571-6a9484c3d756-kubelet-config\") pod \"global-pull-secret-syncer-b9j9q\" (UID: \"8733236d-623f-4def-9571-6a9484c3d756\") " pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:04.145788 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:04.145733    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8733236d-623f-4def-9571-6a9484c3d756-kubelet-config\") pod \"global-pull-secret-syncer-b9j9q\" (UID: \"8733236d-623f-4def-9571-6a9484c3d756\") " pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:04.145964 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:04.145823    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8733236d-623f-4def-9571-6a9484c3d756-dbus\") pod \"global-pull-secret-syncer-b9j9q\" (UID: \"8733236d-623f-4def-9571-6a9484c3d756\") " pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:04.145964 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:04.145847    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8733236d-623f-4def-9571-6a9484c3d756-original-pull-secret\") pod \"global-pull-secret-syncer-b9j9q\" (UID: \"8733236d-623f-4def-9571-6a9484c3d756\") " pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:04.145964 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:04.145891    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8733236d-623f-4def-9571-6a9484c3d756-kubelet-config\") pod \"global-pull-secret-syncer-b9j9q\" (UID: \"8733236d-623f-4def-9571-6a9484c3d756\") " pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:04.146088 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:04.145992    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:41:04.146088 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:04.146000    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8733236d-623f-4def-9571-6a9484c3d756-dbus\") pod \"global-pull-secret-syncer-b9j9q\" (UID: \"8733236d-623f-4def-9571-6a9484c3d756\") " pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:04.146088 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:04.146046    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8733236d-623f-4def-9571-6a9484c3d756-original-pull-secret podName:8733236d-623f-4def-9571-6a9484c3d756 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:04.646031973 +0000 UTC m=+25.912368297 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8733236d-623f-4def-9571-6a9484c3d756-original-pull-secret") pod "global-pull-secret-syncer-b9j9q" (UID: "8733236d-623f-4def-9571-6a9484c3d756") : object "kube-system"/"original-pull-secret" not registered
May 26 19:41:04.347905 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:04.347835    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:41:04.348051 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:04.347945    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twnct" podUID="5b513a26-7609-4fa6-b6ac-ae939b6d6436"
May 26 19:41:04.651377 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:04.651340    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8733236d-623f-4def-9571-6a9484c3d756-original-pull-secret\") pod \"global-pull-secret-syncer-b9j9q\" (UID: \"8733236d-623f-4def-9571-6a9484c3d756\") " pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:04.651519 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:04.651483    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:41:04.651570 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:04.651559    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8733236d-623f-4def-9571-6a9484c3d756-original-pull-secret podName:8733236d-623f-4def-9571-6a9484c3d756 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:05.651538682 +0000 UTC m=+26.917875008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8733236d-623f-4def-9571-6a9484c3d756-original-pull-secret") pod "global-pull-secret-syncer-b9j9q" (UID: "8733236d-623f-4def-9571-6a9484c3d756") : object "kube-system"/"original-pull-secret" not registered
May 26 19:41:04.769234 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:04.769201    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9chd6"
May 26 19:41:04.769903 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:04.769877    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9chd6"
May 26 19:41:05.348839 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:05.348636    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:41:05.349432 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:05.348701    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:05.349432 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:05.348886    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbnpx" podUID="c9b9e277-d07d-4630-9d88-f2fad67bc7e9"
May 26 19:41:05.349432 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:05.348941    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b9j9q" podUID="8733236d-623f-4def-9571-6a9484c3d756"
May 26 19:41:05.509439 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:05.509408    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/ovn-acl-logging/0.log"
May 26 19:41:05.509799 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:05.509752    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w942w" event={"ID":"fb90f68b-f7c0-4406-a24f-4387c42ac7b8","Type":"ContainerStarted","Data":"1e7adb9f7e610be3cda7562398ab7c4f105cbab1013146650b47f871ceb28079"}
May 26 19:41:05.510147 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:05.510125    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:41:05.510294 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:05.510275    2565 scope.go:117] "RemoveContainer" containerID="93775ac176660a84c50a7b822283360e990548c4ad15cd86a318b5dde0b0827e"
May 26 19:41:05.511532 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:05.511510    2565 generic.go:358] "Generic (PLEG): container finished" podID="32a4562d-8bef-44cb-8028-3cb8087dbe94" containerID="7a9a82ca03ab01df77d872c77cab692ab10542efb2298bcde348a8593763cdac" exitCode=0
May 26 19:41:05.513175 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:05.511580    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qv6dg" event={"ID":"32a4562d-8bef-44cb-8028-3cb8087dbe94","Type":"ContainerDied","Data":"7a9a82ca03ab01df77d872c77cab692ab10542efb2298bcde348a8593763cdac"}
May 26 19:41:05.526793 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:05.526759    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:41:05.660118 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:05.660012    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8733236d-623f-4def-9571-6a9484c3d756-original-pull-secret\") pod \"global-pull-secret-syncer-b9j9q\" (UID: \"8733236d-623f-4def-9571-6a9484c3d756\") " pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:05.660288 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:05.660126    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:41:05.660288 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:05.660199    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8733236d-623f-4def-9571-6a9484c3d756-original-pull-secret podName:8733236d-623f-4def-9571-6a9484c3d756 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:07.660181502 +0000 UTC m=+28.926517835 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8733236d-623f-4def-9571-6a9484c3d756-original-pull-secret") pod "global-pull-secret-syncer-b9j9q" (UID: "8733236d-623f-4def-9571-6a9484c3d756") : object "kube-system"/"original-pull-secret" not registered
May 26 19:41:06.348447 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:06.348420    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:41:06.348567 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:06.348529    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twnct" podUID="5b513a26-7609-4fa6-b6ac-ae939b6d6436"
May 26 19:41:06.518214 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:06.517945    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/ovn-acl-logging/0.log"
May 26 19:41:06.518645 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:06.518610    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w942w" event={"ID":"fb90f68b-f7c0-4406-a24f-4387c42ac7b8","Type":"ContainerStarted","Data":"43ab10d5f746fba7a95c61dbbdbfd2eb7bf61e2262b679fa9a8a35e5af78649e"}
May 26 19:41:06.519901 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:06.519879    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:41:06.520608 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:06.520575    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:41:06.523464 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:06.523430    2565 generic.go:358] "Generic (PLEG): container finished" podID="32a4562d-8bef-44cb-8028-3cb8087dbe94" containerID="488b095d48d087e9880b1efa68bce9020c5452583cd892107ffb229689340385" exitCode=0
May 26 19:41:06.523548 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:06.523481    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qv6dg" event={"ID":"32a4562d-8bef-44cb-8028-3cb8087dbe94","Type":"ContainerDied","Data":"488b095d48d087e9880b1efa68bce9020c5452583cd892107ffb229689340385"}
May 26 19:41:06.536232 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:06.536215    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:41:06.549096 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:06.546710    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-w942w" podStartSLOduration=8.793426092 podStartE2EDuration="27.546697568s" podCreationTimestamp="2026-05-26 19:40:39 +0000 UTC" firstStartedPulling="2026-05-26 19:40:40.64909006 +0000 UTC m=+1.915426369" lastFinishedPulling="2026-05-26 19:40:59.402361532 +0000 UTC m=+20.668697845" observedRunningTime="2026-05-26 19:41:06.545515054 +0000 UTC m=+27.811851386" watchObservedRunningTime="2026-05-26 19:41:06.546697568 +0000 UTC m=+27.813033900"
May 26 19:41:07.183852 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:07.183817    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dbnpx"]
May 26 19:41:07.183986 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:07.183968    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:41:07.184107 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:07.184079    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbnpx" podUID="c9b9e277-d07d-4630-9d88-f2fad67bc7e9"
May 26 19:41:07.184687 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:07.184667    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b9j9q"]
May 26 19:41:07.184814 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:07.184752    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:07.184868 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:07.184843    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b9j9q" podUID="8733236d-623f-4def-9571-6a9484c3d756"
May 26 19:41:07.185926 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:07.185903    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-twnct"]
May 26 19:41:07.186011 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:07.185993    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:41:07.186075 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:07.186061    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twnct" podUID="5b513a26-7609-4fa6-b6ac-ae939b6d6436"
May 26 19:41:07.527749 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:07.527665    2565 generic.go:358] "Generic (PLEG): container finished" podID="32a4562d-8bef-44cb-8028-3cb8087dbe94" containerID="3ccbf156bcf213901642a3f20f88639a2968b62d8b81fd1cba345568fff4f956" exitCode=0
May 26 19:41:07.528272 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:07.527754    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qv6dg" event={"ID":"32a4562d-8bef-44cb-8028-3cb8087dbe94","Type":"ContainerDied","Data":"3ccbf156bcf213901642a3f20f88639a2968b62d8b81fd1cba345568fff4f956"}
May 26 19:41:07.675645 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:07.675594    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8733236d-623f-4def-9571-6a9484c3d756-original-pull-secret\") pod \"global-pull-secret-syncer-b9j9q\" (UID: \"8733236d-623f-4def-9571-6a9484c3d756\") " pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:07.675841 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:07.675744    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:41:07.675924 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:07.675844    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8733236d-623f-4def-9571-6a9484c3d756-original-pull-secret podName:8733236d-623f-4def-9571-6a9484c3d756 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:11.675824746 +0000 UTC m=+32.942161059 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8733236d-623f-4def-9571-6a9484c3d756-original-pull-secret") pod "global-pull-secret-syncer-b9j9q" (UID: "8733236d-623f-4def-9571-6a9484c3d756") : object "kube-system"/"original-pull-secret" not registered
May 26 19:41:09.348489 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:09.348462    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:41:09.348878 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:09.348549    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:41:09.348878 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:09.348573    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twnct" podUID="5b513a26-7609-4fa6-b6ac-ae939b6d6436"
May 26 19:41:09.348878 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:09.348634    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbnpx" podUID="c9b9e277-d07d-4630-9d88-f2fad67bc7e9"
May 26 19:41:09.348878 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:09.348637    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:09.348878 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:09.348710    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b9j9q" podUID="8733236d-623f-4def-9571-6a9484c3d756"
May 26 19:41:09.691387 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:09.691350    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9chd6"
May 26 19:41:09.691534 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:09.691497    2565 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 26 19:41:09.692023 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:09.691997    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9chd6"
May 26 19:41:11.347987 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:11.347955    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:11.347987 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:11.347977    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:41:11.348424 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:11.347996    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:41:11.348424 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:11.348083    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-b9j9q" podUID="8733236d-623f-4def-9571-6a9484c3d756"
May 26 19:41:11.348424 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:11.348193    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-twnct" podUID="5b513a26-7609-4fa6-b6ac-ae939b6d6436"
May 26 19:41:11.348424 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:11.348277    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-dbnpx" podUID="c9b9e277-d07d-4630-9d88-f2fad67bc7e9"
May 26 19:41:11.707889 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:11.707845    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8733236d-623f-4def-9571-6a9484c3d756-original-pull-secret\") pod \"global-pull-secret-syncer-b9j9q\" (UID: \"8733236d-623f-4def-9571-6a9484c3d756\") " pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:11.708077 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:11.708006    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 26 19:41:11.708077 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:11.708069    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8733236d-623f-4def-9571-6a9484c3d756-original-pull-secret podName:8733236d-623f-4def-9571-6a9484c3d756 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:19.708053115 +0000 UTC m=+40.974389430 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8733236d-623f-4def-9571-6a9484c3d756-original-pull-secret") pod "global-pull-secret-syncer-b9j9q" (UID: "8733236d-623f-4def-9571-6a9484c3d756") : object "kube-system"/"original-pull-secret" not registered
May 26 19:41:12.011796 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.011510    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs\") pod \"network-metrics-daemon-twnct\" (UID: \"5b513a26-7609-4fa6-b6ac-ae939b6d6436\") " pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:41:12.011796 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:12.011661    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:41:12.012012 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:12.011829    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs podName:5b513a26-7609-4fa6-b6ac-ae939b6d6436 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:44.011809936 +0000 UTC m=+65.278146262 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs") pod "network-metrics-daemon-twnct" (UID: "5b513a26-7609-4fa6-b6ac-ae939b6d6436") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 26 19:41:12.112331 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.112293    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcc59\" (UniqueName: \"kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59\") pod \"network-check-target-dbnpx\" (UID: \"c9b9e277-d07d-4630-9d88-f2fad67bc7e9\") " pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:41:12.112498 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:12.112474    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 26 19:41:12.112569 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:12.112508    2565 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 26 19:41:12.112569 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:12.112522    2565 projected.go:194] Error preparing data for projected volume kube-api-access-pcc59 for pod openshift-network-diagnostics/network-check-target-dbnpx: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:41:12.112646 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:12.112587    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59 podName:c9b9e277-d07d-4630-9d88-f2fad67bc7e9 nodeName:}" failed. No retries permitted until 2026-05-26 19:41:44.11256973 +0000 UTC m=+65.378906065 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pcc59" (UniqueName: "kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59") pod "network-check-target-dbnpx" (UID: "c9b9e277-d07d-4630-9d88-f2fad67bc7e9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 26 19:41:12.552734 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.552705    2565 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-142.ec2.internal" event="NodeReady"
May 26 19:41:12.553219 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.552882    2565 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 26 19:41:12.597309 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.597277    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-gvxvz"]
May 26 19:41:12.624448 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.624418    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6s4k2"]
May 26 19:41:12.624638 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.624606    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvxvz"
May 26 19:41:12.627296 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.627275    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 26 19:41:12.627435 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.627355    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p4rbd\""
May 26 19:41:12.627435 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.627392    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 26 19:41:12.638565 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.638545    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gvxvz"]
May 26 19:41:12.638671 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.638569    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6s4k2"]
May 26 19:41:12.638671 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.638668    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6s4k2"
May 26 19:41:12.641128 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.641106    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 26 19:41:12.641128 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.641124    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 26 19:41:12.641286 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.641154    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nxp95\""
May 26 19:41:12.641286 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.641188    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 26 19:41:12.716124 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.716090    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e65118e0-5ef8-433d-b018-0531067b70aa-tmp-dir\") pod \"dns-default-gvxvz\" (UID: \"e65118e0-5ef8-433d-b018-0531067b70aa\") " pod="openshift-dns/dns-default-gvxvz"
May 26 19:41:12.716309 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.716147    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls\") pod \"dns-default-gvxvz\" (UID: \"e65118e0-5ef8-433d-b018-0531067b70aa\") " pod="openshift-dns/dns-default-gvxvz"
May 26 19:41:12.716309 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.716175    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert\") pod \"ingress-canary-6s4k2\" (UID: \"2cff5eaa-2999-4393-a02f-9df3a3168c4c\") " pod="openshift-ingress-canary/ingress-canary-6s4k2"
May 26 19:41:12.716309 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.716197    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e65118e0-5ef8-433d-b018-0531067b70aa-config-volume\") pod \"dns-default-gvxvz\" (UID: \"e65118e0-5ef8-433d-b018-0531067b70aa\") " pod="openshift-dns/dns-default-gvxvz"
May 26 19:41:12.716309 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.716227    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2dkx\" (UniqueName: \"kubernetes.io/projected/e65118e0-5ef8-433d-b018-0531067b70aa-kube-api-access-m2dkx\") pod \"dns-default-gvxvz\" (UID: \"e65118e0-5ef8-433d-b018-0531067b70aa\") " pod="openshift-dns/dns-default-gvxvz"
May 26 19:41:12.716452 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.716329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v96v6\" (UniqueName: \"kubernetes.io/projected/2cff5eaa-2999-4393-a02f-9df3a3168c4c-kube-api-access-v96v6\") pod \"ingress-canary-6s4k2\" (UID: \"2cff5eaa-2999-4393-a02f-9df3a3168c4c\") " pod="openshift-ingress-canary/ingress-canary-6s4k2"
May 26 19:41:12.817333 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.817245    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2dkx\" (UniqueName: \"kubernetes.io/projected/e65118e0-5ef8-433d-b018-0531067b70aa-kube-api-access-m2dkx\") pod \"dns-default-gvxvz\" (UID: \"e65118e0-5ef8-433d-b018-0531067b70aa\") " pod="openshift-dns/dns-default-gvxvz"
May 26 19:41:12.817497 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.817344    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v96v6\" (UniqueName: \"kubernetes.io/projected/2cff5eaa-2999-4393-a02f-9df3a3168c4c-kube-api-access-v96v6\") pod \"ingress-canary-6s4k2\" (UID: \"2cff5eaa-2999-4393-a02f-9df3a3168c4c\") " pod="openshift-ingress-canary/ingress-canary-6s4k2"
May 26 19:41:12.817497 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.817371    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e65118e0-5ef8-433d-b018-0531067b70aa-tmp-dir\") pod \"dns-default-gvxvz\" (UID: \"e65118e0-5ef8-433d-b018-0531067b70aa\") " pod="openshift-dns/dns-default-gvxvz"
May 26 19:41:12.817497 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.817397    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls\") pod \"dns-default-gvxvz\" (UID: \"e65118e0-5ef8-433d-b018-0531067b70aa\") " pod="openshift-dns/dns-default-gvxvz"
May 26 19:41:12.817497 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.817418    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert\") pod \"ingress-canary-6s4k2\" (UID: \"2cff5eaa-2999-4393-a02f-9df3a3168c4c\") " pod="openshift-ingress-canary/ingress-canary-6s4k2"
May 26 19:41:12.817497 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.817443    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e65118e0-5ef8-433d-b018-0531067b70aa-config-volume\") pod \"dns-default-gvxvz\" (UID: \"e65118e0-5ef8-433d-b018-0531067b70aa\") " pod="openshift-dns/dns-default-gvxvz"
May 26 19:41:12.817750 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:12.817516    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:41:12.817750 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:12.817547    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:41:12.817750 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:12.817590    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls podName:e65118e0-5ef8-433d-b018-0531067b70aa nodeName:}" failed. No retries permitted until 2026-05-26 19:41:13.317571778 +0000 UTC m=+34.583908094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls") pod "dns-default-gvxvz" (UID: "e65118e0-5ef8-433d-b018-0531067b70aa") : secret "dns-default-metrics-tls" not found
May 26 19:41:12.817750 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:12.817608    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert podName:2cff5eaa-2999-4393-a02f-9df3a3168c4c nodeName:}" failed. No retries permitted until 2026-05-26 19:41:13.317600704 +0000 UTC m=+34.583937018 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert") pod "ingress-canary-6s4k2" (UID: "2cff5eaa-2999-4393-a02f-9df3a3168c4c") : secret "canary-serving-cert" not found
May 26 19:41:12.817750 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.817746    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e65118e0-5ef8-433d-b018-0531067b70aa-tmp-dir\") pod \"dns-default-gvxvz\" (UID: \"e65118e0-5ef8-433d-b018-0531067b70aa\") " pod="openshift-dns/dns-default-gvxvz"
May 26 19:41:12.818013 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.817997    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e65118e0-5ef8-433d-b018-0531067b70aa-config-volume\") pod \"dns-default-gvxvz\" (UID: \"e65118e0-5ef8-433d-b018-0531067b70aa\") " pod="openshift-dns/dns-default-gvxvz"
May 26 19:41:12.827650 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.827628    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2dkx\" (UniqueName: \"kubernetes.io/projected/e65118e0-5ef8-433d-b018-0531067b70aa-kube-api-access-m2dkx\") pod \"dns-default-gvxvz\" (UID: \"e65118e0-5ef8-433d-b018-0531067b70aa\") " pod="openshift-dns/dns-default-gvxvz"
May 26 19:41:12.827839 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:12.827731    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v96v6\" (UniqueName: \"kubernetes.io/projected/2cff5eaa-2999-4393-a02f-9df3a3168c4c-kube-api-access-v96v6\") pod \"ingress-canary-6s4k2\" (UID: \"2cff5eaa-2999-4393-a02f-9df3a3168c4c\") " pod="openshift-ingress-canary/ingress-canary-6s4k2"
May 26 19:41:13.322241 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:13.322200    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls\") pod \"dns-default-gvxvz\" (UID: \"e65118e0-5ef8-433d-b018-0531067b70aa\") " pod="openshift-dns/dns-default-gvxvz"
May 26 19:41:13.322241 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:13.322245    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert\") pod \"ingress-canary-6s4k2\" (UID: \"2cff5eaa-2999-4393-a02f-9df3a3168c4c\") " pod="openshift-ingress-canary/ingress-canary-6s4k2"
May 26 19:41:13.322539 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:13.322346    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:41:13.322539 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:13.322384    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:41:13.322539 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:13.322412    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls podName:e65118e0-5ef8-433d-b018-0531067b70aa nodeName:}" failed. No retries permitted until 2026-05-26 19:41:14.322396435 +0000 UTC m=+35.588732762 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls") pod "dns-default-gvxvz" (UID: "e65118e0-5ef8-433d-b018-0531067b70aa") : secret "dns-default-metrics-tls" not found
May 26 19:41:13.322539 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:13.322435    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert podName:2cff5eaa-2999-4393-a02f-9df3a3168c4c nodeName:}" failed. No retries permitted until 2026-05-26 19:41:14.322417207 +0000 UTC m=+35.588753520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert") pod "ingress-canary-6s4k2" (UID: "2cff5eaa-2999-4393-a02f-9df3a3168c4c") : secret "canary-serving-cert" not found
May 26 19:41:13.348535 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:13.348503    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:13.348706 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:13.348503    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:41:13.348706 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:13.348503    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:41:13.352093 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:13.352066    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 19:41:13.352207 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:13.352127    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dx2vm\""
May 26 19:41:13.352666 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:13.352512    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 19:41:13.352666 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:13.352635    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vzqg4\""
May 26 19:41:13.352859 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:13.352636    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 19:41:13.352859 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:13.352743    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 26 19:41:14.330009 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:14.329929    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls\") pod \"dns-default-gvxvz\" (UID: \"e65118e0-5ef8-433d-b018-0531067b70aa\") " pod="openshift-dns/dns-default-gvxvz"
May 26 19:41:14.330009 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:14.329962    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert\") pod \"ingress-canary-6s4k2\" (UID: \"2cff5eaa-2999-4393-a02f-9df3a3168c4c\") " pod="openshift-ingress-canary/ingress-canary-6s4k2"
May 26 19:41:14.330579 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:14.330052    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:41:14.330579 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:14.330062    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:41:14.330579 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:14.330101    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert podName:2cff5eaa-2999-4393-a02f-9df3a3168c4c nodeName:}" failed. No retries permitted until 2026-05-26 19:41:16.330086355 +0000 UTC m=+37.596422678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert") pod "ingress-canary-6s4k2" (UID: "2cff5eaa-2999-4393-a02f-9df3a3168c4c") : secret "canary-serving-cert" not found
May 26 19:41:14.330579 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:14.330113    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls podName:e65118e0-5ef8-433d-b018-0531067b70aa nodeName:}" failed. No retries permitted until 2026-05-26 19:41:16.330107967 +0000 UTC m=+37.596444277 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls") pod "dns-default-gvxvz" (UID: "e65118e0-5ef8-433d-b018-0531067b70aa") : secret "dns-default-metrics-tls" not found
May 26 19:41:14.542967 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:14.542927    2565 generic.go:358] "Generic (PLEG): container finished" podID="32a4562d-8bef-44cb-8028-3cb8087dbe94" containerID="5af8d63871c6916a74a381bf032bdb4738701b8f731913df7af034987d720238" exitCode=0
May 26 19:41:14.543115 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:14.542974    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qv6dg" event={"ID":"32a4562d-8bef-44cb-8028-3cb8087dbe94","Type":"ContainerDied","Data":"5af8d63871c6916a74a381bf032bdb4738701b8f731913df7af034987d720238"}
May 26 19:41:15.549550 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:15.549519    2565 generic.go:358] "Generic (PLEG): container finished" podID="32a4562d-8bef-44cb-8028-3cb8087dbe94" containerID="16643cb189f1dbdf145eff8157212117bdecbac297b14b26a294bce4486473b5" exitCode=0
May 26 19:41:15.549950 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:15.549582    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qv6dg" event={"ID":"32a4562d-8bef-44cb-8028-3cb8087dbe94","Type":"ContainerDied","Data":"16643cb189f1dbdf145eff8157212117bdecbac297b14b26a294bce4486473b5"}
May 26 19:41:16.346125 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:16.346087    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls\") pod \"dns-default-gvxvz\" (UID: \"e65118e0-5ef8-433d-b018-0531067b70aa\") " pod="openshift-dns/dns-default-gvxvz"
May 26 19:41:16.346125 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:16.346124    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert\") pod \"ingress-canary-6s4k2\" (UID: \"2cff5eaa-2999-4393-a02f-9df3a3168c4c\") " pod="openshift-ingress-canary/ingress-canary-6s4k2"
May 26 19:41:16.346363 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:16.346231    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:41:16.346363 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:16.346234    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:41:16.346363 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:16.346284    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert podName:2cff5eaa-2999-4393-a02f-9df3a3168c4c nodeName:}" failed. No retries permitted until 2026-05-26 19:41:20.346270533 +0000 UTC m=+41.612606843 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert") pod "ingress-canary-6s4k2" (UID: "2cff5eaa-2999-4393-a02f-9df3a3168c4c") : secret "canary-serving-cert" not found
May 26 19:41:16.346363 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:16.346296    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls podName:e65118e0-5ef8-433d-b018-0531067b70aa nodeName:}" failed. No retries permitted until 2026-05-26 19:41:20.346290991 +0000 UTC m=+41.612627301 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls") pod "dns-default-gvxvz" (UID: "e65118e0-5ef8-433d-b018-0531067b70aa") : secret "dns-default-metrics-tls" not found
May 26 19:41:16.556214 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:16.556179    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qv6dg" event={"ID":"32a4562d-8bef-44cb-8028-3cb8087dbe94","Type":"ContainerStarted","Data":"b370e718744e8ae1659b9ba13cb91746418f398ca19212ed571e78312263b700"}
May 26 19:41:16.581706 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:16.581227    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qv6dg" podStartSLOduration=4.621326784 podStartE2EDuration="37.581210384s" podCreationTimestamp="2026-05-26 19:40:39 +0000 UTC" firstStartedPulling="2026-05-26 19:40:40.746785388 +0000 UTC m=+2.013121698" lastFinishedPulling="2026-05-26 19:41:13.706668984 +0000 UTC m=+34.973005298" observedRunningTime="2026-05-26 19:41:16.579439001 +0000 UTC m=+37.845775333" watchObservedRunningTime="2026-05-26 19:41:16.581210384 +0000 UTC m=+37.847546717"
May 26 19:41:19.769136 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:19.769096    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8733236d-623f-4def-9571-6a9484c3d756-original-pull-secret\") pod \"global-pull-secret-syncer-b9j9q\" (UID: \"8733236d-623f-4def-9571-6a9484c3d756\") " pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:19.771512 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:19.771482    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8733236d-623f-4def-9571-6a9484c3d756-original-pull-secret\") pod \"global-pull-secret-syncer-b9j9q\" (UID: \"8733236d-623f-4def-9571-6a9484c3d756\") " pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:19.961269 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:19.961235    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-b9j9q"
May 26 19:41:20.151265 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:20.151238    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-b9j9q"]
May 26 19:41:20.154472 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:41:20.154443    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8733236d_623f_4def_9571_6a9484c3d756.slice/crio-b0d2df71d3dbc4ef161c27b829ade8e7d083312bf33398d78c633af8efbaaef7 WatchSource:0}: Error finding container b0d2df71d3dbc4ef161c27b829ade8e7d083312bf33398d78c633af8efbaaef7: Status 404 returned error can't find the container with id b0d2df71d3dbc4ef161c27b829ade8e7d083312bf33398d78c633af8efbaaef7
May 26 19:41:20.374833 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:20.374740    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls\") pod \"dns-default-gvxvz\" (UID: \"e65118e0-5ef8-433d-b018-0531067b70aa\") " pod="openshift-dns/dns-default-gvxvz"
May 26 19:41:20.374833 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:20.374804    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert\") pod \"ingress-canary-6s4k2\" (UID: \"2cff5eaa-2999-4393-a02f-9df3a3168c4c\") " pod="openshift-ingress-canary/ingress-canary-6s4k2"
May 26 19:41:20.375030 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:20.374889    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:41:20.375030 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:20.374893    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:41:20.375030 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:20.374940    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert podName:2cff5eaa-2999-4393-a02f-9df3a3168c4c nodeName:}" failed. No retries permitted until 2026-05-26 19:41:28.374927362 +0000 UTC m=+49.641263673 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert") pod "ingress-canary-6s4k2" (UID: "2cff5eaa-2999-4393-a02f-9df3a3168c4c") : secret "canary-serving-cert" not found
May 26 19:41:20.375030 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:20.374954    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls podName:e65118e0-5ef8-433d-b018-0531067b70aa nodeName:}" failed. No retries permitted until 2026-05-26 19:41:28.374948004 +0000 UTC m=+49.641284314 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls") pod "dns-default-gvxvz" (UID: "e65118e0-5ef8-433d-b018-0531067b70aa") : secret "dns-default-metrics-tls" not found
May 26 19:41:20.564927 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:20.564890    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b9j9q" event={"ID":"8733236d-623f-4def-9571-6a9484c3d756","Type":"ContainerStarted","Data":"b0d2df71d3dbc4ef161c27b829ade8e7d083312bf33398d78c633af8efbaaef7"}
May 26 19:41:25.575651 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:25.575608    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-b9j9q" event={"ID":"8733236d-623f-4def-9571-6a9484c3d756","Type":"ContainerStarted","Data":"21cc19823b8a2615a667bac287f8e42ad2c235fc96d4f7340bcd346ebe7695ca"}
May 26 19:41:25.590142 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:25.590094    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-b9j9q" podStartSLOduration=18.282358255 podStartE2EDuration="22.590080373s" podCreationTimestamp="2026-05-26 19:41:03 +0000 UTC" firstStartedPulling="2026-05-26 19:41:20.156066701 +0000 UTC m=+41.422403011" lastFinishedPulling="2026-05-26 19:41:24.463788819 +0000 UTC m=+45.730125129" observedRunningTime="2026-05-26 19:41:25.589462279 +0000 UTC m=+46.855798611" watchObservedRunningTime="2026-05-26 19:41:25.590080373 +0000 UTC m=+46.856416698"
May 26 19:41:28.437612 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:28.437564    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls\") pod \"dns-default-gvxvz\" (UID: \"e65118e0-5ef8-433d-b018-0531067b70aa\") " pod="openshift-dns/dns-default-gvxvz"
May 26 19:41:28.437612 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:28.437612    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert\") pod \"ingress-canary-6s4k2\" (UID: \"2cff5eaa-2999-4393-a02f-9df3a3168c4c\") " pod="openshift-ingress-canary/ingress-canary-6s4k2"
May 26 19:41:28.438088 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:28.437709    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:41:28.438088 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:28.437728    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:41:28.438088 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:28.437791    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert podName:2cff5eaa-2999-4393-a02f-9df3a3168c4c nodeName:}" failed. No retries permitted until 2026-05-26 19:41:44.437752914 +0000 UTC m=+65.704089225 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert") pod "ingress-canary-6s4k2" (UID: "2cff5eaa-2999-4393-a02f-9df3a3168c4c") : secret "canary-serving-cert" not found
May 26 19:41:28.438088 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:28.437809    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls podName:e65118e0-5ef8-433d-b018-0531067b70aa nodeName:}" failed. No retries permitted until 2026-05-26 19:41:44.437800948 +0000 UTC m=+65.704137257 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls") pod "dns-default-gvxvz" (UID: "e65118e0-5ef8-433d-b018-0531067b70aa") : secret "dns-default-metrics-tls" not found
May 26 19:41:38.540559 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:38.540532    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w942w"
May 26 19:41:44.047736 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:44.047688    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs\") pod \"network-metrics-daemon-twnct\" (UID: \"5b513a26-7609-4fa6-b6ac-ae939b6d6436\") " pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:41:44.051614 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:44.051572    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 26 19:41:44.058802 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:44.058781    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 26 19:41:44.058919 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:44.058858    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs podName:5b513a26-7609-4fa6-b6ac-ae939b6d6436 nodeName:}" failed. No retries permitted until 2026-05-26 19:42:48.058841521 +0000 UTC m=+129.325177844 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs") pod "network-metrics-daemon-twnct" (UID: "5b513a26-7609-4fa6-b6ac-ae939b6d6436") : secret "metrics-daemon-secret" not found
May 26 19:41:44.148089 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:44.148047    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pcc59\" (UniqueName: \"kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59\") pod \"network-check-target-dbnpx\" (UID: \"c9b9e277-d07d-4630-9d88-f2fad67bc7e9\") " pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:41:44.150979 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:44.150956    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 26 19:41:44.160900 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:44.160880    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 26 19:41:44.171158 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:44.171132    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcc59\" (UniqueName: \"kubernetes.io/projected/c9b9e277-d07d-4630-9d88-f2fad67bc7e9-kube-api-access-pcc59\") pod \"network-check-target-dbnpx\" (UID: \"c9b9e277-d07d-4630-9d88-f2fad67bc7e9\") " pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:41:44.274014 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:44.273984    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vzqg4\""
May 26 19:41:44.282103 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:44.282083    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:41:44.397956 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:44.397922    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-dbnpx"]
May 26 19:41:44.401349 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:41:44.401315    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9b9e277_d07d_4630_9d88_f2fad67bc7e9.slice/crio-a7cf727f609333c059c2102f5ac6ff5261b7a2f6ce75591370ac5ed2d75494bd WatchSource:0}: Error finding container a7cf727f609333c059c2102f5ac6ff5261b7a2f6ce75591370ac5ed2d75494bd: Status 404 returned error can't find the container with id a7cf727f609333c059c2102f5ac6ff5261b7a2f6ce75591370ac5ed2d75494bd
May 26 19:41:44.450465 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:44.450428    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls\") pod \"dns-default-gvxvz\" (UID: \"e65118e0-5ef8-433d-b018-0531067b70aa\") " pod="openshift-dns/dns-default-gvxvz"
May 26 19:41:44.450465 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:44.450466    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert\") pod \"ingress-canary-6s4k2\" (UID: \"2cff5eaa-2999-4393-a02f-9df3a3168c4c\") " pod="openshift-ingress-canary/ingress-canary-6s4k2"
May 26 19:41:44.450647 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:44.450573    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:41:44.450647 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:44.450625    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert podName:2cff5eaa-2999-4393-a02f-9df3a3168c4c nodeName:}" failed. No retries permitted until 2026-05-26 19:42:16.450612499 +0000 UTC m=+97.716948809 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert") pod "ingress-canary-6s4k2" (UID: "2cff5eaa-2999-4393-a02f-9df3a3168c4c") : secret "canary-serving-cert" not found
May 26 19:41:44.450754 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:44.450573    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:41:44.450754 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:41:44.450698    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls podName:e65118e0-5ef8-433d-b018-0531067b70aa nodeName:}" failed. No retries permitted until 2026-05-26 19:42:16.450687269 +0000 UTC m=+97.717023596 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls") pod "dns-default-gvxvz" (UID: "e65118e0-5ef8-433d-b018-0531067b70aa") : secret "dns-default-metrics-tls" not found
May 26 19:41:44.613152 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:44.613060    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dbnpx" event={"ID":"c9b9e277-d07d-4630-9d88-f2fad67bc7e9","Type":"ContainerStarted","Data":"a7cf727f609333c059c2102f5ac6ff5261b7a2f6ce75591370ac5ed2d75494bd"}
May 26 19:41:48.620873 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:48.620838    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-dbnpx" event={"ID":"c9b9e277-d07d-4630-9d88-f2fad67bc7e9","Type":"ContainerStarted","Data":"e0166b47da25cc8a267948a7b2d6025e86a1021e6437ed06d1143bca393f59c8"}
May 26 19:41:48.621282 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:48.620955    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:41:48.635618 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:41:48.635558    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-dbnpx" podStartSLOduration=65.982948898 podStartE2EDuration="1m9.63554499s" podCreationTimestamp="2026-05-26 19:40:39 +0000 UTC" firstStartedPulling="2026-05-26 19:41:44.402977896 +0000 UTC m=+65.669314207" lastFinishedPulling="2026-05-26 19:41:48.05557397 +0000 UTC m=+69.321910299" observedRunningTime="2026-05-26 19:41:48.635266476 +0000 UTC m=+69.901602808" watchObservedRunningTime="2026-05-26 19:41:48.63554499 +0000 UTC m=+69.901881322"
May 26 19:42:16.480595 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:16.480469    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls\") pod \"dns-default-gvxvz\" (UID: \"e65118e0-5ef8-433d-b018-0531067b70aa\") " pod="openshift-dns/dns-default-gvxvz"
May 26 19:42:16.480595 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:16.480511    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert\") pod \"ingress-canary-6s4k2\" (UID: \"2cff5eaa-2999-4393-a02f-9df3a3168c4c\") " pod="openshift-ingress-canary/ingress-canary-6s4k2"
May 26 19:42:16.481056 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:16.480605    2565 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 26 19:42:16.481056 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:16.480609    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 26 19:42:16.481056 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:16.480666    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert podName:2cff5eaa-2999-4393-a02f-9df3a3168c4c nodeName:}" failed. No retries permitted until 2026-05-26 19:43:20.480651537 +0000 UTC m=+161.746987848 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert") pod "ingress-canary-6s4k2" (UID: "2cff5eaa-2999-4393-a02f-9df3a3168c4c") : secret "canary-serving-cert" not found
May 26 19:42:16.481056 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:16.480678    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls podName:e65118e0-5ef8-433d-b018-0531067b70aa nodeName:}" failed. No retries permitted until 2026-05-26 19:43:20.480672638 +0000 UTC m=+161.747008948 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls") pod "dns-default-gvxvz" (UID: "e65118e0-5ef8-433d-b018-0531067b70aa") : secret "dns-default-metrics-tls" not found
May 26 19:42:17.504918 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.504887    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4vbkf"]
May 26 19:42:17.507206 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.507191    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4vbkf"
May 26 19:42:17.510154 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.510123    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-dvfjn"]
May 26 19:42:17.511330 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.511309    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-z6xdx\""
May 26 19:42:17.511572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.511555    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 26 19:42:17.511825 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.511811    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 26 19:42:17.511976 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.511959    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-cnsvr"]
May 26 19:42:17.512108 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.512091    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dvfjn"
May 26 19:42:17.513644 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.513628    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-cnsvr"
May 26 19:42:17.515083 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.515058    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 26 19:42:17.515358 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.515336    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 26 19:42:17.515761 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.515655    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 26 19:42:17.515950 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.515931    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-l9lth\""
May 26 19:42:17.516159 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.516142    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c7cbb5886-h967c"]
May 26 19:42:17.516321 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.516302    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 26 19:42:17.516428 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.516412    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 26 19:42:17.516679 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.516663    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 26 19:42:17.517034 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.517012    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qggdh\""
May 26 19:42:17.517119 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.517047    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 26 19:42:17.518120 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.518106    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.520459 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.520439    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 26 19:42:17.520554 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.520471    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 26 19:42:17.520554 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.520447    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 26 19:42:17.520698 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.520686    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-42p9z\""
May 26 19:42:17.527995 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.527973    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4vbkf"]
May 26 19:42:17.529688 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.529669    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 26 19:42:17.531564 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.531545    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 26 19:42:17.533108 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.533086    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-dvfjn"]
May 26 19:42:17.536486 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.536467    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c7cbb5886-h967c"]
May 26 19:42:17.542902 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.542882    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-cnsvr"]
May 26 19:42:17.589363 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.589334    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzc4v\" (UniqueName: \"kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-kube-api-access-tzc4v\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.589363 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.589365    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.589543 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.589391    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d2487f3-ae87-4ee7-8960-52fcade87a1a-serving-cert\") pod \"console-operator-76dff48d59-cnsvr\" (UID: \"1d2487f3-ae87-4ee7-8960-52fcade87a1a\") " pod="openshift-console-operator/console-operator-76dff48d59-cnsvr"
May 26 19:42:17.589543 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.589410    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-image-registry-private-configuration\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.589543 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.589470    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-certificates\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.589543 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.589503    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-trusted-ca\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.589543 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.589529    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-installation-pull-secrets\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.589744 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.589557    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfw6d\" (UniqueName: \"kubernetes.io/projected/7882115c-97f7-489c-8977-948729486766-kube-api-access-mfw6d\") pod \"volume-data-source-validator-5cf8c89d64-4vbkf\" (UID: \"7882115c-97f7-489c-8977-948729486766\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4vbkf"
May 26 19:42:17.589744 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.589595    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/be7f72e5-5cb5-42b9-bf76-99250882e05b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-dvfjn\" (UID: \"be7f72e5-5cb5-42b9-bf76-99250882e05b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dvfjn"
May 26 19:42:17.589744 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.589627    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d2487f3-ae87-4ee7-8960-52fcade87a1a-trusted-ca\") pod \"console-operator-76dff48d59-cnsvr\" (UID: \"1d2487f3-ae87-4ee7-8960-52fcade87a1a\") " pod="openshift-console-operator/console-operator-76dff48d59-cnsvr"
May 26 19:42:17.589744 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.589654    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-658v2\" (UniqueName: \"kubernetes.io/projected/1d2487f3-ae87-4ee7-8960-52fcade87a1a-kube-api-access-658v2\") pod \"console-operator-76dff48d59-cnsvr\" (UID: \"1d2487f3-ae87-4ee7-8960-52fcade87a1a\") " pod="openshift-console-operator/console-operator-76dff48d59-cnsvr"
May 26 19:42:17.589744 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.589678    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-ca-trust-extracted\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.589744 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.589702    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tq6hn\" (UniqueName: \"kubernetes.io/projected/be7f72e5-5cb5-42b9-bf76-99250882e05b-kube-api-access-tq6hn\") pod \"cluster-samples-operator-697587599-dvfjn\" (UID: \"be7f72e5-5cb5-42b9-bf76-99250882e05b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dvfjn"
May 26 19:42:17.590000 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.589808    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-bound-sa-token\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.590000 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.589853    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d2487f3-ae87-4ee7-8960-52fcade87a1a-config\") pod \"console-operator-76dff48d59-cnsvr\" (UID: \"1d2487f3-ae87-4ee7-8960-52fcade87a1a\") " pod="openshift-console-operator/console-operator-76dff48d59-cnsvr"
May 26 19:42:17.601271 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.601247    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qc2wq"]
May 26 19:42:17.603188 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.603172    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qc2wq"
May 26 19:42:17.605361 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.605342    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 26 19:42:17.605475 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.605460    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 26 19:42:17.605544 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.605501    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-hbkx8\""
May 26 19:42:17.606399 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.606384    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 26 19:42:17.607556 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.607527    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 26 19:42:17.614234 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.614213    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qc2wq"]
May 26 19:42:17.690878 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.690849    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d2487f3-ae87-4ee7-8960-52fcade87a1a-serving-cert\") pod \"console-operator-76dff48d59-cnsvr\" (UID: \"1d2487f3-ae87-4ee7-8960-52fcade87a1a\") " pod="openshift-console-operator/console-operator-76dff48d59-cnsvr"
May 26 19:42:17.690878 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.690880    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-image-registry-private-configuration\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.691109 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.690907    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-certificates\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.691109 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.690922    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-trusted-ca\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.691109 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.690939    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-installation-pull-secrets\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.691109 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.690964    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mfw6d\" (UniqueName: \"kubernetes.io/projected/7882115c-97f7-489c-8977-948729486766-kube-api-access-mfw6d\") pod \"volume-data-source-validator-5cf8c89d64-4vbkf\" (UID: \"7882115c-97f7-489c-8977-948729486766\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4vbkf"
May 26 19:42:17.691109 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.690981    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/be7f72e5-5cb5-42b9-bf76-99250882e05b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-dvfjn\" (UID: \"be7f72e5-5cb5-42b9-bf76-99250882e05b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dvfjn"
May 26 19:42:17.691109 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.691000    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d2487f3-ae87-4ee7-8960-52fcade87a1a-trusted-ca\") pod \"console-operator-76dff48d59-cnsvr\" (UID: \"1d2487f3-ae87-4ee7-8960-52fcade87a1a\") " pod="openshift-console-operator/console-operator-76dff48d59-cnsvr"
May 26 19:42:17.691109 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.691026    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-658v2\" (UniqueName: \"kubernetes.io/projected/1d2487f3-ae87-4ee7-8960-52fcade87a1a-kube-api-access-658v2\") pod \"console-operator-76dff48d59-cnsvr\" (UID: \"1d2487f3-ae87-4ee7-8960-52fcade87a1a\") " pod="openshift-console-operator/console-operator-76dff48d59-cnsvr"
May 26 19:42:17.691109 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.691049    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-ca-trust-extracted\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.691109 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.691075    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tq6hn\" (UniqueName: \"kubernetes.io/projected/be7f72e5-5cb5-42b9-bf76-99250882e05b-kube-api-access-tq6hn\") pod \"cluster-samples-operator-697587599-dvfjn\" (UID: \"be7f72e5-5cb5-42b9-bf76-99250882e05b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dvfjn"
May 26 19:42:17.691549 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:17.691108    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 19:42:17.691549 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.691130    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cfhxl\" (UniqueName: \"kubernetes.io/projected/ef306df5-e9fa-457e-b43b-6664145a0912-kube-api-access-cfhxl\") pod \"kube-storage-version-migrator-operator-565644f49-qc2wq\" (UID: \"ef306df5-e9fa-457e-b43b-6664145a0912\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qc2wq"
May 26 19:42:17.691549 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:17.691179    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be7f72e5-5cb5-42b9-bf76-99250882e05b-samples-operator-tls podName:be7f72e5-5cb5-42b9-bf76-99250882e05b nodeName:}" failed. No retries permitted until 2026-05-26 19:42:18.191158413 +0000 UTC m=+99.457494740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/be7f72e5-5cb5-42b9-bf76-99250882e05b-samples-operator-tls") pod "cluster-samples-operator-697587599-dvfjn" (UID: "be7f72e5-5cb5-42b9-bf76-99250882e05b") : secret "samples-operator-tls" not found
May 26 19:42:17.691549 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.691206    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-bound-sa-token\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.691549 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.691241    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef306df5-e9fa-457e-b43b-6664145a0912-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-qc2wq\" (UID: \"ef306df5-e9fa-457e-b43b-6664145a0912\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qc2wq"
May 26 19:42:17.691549 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.691290    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d2487f3-ae87-4ee7-8960-52fcade87a1a-config\") pod \"console-operator-76dff48d59-cnsvr\" (UID: \"1d2487f3-ae87-4ee7-8960-52fcade87a1a\") " pod="openshift-console-operator/console-operator-76dff48d59-cnsvr"
May 26 19:42:17.691549 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.691321    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzc4v\" (UniqueName: \"kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-kube-api-access-tzc4v\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.691549 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.691350    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.691549 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.691375    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef306df5-e9fa-457e-b43b-6664145a0912-config\") pod \"kube-storage-version-migrator-operator-565644f49-qc2wq\" (UID: \"ef306df5-e9fa-457e-b43b-6664145a0912\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qc2wq"
May 26 19:42:17.692028 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.691587    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-certificates\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.692028 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.691715    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-ca-trust-extracted\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.692028 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:17.691850    2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:42:17.692028 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:17.691865    2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c7cbb5886-h967c: secret "image-registry-tls" not found
May 26 19:42:17.692028 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:17.691916    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls podName:995b5c3e-cbc2-4b6e-a32d-4998dce0666c nodeName:}" failed. No retries permitted until 2026-05-26 19:42:18.191898161 +0000 UTC m=+99.458234488 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls") pod "image-registry-7c7cbb5886-h967c" (UID: "995b5c3e-cbc2-4b6e-a32d-4998dce0666c") : secret "image-registry-tls" not found
May 26 19:42:17.692028 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.691997    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d2487f3-ae87-4ee7-8960-52fcade87a1a-trusted-ca\") pod \"console-operator-76dff48d59-cnsvr\" (UID: \"1d2487f3-ae87-4ee7-8960-52fcade87a1a\") " pod="openshift-console-operator/console-operator-76dff48d59-cnsvr"
May 26 19:42:17.692232 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.692058    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d2487f3-ae87-4ee7-8960-52fcade87a1a-config\") pod \"console-operator-76dff48d59-cnsvr\" (UID: \"1d2487f3-ae87-4ee7-8960-52fcade87a1a\") " pod="openshift-console-operator/console-operator-76dff48d59-cnsvr"
May 26 19:42:17.692232 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.692073    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-trusted-ca\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.694052 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.694024    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-image-registry-private-configuration\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.694218 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.694204    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-installation-pull-secrets\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.699905 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.699862    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d2487f3-ae87-4ee7-8960-52fcade87a1a-serving-cert\") pod \"console-operator-76dff48d59-cnsvr\" (UID: \"1d2487f3-ae87-4ee7-8960-52fcade87a1a\") " pod="openshift-console-operator/console-operator-76dff48d59-cnsvr"
May 26 19:42:17.700476 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.700430    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-bound-sa-token\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.700594 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.700532    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tq6hn\" (UniqueName: \"kubernetes.io/projected/be7f72e5-5cb5-42b9-bf76-99250882e05b-kube-api-access-tq6hn\") pod \"cluster-samples-operator-697587599-dvfjn\" (UID: \"be7f72e5-5cb5-42b9-bf76-99250882e05b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dvfjn"
May 26 19:42:17.700594 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.700587    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-658v2\" (UniqueName: \"kubernetes.io/projected/1d2487f3-ae87-4ee7-8960-52fcade87a1a-kube-api-access-658v2\") pod \"console-operator-76dff48d59-cnsvr\" (UID: \"1d2487f3-ae87-4ee7-8960-52fcade87a1a\") " pod="openshift-console-operator/console-operator-76dff48d59-cnsvr"
May 26 19:42:17.700754 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.700730    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzc4v\" (UniqueName: \"kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-kube-api-access-tzc4v\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:17.700888 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.700835    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfw6d\" (UniqueName: \"kubernetes.io/projected/7882115c-97f7-489c-8977-948729486766-kube-api-access-mfw6d\") pod \"volume-data-source-validator-5cf8c89d64-4vbkf\" (UID: \"7882115c-97f7-489c-8977-948729486766\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4vbkf"
May 26 19:42:17.792111 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.792005    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cfhxl\" (UniqueName: \"kubernetes.io/projected/ef306df5-e9fa-457e-b43b-6664145a0912-kube-api-access-cfhxl\") pod \"kube-storage-version-migrator-operator-565644f49-qc2wq\" (UID: \"ef306df5-e9fa-457e-b43b-6664145a0912\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qc2wq"
May 26 19:42:17.792111 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.792065    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef306df5-e9fa-457e-b43b-6664145a0912-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-qc2wq\" (UID: \"ef306df5-e9fa-457e-b43b-6664145a0912\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qc2wq"
May 26 19:42:17.792291 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.792249    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef306df5-e9fa-457e-b43b-6664145a0912-config\") pod \"kube-storage-version-migrator-operator-565644f49-qc2wq\" (UID: \"ef306df5-e9fa-457e-b43b-6664145a0912\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qc2wq"
May 26 19:42:17.792702 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.792681    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef306df5-e9fa-457e-b43b-6664145a0912-config\") pod \"kube-storage-version-migrator-operator-565644f49-qc2wq\" (UID: \"ef306df5-e9fa-457e-b43b-6664145a0912\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qc2wq"
May 26 19:42:17.794193 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.794173    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef306df5-e9fa-457e-b43b-6664145a0912-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-qc2wq\" (UID: \"ef306df5-e9fa-457e-b43b-6664145a0912\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qc2wq"
May 26 19:42:17.799714 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.799693    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cfhxl\" (UniqueName: \"kubernetes.io/projected/ef306df5-e9fa-457e-b43b-6664145a0912-kube-api-access-cfhxl\") pod \"kube-storage-version-migrator-operator-565644f49-qc2wq\" (UID: \"ef306df5-e9fa-457e-b43b-6664145a0912\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qc2wq"
May 26 19:42:17.818607 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.818586    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4vbkf"
May 26 19:42:17.833788 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.833758    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-cnsvr"
May 26 19:42:17.912634 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.912296    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qc2wq"
May 26 19:42:17.943164 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.943130    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4vbkf"]
May 26 19:42:17.946945 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:42:17.946901    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7882115c_97f7_489c_8977_948729486766.slice/crio-7bd6f5c7d739531397cf6cf6d49f2e807a75fc957f73e79175a691d4bce9700a WatchSource:0}: Error finding container 7bd6f5c7d739531397cf6cf6d49f2e807a75fc957f73e79175a691d4bce9700a: Status 404 returned error can't find the container with id 7bd6f5c7d739531397cf6cf6d49f2e807a75fc957f73e79175a691d4bce9700a
May 26 19:42:17.961807 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:17.961442    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-cnsvr"]
May 26 19:42:17.965303 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:42:17.965272    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d2487f3_ae87_4ee7_8960_52fcade87a1a.slice/crio-eed95582bdb1b0f9094fd4f0d819426d9551d4277534b14d1b98c62b7138d5c0 WatchSource:0}: Error finding container eed95582bdb1b0f9094fd4f0d819426d9551d4277534b14d1b98c62b7138d5c0: Status 404 returned error can't find the container with id eed95582bdb1b0f9094fd4f0d819426d9551d4277534b14d1b98c62b7138d5c0
May 26 19:42:18.032803 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:18.032752    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qc2wq"]
May 26 19:42:18.035703 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:42:18.035676    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef306df5_e9fa_457e_b43b_6664145a0912.slice/crio-640b2e0faf2ae49ee42f246e1691a9a6a6931009dd3e30479acfed54f14c3a0f WatchSource:0}: Error finding container 640b2e0faf2ae49ee42f246e1691a9a6a6931009dd3e30479acfed54f14c3a0f: Status 404 returned error can't find the container with id 640b2e0faf2ae49ee42f246e1691a9a6a6931009dd3e30479acfed54f14c3a0f
May 26 19:42:18.196393 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:18.196367    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:18.196538 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:18.196414    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/be7f72e5-5cb5-42b9-bf76-99250882e05b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-dvfjn\" (UID: \"be7f72e5-5cb5-42b9-bf76-99250882e05b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dvfjn"
May 26 19:42:18.196538 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:18.196507    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 19:42:18.196538 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:18.196513    2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:42:18.196538 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:18.196532    2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c7cbb5886-h967c: secret "image-registry-tls" not found
May 26 19:42:18.196738 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:18.196559    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be7f72e5-5cb5-42b9-bf76-99250882e05b-samples-operator-tls podName:be7f72e5-5cb5-42b9-bf76-99250882e05b nodeName:}" failed. No retries permitted until 2026-05-26 19:42:19.196544767 +0000 UTC m=+100.462881077 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/be7f72e5-5cb5-42b9-bf76-99250882e05b-samples-operator-tls") pod "cluster-samples-operator-697587599-dvfjn" (UID: "be7f72e5-5cb5-42b9-bf76-99250882e05b") : secret "samples-operator-tls" not found
May 26 19:42:18.196738 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:18.196571    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls podName:995b5c3e-cbc2-4b6e-a32d-4998dce0666c nodeName:}" failed. No retries permitted until 2026-05-26 19:42:19.19656572 +0000 UTC m=+100.462902030 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls") pod "image-registry-7c7cbb5886-h967c" (UID: "995b5c3e-cbc2-4b6e-a32d-4998dce0666c") : secret "image-registry-tls" not found
May 26 19:42:18.679413 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:18.679322    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-cnsvr" event={"ID":"1d2487f3-ae87-4ee7-8960-52fcade87a1a","Type":"ContainerStarted","Data":"eed95582bdb1b0f9094fd4f0d819426d9551d4277534b14d1b98c62b7138d5c0"}
May 26 19:42:18.681517 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:18.681452    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qc2wq" event={"ID":"ef306df5-e9fa-457e-b43b-6664145a0912","Type":"ContainerStarted","Data":"640b2e0faf2ae49ee42f246e1691a9a6a6931009dd3e30479acfed54f14c3a0f"}
May 26 19:42:18.683002 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:18.682956    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4vbkf" event={"ID":"7882115c-97f7-489c-8977-948729486766","Type":"ContainerStarted","Data":"7bd6f5c7d739531397cf6cf6d49f2e807a75fc957f73e79175a691d4bce9700a"}
May 26 19:42:19.204696 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:19.204657    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/be7f72e5-5cb5-42b9-bf76-99250882e05b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-dvfjn\" (UID: \"be7f72e5-5cb5-42b9-bf76-99250882e05b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dvfjn"
May 26 19:42:19.205513 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:19.204808    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:19.205513 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:19.204822    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 19:42:19.205513 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:19.204885    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be7f72e5-5cb5-42b9-bf76-99250882e05b-samples-operator-tls podName:be7f72e5-5cb5-42b9-bf76-99250882e05b nodeName:}" failed. No retries permitted until 2026-05-26 19:42:21.204869489 +0000 UTC m=+102.471205798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/be7f72e5-5cb5-42b9-bf76-99250882e05b-samples-operator-tls") pod "cluster-samples-operator-697587599-dvfjn" (UID: "be7f72e5-5cb5-42b9-bf76-99250882e05b") : secret "samples-operator-tls" not found
May 26 19:42:19.205513 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:19.204894    2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:42:19.205513 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:19.204904    2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c7cbb5886-h967c: secret "image-registry-tls" not found
May 26 19:42:19.205513 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:19.204952    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls podName:995b5c3e-cbc2-4b6e-a32d-4998dce0666c nodeName:}" failed. No retries permitted until 2026-05-26 19:42:21.204940328 +0000 UTC m=+102.471276637 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls") pod "image-registry-7c7cbb5886-h967c" (UID: "995b5c3e-cbc2-4b6e-a32d-4998dce0666c") : secret "image-registry-tls" not found
May 26 19:42:19.624749 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:19.624679    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-dbnpx"
May 26 19:42:21.224007 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:21.223970    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:21.224410 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:21.224037    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/be7f72e5-5cb5-42b9-bf76-99250882e05b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-dvfjn\" (UID: \"be7f72e5-5cb5-42b9-bf76-99250882e05b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dvfjn"
May 26 19:42:21.224410 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:21.224117    2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:42:21.224410 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:21.224137    2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c7cbb5886-h967c: secret "image-registry-tls" not found
May 26 19:42:21.224410 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:21.224148    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 19:42:21.224410 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:21.224193    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls podName:995b5c3e-cbc2-4b6e-a32d-4998dce0666c nodeName:}" failed. No retries permitted until 2026-05-26 19:42:25.224177384 +0000 UTC m=+106.490513694 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls") pod "image-registry-7c7cbb5886-h967c" (UID: "995b5c3e-cbc2-4b6e-a32d-4998dce0666c") : secret "image-registry-tls" not found
May 26 19:42:21.224410 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:21.224214    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be7f72e5-5cb5-42b9-bf76-99250882e05b-samples-operator-tls podName:be7f72e5-5cb5-42b9-bf76-99250882e05b nodeName:}" failed. No retries permitted until 2026-05-26 19:42:25.224198022 +0000 UTC m=+106.490534350 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/be7f72e5-5cb5-42b9-bf76-99250882e05b-samples-operator-tls") pod "cluster-samples-operator-697587599-dvfjn" (UID: "be7f72e5-5cb5-42b9-bf76-99250882e05b") : secret "samples-operator-tls" not found
May 26 19:42:21.623959 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:21.623872    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-5nhgx"]
May 26 19:42:21.625644 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:21.625623    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-5nhgx"
May 26 19:42:21.627890 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:21.627871    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-twptn\""
May 26 19:42:21.633980 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:21.633955    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-5nhgx"]
May 26 19:42:21.691286 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:21.691258    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/0.log"
May 26 19:42:21.691471 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:21.691300    2565 generic.go:358] "Generic (PLEG): container finished" podID="1d2487f3-ae87-4ee7-8960-52fcade87a1a" containerID="d498aeecc20ea7a429789b6a8245d9034e49d39a2e3b8f8a262179ef7848f47c" exitCode=255
May 26 19:42:21.691471 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:21.691376    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-cnsvr" event={"ID":"1d2487f3-ae87-4ee7-8960-52fcade87a1a","Type":"ContainerDied","Data":"d498aeecc20ea7a429789b6a8245d9034e49d39a2e3b8f8a262179ef7848f47c"}
May 26 19:42:21.691647 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:21.691623    2565 scope.go:117] "RemoveContainer" containerID="d498aeecc20ea7a429789b6a8245d9034e49d39a2e3b8f8a262179ef7848f47c"
May 26 19:42:21.692824 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:21.692798    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qc2wq" event={"ID":"ef306df5-e9fa-457e-b43b-6664145a0912","Type":"ContainerStarted","Data":"6749a6a2d3fba182c20f11e8cc5c8439f02dfa47b113c0b141d1e0774543e314"}
May 26 19:42:21.694015 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:21.693985    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4vbkf" event={"ID":"7882115c-97f7-489c-8977-948729486766","Type":"ContainerStarted","Data":"e89061c0b448a72522c988947a6192b6ea1a49f30d023e73961dc6d5290d0dd2"}
May 26 19:42:21.723271 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:21.723226    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-4vbkf" podStartSLOduration=2.03302958 podStartE2EDuration="4.723211172s" podCreationTimestamp="2026-05-26 19:42:17 +0000 UTC" firstStartedPulling="2026-05-26 19:42:17.949341171 +0000 UTC m=+99.215677481" lastFinishedPulling="2026-05-26 19:42:20.639522747 +0000 UTC m=+101.905859073" observedRunningTime="2026-05-26 19:42:21.722365461 +0000 UTC m=+102.988701804" watchObservedRunningTime="2026-05-26 19:42:21.723211172 +0000 UTC m=+102.989547503"
May 26 19:42:21.726374 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:21.726351    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8bp8\" (UniqueName: \"kubernetes.io/projected/3c9ea837-661c-4532-a6a3-fd15ba706497-kube-api-access-n8bp8\") pod \"network-check-source-7f44b6dd87-5nhgx\" (UID: \"3c9ea837-661c-4532-a6a3-fd15ba706497\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-5nhgx"
May 26 19:42:21.738905 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:21.738861    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qc2wq" podStartSLOduration=2.13025649 podStartE2EDuration="4.738847682s" podCreationTimestamp="2026-05-26 19:42:17 +0000 UTC" firstStartedPulling="2026-05-26 19:42:18.037573197 +0000 UTC m=+99.303909506" lastFinishedPulling="2026-05-26 19:42:20.646164385 +0000 UTC m=+101.912500698" observedRunningTime="2026-05-26 19:42:21.737986253 +0000 UTC m=+103.004322595" watchObservedRunningTime="2026-05-26 19:42:21.738847682 +0000 UTC m=+103.005184016"
May 26 19:42:21.827591 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:21.827557    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n8bp8\" (UniqueName: \"kubernetes.io/projected/3c9ea837-661c-4532-a6a3-fd15ba706497-kube-api-access-n8bp8\") pod \"network-check-source-7f44b6dd87-5nhgx\" (UID: \"3c9ea837-661c-4532-a6a3-fd15ba706497\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-5nhgx"
May 26 19:42:21.845486 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:21.845446    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8bp8\" (UniqueName: \"kubernetes.io/projected/3c9ea837-661c-4532-a6a3-fd15ba706497-kube-api-access-n8bp8\") pod \"network-check-source-7f44b6dd87-5nhgx\" (UID: \"3c9ea837-661c-4532-a6a3-fd15ba706497\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-5nhgx"
May 26 19:42:21.934413 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:21.934376    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-5nhgx"
May 26 19:42:22.055534 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:22.055498    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-5nhgx"]
May 26 19:42:22.058704 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:42:22.058677    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c9ea837_661c_4532_a6a3_fd15ba706497.slice/crio-abf736f8067fb4dd7986415a04ae7e722eedf6ef7f53d8ee254c0b96f3ad1909 WatchSource:0}: Error finding container abf736f8067fb4dd7986415a04ae7e722eedf6ef7f53d8ee254c0b96f3ad1909: Status 404 returned error can't find the container with id abf736f8067fb4dd7986415a04ae7e722eedf6ef7f53d8ee254c0b96f3ad1909
May 26 19:42:22.702498 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:22.702469    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/1.log"
May 26 19:42:22.702883 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:22.702821    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/0.log"
May 26 19:42:22.702883 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:22.702852    2565 generic.go:358] "Generic (PLEG): container finished" podID="1d2487f3-ae87-4ee7-8960-52fcade87a1a" containerID="baa8d1fa09a8d3a48b2d5d44e0dda20d5606ad2d2df048b8cf1332b019919d17" exitCode=255
May 26 19:42:22.702977 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:22.702914    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-cnsvr" event={"ID":"1d2487f3-ae87-4ee7-8960-52fcade87a1a","Type":"ContainerDied","Data":"baa8d1fa09a8d3a48b2d5d44e0dda20d5606ad2d2df048b8cf1332b019919d17"}
May 26 19:42:22.702977 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:22.702945    2565 scope.go:117] "RemoveContainer" containerID="d498aeecc20ea7a429789b6a8245d9034e49d39a2e3b8f8a262179ef7848f47c"
May 26 19:42:22.703240 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:22.703222    2565 scope.go:117] "RemoveContainer" containerID="baa8d1fa09a8d3a48b2d5d44e0dda20d5606ad2d2df048b8cf1332b019919d17"
May 26 19:42:22.703450 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:22.703429    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-cnsvr_openshift-console-operator(1d2487f3-ae87-4ee7-8960-52fcade87a1a)\"" pod="openshift-console-operator/console-operator-76dff48d59-cnsvr" podUID="1d2487f3-ae87-4ee7-8960-52fcade87a1a"
May 26 19:42:22.705088 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:22.705061    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-5nhgx" event={"ID":"3c9ea837-661c-4532-a6a3-fd15ba706497","Type":"ContainerStarted","Data":"63f7c94f592f8688da8a5e27e0959760bc65d7a1d0ad20ce35ddce011bc4b2cf"}
May 26 19:42:22.705188 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:22.705098    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-5nhgx" event={"ID":"3c9ea837-661c-4532-a6a3-fd15ba706497","Type":"ContainerStarted","Data":"abf736f8067fb4dd7986415a04ae7e722eedf6ef7f53d8ee254c0b96f3ad1909"}
May 26 19:42:22.735654 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:22.735605    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-5nhgx" podStartSLOduration=1.735590019 podStartE2EDuration="1.735590019s" podCreationTimestamp="2026-05-26 19:42:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:42:22.734926277 +0000 UTC m=+104.001262608" watchObservedRunningTime="2026-05-26 19:42:22.735590019 +0000 UTC m=+104.001926351"
May 26 19:42:23.710932 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:23.710901    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/1.log"
May 26 19:42:23.711362 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:23.711243    2565 scope.go:117] "RemoveContainer" containerID="baa8d1fa09a8d3a48b2d5d44e0dda20d5606ad2d2df048b8cf1332b019919d17"
May 26 19:42:23.711409 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:23.711394    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-cnsvr_openshift-console-operator(1d2487f3-ae87-4ee7-8960-52fcade87a1a)\"" pod="openshift-console-operator/console-operator-76dff48d59-cnsvr" podUID="1d2487f3-ae87-4ee7-8960-52fcade87a1a"
May 26 19:42:25.256808 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:25.256735    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/be7f72e5-5cb5-42b9-bf76-99250882e05b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-dvfjn\" (UID: \"be7f72e5-5cb5-42b9-bf76-99250882e05b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dvfjn"
May 26 19:42:25.257181 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:25.256865    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:25.257181 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:25.256883    2565 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 26 19:42:25.257181 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:25.256946    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/be7f72e5-5cb5-42b9-bf76-99250882e05b-samples-operator-tls podName:be7f72e5-5cb5-42b9-bf76-99250882e05b nodeName:}" failed. No retries permitted until 2026-05-26 19:42:33.256930665 +0000 UTC m=+114.523266976 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/be7f72e5-5cb5-42b9-bf76-99250882e05b-samples-operator-tls") pod "cluster-samples-operator-697587599-dvfjn" (UID: "be7f72e5-5cb5-42b9-bf76-99250882e05b") : secret "samples-operator-tls" not found
May 26 19:42:25.257181 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:25.256964    2565 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 26 19:42:25.257181 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:25.256976    2565 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c7cbb5886-h967c: secret "image-registry-tls" not found
May 26 19:42:25.257181 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:25.257024    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls podName:995b5c3e-cbc2-4b6e-a32d-4998dce0666c nodeName:}" failed. No retries permitted until 2026-05-26 19:42:33.257011347 +0000 UTC m=+114.523347670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls") pod "image-registry-7c7cbb5886-h967c" (UID: "995b5c3e-cbc2-4b6e-a32d-4998dce0666c") : secret "image-registry-tls" not found
May 26 19:42:25.413875 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:25.413846    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bm27c_99700566-adbe-45d2-b160-8bf4530daeb3/dns-node-resolver/0.log"
May 26 19:42:26.813444 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:26.813419    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mf2pb_e3c2e921-2ac0-4eb4-a114-cfc760676be0/node-ca/0.log"
May 26 19:42:27.834559 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:27.834517    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-cnsvr"
May 26 19:42:27.834559 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:27.834558    2565 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-cnsvr"
May 26 19:42:27.835002 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:27.834928    2565 scope.go:117] "RemoveContainer" containerID="baa8d1fa09a8d3a48b2d5d44e0dda20d5606ad2d2df048b8cf1332b019919d17"
May 26 19:42:27.835114 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:27.835096    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-cnsvr_openshift-console-operator(1d2487f3-ae87-4ee7-8960-52fcade87a1a)\"" pod="openshift-console-operator/console-operator-76dff48d59-cnsvr" podUID="1d2487f3-ae87-4ee7-8960-52fcade87a1a"
May 26 19:42:28.215591 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:28.215540    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-qc2wq_ef306df5-e9fa-457e-b43b-6664145a0912/kube-storage-version-migrator-operator/0.log"
May 26 19:42:33.327408 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:33.327366    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:33.327914 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:33.327439    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/be7f72e5-5cb5-42b9-bf76-99250882e05b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-dvfjn\" (UID: \"be7f72e5-5cb5-42b9-bf76-99250882e05b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dvfjn"
May 26 19:42:33.329846 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:33.329811    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/be7f72e5-5cb5-42b9-bf76-99250882e05b-samples-operator-tls\") pod \"cluster-samples-operator-697587599-dvfjn\" (UID: \"be7f72e5-5cb5-42b9-bf76-99250882e05b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dvfjn"
May 26 19:42:33.329959 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:33.329820    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls\") pod \"image-registry-7c7cbb5886-h967c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") " pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:33.426022 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:33.425984    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dvfjn"
May 26 19:42:33.439920 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:33.439889    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:33.557999 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:33.557969    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-dvfjn"]
May 26 19:42:33.573514 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:33.573487    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c7cbb5886-h967c"]
May 26 19:42:33.577386 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:42:33.577360    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod995b5c3e_cbc2_4b6e_a32d_4998dce0666c.slice/crio-54a1a372651ddaa00cfa49352e81b2610706c83b572c308178cfb341258f071a WatchSource:0}: Error finding container 54a1a372651ddaa00cfa49352e81b2610706c83b572c308178cfb341258f071a: Status 404 returned error can't find the container with id 54a1a372651ddaa00cfa49352e81b2610706c83b572c308178cfb341258f071a
May 26 19:42:33.734501 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:33.734463    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dvfjn" event={"ID":"be7f72e5-5cb5-42b9-bf76-99250882e05b","Type":"ContainerStarted","Data":"9f5d9b7041d63eaad8e7c2bf9627ad86dd7b3e06da9f2f3a4653645539f2e9a5"}
May 26 19:42:33.735821 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:33.735799    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c7cbb5886-h967c" event={"ID":"995b5c3e-cbc2-4b6e-a32d-4998dce0666c","Type":"ContainerStarted","Data":"999b25b749a237626b4f4f1471ae396fa274087dc0878c1dac70ae8925071e98"}
May 26 19:42:33.735958 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:33.735827    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c7cbb5886-h967c" event={"ID":"995b5c3e-cbc2-4b6e-a32d-4998dce0666c","Type":"ContainerStarted","Data":"54a1a372651ddaa00cfa49352e81b2610706c83b572c308178cfb341258f071a"}
May 26 19:42:33.736022 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:33.735980    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:42:33.754341 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:33.754290    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7c7cbb5886-h967c" podStartSLOduration=16.754277836 podStartE2EDuration="16.754277836s" podCreationTimestamp="2026-05-26 19:42:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:42:33.753453981 +0000 UTC m=+115.019790314" watchObservedRunningTime="2026-05-26 19:42:33.754277836 +0000 UTC m=+115.020614169"
May 26 19:42:35.742588 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:35.742540    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dvfjn" event={"ID":"be7f72e5-5cb5-42b9-bf76-99250882e05b","Type":"ContainerStarted","Data":"92d909a2ee9dc5f19a734be667453259450b65320df57e2a46a921462e08980a"}
May 26 19:42:35.742588 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:35.742582    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dvfjn" event={"ID":"be7f72e5-5cb5-42b9-bf76-99250882e05b","Type":"ContainerStarted","Data":"ca430b50863d144d64e908c5fe6220b096dfa1f33f1ec2eb8d22c18eff170972"}
May 26 19:42:35.763360 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:35.763259    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-dvfjn" podStartSLOduration=16.81409627 podStartE2EDuration="18.763244081s" podCreationTimestamp="2026-05-26 19:42:17 +0000 UTC" firstStartedPulling="2026-05-26 19:42:33.606308077 +0000 UTC m=+114.872644401" lastFinishedPulling="2026-05-26 19:42:35.555455893 +0000 UTC m=+116.821792212" observedRunningTime="2026-05-26 19:42:35.761751999 +0000 UTC m=+117.028088332" watchObservedRunningTime="2026-05-26 19:42:35.763244081 +0000 UTC m=+117.029580413"
May 26 19:42:38.348514 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:38.348486    2565 scope.go:117] "RemoveContainer" containerID="baa8d1fa09a8d3a48b2d5d44e0dda20d5606ad2d2df048b8cf1332b019919d17"
May 26 19:42:38.751594 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:38.751563    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/2.log"
May 26 19:42:38.751942 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:38.751926    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/1.log"
May 26 19:42:38.752003 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:38.751959    2565 generic.go:358] "Generic (PLEG): container finished" podID="1d2487f3-ae87-4ee7-8960-52fcade87a1a" containerID="eb4696084daee1bf1335e32908d4904f8c435327efd125b67783e81bd179b1aa" exitCode=255
May 26 19:42:38.752003 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:38.751991    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-cnsvr" event={"ID":"1d2487f3-ae87-4ee7-8960-52fcade87a1a","Type":"ContainerDied","Data":"eb4696084daee1bf1335e32908d4904f8c435327efd125b67783e81bd179b1aa"}
May 26 19:42:38.752101 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:38.752018    2565 scope.go:117] "RemoveContainer" containerID="baa8d1fa09a8d3a48b2d5d44e0dda20d5606ad2d2df048b8cf1332b019919d17"
May 26 19:42:38.752388 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:38.752359    2565 scope.go:117] "RemoveContainer" containerID="eb4696084daee1bf1335e32908d4904f8c435327efd125b67783e81bd179b1aa"
May 26 19:42:38.752573 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:38.752555    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-cnsvr_openshift-console-operator(1d2487f3-ae87-4ee7-8960-52fcade87a1a)\"" pod="openshift-console-operator/console-operator-76dff48d59-cnsvr" podUID="1d2487f3-ae87-4ee7-8960-52fcade87a1a"
May 26 19:42:39.755538 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:39.755507    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/2.log"
May 26 19:42:44.250692 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.250659    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-zql5r"]
May 26 19:42:44.255401 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.255381    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zql5r"
May 26 19:42:44.257896 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.257851    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 26 19:42:44.258161 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.258139    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 26 19:42:44.258889 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.258871    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-jj99j\""
May 26 19:42:44.262623 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.262605    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c7cbb5886-h967c"]
May 26 19:42:44.263757 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.263732    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-zql5r"]
May 26 19:42:44.272840 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.272806    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-q5vpf"]
May 26 19:42:44.275822 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.275806    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q5vpf"
May 26 19:42:44.277999 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.277980    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 26 19:42:44.278271 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.278253    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 26 19:42:44.278271 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.278262    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 26 19:42:44.278419 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.278383    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 26 19:42:44.278485 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.278469    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-fr5np\""
May 26 19:42:44.289431 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.289406    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q5vpf"]
May 26 19:42:44.302508 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.302485    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-574cdc6788-rww48"]
May 26 19:42:44.305352 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.305337    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.307489 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.307471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f3add0f1-c81f-478c-9e05-616b40159287-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-zql5r\" (UID: \"f3add0f1-c81f-478c-9e05-616b40159287\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zql5r"
May 26 19:42:44.307565 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.307517    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c20cc0c3-ed86-4f80-935d-5f4b9ce70e51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q5vpf\" (UID: \"c20cc0c3-ed86-4f80-935d-5f4b9ce70e51\") " pod="openshift-insights/insights-runtime-extractor-q5vpf"
May 26 19:42:44.307628 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.307602    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c20cc0c3-ed86-4f80-935d-5f4b9ce70e51-data-volume\") pod \"insights-runtime-extractor-q5vpf\" (UID: \"c20cc0c3-ed86-4f80-935d-5f4b9ce70e51\") " pod="openshift-insights/insights-runtime-extractor-q5vpf"
May 26 19:42:44.307677 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.307645    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-274mr\" (UniqueName: \"kubernetes.io/projected/c20cc0c3-ed86-4f80-935d-5f4b9ce70e51-kube-api-access-274mr\") pod \"insights-runtime-extractor-q5vpf\" (UID: \"c20cc0c3-ed86-4f80-935d-5f4b9ce70e51\") " pod="openshift-insights/insights-runtime-extractor-q5vpf"
May 26 19:42:44.307713 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.307684    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c20cc0c3-ed86-4f80-935d-5f4b9ce70e51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q5vpf\" (UID: \"c20cc0c3-ed86-4f80-935d-5f4b9ce70e51\") " pod="openshift-insights/insights-runtime-extractor-q5vpf"
May 26 19:42:44.307713 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.307708    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c20cc0c3-ed86-4f80-935d-5f4b9ce70e51-crio-socket\") pod \"insights-runtime-extractor-q5vpf\" (UID: \"c20cc0c3-ed86-4f80-935d-5f4b9ce70e51\") " pod="openshift-insights/insights-runtime-extractor-q5vpf"
May 26 19:42:44.307790 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.307726    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f3add0f1-c81f-478c-9e05-616b40159287-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-zql5r\" (UID: \"f3add0f1-c81f-478c-9e05-616b40159287\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zql5r"
May 26 19:42:44.316955 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.316936    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-574cdc6788-rww48"]
May 26 19:42:44.408844 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.408786    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-274mr\" (UniqueName: \"kubernetes.io/projected/c20cc0c3-ed86-4f80-935d-5f4b9ce70e51-kube-api-access-274mr\") pod \"insights-runtime-extractor-q5vpf\" (UID: \"c20cc0c3-ed86-4f80-935d-5f4b9ce70e51\") " pod="openshift-insights/insights-runtime-extractor-q5vpf"
May 26 19:42:44.408844 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.408844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fbbcb30f-9e23-4892-aee0-75b52283d6b7-registry-tls\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.409090 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.408869    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c20cc0c3-ed86-4f80-935d-5f4b9ce70e51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q5vpf\" (UID: \"c20cc0c3-ed86-4f80-935d-5f4b9ce70e51\") " pod="openshift-insights/insights-runtime-extractor-q5vpf"
May 26 19:42:44.409090 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.408890    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c20cc0c3-ed86-4f80-935d-5f4b9ce70e51-crio-socket\") pod \"insights-runtime-extractor-q5vpf\" (UID: \"c20cc0c3-ed86-4f80-935d-5f4b9ce70e51\") " pod="openshift-insights/insights-runtime-extractor-q5vpf"
May 26 19:42:44.409090 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.408906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbbcb30f-9e23-4892-aee0-75b52283d6b7-bound-sa-token\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.409090 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.408927    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f3add0f1-c81f-478c-9e05-616b40159287-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-zql5r\" (UID: \"f3add0f1-c81f-478c-9e05-616b40159287\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zql5r"
May 26 19:42:44.409090 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.408947    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fbbcb30f-9e23-4892-aee0-75b52283d6b7-ca-trust-extracted\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.409090 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.408978    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f3add0f1-c81f-478c-9e05-616b40159287-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-zql5r\" (UID: \"f3add0f1-c81f-478c-9e05-616b40159287\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zql5r"
May 26 19:42:44.409090 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.409005    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fbbcb30f-9e23-4892-aee0-75b52283d6b7-image-registry-private-configuration\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.409416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.409105    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c20cc0c3-ed86-4f80-935d-5f4b9ce70e51-crio-socket\") pod \"insights-runtime-extractor-q5vpf\" (UID: \"c20cc0c3-ed86-4f80-935d-5f4b9ce70e51\") " pod="openshift-insights/insights-runtime-extractor-q5vpf"
May 26 19:42:44.409416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.409233    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c20cc0c3-ed86-4f80-935d-5f4b9ce70e51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q5vpf\" (UID: \"c20cc0c3-ed86-4f80-935d-5f4b9ce70e51\") " pod="openshift-insights/insights-runtime-extractor-q5vpf"
May 26 19:42:44.409416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.409285    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fbbcb30f-9e23-4892-aee0-75b52283d6b7-installation-pull-secrets\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.409416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.409328    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fbbcb30f-9e23-4892-aee0-75b52283d6b7-trusted-ca\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.409416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.409369    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjv7k\" (UniqueName: \"kubernetes.io/projected/fbbcb30f-9e23-4892-aee0-75b52283d6b7-kube-api-access-jjv7k\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.409592 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.409423    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fbbcb30f-9e23-4892-aee0-75b52283d6b7-registry-certificates\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.409592 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.409464    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c20cc0c3-ed86-4f80-935d-5f4b9ce70e51-data-volume\") pod \"insights-runtime-extractor-q5vpf\" (UID: \"c20cc0c3-ed86-4f80-935d-5f4b9ce70e51\") " pod="openshift-insights/insights-runtime-extractor-q5vpf"
May 26 19:42:44.409592 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.409501    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c20cc0c3-ed86-4f80-935d-5f4b9ce70e51-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-q5vpf\" (UID: \"c20cc0c3-ed86-4f80-935d-5f4b9ce70e51\") " pod="openshift-insights/insights-runtime-extractor-q5vpf"
May 26 19:42:44.409725 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.409638    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f3add0f1-c81f-478c-9e05-616b40159287-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-zql5r\" (UID: \"f3add0f1-c81f-478c-9e05-616b40159287\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zql5r"
May 26 19:42:44.409725 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.409687    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c20cc0c3-ed86-4f80-935d-5f4b9ce70e51-data-volume\") pod \"insights-runtime-extractor-q5vpf\" (UID: \"c20cc0c3-ed86-4f80-935d-5f4b9ce70e51\") " pod="openshift-insights/insights-runtime-extractor-q5vpf"
May 26 19:42:44.411373 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.411341    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f3add0f1-c81f-478c-9e05-616b40159287-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-zql5r\" (UID: \"f3add0f1-c81f-478c-9e05-616b40159287\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zql5r"
May 26 19:42:44.411489 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.411473    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c20cc0c3-ed86-4f80-935d-5f4b9ce70e51-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-q5vpf\" (UID: \"c20cc0c3-ed86-4f80-935d-5f4b9ce70e51\") " pod="openshift-insights/insights-runtime-extractor-q5vpf"
May 26 19:42:44.419292 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.419269    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-274mr\" (UniqueName: \"kubernetes.io/projected/c20cc0c3-ed86-4f80-935d-5f4b9ce70e51-kube-api-access-274mr\") pod \"insights-runtime-extractor-q5vpf\" (UID: \"c20cc0c3-ed86-4f80-935d-5f4b9ce70e51\") " pod="openshift-insights/insights-runtime-extractor-q5vpf"
May 26 19:42:44.510582 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.510500    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jjv7k\" (UniqueName: \"kubernetes.io/projected/fbbcb30f-9e23-4892-aee0-75b52283d6b7-kube-api-access-jjv7k\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.510582 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.510537    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fbbcb30f-9e23-4892-aee0-75b52283d6b7-registry-certificates\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.510582 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.510573    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fbbcb30f-9e23-4892-aee0-75b52283d6b7-registry-tls\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.510846 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.510607    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbbcb30f-9e23-4892-aee0-75b52283d6b7-bound-sa-token\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.510846 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.510628    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fbbcb30f-9e23-4892-aee0-75b52283d6b7-ca-trust-extracted\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.510846 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.510647    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fbbcb30f-9e23-4892-aee0-75b52283d6b7-image-registry-private-configuration\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.510846 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.510736    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fbbcb30f-9e23-4892-aee0-75b52283d6b7-installation-pull-secrets\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.510846 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.510815    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fbbcb30f-9e23-4892-aee0-75b52283d6b7-trusted-ca\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.511083 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.511062    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fbbcb30f-9e23-4892-aee0-75b52283d6b7-ca-trust-extracted\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.511466 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.511440    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fbbcb30f-9e23-4892-aee0-75b52283d6b7-registry-certificates\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.511843 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.511821    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fbbcb30f-9e23-4892-aee0-75b52283d6b7-trusted-ca\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.513183 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.513165    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fbbcb30f-9e23-4892-aee0-75b52283d6b7-registry-tls\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.513265 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.513165    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fbbcb30f-9e23-4892-aee0-75b52283d6b7-image-registry-private-configuration\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.513300 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.513281    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fbbcb30f-9e23-4892-aee0-75b52283d6b7-installation-pull-secrets\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.519746 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.519722    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjv7k\" (UniqueName: \"kubernetes.io/projected/fbbcb30f-9e23-4892-aee0-75b52283d6b7-kube-api-access-jjv7k\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.519848 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.519799    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fbbcb30f-9e23-4892-aee0-75b52283d6b7-bound-sa-token\") pod \"image-registry-574cdc6788-rww48\" (UID: \"fbbcb30f-9e23-4892-aee0-75b52283d6b7\") " pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.564918 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.564884    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zql5r"
May 26 19:42:44.585563 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.585538    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-q5vpf"
May 26 19:42:44.614804 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.614761    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:44.708576 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.708544    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-zql5r"]
May 26 19:42:44.716000 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:42:44.715951    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3add0f1_c81f_478c_9e05_616b40159287.slice/crio-d62f073365e6ed0d8167e5c7105ca078ac4135606e7e0fe02de00b5db02b13dd WatchSource:0}: Error finding container d62f073365e6ed0d8167e5c7105ca078ac4135606e7e0fe02de00b5db02b13dd: Status 404 returned error can't find the container with id d62f073365e6ed0d8167e5c7105ca078ac4135606e7e0fe02de00b5db02b13dd
May 26 19:42:44.736477 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.736418    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-q5vpf"]
May 26 19:42:44.746659 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:42:44.746626    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc20cc0c3_ed86_4f80_935d_5f4b9ce70e51.slice/crio-30df7c6cc7445502a873a22f7f7500117c05e2c86a1887457deaa0eaa6785937 WatchSource:0}: Error finding container 30df7c6cc7445502a873a22f7f7500117c05e2c86a1887457deaa0eaa6785937: Status 404 returned error can't find the container with id 30df7c6cc7445502a873a22f7f7500117c05e2c86a1887457deaa0eaa6785937
May 26 19:42:44.768203 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.768173    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q5vpf" event={"ID":"c20cc0c3-ed86-4f80-935d-5f4b9ce70e51","Type":"ContainerStarted","Data":"30df7c6cc7445502a873a22f7f7500117c05e2c86a1887457deaa0eaa6785937"}
May 26 19:42:44.769039 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.769017    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zql5r" event={"ID":"f3add0f1-c81f-478c-9e05-616b40159287","Type":"ContainerStarted","Data":"d62f073365e6ed0d8167e5c7105ca078ac4135606e7e0fe02de00b5db02b13dd"}
May 26 19:42:44.772231 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:44.772211    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-574cdc6788-rww48"]
May 26 19:42:44.776084 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:42:44.776056    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbbcb30f_9e23_4892_aee0_75b52283d6b7.slice/crio-0a4dd884f24f0ba7a020f82f271d2c4c8c4e27dbd3a7b63fe7e55600016e9e86 WatchSource:0}: Error finding container 0a4dd884f24f0ba7a020f82f271d2c4c8c4e27dbd3a7b63fe7e55600016e9e86: Status 404 returned error can't find the container with id 0a4dd884f24f0ba7a020f82f271d2c4c8c4e27dbd3a7b63fe7e55600016e9e86
May 26 19:42:45.773283 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:45.773186    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-574cdc6788-rww48" event={"ID":"fbbcb30f-9e23-4892-aee0-75b52283d6b7","Type":"ContainerStarted","Data":"b27b56c60762869399c5629c0a0ad080371ba7dbb2a336c9fd8775191afa8ec2"}
May 26 19:42:45.773283 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:45.773239    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-574cdc6788-rww48" event={"ID":"fbbcb30f-9e23-4892-aee0-75b52283d6b7","Type":"ContainerStarted","Data":"0a4dd884f24f0ba7a020f82f271d2c4c8c4e27dbd3a7b63fe7e55600016e9e86"}
May 26 19:42:45.773821 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:45.773287    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:42:45.775007 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:45.774985    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q5vpf" event={"ID":"c20cc0c3-ed86-4f80-935d-5f4b9ce70e51","Type":"ContainerStarted","Data":"f9ac7684b5e45e2ca270e5b9fd65b224495e75e32d99dd5ea5b4602bcc09abc6"}
May 26 19:42:45.775097 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:45.775009    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q5vpf" event={"ID":"c20cc0c3-ed86-4f80-935d-5f4b9ce70e51","Type":"ContainerStarted","Data":"7e601945cd29415d7b2a0cebfc65c1e324e817f2391c7a6459930f668fba0d51"}
May 26 19:42:45.791721 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:45.791670    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-574cdc6788-rww48" podStartSLOduration=1.791655045 podStartE2EDuration="1.791655045s" podCreationTimestamp="2026-05-26 19:42:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:42:45.790907205 +0000 UTC m=+127.057243539" watchObservedRunningTime="2026-05-26 19:42:45.791655045 +0000 UTC m=+127.057991377"
May 26 19:42:46.779561 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:46.779524    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zql5r" event={"ID":"f3add0f1-c81f-478c-9e05-616b40159287","Type":"ContainerStarted","Data":"d95b853f8fdbb761dde217c04a054bc75a44740328bcea9ba3eb1e6a0a7bd9ca"}
May 26 19:42:46.794528 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:46.794469    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-zql5r" podStartSLOduration=1.51701439 podStartE2EDuration="2.794457591s" podCreationTimestamp="2026-05-26 19:42:44 +0000 UTC" firstStartedPulling="2026-05-26 19:42:44.71812755 +0000 UTC m=+125.984463866" lastFinishedPulling="2026-05-26 19:42:45.995570754 +0000 UTC m=+127.261907067" observedRunningTime="2026-05-26 19:42:46.79323668 +0000 UTC m=+128.059573013" watchObservedRunningTime="2026-05-26 19:42:46.794457591 +0000 UTC m=+128.060793922"
May 26 19:42:47.784244 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:47.784208    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-q5vpf" event={"ID":"c20cc0c3-ed86-4f80-935d-5f4b9ce70e51","Type":"ContainerStarted","Data":"facb969a9a616e2056982b4a84522baf97893a0ce7df4b8a39d1b42c08e74484"}
May 26 19:42:47.802223 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:47.802169    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-q5vpf" podStartSLOduration=1.441567338 podStartE2EDuration="3.802151857s" podCreationTimestamp="2026-05-26 19:42:44 +0000 UTC" firstStartedPulling="2026-05-26 19:42:44.800966558 +0000 UTC m=+126.067302868" lastFinishedPulling="2026-05-26 19:42:47.16155106 +0000 UTC m=+128.427887387" observedRunningTime="2026-05-26 19:42:47.801785506 +0000 UTC m=+129.068121833" watchObservedRunningTime="2026-05-26 19:42:47.802151857 +0000 UTC m=+129.068488189"
May 26 19:42:47.834006 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:47.833976    2565 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-cnsvr"
May 26 19:42:47.834006 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:47.834009    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-cnsvr"
May 26 19:42:47.834332 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:47.834320    2565 scope.go:117] "RemoveContainer" containerID="eb4696084daee1bf1335e32908d4904f8c435327efd125b67783e81bd179b1aa"
May 26 19:42:47.834502 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:42:47.834485    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-cnsvr_openshift-console-operator(1d2487f3-ae87-4ee7-8960-52fcade87a1a)\"" pod="openshift-console-operator/console-operator-76dff48d59-cnsvr" podUID="1d2487f3-ae87-4ee7-8960-52fcade87a1a"
May 26 19:42:48.143086 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:48.142980    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs\") pod \"network-metrics-daemon-twnct\" (UID: \"5b513a26-7609-4fa6-b6ac-ae939b6d6436\") " pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:42:48.145234 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:48.145213    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5b513a26-7609-4fa6-b6ac-ae939b6d6436-metrics-certs\") pod \"network-metrics-daemon-twnct\" (UID: \"5b513a26-7609-4fa6-b6ac-ae939b6d6436\") " pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:42:48.169643 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:48.169612    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dx2vm\""
May 26 19:42:48.177237 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:48.177212    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-twnct"
May 26 19:42:48.295730 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:48.295699    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-twnct"]
May 26 19:42:48.298667 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:42:48.298636    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b513a26_7609_4fa6_b6ac_ae939b6d6436.slice/crio-9fdb65f36c74a3097909a1b92dc966751b966f9d99cf80daf977644b0a1d7270 WatchSource:0}: Error finding container 9fdb65f36c74a3097909a1b92dc966751b966f9d99cf80daf977644b0a1d7270: Status 404 returned error can't find the container with id 9fdb65f36c74a3097909a1b92dc966751b966f9d99cf80daf977644b0a1d7270
May 26 19:42:48.788468 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:48.788427    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-twnct" event={"ID":"5b513a26-7609-4fa6-b6ac-ae939b6d6436","Type":"ContainerStarted","Data":"9fdb65f36c74a3097909a1b92dc966751b966f9d99cf80daf977644b0a1d7270"}
May 26 19:42:49.792526 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:49.792491    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-twnct" event={"ID":"5b513a26-7609-4fa6-b6ac-ae939b6d6436","Type":"ContainerStarted","Data":"ba5145341ed4f9ad479f3fb365b43e39ad5ed0930cb9dcac01a753e8b3ec4a70"}
May 26 19:42:49.792526 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:49.792533    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-twnct" event={"ID":"5b513a26-7609-4fa6-b6ac-ae939b6d6436","Type":"ContainerStarted","Data":"f2e15c94b0d399f9d4b357f633963d521a7646554aeefe4e7ec2d19cda6a203b"}
May 26 19:42:49.808719 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:49.808652    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-twnct" podStartSLOduration=129.722785181 podStartE2EDuration="2m10.808638093s" podCreationTimestamp="2026-05-26 19:40:39 +0000 UTC" firstStartedPulling="2026-05-26 19:42:48.300541253 +0000 UTC m=+129.566877563" lastFinishedPulling="2026-05-26 19:42:49.386394153 +0000 UTC m=+130.652730475" observedRunningTime="2026-05-26 19:42:49.807273433 +0000 UTC m=+131.073609764" watchObservedRunningTime="2026-05-26 19:42:49.808638093 +0000 UTC m=+131.074974424"
May 26 19:42:52.144724 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:52.144690    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-897nj"]
May 26 19:42:52.147205 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:52.147186    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-897nj"
May 26 19:42:52.149479 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:52.149460    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 26 19:42:52.149577 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:52.149491    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jpt65\""
May 26 19:42:52.155246 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:52.155224    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-897nj"]
May 26 19:42:52.173524 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:52.173494    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f95fd27a-8474-4bfa-b0ce-14c52ed9b01f-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-897nj\" (UID: \"f95fd27a-8474-4bfa-b0ce-14c52ed9b01f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-897nj"
May 26 19:42:52.274544 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:52.274503    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f95fd27a-8474-4bfa-b0ce-14c52ed9b01f-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-897nj\" (UID: \"f95fd27a-8474-4bfa-b0ce-14c52ed9b01f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-897nj"
May 26 19:42:52.276951 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:52.276925    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f95fd27a-8474-4bfa-b0ce-14c52ed9b01f-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-897nj\" (UID: \"f95fd27a-8474-4bfa-b0ce-14c52ed9b01f\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-897nj"
May 26 19:42:52.456513 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:52.456477    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-897nj"
May 26 19:42:52.577201 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:52.577168    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-897nj"]
May 26 19:42:52.579899 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:42:52.579871    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf95fd27a_8474_4bfa_b0ce_14c52ed9b01f.slice/crio-bda96351697bbdecb74dc65d9a2814223ad1f5ebe1c0e1eebf7150a54414e4ae WatchSource:0}: Error finding container bda96351697bbdecb74dc65d9a2814223ad1f5ebe1c0e1eebf7150a54414e4ae: Status 404 returned error can't find the container with id bda96351697bbdecb74dc65d9a2814223ad1f5ebe1c0e1eebf7150a54414e4ae
May 26 19:42:52.801457 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:52.801372    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-897nj" event={"ID":"f95fd27a-8474-4bfa-b0ce-14c52ed9b01f","Type":"ContainerStarted","Data":"bda96351697bbdecb74dc65d9a2814223ad1f5ebe1c0e1eebf7150a54414e4ae"}
May 26 19:42:53.805074 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:53.805032    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-897nj" event={"ID":"f95fd27a-8474-4bfa-b0ce-14c52ed9b01f","Type":"ContainerStarted","Data":"7efa7341af7f71faa27928a59e8667e45379f0e645838dc202782984796f251d"}
May 26 19:42:53.805466 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:53.805232    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-897nj"
May 26 19:42:53.810095 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:53.810070    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-897nj"
May 26 19:42:53.820663 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:53.820586    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-897nj" podStartSLOduration=0.73237918 podStartE2EDuration="1.820575089s" podCreationTimestamp="2026-05-26 19:42:52 +0000 UTC" firstStartedPulling="2026-05-26 19:42:52.58171054 +0000 UTC m=+133.848046856" lastFinishedPulling="2026-05-26 19:42:53.66990645 +0000 UTC m=+134.936242765" observedRunningTime="2026-05-26 19:42:53.819183972 +0000 UTC m=+135.085520295" watchObservedRunningTime="2026-05-26 19:42:53.820575089 +0000 UTC m=+135.086911421"
May 26 19:42:54.268091 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:54.268055    2565 patch_prober.go:28] interesting pod/image-registry-7c7cbb5886-h967c container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
May 26 19:42:54.268243 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:54.268120    2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-7c7cbb5886-h967c" podUID="995b5c3e-cbc2-4b6e-a32d-4998dce0666c" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
May 26 19:42:58.573408 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.573374    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6xttm"]
May 26 19:42:58.576733 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.576714    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.579898 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.579868    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 26 19:42:58.580240 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.580221    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6vsnp\""
May 26 19:42:58.581091 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.581064    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 26 19:42:58.581177 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.581079    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 26 19:42:58.581177 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.581099    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 26 19:42:58.581177 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.581170    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 26 19:42:58.581327 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.581196    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 26 19:42:58.625972 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.625928    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ef074d7-7b4b-4a92-a843-cd03295c51ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.626197 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.625997    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9ef074d7-7b4b-4a92-a843-cd03295c51ce-node-exporter-wtmp\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.626197 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.626034    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9ef074d7-7b4b-4a92-a843-cd03295c51ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.626197 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.626052    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ef074d7-7b4b-4a92-a843-cd03295c51ce-sys\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.626197 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.626132    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9ef074d7-7b4b-4a92-a843-cd03295c51ce-node-exporter-textfile\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.626197 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.626158    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ef074d7-7b4b-4a92-a843-cd03295c51ce-metrics-client-ca\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.626197 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.626178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4tmf\" (UniqueName: \"kubernetes.io/projected/9ef074d7-7b4b-4a92-a843-cd03295c51ce-kube-api-access-m4tmf\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.626197 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.626200    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9ef074d7-7b4b-4a92-a843-cd03295c51ce-node-exporter-tls\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.626418 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.626222    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9ef074d7-7b4b-4a92-a843-cd03295c51ce-root\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.727344 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.727310    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ef074d7-7b4b-4a92-a843-cd03295c51ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.727524 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.727359    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9ef074d7-7b4b-4a92-a843-cd03295c51ce-node-exporter-wtmp\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.727524 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.727391    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9ef074d7-7b4b-4a92-a843-cd03295c51ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.727524 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.727410    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ef074d7-7b4b-4a92-a843-cd03295c51ce-sys\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.727524 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.727443    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9ef074d7-7b4b-4a92-a843-cd03295c51ce-node-exporter-textfile\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.727524 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.727467    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ef074d7-7b4b-4a92-a843-cd03295c51ce-metrics-client-ca\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.727744 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.727513    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ef074d7-7b4b-4a92-a843-cd03295c51ce-sys\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.727744 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.727545    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9ef074d7-7b4b-4a92-a843-cd03295c51ce-node-exporter-wtmp\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.727744 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.727567    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m4tmf\" (UniqueName: \"kubernetes.io/projected/9ef074d7-7b4b-4a92-a843-cd03295c51ce-kube-api-access-m4tmf\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.727744 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.727604    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9ef074d7-7b4b-4a92-a843-cd03295c51ce-node-exporter-tls\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.727744 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.727639    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9ef074d7-7b4b-4a92-a843-cd03295c51ce-root\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.727949 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.727750    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9ef074d7-7b4b-4a92-a843-cd03295c51ce-root\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.727949 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.727897    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9ef074d7-7b4b-4a92-a843-cd03295c51ce-node-exporter-textfile\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.728255 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.728233    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9ef074d7-7b4b-4a92-a843-cd03295c51ce-node-exporter-accelerators-collector-config\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.728325 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.728233    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ef074d7-7b4b-4a92-a843-cd03295c51ce-metrics-client-ca\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.729860 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.729833    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9ef074d7-7b4b-4a92-a843-cd03295c51ce-node-exporter-tls\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.729953 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.729887    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9ef074d7-7b4b-4a92-a843-cd03295c51ce-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.755267 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.755242    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4tmf\" (UniqueName: \"kubernetes.io/projected/9ef074d7-7b4b-4a92-a843-cd03295c51ce-kube-api-access-m4tmf\") pod \"node-exporter-6xttm\" (UID: \"9ef074d7-7b4b-4a92-a843-cd03295c51ce\") " pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.886382 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:58.886288    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6xttm"
May 26 19:42:58.894543 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:42:58.894513    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ef074d7_7b4b_4a92_a843_cd03295c51ce.slice/crio-066a80c11881e984e0049ceda63e6c7addf989142b6f89af58d1f090d7106fa5 WatchSource:0}: Error finding container 066a80c11881e984e0049ceda63e6c7addf989142b6f89af58d1f090d7106fa5: Status 404 returned error can't find the container with id 066a80c11881e984e0049ceda63e6c7addf989142b6f89af58d1f090d7106fa5
May 26 19:42:59.658751 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.658713    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 19:42:59.662958 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.662931    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.665366 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.665341    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 26 19:42:59.665501 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.665447    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-cplgp\""
May 26 19:42:59.665733 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.665709    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 26 19:42:59.665733 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.665715    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 26 19:42:59.665925 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.665856    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 26 19:42:59.666060 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.666039    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 26 19:42:59.666127 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.666103    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 26 19:42:59.666127 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.666104    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 26 19:42:59.666296 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.666273    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 26 19:42:59.666419 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.666337    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 26 19:42:59.675722 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.675696    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 19:42:59.736888 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.736853    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-config-volume\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.736888 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.736897    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8cd24370-9603-4f64-bc41-12eee61cf0ef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.737142 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.736941    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8cd24370-9603-4f64-bc41-12eee61cf0ef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.737142 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.736967    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.737142 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.737036    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.737142 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.737078    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.737142 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.737122    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-web-config\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.737392 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.737171    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.737392 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.737203    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77q2s\" (UniqueName: \"kubernetes.io/projected/8cd24370-9603-4f64-bc41-12eee61cf0ef-kube-api-access-77q2s\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.737392 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.737234    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8cd24370-9603-4f64-bc41-12eee61cf0ef-config-out\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.737392 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.737278    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.737392 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.737327    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cd24370-9603-4f64-bc41-12eee61cf0ef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.737392 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.737359    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cd24370-9603-4f64-bc41-12eee61cf0ef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.819981 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.819955    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6xttm" event={"ID":"9ef074d7-7b4b-4a92-a843-cd03295c51ce","Type":"ContainerStarted","Data":"066a80c11881e984e0049ceda63e6c7addf989142b6f89af58d1f090d7106fa5"}
May 26 19:42:59.837739 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.837712    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cd24370-9603-4f64-bc41-12eee61cf0ef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.837889 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.837750    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cd24370-9603-4f64-bc41-12eee61cf0ef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.837889 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.837800    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-config-volume\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.837889 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.837825    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8cd24370-9603-4f64-bc41-12eee61cf0ef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.838042 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.838023    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8cd24370-9603-4f64-bc41-12eee61cf0ef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.838101 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.838063    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.838150 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.838099    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.838150 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.838135    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.838247 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.838164    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-web-config\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.838247 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.838179    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8cd24370-9603-4f64-bc41-12eee61cf0ef-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.838247 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.838198    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.838247 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.838225    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-77q2s\" (UniqueName: \"kubernetes.io/projected/8cd24370-9603-4f64-bc41-12eee61cf0ef-kube-api-access-77q2s\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.838450 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.838257    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8cd24370-9603-4f64-bc41-12eee61cf0ef-config-out\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.838450 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.838301    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.838900 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.838571    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cd24370-9603-4f64-bc41-12eee61cf0ef-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.838900 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.838796    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cd24370-9603-4f64-bc41-12eee61cf0ef-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.841632 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.841584    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8cd24370-9603-4f64-bc41-12eee61cf0ef-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.841741 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.841724    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-config-volume\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.841817 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.841755    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.842272 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.842246    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.842383 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.842299    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.842447 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.842394    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.842897 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.842856    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8cd24370-9603-4f64-bc41-12eee61cf0ef-config-out\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.843225 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.843206    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.843626 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.843608    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-web-config\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.846033 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.846017    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77q2s\" (UniqueName: \"kubernetes.io/projected/8cd24370-9603-4f64-bc41-12eee61cf0ef-kube-api-access-77q2s\") pod \"alertmanager-main-0\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") " pod="openshift-monitoring/alertmanager-main-0"
May 26 19:42:59.974034 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:42:59.973999    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 19:43:00.114605 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:00.114567    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 19:43:00.117393 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:43:00.117365    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cd24370_9603_4f64_bc41_12eee61cf0ef.slice/crio-849b892ce224ee661a613c97521678d0b96f59af24dfc447bfa0e89e1d43a42f WatchSource:0}: Error finding container 849b892ce224ee661a613c97521678d0b96f59af24dfc447bfa0e89e1d43a42f: Status 404 returned error can't find the container with id 849b892ce224ee661a613c97521678d0b96f59af24dfc447bfa0e89e1d43a42f
May 26 19:43:00.349137 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:00.349045    2565 scope.go:117] "RemoveContainer" containerID="eb4696084daee1bf1335e32908d4904f8c435327efd125b67783e81bd179b1aa"
May 26 19:43:00.824425 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:00.824382    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd24370-9603-4f64-bc41-12eee61cf0ef","Type":"ContainerStarted","Data":"849b892ce224ee661a613c97521678d0b96f59af24dfc447bfa0e89e1d43a42f"}
May 26 19:43:00.826054 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:00.825972    2565 generic.go:358] "Generic (PLEG): container finished" podID="9ef074d7-7b4b-4a92-a843-cd03295c51ce" containerID="bc228067be14f007186d0cb5347cc38c67a9a1c76259e463ced4198f96569293" exitCode=0
May 26 19:43:00.826238 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:00.826077    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6xttm" event={"ID":"9ef074d7-7b4b-4a92-a843-cd03295c51ce","Type":"ContainerDied","Data":"bc228067be14f007186d0cb5347cc38c67a9a1c76259e463ced4198f96569293"}
May 26 19:43:00.827823 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:00.827803    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/2.log"
May 26 19:43:00.827911 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:00.827863    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-cnsvr" event={"ID":"1d2487f3-ae87-4ee7-8960-52fcade87a1a","Type":"ContainerStarted","Data":"c8b2940ffa927da8293ce15eff704381812deeea3253fa210df264a55ae5a34b"}
May 26 19:43:00.828185 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:00.828148    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-cnsvr"
May 26 19:43:00.858927 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:00.858886    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-cnsvr" podStartSLOduration=41.183407747 podStartE2EDuration="43.858870828s" podCreationTimestamp="2026-05-26 19:42:17 +0000 UTC" firstStartedPulling="2026-05-26 19:42:17.968299709 +0000 UTC m=+99.234636023" lastFinishedPulling="2026-05-26 19:42:20.64376278 +0000 UTC m=+101.910099104" observedRunningTime="2026-05-26 19:43:00.858612949 +0000 UTC m=+142.124949282" watchObservedRunningTime="2026-05-26 19:43:00.858870828 +0000 UTC m=+142.125207160"
May 26 19:43:00.888425 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:00.888402    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-cnsvr"
May 26 19:43:01.831894 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:01.831858    2565 generic.go:358] "Generic (PLEG): container finished" podID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerID="f267b411786c1aff27e25781baa565959c30ec5b568af0945e85ebc07d393e09" exitCode=0
May 26 19:43:01.832350 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:01.831948    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd24370-9603-4f64-bc41-12eee61cf0ef","Type":"ContainerDied","Data":"f267b411786c1aff27e25781baa565959c30ec5b568af0945e85ebc07d393e09"}
May 26 19:43:01.834115 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:01.834085    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6xttm" event={"ID":"9ef074d7-7b4b-4a92-a843-cd03295c51ce","Type":"ContainerStarted","Data":"f4a6c486131502dc60d46c5e9a642303e01f8470fe08c664b54a47b75b762184"}
May 26 19:43:01.834201 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:01.834122    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6xttm" event={"ID":"9ef074d7-7b4b-4a92-a843-cd03295c51ce","Type":"ContainerStarted","Data":"f7e1e3451cc25007d5eef5e8b22cb2a9549a5cc2c25895a1525a03d30e24e321"}
May 26 19:43:01.874754 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:01.874702    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6xttm" podStartSLOduration=2.952263785 podStartE2EDuration="3.874689626s" podCreationTimestamp="2026-05-26 19:42:58 +0000 UTC" firstStartedPulling="2026-05-26 19:42:58.896244096 +0000 UTC m=+140.162580409" lastFinishedPulling="2026-05-26 19:42:59.818669939 +0000 UTC m=+141.085006250" observedRunningTime="2026-05-26 19:43:01.873026094 +0000 UTC m=+143.139362425" watchObservedRunningTime="2026-05-26 19:43:01.874689626 +0000 UTC m=+143.141025958"
May 26 19:43:02.650750 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.650710    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5c64c5896-dklpv"]
May 26 19:43:02.654846 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.654816    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.657489 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.657327    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nspmg\""
May 26 19:43:02.657489 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.657354    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 26 19:43:02.657489 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.657327    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 26 19:43:02.657489 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.657488    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 26 19:43:02.658236 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.658189    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 26 19:43:02.658550 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.658319    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-442ae4vfk4vt6\""
May 26 19:43:02.658550 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.658395    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 26 19:43:02.669942 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.669908    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c64c5896-dklpv"]
May 26 19:43:02.761566 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.761531    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9eef388b-9754-40d7-8922-0d6edd003862-metrics-client-ca\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.761703 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.761584    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9eef388b-9754-40d7-8922-0d6edd003862-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.761703 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.761613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9eef388b-9754-40d7-8922-0d6edd003862-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.761703 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.761671    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9eef388b-9754-40d7-8922-0d6edd003862-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.761844 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.761726    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7vcz\" (UniqueName: \"kubernetes.io/projected/9eef388b-9754-40d7-8922-0d6edd003862-kube-api-access-n7vcz\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.761844 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.761793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9eef388b-9754-40d7-8922-0d6edd003862-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.761844 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.761825    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9eef388b-9754-40d7-8922-0d6edd003862-secret-thanos-querier-tls\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.761938 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.761844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9eef388b-9754-40d7-8922-0d6edd003862-secret-grpc-tls\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.862303 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.862266    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9eef388b-9754-40d7-8922-0d6edd003862-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.862753 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.862322    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9eef388b-9754-40d7-8922-0d6edd003862-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.862753 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.862374    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7vcz\" (UniqueName: \"kubernetes.io/projected/9eef388b-9754-40d7-8922-0d6edd003862-kube-api-access-n7vcz\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.862753 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.862431    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9eef388b-9754-40d7-8922-0d6edd003862-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.862753 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.862480    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9eef388b-9754-40d7-8922-0d6edd003862-secret-thanos-querier-tls\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.862753 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.862509    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9eef388b-9754-40d7-8922-0d6edd003862-secret-grpc-tls\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.862753 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.862551    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9eef388b-9754-40d7-8922-0d6edd003862-metrics-client-ca\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.862753 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.862598    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9eef388b-9754-40d7-8922-0d6edd003862-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.863734 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.863420    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9eef388b-9754-40d7-8922-0d6edd003862-metrics-client-ca\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.865943 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.865915    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9eef388b-9754-40d7-8922-0d6edd003862-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.865943 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.865917    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9eef388b-9754-40d7-8922-0d6edd003862-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.866111 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.866031    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9eef388b-9754-40d7-8922-0d6edd003862-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.866111 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.866090    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9eef388b-9754-40d7-8922-0d6edd003862-secret-thanos-querier-tls\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.866584 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.866546    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9eef388b-9754-40d7-8922-0d6edd003862-secret-grpc-tls\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.866711 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.866674    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9eef388b-9754-40d7-8922-0d6edd003862-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.872309 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.872288    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7vcz\" (UniqueName: \"kubernetes.io/projected/9eef388b-9754-40d7-8922-0d6edd003862-kube-api-access-n7vcz\") pod \"thanos-querier-5c64c5896-dklpv\" (UID: \"9eef388b-9754-40d7-8922-0d6edd003862\") " pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:02.967429 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:02.967400    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:03.114088 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:03.114064    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5c64c5896-dklpv"]
May 26 19:43:03.353198 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:03.353122    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-2lt99"]
May 26 19:43:03.357701 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:03.357676    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2lt99"
May 26 19:43:03.360063 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:03.360036    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 26 19:43:03.360169 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:03.360087    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-skwjh\""
May 26 19:43:03.365818 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:03.365793    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-2lt99"]
May 26 19:43:03.438815 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:43:03.438779    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eef388b_9754_40d7_8922_0d6edd003862.slice/crio-4eedb130f4768166e2a2a07236376e33c1f183c03052fae40623b41862f1e236 WatchSource:0}: Error finding container 4eedb130f4768166e2a2a07236376e33c1f183c03052fae40623b41862f1e236: Status 404 returned error can't find the container with id 4eedb130f4768166e2a2a07236376e33c1f183c03052fae40623b41862f1e236
May 26 19:43:03.467955 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:03.467932    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/04192970-92db-49ab-97ac-7ba829140333-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-2lt99\" (UID: \"04192970-92db-49ab-97ac-7ba829140333\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-2lt99"
May 26 19:43:03.569010 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:03.568986    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/04192970-92db-49ab-97ac-7ba829140333-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-2lt99\" (UID: \"04192970-92db-49ab-97ac-7ba829140333\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-2lt99"
May 26 19:43:03.571308 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:03.571289    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/04192970-92db-49ab-97ac-7ba829140333-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-2lt99\" (UID: \"04192970-92db-49ab-97ac-7ba829140333\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-2lt99"
May 26 19:43:03.670138 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:03.670115    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2lt99"
May 26 19:43:03.810467 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:03.810439    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-2lt99"]
May 26 19:43:03.812698 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:43:03.812670    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04192970_92db_49ab_97ac_7ba829140333.slice/crio-1d24b175ec97166e5322ee90a80c63787108f82a456e88ff573f58d76000ce46 WatchSource:0}: Error finding container 1d24b175ec97166e5322ee90a80c63787108f82a456e88ff573f58d76000ce46: Status 404 returned error can't find the container with id 1d24b175ec97166e5322ee90a80c63787108f82a456e88ff573f58d76000ce46
May 26 19:43:03.842355 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:03.842322    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd24370-9603-4f64-bc41-12eee61cf0ef","Type":"ContainerStarted","Data":"c26c5f4f7c346de9540a29ea320537a97441fda287c2f32eb0be58ae5e42adb0"}
May 26 19:43:03.842355 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:03.842362    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd24370-9603-4f64-bc41-12eee61cf0ef","Type":"ContainerStarted","Data":"d8715882a7543597dcb47bed6ae07312afc3afb8fa891f39b4373ab7a5d60984"}
May 26 19:43:03.842550 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:03.842377    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd24370-9603-4f64-bc41-12eee61cf0ef","Type":"ContainerStarted","Data":"f9f158cfc258339a0192d99177899c4cf1d39c84dfd6f4f64452e13b67b0b013"}
May 26 19:43:03.842550 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:03.842390    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd24370-9603-4f64-bc41-12eee61cf0ef","Type":"ContainerStarted","Data":"689c928e490401292198d0c955880ff402a39ff84cc657d15f197285061deefc"}
May 26 19:43:03.842550 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:03.842400    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd24370-9603-4f64-bc41-12eee61cf0ef","Type":"ContainerStarted","Data":"aeebf186f1d0f81f0b4c879722ef6c3ead7c92d267566cd5136f9c54d8fdf865"}
May 26 19:43:03.843397 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:03.843372    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv" event={"ID":"9eef388b-9754-40d7-8922-0d6edd003862","Type":"ContainerStarted","Data":"4eedb130f4768166e2a2a07236376e33c1f183c03052fae40623b41862f1e236"}
May 26 19:43:03.844249 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:03.844227    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2lt99" event={"ID":"04192970-92db-49ab-97ac-7ba829140333","Type":"ContainerStarted","Data":"1d24b175ec97166e5322ee90a80c63787108f82a456e88ff573f58d76000ce46"}
May 26 19:43:04.267842 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.267797    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:43:04.851385 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.851350    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd24370-9603-4f64-bc41-12eee61cf0ef","Type":"ContainerStarted","Data":"68c7512b6cfa0e177d0fa0ff932a5f65971ca6b67b2a17bfc43fccae7dcee7e2"}
May 26 19:43:04.873582 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.873546    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 19:43:04.879971 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.879914    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:04.882636 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.882614    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 26 19:43:04.884473 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.884426    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 26 19:43:04.888441 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.884976    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 26 19:43:04.888441 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.884990    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a114f5h5tvs78\""
May 26 19:43:04.888441 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.885434    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 26 19:43:04.888441 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.885478    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 26 19:43:04.888441 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.885527    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 26 19:43:04.888441 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.885708    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 26 19:43:04.888441 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.885958    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 26 19:43:04.888441 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.886139    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 26 19:43:04.888441 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.886225    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 26 19:43:04.888441 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.886378    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 26 19:43:04.888441 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.886484    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2rwbz\""
May 26 19:43:04.888441 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.886729    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 26 19:43:04.888441 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.887394    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.3264488110000001 podStartE2EDuration="5.887378636s" podCreationTimestamp="2026-05-26 19:42:59 +0000 UTC" firstStartedPulling="2026-05-26 19:43:00.119221848 +0000 UTC m=+141.385558158" lastFinishedPulling="2026-05-26 19:43:04.680151658 +0000 UTC m=+145.946487983" observedRunningTime="2026-05-26 19:43:04.883234398 +0000 UTC m=+146.149570958" watchObservedRunningTime="2026-05-26 19:43:04.887378636 +0000 UTC m=+146.153714968"
May 26 19:43:04.889424 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.888606    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 26 19:43:04.896497 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.896150    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 19:43:04.982134 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.982092    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:04.982435 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.982138    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:04.982435 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.982183    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:04.982435 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.982235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:04.982435 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.982283    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:04.982435 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.982377    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:04.982716 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.982449    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-config\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:04.982716 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.982480    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-config-out\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:04.982716 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.982507    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:04.982716 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.982532    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:04.982716 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.982582    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:04.982999 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.982892    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:04.982999 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.982926    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-web-config\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:04.983109 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.983038    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:04.983109 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.983063    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:04.983109 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.983088    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzwpv\" (UniqueName: \"kubernetes.io/projected/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-kube-api-access-bzwpv\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:04.983253 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.983194    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:04.983308 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:04.983248    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.084755 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.084709    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.084950 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.084785    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.084950 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.084822    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.084950 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.084845    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.084950 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.084884    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.085271 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.085247    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.085367 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.085287    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.085367 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.085361    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.085469 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.085402    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-config\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.085469 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.085425    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-config-out\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.085724 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.085692    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.085837 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.085739    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.085837 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.085817    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.085924 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.085849    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.085924 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.085886    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.086028 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.085931    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.086028 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.085963    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-web-config\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.086028 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.086000    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.086192 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.086026    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.086192 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.086052    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bzwpv\" (UniqueName: \"kubernetes.io/projected/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-kube-api-access-bzwpv\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.087224 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.087107    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.088052 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.088026    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-config-out\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.088698 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.088388    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.088698 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.088437    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.089486 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.088963    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.089486 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.089117    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-config\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.089486 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.089152    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.090069 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.090013    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.090069 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.090054    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.090226 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.090103    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.090226 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.090164    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.090782 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.090716    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-web-config\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.091600 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.091580    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.091827 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.091804    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.092253 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.092213    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.113519 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.113489    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzwpv\" (UniqueName: \"kubernetes.io/projected/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-kube-api-access-bzwpv\") pod \"prometheus-k8s-0\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.193908 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.193870    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:05.365609 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.365576    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 19:43:05.786714 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:43:05.786678    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffb370cc_8f84_43a8_bb51_aa6e6a735fa6.slice/crio-9e433a992c8c0d00c44a6e4a0ae23d7610267b8ccbe2bd01e287789aca2dc180 WatchSource:0}: Error finding container 9e433a992c8c0d00c44a6e4a0ae23d7610267b8ccbe2bd01e287789aca2dc180: Status 404 returned error can't find the container with id 9e433a992c8c0d00c44a6e4a0ae23d7610267b8ccbe2bd01e287789aca2dc180
May 26 19:43:05.855201 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:05.855135    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6","Type":"ContainerStarted","Data":"9e433a992c8c0d00c44a6e4a0ae23d7610267b8ccbe2bd01e287789aca2dc180"}
May 26 19:43:06.784261 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:06.784228    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-574cdc6788-rww48"
May 26 19:43:06.862556 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:06.862527    2565 generic.go:358] "Generic (PLEG): container finished" podID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerID="191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93" exitCode=0
May 26 19:43:06.862727 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:06.862596    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6","Type":"ContainerDied","Data":"191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93"}
May 26 19:43:06.864041 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:06.864008    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2lt99" event={"ID":"04192970-92db-49ab-97ac-7ba829140333","Type":"ContainerStarted","Data":"bb82d164494ee1c2114cd750c8ff4ec1cd06c62e4cd661508297ccd35069e66c"}
May 26 19:43:06.864246 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:06.864208    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2lt99"
May 26 19:43:06.867035 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:06.867000    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv" event={"ID":"9eef388b-9754-40d7-8922-0d6edd003862","Type":"ContainerStarted","Data":"f4018dfd83cdf93cc81c11bb76a64fe4019de49b6497b9908571edfc452aac29"}
May 26 19:43:06.867035 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:06.867028    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv" event={"ID":"9eef388b-9754-40d7-8922-0d6edd003862","Type":"ContainerStarted","Data":"54bd4f58ae287da15bf110da30b8d7e3141c865a0d98fd6058bbd83b374503df"}
May 26 19:43:06.867176 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:06.867043    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv" event={"ID":"9eef388b-9754-40d7-8922-0d6edd003862","Type":"ContainerStarted","Data":"597171c7b6fa90ae5ed2a21bc91bee3279f3de9e0ca8b90cd3f7d2b54078e8c1"}
May 26 19:43:06.867176 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:06.867059    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv" event={"ID":"9eef388b-9754-40d7-8922-0d6edd003862","Type":"ContainerStarted","Data":"00a36f25b769e9745776100c324797094bc4ee9effc87ff75af8ca9662f550f4"}
May 26 19:43:06.867176 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:06.867067    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv" event={"ID":"9eef388b-9754-40d7-8922-0d6edd003862","Type":"ContainerStarted","Data":"0ea9b297365a919df4a0f22c17e3c488a9e6a5ecacdde64a29c2cd439d779dcf"}
May 26 19:43:06.867176 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:06.867075    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv" event={"ID":"9eef388b-9754-40d7-8922-0d6edd003862","Type":"ContainerStarted","Data":"2cad6ee0e81c761e53b540d5096534bebb8f02b4c0a13c299dbc986cee80875c"}
May 26 19:43:06.867372 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:06.867186    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:06.869264 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:06.869243    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2lt99"
May 26 19:43:06.918554 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:06.918495    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv" podStartSLOduration=2.518800643 podStartE2EDuration="4.918479839s" podCreationTimestamp="2026-05-26 19:43:02 +0000 UTC" firstStartedPulling="2026-05-26 19:43:03.440639724 +0000 UTC m=+144.706976040" lastFinishedPulling="2026-05-26 19:43:05.840318923 +0000 UTC m=+147.106655236" observedRunningTime="2026-05-26 19:43:06.91835798 +0000 UTC m=+148.184694312" watchObservedRunningTime="2026-05-26 19:43:06.918479839 +0000 UTC m=+148.184816171"
May 26 19:43:06.937824 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:06.937739    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-2lt99" podStartSLOduration=1.959826254 podStartE2EDuration="3.937723906s" podCreationTimestamp="2026-05-26 19:43:03 +0000 UTC" firstStartedPulling="2026-05-26 19:43:03.81457316 +0000 UTC m=+145.080909470" lastFinishedPulling="2026-05-26 19:43:05.792470798 +0000 UTC m=+147.058807122" observedRunningTime="2026-05-26 19:43:06.936390639 +0000 UTC m=+148.202726971" watchObservedRunningTime="2026-05-26 19:43:06.937723906 +0000 UTC m=+148.204060264"
May 26 19:43:09.282997 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.282948    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7c7cbb5886-h967c" podUID="995b5c3e-cbc2-4b6e-a32d-4998dce0666c" containerName="registry" containerID="cri-o://999b25b749a237626b4f4f1471ae396fa274087dc0878c1dac70ae8925071e98" gracePeriod=30
May 26 19:43:09.788015 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.787984    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:43:09.879377 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.879335    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6","Type":"ContainerStarted","Data":"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704"}
May 26 19:43:09.879554 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.879534    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6","Type":"ContainerStarted","Data":"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c"}
May 26 19:43:09.879674 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.879659    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6","Type":"ContainerStarted","Data":"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859"}
May 26 19:43:09.880828 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.880803    2565 generic.go:358] "Generic (PLEG): container finished" podID="995b5c3e-cbc2-4b6e-a32d-4998dce0666c" containerID="999b25b749a237626b4f4f1471ae396fa274087dc0878c1dac70ae8925071e98" exitCode=0
May 26 19:43:09.880931 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.880852    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c7cbb5886-h967c" event={"ID":"995b5c3e-cbc2-4b6e-a32d-4998dce0666c","Type":"ContainerDied","Data":"999b25b749a237626b4f4f1471ae396fa274087dc0878c1dac70ae8925071e98"}
May 26 19:43:09.880931 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.880882    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7c7cbb5886-h967c" event={"ID":"995b5c3e-cbc2-4b6e-a32d-4998dce0666c","Type":"ContainerDied","Data":"54a1a372651ddaa00cfa49352e81b2610706c83b572c308178cfb341258f071a"}
May 26 19:43:09.880931 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.880892    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c7cbb5886-h967c"
May 26 19:43:09.881091 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.880903    2565 scope.go:117] "RemoveContainer" containerID="999b25b749a237626b4f4f1471ae396fa274087dc0878c1dac70ae8925071e98"
May 26 19:43:09.901689 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.901575    2565 scope.go:117] "RemoveContainer" containerID="999b25b749a237626b4f4f1471ae396fa274087dc0878c1dac70ae8925071e98"
May 26 19:43:09.902059 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:43:09.902025    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"999b25b749a237626b4f4f1471ae396fa274087dc0878c1dac70ae8925071e98\": container with ID starting with 999b25b749a237626b4f4f1471ae396fa274087dc0878c1dac70ae8925071e98 not found: ID does not exist" containerID="999b25b749a237626b4f4f1471ae396fa274087dc0878c1dac70ae8925071e98"
May 26 19:43:09.902178 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.902073    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"999b25b749a237626b4f4f1471ae396fa274087dc0878c1dac70ae8925071e98"} err="failed to get container status \"999b25b749a237626b4f4f1471ae396fa274087dc0878c1dac70ae8925071e98\": rpc error: code = NotFound desc = could not find container \"999b25b749a237626b4f4f1471ae396fa274087dc0878c1dac70ae8925071e98\": container with ID starting with 999b25b749a237626b4f4f1471ae396fa274087dc0878c1dac70ae8925071e98 not found: ID does not exist"
May 26 19:43:09.937306 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.937135    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls\") pod \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") "
May 26 19:43:09.937306 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.937207    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-ca-trust-extracted\") pod \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") "
May 26 19:43:09.937306 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.937259    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-image-registry-private-configuration\") pod \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") "
May 26 19:43:09.937306 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.937296    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-bound-sa-token\") pod \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") "
May 26 19:43:09.937650 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.937353    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-installation-pull-secrets\") pod \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") "
May 26 19:43:09.937650 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.937387    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzc4v\" (UniqueName: \"kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-kube-api-access-tzc4v\") pod \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") "
May 26 19:43:09.937650 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.937425    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-certificates\") pod \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") "
May 26 19:43:09.937650 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.937448    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-trusted-ca\") pod \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\" (UID: \"995b5c3e-cbc2-4b6e-a32d-4998dce0666c\") "
May 26 19:43:09.941841 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.938551    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "995b5c3e-cbc2-4b6e-a32d-4998dce0666c" (UID: "995b5c3e-cbc2-4b6e-a32d-4998dce0666c"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 19:43:09.941841 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.939963    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "995b5c3e-cbc2-4b6e-a32d-4998dce0666c" (UID: "995b5c3e-cbc2-4b6e-a32d-4998dce0666c"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 19:43:09.945047 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.944936    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "995b5c3e-cbc2-4b6e-a32d-4998dce0666c" (UID: "995b5c3e-cbc2-4b6e-a32d-4998dce0666c"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:43:09.945047 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.945022    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "995b5c3e-cbc2-4b6e-a32d-4998dce0666c" (UID: "995b5c3e-cbc2-4b6e-a32d-4998dce0666c"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:43:09.945218 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.945115    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "995b5c3e-cbc2-4b6e-a32d-4998dce0666c" (UID: "995b5c3e-cbc2-4b6e-a32d-4998dce0666c"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:43:09.951543 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.947611    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "995b5c3e-cbc2-4b6e-a32d-4998dce0666c" (UID: "995b5c3e-cbc2-4b6e-a32d-4998dce0666c"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:43:09.957582 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.957544    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "995b5c3e-cbc2-4b6e-a32d-4998dce0666c" (UID: "995b5c3e-cbc2-4b6e-a32d-4998dce0666c"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 19:43:09.958291 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:09.958196    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-kube-api-access-tzc4v" (OuterVolumeSpecName: "kube-api-access-tzc4v") pod "995b5c3e-cbc2-4b6e-a32d-4998dce0666c" (UID: "995b5c3e-cbc2-4b6e-a32d-4998dce0666c"). InnerVolumeSpecName "kube-api-access-tzc4v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:43:10.039278 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:10.039241    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-installation-pull-secrets\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:43:10.039401 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:10.039386    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzc4v\" (UniqueName: \"kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-kube-api-access-tzc4v\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:43:10.039475 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:10.039407    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-certificates\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:43:10.039475 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:10.039422    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-trusted-ca\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:43:10.039475 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:10.039436    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-registry-tls\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:43:10.039475 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:10.039452    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-ca-trust-extracted\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:43:10.039475 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:10.039468    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-image-registry-private-configuration\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:43:10.039629 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:10.039483    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/995b5c3e-cbc2-4b6e-a32d-4998dce0666c-bound-sa-token\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:43:10.202580 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:10.202542    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c7cbb5886-h967c"]
May 26 19:43:10.206390 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:10.206368    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c7cbb5886-h967c"]
May 26 19:43:10.886876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:10.886841    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6","Type":"ContainerStarted","Data":"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d"}
May 26 19:43:10.886876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:10.886877    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6","Type":"ContainerStarted","Data":"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9"}
May 26 19:43:10.886876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:10.886885    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6","Type":"ContainerStarted","Data":"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448"}
May 26 19:43:10.916254 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:10.916142    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.106478666 podStartE2EDuration="6.916127298s" podCreationTimestamp="2026-05-26 19:43:04 +0000 UTC" firstStartedPulling="2026-05-26 19:43:06.863821664 +0000 UTC m=+148.130157975" lastFinishedPulling="2026-05-26 19:43:09.673470281 +0000 UTC m=+150.939806607" observedRunningTime="2026-05-26 19:43:10.913482903 +0000 UTC m=+152.179819234" watchObservedRunningTime="2026-05-26 19:43:10.916127298 +0000 UTC m=+152.182463673"
May 26 19:43:11.352470 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:11.352435    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="995b5c3e-cbc2-4b6e-a32d-4998dce0666c" path="/var/lib/kubelet/pods/995b5c3e-cbc2-4b6e-a32d-4998dce0666c/volumes"
May 26 19:43:12.875895 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:12.875868    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5c64c5896-dklpv"
May 26 19:43:15.194431 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:15.194392    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:43:15.635586 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:43:15.635491    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-gvxvz" podUID="e65118e0-5ef8-433d-b018-0531067b70aa"
May 26 19:43:15.648825 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:43:15.648796    2565 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-6s4k2" podUID="2cff5eaa-2999-4393-a02f-9df3a3168c4c"
May 26 19:43:15.902090 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:15.902012    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvxvz"
May 26 19:43:20.540233 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:20.540190    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls\") pod \"dns-default-gvxvz\" (UID: \"e65118e0-5ef8-433d-b018-0531067b70aa\") " pod="openshift-dns/dns-default-gvxvz"
May 26 19:43:20.540651 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:20.540272    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert\") pod \"ingress-canary-6s4k2\" (UID: \"2cff5eaa-2999-4393-a02f-9df3a3168c4c\") " pod="openshift-ingress-canary/ingress-canary-6s4k2"
May 26 19:43:20.542580 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:20.542552    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e65118e0-5ef8-433d-b018-0531067b70aa-metrics-tls\") pod \"dns-default-gvxvz\" (UID: \"e65118e0-5ef8-433d-b018-0531067b70aa\") " pod="openshift-dns/dns-default-gvxvz"
May 26 19:43:20.542674 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:20.542602    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2cff5eaa-2999-4393-a02f-9df3a3168c4c-cert\") pod \"ingress-canary-6s4k2\" (UID: \"2cff5eaa-2999-4393-a02f-9df3a3168c4c\") " pod="openshift-ingress-canary/ingress-canary-6s4k2"
May 26 19:43:20.705320 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:20.705286    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-p4rbd\""
May 26 19:43:20.713058 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:20.713036    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-gvxvz"
May 26 19:43:20.842712 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:20.842687    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-gvxvz"]
May 26 19:43:20.845157 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:43:20.845133    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode65118e0_5ef8_433d_b018_0531067b70aa.slice/crio-629b111ad86e9db53e9261cbd25151367ee51d2c4c588742c5a3be3860b4641f WatchSource:0}: Error finding container 629b111ad86e9db53e9261cbd25151367ee51d2c4c588742c5a3be3860b4641f: Status 404 returned error can't find the container with id 629b111ad86e9db53e9261cbd25151367ee51d2c4c588742c5a3be3860b4641f
May 26 19:43:20.917244 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:20.917210    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvxvz" event={"ID":"e65118e0-5ef8-433d-b018-0531067b70aa","Type":"ContainerStarted","Data":"629b111ad86e9db53e9261cbd25151367ee51d2c4c588742c5a3be3860b4641f"}
May 26 19:43:22.925686 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:22.925650    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvxvz" event={"ID":"e65118e0-5ef8-433d-b018-0531067b70aa","Type":"ContainerStarted","Data":"602a5c4720668ec5d946357f31db3e01b078c84289cc7dcd46f67d8614a4d7e6"}
May 26 19:43:22.925686 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:22.925688    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-gvxvz" event={"ID":"e65118e0-5ef8-433d-b018-0531067b70aa","Type":"ContainerStarted","Data":"00024dd4a01e8b8c27f47b5c76029b24f42d40f8ed2d5d69269f8e50a057b428"}
May 26 19:43:22.926172 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:22.925801    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-gvxvz"
May 26 19:43:22.945471 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:22.945421    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-gvxvz" podStartSLOduration=129.66583761 podStartE2EDuration="2m10.945409272s" podCreationTimestamp="2026-05-26 19:41:12 +0000 UTC" firstStartedPulling="2026-05-26 19:43:20.849550804 +0000 UTC m=+162.115887121" lastFinishedPulling="2026-05-26 19:43:22.129122473 +0000 UTC m=+163.395458783" observedRunningTime="2026-05-26 19:43:22.943524568 +0000 UTC m=+164.209860902" watchObservedRunningTime="2026-05-26 19:43:22.945409272 +0000 UTC m=+164.211745609"
May 26 19:43:26.348682 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:26.348643    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6s4k2"
May 26 19:43:26.351735 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:26.351716    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nxp95\""
May 26 19:43:26.359918 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:26.359896    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6s4k2"
May 26 19:43:26.490367 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:26.490240    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6s4k2"]
May 26 19:43:26.493199 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:43:26.493166    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cff5eaa_2999_4393_a02f_9df3a3168c4c.slice/crio-de2544686863e3a72156d9a906f5a300b0b2a6b32ac52a8407d03e28fc94fb10 WatchSource:0}: Error finding container de2544686863e3a72156d9a906f5a300b0b2a6b32ac52a8407d03e28fc94fb10: Status 404 returned error can't find the container with id de2544686863e3a72156d9a906f5a300b0b2a6b32ac52a8407d03e28fc94fb10
May 26 19:43:26.941174 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:26.941133    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6s4k2" event={"ID":"2cff5eaa-2999-4393-a02f-9df3a3168c4c","Type":"ContainerStarted","Data":"de2544686863e3a72156d9a906f5a300b0b2a6b32ac52a8407d03e28fc94fb10"}
May 26 19:43:28.949910 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:28.949869    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6s4k2" event={"ID":"2cff5eaa-2999-4393-a02f-9df3a3168c4c","Type":"ContainerStarted","Data":"5e00812a8a9f53416e5fac0ed675762dad8ddffcca6de174f32f47cb40b3d7b9"}
May 26 19:43:28.965665 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:28.965610    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6s4k2" podStartSLOduration=135.14505219 podStartE2EDuration="2m16.965591206s" podCreationTimestamp="2026-05-26 19:41:12 +0000 UTC" firstStartedPulling="2026-05-26 19:43:26.495086331 +0000 UTC m=+167.761422641" lastFinishedPulling="2026-05-26 19:43:28.315625347 +0000 UTC m=+169.581961657" observedRunningTime="2026-05-26 19:43:28.964474557 +0000 UTC m=+170.230810889" watchObservedRunningTime="2026-05-26 19:43:28.965591206 +0000 UTC m=+170.231927537"
May 26 19:43:32.932352 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:32.932322    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-gvxvz"
May 26 19:43:34.861404 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:34.861376    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8cd24370-9603-4f64-bc41-12eee61cf0ef/init-config-reloader/0.log"
May 26 19:43:35.060835 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:35.060809    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8cd24370-9603-4f64-bc41-12eee61cf0ef/alertmanager/0.log"
May 26 19:43:35.261687 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:35.261659    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8cd24370-9603-4f64-bc41-12eee61cf0ef/config-reloader/0.log"
May 26 19:43:35.460920 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:35.460889    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8cd24370-9603-4f64-bc41-12eee61cf0ef/kube-rbac-proxy-web/0.log"
May 26 19:43:35.661197 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:35.661127    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8cd24370-9603-4f64-bc41-12eee61cf0ef/kube-rbac-proxy/0.log"
May 26 19:43:35.861401 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:35.861371    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8cd24370-9603-4f64-bc41-12eee61cf0ef/kube-rbac-proxy-metric/0.log"
May 26 19:43:36.060986 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:36.060960    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8cd24370-9603-4f64-bc41-12eee61cf0ef/prom-label-proxy/0.log"
May 26 19:43:37.261085 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:37.261054    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-2lt99_04192970-92db-49ab-97ac-7ba829140333/monitoring-plugin/0.log"
May 26 19:43:37.461452 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:37.461418    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6xttm_9ef074d7-7b4b-4a92-a843-cd03295c51ce/init-textfile/0.log"
May 26 19:43:37.661338 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:37.661271    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6xttm_9ef074d7-7b4b-4a92-a843-cd03295c51ce/node-exporter/0.log"
May 26 19:43:37.860710 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:37.860683    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6xttm_9ef074d7-7b4b-4a92-a843-cd03295c51ce/kube-rbac-proxy/0.log"
May 26 19:43:39.860447 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:39.860416    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ffb370cc-8f84-43a8-bb51-aa6e6a735fa6/init-config-reloader/0.log"
May 26 19:43:40.063296 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:40.063263    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ffb370cc-8f84-43a8-bb51-aa6e6a735fa6/prometheus/0.log"
May 26 19:43:40.261728 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:40.261701    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ffb370cc-8f84-43a8-bb51-aa6e6a735fa6/config-reloader/0.log"
May 26 19:43:40.461124 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:40.461089    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ffb370cc-8f84-43a8-bb51-aa6e6a735fa6/thanos-sidecar/0.log"
May 26 19:43:40.661361 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:40.661290    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ffb370cc-8f84-43a8-bb51-aa6e6a735fa6/kube-rbac-proxy-web/0.log"
May 26 19:43:40.860568 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:40.860541    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ffb370cc-8f84-43a8-bb51-aa6e6a735fa6/kube-rbac-proxy/0.log"
May 26 19:43:41.060937 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:41.060909    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ffb370cc-8f84-43a8-bb51-aa6e6a735fa6/kube-rbac-proxy-thanos/0.log"
May 26 19:43:41.660564 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:41.660535    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-897nj_f95fd27a-8474-4bfa-b0ce-14c52ed9b01f/prometheus-operator-admission-webhook/0.log"
May 26 19:43:42.461605 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:42.461580    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c64c5896-dklpv_9eef388b-9754-40d7-8922-0d6edd003862/thanos-query/0.log"
May 26 19:43:42.660977 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:42.660952    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c64c5896-dklpv_9eef388b-9754-40d7-8922-0d6edd003862/kube-rbac-proxy-web/0.log"
May 26 19:43:42.861303 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:42.861231    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c64c5896-dklpv_9eef388b-9754-40d7-8922-0d6edd003862/kube-rbac-proxy/0.log"
May 26 19:43:43.061251 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:43.061223    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c64c5896-dklpv_9eef388b-9754-40d7-8922-0d6edd003862/prom-label-proxy/0.log"
May 26 19:43:43.264638 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:43.264581    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c64c5896-dklpv_9eef388b-9754-40d7-8922-0d6edd003862/kube-rbac-proxy-rules/0.log"
May 26 19:43:43.461975 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:43.461947    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c64c5896-dklpv_9eef388b-9754-40d7-8922-0d6edd003862/kube-rbac-proxy-metrics/0.log"
May 26 19:43:43.660602 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:43.660534    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-zql5r_f3add0f1-c81f-478c-9e05-616b40159287/networking-console-plugin/0.log"
May 26 19:43:43.861488 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:43.861464    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/2.log"
May 26 19:43:44.061677 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:44.061647    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/3.log"
May 26 19:43:45.261325 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:45.261294    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6s4k2_2cff5eaa-2999-4393-a02f-9df3a3168c4c/serve-healthcheck-canary/0.log"
May 26 19:43:52.027128 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:52.027093    2565 generic.go:358] "Generic (PLEG): container finished" podID="ef306df5-e9fa-457e-b43b-6664145a0912" containerID="6749a6a2d3fba182c20f11e8cc5c8439f02dfa47b113c0b141d1e0774543e314" exitCode=0
May 26 19:43:52.027487 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:52.027156    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qc2wq" event={"ID":"ef306df5-e9fa-457e-b43b-6664145a0912","Type":"ContainerDied","Data":"6749a6a2d3fba182c20f11e8cc5c8439f02dfa47b113c0b141d1e0774543e314"}
May 26 19:43:52.027487 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:52.027439    2565 scope.go:117] "RemoveContainer" containerID="6749a6a2d3fba182c20f11e8cc5c8439f02dfa47b113c0b141d1e0774543e314"
May 26 19:43:53.034709 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:43:53.034667    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-qc2wq" event={"ID":"ef306df5-e9fa-457e-b43b-6664145a0912","Type":"ContainerStarted","Data":"4faf845e83ed7805b666652a0f7072066166e7d22ad8561b9c9df8a367f9c588"}
May 26 19:44:05.195108 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:05.195057    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:05.215040 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:05.215014    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:06.086974 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:06.086948    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:18.945525 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:18.945485    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 19:44:18.946139 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:18.946096    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="alertmanager" containerID="cri-o://aeebf186f1d0f81f0b4c879722ef6c3ead7c92d267566cd5136f9c54d8fdf865" gracePeriod=120
May 26 19:44:18.946226 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:18.946186    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="kube-rbac-proxy-web" containerID="cri-o://f9f158cfc258339a0192d99177899c4cf1d39c84dfd6f4f64452e13b67b0b013" gracePeriod=120
May 26 19:44:18.946283 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:18.946218    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="prom-label-proxy" containerID="cri-o://68c7512b6cfa0e177d0fa0ff932a5f65971ca6b67b2a17bfc43fccae7dcee7e2" gracePeriod=120
May 26 19:44:18.946283 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:18.946233    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="kube-rbac-proxy" containerID="cri-o://d8715882a7543597dcb47bed6ae07312afc3afb8fa891f39b4373ab7a5d60984" gracePeriod=120
May 26 19:44:18.946389 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:18.946257    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="config-reloader" containerID="cri-o://689c928e490401292198d0c955880ff402a39ff84cc657d15f197285061deefc" gracePeriod=120
May 26 19:44:18.946389 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:18.946169    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="kube-rbac-proxy-metric" containerID="cri-o://c26c5f4f7c346de9540a29ea320537a97441fda287c2f32eb0be58ae5e42adb0" gracePeriod=120
May 26 19:44:19.111991 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:19.111960    2565 generic.go:358] "Generic (PLEG): container finished" podID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerID="68c7512b6cfa0e177d0fa0ff932a5f65971ca6b67b2a17bfc43fccae7dcee7e2" exitCode=0
May 26 19:44:19.111991 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:19.111985    2565 generic.go:358] "Generic (PLEG): container finished" podID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerID="d8715882a7543597dcb47bed6ae07312afc3afb8fa891f39b4373ab7a5d60984" exitCode=0
May 26 19:44:19.111991 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:19.111992    2565 generic.go:358] "Generic (PLEG): container finished" podID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerID="689c928e490401292198d0c955880ff402a39ff84cc657d15f197285061deefc" exitCode=0
May 26 19:44:19.111991 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:19.111998    2565 generic.go:358] "Generic (PLEG): container finished" podID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerID="aeebf186f1d0f81f0b4c879722ef6c3ead7c92d267566cd5136f9c54d8fdf865" exitCode=0
May 26 19:44:19.112237 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:19.112023    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd24370-9603-4f64-bc41-12eee61cf0ef","Type":"ContainerDied","Data":"68c7512b6cfa0e177d0fa0ff932a5f65971ca6b67b2a17bfc43fccae7dcee7e2"}
May 26 19:44:19.112237 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:19.112045    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd24370-9603-4f64-bc41-12eee61cf0ef","Type":"ContainerDied","Data":"d8715882a7543597dcb47bed6ae07312afc3afb8fa891f39b4373ab7a5d60984"}
May 26 19:44:19.112237 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:19.112054    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd24370-9603-4f64-bc41-12eee61cf0ef","Type":"ContainerDied","Data":"689c928e490401292198d0c955880ff402a39ff84cc657d15f197285061deefc"}
May 26 19:44:19.112237 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:19.112063    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd24370-9603-4f64-bc41-12eee61cf0ef","Type":"ContainerDied","Data":"aeebf186f1d0f81f0b4c879722ef6c3ead7c92d267566cd5136f9c54d8fdf865"}
May 26 19:44:20.118955 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.118924    2565 generic.go:358] "Generic (PLEG): container finished" podID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerID="c26c5f4f7c346de9540a29ea320537a97441fda287c2f32eb0be58ae5e42adb0" exitCode=0
May 26 19:44:20.118955 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.118950    2565 generic.go:358] "Generic (PLEG): container finished" podID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerID="f9f158cfc258339a0192d99177899c4cf1d39c84dfd6f4f64452e13b67b0b013" exitCode=0
May 26 19:44:20.119346 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.118964    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd24370-9603-4f64-bc41-12eee61cf0ef","Type":"ContainerDied","Data":"c26c5f4f7c346de9540a29ea320537a97441fda287c2f32eb0be58ae5e42adb0"}
May 26 19:44:20.119346 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.118998    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd24370-9603-4f64-bc41-12eee61cf0ef","Type":"ContainerDied","Data":"f9f158cfc258339a0192d99177899c4cf1d39c84dfd6f4f64452e13b67b0b013"}
May 26 19:44:20.188403 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.188381    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 19:44:20.260942 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.260909    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cd24370-9603-4f64-bc41-12eee61cf0ef-alertmanager-trusted-ca-bundle\") pod \"8cd24370-9603-4f64-bc41-12eee61cf0ef\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") "
May 26 19:44:20.260942 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.260947    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-kube-rbac-proxy\") pod \"8cd24370-9603-4f64-bc41-12eee61cf0ef\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") "
May 26 19:44:20.261165 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.260971    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-main-tls\") pod \"8cd24370-9603-4f64-bc41-12eee61cf0ef\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") "
May 26 19:44:20.261165 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.261004    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-web-config\") pod \"8cd24370-9603-4f64-bc41-12eee61cf0ef\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") "
May 26 19:44:20.261165 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.261050    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8cd24370-9603-4f64-bc41-12eee61cf0ef-tls-assets\") pod \"8cd24370-9603-4f64-bc41-12eee61cf0ef\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") "
May 26 19:44:20.261165 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.261084    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8cd24370-9603-4f64-bc41-12eee61cf0ef\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") "
May 26 19:44:20.261165 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.261137    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-77q2s\" (UniqueName: \"kubernetes.io/projected/8cd24370-9603-4f64-bc41-12eee61cf0ef-kube-api-access-77q2s\") pod \"8cd24370-9603-4f64-bc41-12eee61cf0ef\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") "
May 26 19:44:20.261422 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.261176    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-kube-rbac-proxy-web\") pod \"8cd24370-9603-4f64-bc41-12eee61cf0ef\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") "
May 26 19:44:20.261422 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.261220    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cd24370-9603-4f64-bc41-12eee61cf0ef-metrics-client-ca\") pod \"8cd24370-9603-4f64-bc41-12eee61cf0ef\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") "
May 26 19:44:20.261422 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.261251    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-cluster-tls-config\") pod \"8cd24370-9603-4f64-bc41-12eee61cf0ef\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") "
May 26 19:44:20.261422 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.261280    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8cd24370-9603-4f64-bc41-12eee61cf0ef-config-out\") pod \"8cd24370-9603-4f64-bc41-12eee61cf0ef\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") "
May 26 19:44:20.261422 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.261307    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-config-volume\") pod \"8cd24370-9603-4f64-bc41-12eee61cf0ef\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") "
May 26 19:44:20.261422 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.261333    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8cd24370-9603-4f64-bc41-12eee61cf0ef-alertmanager-main-db\") pod \"8cd24370-9603-4f64-bc41-12eee61cf0ef\" (UID: \"8cd24370-9603-4f64-bc41-12eee61cf0ef\") "
May 26 19:44:20.261422 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.261379    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cd24370-9603-4f64-bc41-12eee61cf0ef-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8cd24370-9603-4f64-bc41-12eee61cf0ef" (UID: "8cd24370-9603-4f64-bc41-12eee61cf0ef"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 19:44:20.261789 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.261583    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8cd24370-9603-4f64-bc41-12eee61cf0ef-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:20.262112 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.261883    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cd24370-9603-4f64-bc41-12eee61cf0ef-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8cd24370-9603-4f64-bc41-12eee61cf0ef" (UID: "8cd24370-9603-4f64-bc41-12eee61cf0ef"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 19:44:20.262112 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.262041    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cd24370-9603-4f64-bc41-12eee61cf0ef-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8cd24370-9603-4f64-bc41-12eee61cf0ef" (UID: "8cd24370-9603-4f64-bc41-12eee61cf0ef"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 19:44:20.264910 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.264189    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cd24370-9603-4f64-bc41-12eee61cf0ef-kube-api-access-77q2s" (OuterVolumeSpecName: "kube-api-access-77q2s") pod "8cd24370-9603-4f64-bc41-12eee61cf0ef" (UID: "8cd24370-9603-4f64-bc41-12eee61cf0ef"). InnerVolumeSpecName "kube-api-access-77q2s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:44:20.265382 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.265331    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8cd24370-9603-4f64-bc41-12eee61cf0ef-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8cd24370-9603-4f64-bc41-12eee61cf0ef" (UID: "8cd24370-9603-4f64-bc41-12eee61cf0ef"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:44:20.265382 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.265331    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8cd24370-9603-4f64-bc41-12eee61cf0ef" (UID: "8cd24370-9603-4f64-bc41-12eee61cf0ef"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:44:20.265526 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.265446    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8cd24370-9603-4f64-bc41-12eee61cf0ef" (UID: "8cd24370-9603-4f64-bc41-12eee61cf0ef"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:44:20.265723 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.265701    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8cd24370-9603-4f64-bc41-12eee61cf0ef" (UID: "8cd24370-9603-4f64-bc41-12eee61cf0ef"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:44:20.266009 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.265987    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8cd24370-9603-4f64-bc41-12eee61cf0ef-config-out" (OuterVolumeSpecName: "config-out") pod "8cd24370-9603-4f64-bc41-12eee61cf0ef" (UID: "8cd24370-9603-4f64-bc41-12eee61cf0ef"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 19:44:20.266236 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.266207    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-config-volume" (OuterVolumeSpecName: "config-volume") pod "8cd24370-9603-4f64-bc41-12eee61cf0ef" (UID: "8cd24370-9603-4f64-bc41-12eee61cf0ef"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:44:20.266317 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.266264    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8cd24370-9603-4f64-bc41-12eee61cf0ef" (UID: "8cd24370-9603-4f64-bc41-12eee61cf0ef"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:44:20.269324 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.269302    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8cd24370-9603-4f64-bc41-12eee61cf0ef" (UID: "8cd24370-9603-4f64-bc41-12eee61cf0ef"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:44:20.275950 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.275929    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-web-config" (OuterVolumeSpecName: "web-config") pod "8cd24370-9603-4f64-bc41-12eee61cf0ef" (UID: "8cd24370-9603-4f64-bc41-12eee61cf0ef"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:44:20.362656 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.362617    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:20.362656 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.362651    2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8cd24370-9603-4f64-bc41-12eee61cf0ef-metrics-client-ca\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:20.362656 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.362661    2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-cluster-tls-config\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:20.362893 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.362670    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8cd24370-9603-4f64-bc41-12eee61cf0ef-config-out\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:20.362893 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.362679    2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-config-volume\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:20.362893 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.362689    2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8cd24370-9603-4f64-bc41-12eee61cf0ef-alertmanager-main-db\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:20.362893 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.362698    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:20.362893 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.362706    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-main-tls\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:20.362893 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.362714    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-web-config\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:20.362893 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.362723    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8cd24370-9603-4f64-bc41-12eee61cf0ef-tls-assets\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:20.362893 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.362733    2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8cd24370-9603-4f64-bc41-12eee61cf0ef-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:20.362893 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:20.362742    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-77q2s\" (UniqueName: \"kubernetes.io/projected/8cd24370-9603-4f64-bc41-12eee61cf0ef-kube-api-access-77q2s\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:21.124850 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:21.124818    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8cd24370-9603-4f64-bc41-12eee61cf0ef","Type":"ContainerDied","Data":"849b892ce224ee661a613c97521678d0b96f59af24dfc447bfa0e89e1d43a42f"}
May 26 19:44:21.125292 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:21.124861    2565 scope.go:117] "RemoveContainer" containerID="68c7512b6cfa0e177d0fa0ff932a5f65971ca6b67b2a17bfc43fccae7dcee7e2"
May 26 19:44:21.125292 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:21.124898    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 26 19:44:21.132248 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:21.132231    2565 scope.go:117] "RemoveContainer" containerID="c26c5f4f7c346de9540a29ea320537a97441fda287c2f32eb0be58ae5e42adb0"
May 26 19:44:21.140296 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:21.140277    2565 scope.go:117] "RemoveContainer" containerID="d8715882a7543597dcb47bed6ae07312afc3afb8fa891f39b4373ab7a5d60984"
May 26 19:44:21.146975 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:21.146858    2565 scope.go:117] "RemoveContainer" containerID="f9f158cfc258339a0192d99177899c4cf1d39c84dfd6f4f64452e13b67b0b013"
May 26 19:44:21.149691 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:21.149663    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 19:44:21.154247 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:21.154220    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 26 19:44:21.154998 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:21.154982    2565 scope.go:117] "RemoveContainer" containerID="689c928e490401292198d0c955880ff402a39ff84cc657d15f197285061deefc"
May 26 19:44:21.161563 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:21.161547    2565 scope.go:117] "RemoveContainer" containerID="aeebf186f1d0f81f0b4c879722ef6c3ead7c92d267566cd5136f9c54d8fdf865"
May 26 19:44:21.167968 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:21.167946    2565 scope.go:117] "RemoveContainer" containerID="f267b411786c1aff27e25781baa565959c30ec5b568af0945e85ebc07d393e09"
May 26 19:44:21.356538 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:21.356457    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" path="/var/lib/kubelet/pods/8cd24370-9603-4f64-bc41-12eee61cf0ef/volumes"
May 26 19:44:23.206395 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.206359    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 19:44:23.206882 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.206756    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="prometheus" containerID="cri-o://fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859" gracePeriod=600
May 26 19:44:23.206882 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.206809    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="thanos-sidecar" containerID="cri-o://2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704" gracePeriod=600
May 26 19:44:23.206882 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.206823    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="config-reloader" containerID="cri-o://dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c" gracePeriod=600
May 26 19:44:23.206882 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.206859    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="kube-rbac-proxy-web" containerID="cri-o://fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448" gracePeriod=600
May 26 19:44:23.207090 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.206873    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d" gracePeriod=600
May 26 19:44:23.207090 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.206792    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="kube-rbac-proxy" containerID="cri-o://db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9" gracePeriod=600
May 26 19:44:23.445231 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.445208    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:23.487399 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.487324    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") "
May 26 19:44:23.487399 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.487368    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-grpc-tls\") pod \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") "
May 26 19:44:23.487606 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.487412    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-prometheus-k8s-db\") pod \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") "
May 26 19:44:23.487606 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.487437    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-thanos-prometheus-http-client-file\") pod \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") "
May 26 19:44:23.487606 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.487461    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-configmap-metrics-client-ca\") pod \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") "
May 26 19:44:23.487606 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.487485    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-metrics-client-certs\") pod \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") "
May 26 19:44:23.487606 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.487512    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-config\") pod \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") "
May 26 19:44:23.487606 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.487536    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-prometheus-trusted-ca-bundle\") pod \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") "
May 26 19:44:23.487606 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.487575    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-configmap-kubelet-serving-ca-bundle\") pod \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") "
May 26 19:44:23.487606 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.487601    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") "
May 26 19:44:23.488003 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.487658    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-configmap-serving-certs-ca-bundle\") pod \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") "
May 26 19:44:23.488003 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.487696    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-tls-assets\") pod \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") "
May 26 19:44:23.488003 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.487723    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bzwpv\" (UniqueName: \"kubernetes.io/projected/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-kube-api-access-bzwpv\") pod \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") "
May 26 19:44:23.488003 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.487754    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-web-config\") pod \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") "
May 26 19:44:23.488003 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.487808    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-prometheus-k8s-tls\") pod \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") "
May 26 19:44:23.488003 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.487836    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-kube-rbac-proxy\") pod \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") "
May 26 19:44:23.488003 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.487893    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-prometheus-k8s-rulefiles-0\") pod \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") "
May 26 19:44:23.488003 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.487922    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-config-out\") pod \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\" (UID: \"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6\") "
May 26 19:44:23.488371 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.488106    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" (UID: "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 19:44:23.488371 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.488260    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" (UID: "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 19:44:23.489132 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.488911    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" (UID: "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 19:44:23.489132 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.488976    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" (UID: "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 19:44:23.490003 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.489707    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" (UID: "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 19:44:23.491812 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.491750    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" (UID: "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:44:23.491945 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.491921    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" (UID: "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:44:23.492313 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.492166    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-config" (OuterVolumeSpecName: "config") pod "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" (UID: "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:44:23.492313 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.492251    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" (UID: "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:44:23.492313 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.492288    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" (UID: "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:44:23.492559 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.492326    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" (UID: "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:44:23.492559 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.492500    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" (UID: "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 26 19:44:23.492680 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.492607    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-config-out" (OuterVolumeSpecName: "config-out") pod "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" (UID: "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 19:44:23.493127 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.493086    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-kube-api-access-bzwpv" (OuterVolumeSpecName: "kube-api-access-bzwpv") pod "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" (UID: "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6"). InnerVolumeSpecName "kube-api-access-bzwpv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:44:23.493380 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.493344    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" (UID: "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:44:23.493589 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.493568    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" (UID: "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:44:23.494013 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.493991    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" (UID: "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:44:23.503086 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.503066    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-web-config" (OuterVolumeSpecName: "web-config") pod "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" (UID: "ffb370cc-8f84-43a8-bb51-aa6e6a735fa6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 26 19:44:23.589162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.589123    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:23.589162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.589157    2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-grpc-tls\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:23.589162 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.589168    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-prometheus-k8s-db\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:23.589394 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.589178    2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:23.589394 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.589187    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-configmap-metrics-client-ca\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:23.589394 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.589197    2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-metrics-client-certs\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:23.589394 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.589206    2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-config\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:23.589394 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.589215    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:23.589394 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.589224    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:23.589394 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.589234    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:23.589394 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.589243    2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:23.589394 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.589251    2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-tls-assets\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:23.589394 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.589263    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bzwpv\" (UniqueName: \"kubernetes.io/projected/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-kube-api-access-bzwpv\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:23.589394 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.589271    2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-web-config\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:23.589394 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.589280    2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:23.589394 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.589288    2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-secret-kube-rbac-proxy\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:23.589394 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.589298    2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:23.589394 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:23.589307    2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6-config-out\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:44:24.135929 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.135893    2565 generic.go:358] "Generic (PLEG): container finished" podID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerID="b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d" exitCode=0
May 26 19:44:24.135929 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.135918    2565 generic.go:358] "Generic (PLEG): container finished" podID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerID="db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9" exitCode=0
May 26 19:44:24.135929 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.135926    2565 generic.go:358] "Generic (PLEG): container finished" podID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerID="fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448" exitCode=0
May 26 19:44:24.135929 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.135931    2565 generic.go:358] "Generic (PLEG): container finished" podID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerID="2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704" exitCode=0
May 26 19:44:24.135929 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.135938    2565 generic.go:358] "Generic (PLEG): container finished" podID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerID="dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c" exitCode=0
May 26 19:44:24.135929 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.135943    2565 generic.go:358] "Generic (PLEG): container finished" podID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerID="fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859" exitCode=0
May 26 19:44:24.136328 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.135939    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6","Type":"ContainerDied","Data":"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d"}
May 26 19:44:24.136328 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.135988    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6","Type":"ContainerDied","Data":"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9"}
May 26 19:44:24.136328 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.135992    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.136328 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.136003    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6","Type":"ContainerDied","Data":"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448"}
May 26 19:44:24.136328 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.136019    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6","Type":"ContainerDied","Data":"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704"}
May 26 19:44:24.136328 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.136031    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6","Type":"ContainerDied","Data":"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c"}
May 26 19:44:24.136328 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.136042    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6","Type":"ContainerDied","Data":"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859"}
May 26 19:44:24.136328 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.136052    2565 scope.go:117] "RemoveContainer" containerID="b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d"
May 26 19:44:24.136328 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.136056    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ffb370cc-8f84-43a8-bb51-aa6e6a735fa6","Type":"ContainerDied","Data":"9e433a992c8c0d00c44a6e4a0ae23d7610267b8ccbe2bd01e287789aca2dc180"}
May 26 19:44:24.143622 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.143605    2565 scope.go:117] "RemoveContainer" containerID="db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9"
May 26 19:44:24.150551 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.150531    2565 scope.go:117] "RemoveContainer" containerID="fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448"
May 26 19:44:24.157470 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.157453    2565 scope.go:117] "RemoveContainer" containerID="2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704"
May 26 19:44:24.159247 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.159203    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 19:44:24.163155 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.163125    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 19:44:24.164442 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.164427    2565 scope.go:117] "RemoveContainer" containerID="dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c"
May 26 19:44:24.170972 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.170947    2565 scope.go:117] "RemoveContainer" containerID="fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859"
May 26 19:44:24.177351 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.177334    2565 scope.go:117] "RemoveContainer" containerID="191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93"
May 26 19:44:24.183416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.183401    2565 scope.go:117] "RemoveContainer" containerID="b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d"
May 26 19:44:24.183634 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:44:24.183617    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d\": container with ID starting with b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d not found: ID does not exist" containerID="b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d"
May 26 19:44:24.183688 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.183641    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d"} err="failed to get container status \"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d\": rpc error: code = NotFound desc = could not find container \"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d\": container with ID starting with b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d not found: ID does not exist"
May 26 19:44:24.183688 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.183658    2565 scope.go:117] "RemoveContainer" containerID="db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9"
May 26 19:44:24.183914 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:44:24.183898    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9\": container with ID starting with db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9 not found: ID does not exist" containerID="db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9"
May 26 19:44:24.183973 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.183920    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9"} err="failed to get container status \"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9\": rpc error: code = NotFound desc = could not find container \"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9\": container with ID starting with db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9 not found: ID does not exist"
May 26 19:44:24.183973 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.183937    2565 scope.go:117] "RemoveContainer" containerID="fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448"
May 26 19:44:24.184153 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:44:24.184136    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448\": container with ID starting with fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448 not found: ID does not exist" containerID="fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448"
May 26 19:44:24.184190 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.184168    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448"} err="failed to get container status \"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448\": rpc error: code = NotFound desc = could not find container \"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448\": container with ID starting with fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448 not found: ID does not exist"
May 26 19:44:24.184190 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.184184    2565 scope.go:117] "RemoveContainer" containerID="2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704"
May 26 19:44:24.184410 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:44:24.184394    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704\": container with ID starting with 2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704 not found: ID does not exist" containerID="2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704"
May 26 19:44:24.184461 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.184411    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704"} err="failed to get container status \"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704\": rpc error: code = NotFound desc = could not find container \"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704\": container with ID starting with 2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704 not found: ID does not exist"
May 26 19:44:24.184461 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.184423    2565 scope.go:117] "RemoveContainer" containerID="dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c"
May 26 19:44:24.184606 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:44:24.184592    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c\": container with ID starting with dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c not found: ID does not exist" containerID="dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c"
May 26 19:44:24.184647 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.184607    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c"} err="failed to get container status \"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c\": rpc error: code = NotFound desc = could not find container \"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c\": container with ID starting with dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c not found: ID does not exist"
May 26 19:44:24.184647 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.184618    2565 scope.go:117] "RemoveContainer" containerID="fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859"
May 26 19:44:24.184794 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:44:24.184776    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859\": container with ID starting with fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859 not found: ID does not exist" containerID="fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859"
May 26 19:44:24.184840 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.184799    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859"} err="failed to get container status \"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859\": rpc error: code = NotFound desc = could not find container \"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859\": container with ID starting with fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859 not found: ID does not exist"
May 26 19:44:24.184840 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.184816    2565 scope.go:117] "RemoveContainer" containerID="191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93"
May 26 19:44:24.185032 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:44:24.185013    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93\": container with ID starting with 191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93 not found: ID does not exist" containerID="191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93"
May 26 19:44:24.185073 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.185036    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93"} err="failed to get container status \"191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93\": rpc error: code = NotFound desc = could not find container \"191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93\": container with ID starting with 191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93 not found: ID does not exist"
May 26 19:44:24.185073 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.185050    2565 scope.go:117] "RemoveContainer" containerID="b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d"
May 26 19:44:24.185249 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.185230    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d"} err="failed to get container status \"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d\": rpc error: code = NotFound desc = could not find container \"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d\": container with ID starting with b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d not found: ID does not exist"
May 26 19:44:24.185318 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.185252    2565 scope.go:117] "RemoveContainer" containerID="db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9"
May 26 19:44:24.185449 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.185432    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9"} err="failed to get container status \"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9\": rpc error: code = NotFound desc = could not find container \"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9\": container with ID starting with db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9 not found: ID does not exist"
May 26 19:44:24.185510 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.185449    2565 scope.go:117] "RemoveContainer" containerID="fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448"
May 26 19:44:24.185638 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.185622    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448"} err="failed to get container status \"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448\": rpc error: code = NotFound desc = could not find container \"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448\": container with ID starting with fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448 not found: ID does not exist"
May 26 19:44:24.185682 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.185639    2565 scope.go:117] "RemoveContainer" containerID="2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704"
May 26 19:44:24.185825 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.185810    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704"} err="failed to get container status \"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704\": rpc error: code = NotFound desc = could not find container \"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704\": container with ID starting with 2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704 not found: ID does not exist"
May 26 19:44:24.185876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.185826    2565 scope.go:117] "RemoveContainer" containerID="dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c"
May 26 19:44:24.186110 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.186088    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c"} err="failed to get container status \"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c\": rpc error: code = NotFound desc = could not find container \"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c\": container with ID starting with dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c not found: ID does not exist"
May 26 19:44:24.186151 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.186112    2565 scope.go:117] "RemoveContainer" containerID="fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859"
May 26 19:44:24.186347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.186320    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859"} err="failed to get container status \"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859\": rpc error: code = NotFound desc = could not find container \"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859\": container with ID starting with fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859 not found: ID does not exist"
May 26 19:44:24.186347 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.186346    2565 scope.go:117] "RemoveContainer" containerID="191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93"
May 26 19:44:24.186561 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.186541    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93"} err="failed to get container status \"191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93\": rpc error: code = NotFound desc = could not find container \"191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93\": container with ID starting with 191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93 not found: ID does not exist"
May 26 19:44:24.186641 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.186564    2565 scope.go:117] "RemoveContainer" containerID="b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d"
May 26 19:44:24.187028 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.186933    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d"} err="failed to get container status \"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d\": rpc error: code = NotFound desc = could not find container \"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d\": container with ID starting with b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d not found: ID does not exist"
May 26 19:44:24.187028 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.186960    2565 scope.go:117] "RemoveContainer" containerID="db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9"
May 26 19:44:24.187455 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.187430    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9"} err="failed to get container status \"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9\": rpc error: code = NotFound desc = could not find container \"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9\": container with ID starting with db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9 not found: ID does not exist"
May 26 19:44:24.187541 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.187456    2565 scope.go:117] "RemoveContainer" containerID="fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448"
May 26 19:44:24.187719 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.187698    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448"} err="failed to get container status \"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448\": rpc error: code = NotFound desc = could not find container \"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448\": container with ID starting with fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448 not found: ID does not exist"
May 26 19:44:24.187829 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.187721    2565 scope.go:117] "RemoveContainer" containerID="2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704"
May 26 19:44:24.188005 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.187988    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704"} err="failed to get container status \"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704\": rpc error: code = NotFound desc = could not find container \"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704\": container with ID starting with 2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704 not found: ID does not exist"
May 26 19:44:24.188005 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188007    2565 scope.go:117] "RemoveContainer" containerID="dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c"
May 26 19:44:24.188133 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188113    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 19:44:24.188253 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188236    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c"} err="failed to get container status \"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c\": rpc error: code = NotFound desc = could not find container \"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c\": container with ID starting with dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c not found: ID does not exist"
May 26 19:44:24.188321 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188256    2565 scope.go:117] "RemoveContainer" containerID="fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859"
May 26 19:44:24.188471 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188445    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="kube-rbac-proxy-web"
May 26 19:44:24.188471 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188467    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="kube-rbac-proxy-web"
May 26 19:44:24.188546 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188488    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="config-reloader"
May 26 19:44:24.188546 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188496    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="config-reloader"
May 26 19:44:24.188546 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188502    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="kube-rbac-proxy"
May 26 19:44:24.188546 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188508    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="kube-rbac-proxy"
May 26 19:44:24.188546 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188515    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="init-config-reloader"
May 26 19:44:24.188546 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188520    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="init-config-reloader"
May 26 19:44:24.188546 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188438    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859"} err="failed to get container status \"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859\": rpc error: code = NotFound desc = could not find container \"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859\": container with ID starting with fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859 not found: ID does not exist"
May 26 19:44:24.188546 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188540    2565 scope.go:117] "RemoveContainer" containerID="191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188526    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="alertmanager"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188591    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="alertmanager"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188605    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="prometheus"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188611    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="prometheus"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188620    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="config-reloader"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188628    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="config-reloader"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188640    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="kube-rbac-proxy-metric"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188646    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="kube-rbac-proxy-metric"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188652    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="init-config-reloader"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188657    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="init-config-reloader"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188670    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="prom-label-proxy"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188678    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="prom-label-proxy"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188685    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="kube-rbac-proxy-thanos"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188692    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="kube-rbac-proxy-thanos"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188704    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="thanos-sidecar"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188711    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="thanos-sidecar"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188720    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="kube-rbac-proxy"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188725    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="kube-rbac-proxy"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188733    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="995b5c3e-cbc2-4b6e-a32d-4998dce0666c" containerName="registry"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188738    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="995b5c3e-cbc2-4b6e-a32d-4998dce0666c" containerName="registry"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188746    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="kube-rbac-proxy-web"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188751    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="kube-rbac-proxy-web"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188808    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93"} err="failed to get container status \"191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93\": rpc error: code = NotFound desc = could not find container \"191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93\": container with ID starting with 191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93 not found: ID does not exist"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188829    2565 scope.go:117] "RemoveContainer" containerID="b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188894    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="prometheus"
May 26 19:44:24.188904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188922    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="kube-rbac-proxy-web"
May 26 19:44:24.189876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188931    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="config-reloader"
May 26 19:44:24.189876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188937    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="kube-rbac-proxy"
May 26 19:44:24.189876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188944    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="995b5c3e-cbc2-4b6e-a32d-4998dce0666c" containerName="registry"
May 26 19:44:24.189876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188950    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="prom-label-proxy"
May 26 19:44:24.189876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188960    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="kube-rbac-proxy-thanos"
May 26 19:44:24.189876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188972    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="kube-rbac-proxy"
May 26 19:44:24.189876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188982    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="thanos-sidecar"
May 26 19:44:24.189876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.188992    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="alertmanager"
May 26 19:44:24.189876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.189000    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="8cd24370-9603-4f64-bc41-12eee61cf0ef" containerName="kube-rbac-proxy-metric"
May 26 19:44:24.189876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.189007    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="kube-rbac-proxy-web"
May 26 19:44:24.189876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.189013    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" containerName="config-reloader"
May 26 19:44:24.189876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.189047    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d"} err="failed to get container status \"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d\": rpc error: code = NotFound desc = could not find container \"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d\": container with ID starting with b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d not found: ID does not exist"
May 26 19:44:24.189876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.189061    2565 scope.go:117] "RemoveContainer" containerID="db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9"
May 26 19:44:24.189876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.189261    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9"} err="failed to get container status \"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9\": rpc error: code = NotFound desc = could not find container \"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9\": container with ID starting with db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9 not found: ID does not exist"
May 26 19:44:24.189876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.189283    2565 scope.go:117] "RemoveContainer" containerID="fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448"
May 26 19:44:24.189876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.189498    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448"} err="failed to get container status \"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448\": rpc error: code = NotFound desc = could not find container \"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448\": container with ID starting with fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448 not found: ID does not exist"
May 26 19:44:24.189876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.189517    2565 scope.go:117] "RemoveContainer" containerID="2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704"
May 26 19:44:24.189876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.189729    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704"} err="failed to get container status \"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704\": rpc error: code = NotFound desc = could not find container \"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704\": container with ID starting with 2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704 not found: ID does not exist"
May 26 19:44:24.189876 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.189744    2565 scope.go:117] "RemoveContainer" containerID="dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c"
May 26 19:44:24.190516 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.189963    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c"} err="failed to get container status \"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c\": rpc error: code = NotFound desc = could not find container \"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c\": container with ID starting with dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c not found: ID does not exist"
May 26 19:44:24.190516 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.189985    2565 scope.go:117] "RemoveContainer" containerID="fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859"
May 26 19:44:24.190516 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.190169    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859"} err="failed to get container status \"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859\": rpc error: code = NotFound desc = could not find container \"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859\": container with ID starting with fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859 not found: ID does not exist"
May 26 19:44:24.190516 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.190181    2565 scope.go:117] "RemoveContainer" containerID="191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93"
May 26 19:44:24.190516 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.190340    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93"} err="failed to get container status \"191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93\": rpc error: code = NotFound desc = could not find container \"191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93\": container with ID starting with 191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93 not found: ID does not exist"
May 26 19:44:24.190516 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.190353    2565 scope.go:117] "RemoveContainer" containerID="b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d"
May 26 19:44:24.190820 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.190531    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d"} err="failed to get container status \"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d\": rpc error: code = NotFound desc = could not find container \"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d\": container with ID starting with b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d not found: ID does not exist"
May 26 19:44:24.190820 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.190546    2565 scope.go:117] "RemoveContainer" containerID="db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9"
May 26 19:44:24.190820 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.190692    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9"} err="failed to get container status \"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9\": rpc error: code = NotFound desc = could not find container \"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9\": container with ID starting with db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9 not found: ID does not exist"
May 26 19:44:24.190820 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.190714    2565 scope.go:117] "RemoveContainer" containerID="fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448"
May 26 19:44:24.190967 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.190943    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448"} err="failed to get container status \"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448\": rpc error: code = NotFound desc = could not find container \"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448\": container with ID starting with fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448 not found: ID does not exist"
May 26 19:44:24.190967 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.190958    2565 scope.go:117] "RemoveContainer" containerID="2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704"
May 26 19:44:24.191132 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.191114    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704"} err="failed to get container status \"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704\": rpc error: code = NotFound desc = could not find container \"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704\": container with ID starting with 2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704 not found: ID does not exist"
May 26 19:44:24.191197 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.191133    2565 scope.go:117] "RemoveContainer" containerID="dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c"
May 26 19:44:24.191386 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.191367    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c"} err="failed to get container status \"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c\": rpc error: code = NotFound desc = could not find container \"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c\": container with ID starting with dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c not found: ID does not exist"
May 26 19:44:24.191459 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.191387    2565 scope.go:117] "RemoveContainer" containerID="fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859"
May 26 19:44:24.191583 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.191564    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859"} err="failed to get container status \"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859\": rpc error: code = NotFound desc = could not find container \"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859\": container with ID starting with fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859 not found: ID does not exist"
May 26 19:44:24.191624 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.191583    2565 scope.go:117] "RemoveContainer" containerID="191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93"
May 26 19:44:24.191811 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.191794    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93"} err="failed to get container status \"191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93\": rpc error: code = NotFound desc = could not find container \"191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93\": container with ID starting with 191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93 not found: ID does not exist"
May 26 19:44:24.191891 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.191812    2565 scope.go:117] "RemoveContainer" containerID="b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d"
May 26 19:44:24.192044 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.192018    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d"} err="failed to get container status \"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d\": rpc error: code = NotFound desc = could not find container \"b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d\": container with ID starting with b765a810e0b81011e1519ea426834632ea93aef61231edc921ebc3975c2d9a1d not found: ID does not exist"
May 26 19:44:24.192108 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.192045    2565 scope.go:117] "RemoveContainer" containerID="db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9"
May 26 19:44:24.192236 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.192220    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9"} err="failed to get container status \"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9\": rpc error: code = NotFound desc = could not find container \"db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9\": container with ID starting with db197d0428f3916ee487e6ae72d7d802658a7d65b5a3a0cacd179a4fe508abf9 not found: ID does not exist"
May 26 19:44:24.192281 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.192238    2565 scope.go:117] "RemoveContainer" containerID="fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448"
May 26 19:44:24.192426 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.192407    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448"} err="failed to get container status \"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448\": rpc error: code = NotFound desc = could not find container \"fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448\": container with ID starting with fa51f0f195d5e7e56953e9a8949977b3a9de43d481259a99c88a3941db581448 not found: ID does not exist"
May 26 19:44:24.192467 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.192427    2565 scope.go:117] "RemoveContainer" containerID="2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704"
May 26 19:44:24.192598 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.192584    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704"} err="failed to get container status \"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704\": rpc error: code = NotFound desc = could not find container \"2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704\": container with ID starting with 2fefba02e8739ce6638c23d9e9caa51bba7080c706cb864a714fbdcb6abbb704 not found: ID does not exist"
May 26 19:44:24.192647 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.192598    2565 scope.go:117] "RemoveContainer" containerID="dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c"
May 26 19:44:24.192813 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.192794    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c"} err="failed to get container status \"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c\": rpc error: code = NotFound desc = could not find container \"dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c\": container with ID starting with dcd5214e2fdaedf620aefe60870461bd4e9b921b9ea35d41eaf4e0bf61a3913c not found: ID does not exist"
May 26 19:44:24.192879 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.192814    2565 scope.go:117] "RemoveContainer" containerID="fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859"
May 26 19:44:24.193011 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.192994    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859"} err="failed to get container status \"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859\": rpc error: code = NotFound desc = could not find container \"fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859\": container with ID starting with fbced50e35036b03aa9f8b17f6e0d4534e31ca27f81a10defe330a8528e9b859 not found: ID does not exist"
May 26 19:44:24.193065 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.193012    2565 scope.go:117] "RemoveContainer" containerID="191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93"
May 26 19:44:24.193206 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.193191    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93"} err="failed to get container status \"191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93\": rpc error: code = NotFound desc = could not find container \"191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93\": container with ID starting with 191c5bdc8308fa891f4b3e1b294991436d3656659b20c739e634fe443589ff93 not found: ID does not exist"
May 26 19:44:24.194479 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.194462    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.197502 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.197485    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 26 19:44:24.197502 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.197495    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 26 19:44:24.197653 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.197518    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 26 19:44:24.197653 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.197490    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 26 19:44:24.197653 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.197577    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 26 19:44:24.198051 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.198032    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-2rwbz\""
May 26 19:44:24.198171 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.198156    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 26 19:44:24.198393 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.198380    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 26 19:44:24.198650 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.198611    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 26 19:44:24.198731 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.198680    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 26 19:44:24.198731 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.198688    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 26 19:44:24.199133 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.199116    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a114f5h5tvs78\""
May 26 19:44:24.200020 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.199985    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 26 19:44:24.201280 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.201126    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 26 19:44:24.204044 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.204024    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 26 19:44:24.205045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.205026    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 19:44:24.295168 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.295139    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.295168 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.295170    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.295560 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.295202    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-config\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.295560 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.295273    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-config-out\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.295560 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.295310    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-web-config\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.295560 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.295343    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.295560 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.295364    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.295560 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.295389    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.295560 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.295407    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.295560 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.295421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.295560 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.295474    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.295560 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.295499    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.295560 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.295518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.295560 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.295533    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.295560 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.295549    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbxgm\" (UniqueName: \"kubernetes.io/projected/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-kube-api-access-wbxgm\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.295960 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.295576    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.295960 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.295590    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.295960 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.295609    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.396202 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.396107    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wbxgm\" (UniqueName: \"kubernetes.io/projected/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-kube-api-access-wbxgm\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.396202 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.396161    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.396202 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.396185    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.396485 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.396210    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.396485 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.396245    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.396485 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.396380    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.396485 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.396423    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-config\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.396485 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.396472    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-config-out\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.396749 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.396502    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-web-config\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.396749 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.396548    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.396749 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.396582    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.396749 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.396610    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.396749 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.396637    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.396749 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.396665    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.396749 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.396696    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.396749 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.396722    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.396749 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.396747    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.397210 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.396788    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.397210 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.396931    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.398044 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.398012    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.399756 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.399464    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.399756 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.399487    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.399756 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.399464    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.399756 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.399551    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-config\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.399756 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.399636    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.399756 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.399674    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.400138 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.400114    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.400189 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.400154    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.400379 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.400354    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-config-out\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.400515 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.400496    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.400643 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.400618    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-web-config\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.401682 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.401654    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.401899 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.401883    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.402221 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.402205    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.403186 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.403167    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.408631 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.408611    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbxgm\" (UniqueName: \"kubernetes.io/projected/a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d-kube-api-access-wbxgm\") pod \"prometheus-k8s-0\" (UID: \"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d\") " pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.503981 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.503941    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:44:24.640700 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:24.640666    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 26 19:44:24.643857 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:44:24.643833    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4cb5591_f5fb_49f0_8f0d_2c9a51131d9d.slice/crio-ebcf5a6bfac3c185a1931344f1b84186d66698a7c8979cad48123412c745590b WatchSource:0}: Error finding container ebcf5a6bfac3c185a1931344f1b84186d66698a7c8979cad48123412c745590b: Status 404 returned error can't find the container with id ebcf5a6bfac3c185a1931344f1b84186d66698a7c8979cad48123412c745590b
May 26 19:44:25.140370 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:25.140339    2565 generic.go:358] "Generic (PLEG): container finished" podID="a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d" containerID="90195a50da27c56b93d57ff5a212229f514f7042273d6dfa9b8820fbce2ad551" exitCode=0
May 26 19:44:25.140543 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:25.140430    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d","Type":"ContainerDied","Data":"90195a50da27c56b93d57ff5a212229f514f7042273d6dfa9b8820fbce2ad551"}
May 26 19:44:25.140543 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:25.140468    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d","Type":"ContainerStarted","Data":"ebcf5a6bfac3c185a1931344f1b84186d66698a7c8979cad48123412c745590b"}
May 26 19:44:25.355617 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:25.355531    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ffb370cc-8f84-43a8-bb51-aa6e6a735fa6" path="/var/lib/kubelet/pods/ffb370cc-8f84-43a8-bb51-aa6e6a735fa6/volumes"
May 26 19:44:26.149684 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:26.149649    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d","Type":"ContainerStarted","Data":"1238d1891d94a0d48c4abfd516739fc1eb16e71c77d44889b226716403c024f0"}
May 26 19:44:26.150018 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:26.149691    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d","Type":"ContainerStarted","Data":"5914fe4db0c9b256b1a0240cbb6bdfd9c003dfb128d6515780615a9534b4c791"}
May 26 19:44:26.150018 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:26.149706    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d","Type":"ContainerStarted","Data":"7b411090446cb86acea6e46ef3cac3f32ad31334b5f436c2c73d50b9decf96fb"}
May 26 19:44:26.150018 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:26.149714    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d","Type":"ContainerStarted","Data":"5a2c7389deaaaeeaac2f1ab2b9baf7d4d2327ed4e201a4fe9a201e68e5a1b5d7"}
May 26 19:44:26.150018 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:26.149722    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d","Type":"ContainerStarted","Data":"42ba653cab750839081a5a8e234f42decfc744d50a0b77461668861732c2695a"}
May 26 19:44:26.150018 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:26.149732    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d","Type":"ContainerStarted","Data":"c9ba1f2ea1449c1877012671cfa18693f2f2a15a8f9e311afbd210c2cf79bb99"}
May 26 19:44:26.176218 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:26.176166    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.176153655 podStartE2EDuration="2.176153655s" podCreationTimestamp="2026-05-26 19:44:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:44:26.17491237 +0000 UTC m=+227.441248702" watchObservedRunningTime="2026-05-26 19:44:26.176153655 +0000 UTC m=+227.442489989"
May 26 19:44:29.504209 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:44:29.504174    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:45:24.504238 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:24.504200    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:45:24.519629 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:24.519604    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:45:25.346458 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:25.346435    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 26 19:45:39.264804 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:39.264777    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/2.log"
May 26 19:45:39.265223 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:39.264869    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/2.log"
May 26 19:45:39.270355 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:39.270332    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/ovn-acl-logging/0.log"
May 26 19:45:39.270498 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:39.270414    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/ovn-acl-logging/0.log"
May 26 19:45:39.273896 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:39.273879    2565 kubelet.go:1628] "Image garbage collection succeeded"
May 26 19:45:49.252687 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:49.252651    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-nlhwq"]
May 26 19:45:49.256387 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:49.256369    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-nlhwq"
May 26 19:45:49.258877 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:49.258852    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 26 19:45:49.259008 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:49.258938    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 26 19:45:49.259008 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:49.258974    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-vvfnq\""
May 26 19:45:49.262797 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:49.262778    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-nlhwq"]
May 26 19:45:49.391005 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:49.390962    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsgnc\" (UniqueName: \"kubernetes.io/projected/8a2b2188-890f-4af9-9f33-1c5b71d01f1f-kube-api-access-tsgnc\") pod \"cert-manager-79c8d999ff-nlhwq\" (UID: \"8a2b2188-890f-4af9-9f33-1c5b71d01f1f\") " pod="cert-manager/cert-manager-79c8d999ff-nlhwq"
May 26 19:45:49.391184 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:49.391048    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a2b2188-890f-4af9-9f33-1c5b71d01f1f-bound-sa-token\") pod \"cert-manager-79c8d999ff-nlhwq\" (UID: \"8a2b2188-890f-4af9-9f33-1c5b71d01f1f\") " pod="cert-manager/cert-manager-79c8d999ff-nlhwq"
May 26 19:45:49.492283 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:49.492244    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a2b2188-890f-4af9-9f33-1c5b71d01f1f-bound-sa-token\") pod \"cert-manager-79c8d999ff-nlhwq\" (UID: \"8a2b2188-890f-4af9-9f33-1c5b71d01f1f\") " pod="cert-manager/cert-manager-79c8d999ff-nlhwq"
May 26 19:45:49.492456 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:49.492300    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tsgnc\" (UniqueName: \"kubernetes.io/projected/8a2b2188-890f-4af9-9f33-1c5b71d01f1f-kube-api-access-tsgnc\") pod \"cert-manager-79c8d999ff-nlhwq\" (UID: \"8a2b2188-890f-4af9-9f33-1c5b71d01f1f\") " pod="cert-manager/cert-manager-79c8d999ff-nlhwq"
May 26 19:45:49.500730 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:49.500703    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8a2b2188-890f-4af9-9f33-1c5b71d01f1f-bound-sa-token\") pod \"cert-manager-79c8d999ff-nlhwq\" (UID: \"8a2b2188-890f-4af9-9f33-1c5b71d01f1f\") " pod="cert-manager/cert-manager-79c8d999ff-nlhwq"
May 26 19:45:49.500875 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:49.500850    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsgnc\" (UniqueName: \"kubernetes.io/projected/8a2b2188-890f-4af9-9f33-1c5b71d01f1f-kube-api-access-tsgnc\") pod \"cert-manager-79c8d999ff-nlhwq\" (UID: \"8a2b2188-890f-4af9-9f33-1c5b71d01f1f\") " pod="cert-manager/cert-manager-79c8d999ff-nlhwq"
May 26 19:45:49.578990 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:49.578905    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-nlhwq"
May 26 19:45:49.708544 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:49.708521    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-nlhwq"]
May 26 19:45:49.710873 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:45:49.710839    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8a2b2188_890f_4af9_9f33_1c5b71d01f1f.slice/crio-2de2d16a6cac3cd6c4073a6562e4dfaed642b16954deb15622120ba1b5310531 WatchSource:0}: Error finding container 2de2d16a6cac3cd6c4073a6562e4dfaed642b16954deb15622120ba1b5310531: Status 404 returned error can't find the container with id 2de2d16a6cac3cd6c4073a6562e4dfaed642b16954deb15622120ba1b5310531
May 26 19:45:49.712597 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:49.712579    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 19:45:50.401501 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:50.401462    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-nlhwq" event={"ID":"8a2b2188-890f-4af9-9f33-1c5b71d01f1f","Type":"ContainerStarted","Data":"2de2d16a6cac3cd6c4073a6562e4dfaed642b16954deb15622120ba1b5310531"}
May 26 19:45:53.410811 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:53.410776    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-nlhwq" event={"ID":"8a2b2188-890f-4af9-9f33-1c5b71d01f1f","Type":"ContainerStarted","Data":"762dc4ecba80e3996ceed9a37b861d7d55550390aad349e9ee1e6a72fd8757f8"}
May 26 19:45:53.427296 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:45:53.427241    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-nlhwq" podStartSLOduration=1.675785323 podStartE2EDuration="4.427227407s" podCreationTimestamp="2026-05-26 19:45:49 +0000 UTC" firstStartedPulling="2026-05-26 19:45:49.712715706 +0000 UTC m=+310.979052017" lastFinishedPulling="2026-05-26 19:45:52.464157788 +0000 UTC m=+313.730494101" observedRunningTime="2026-05-26 19:45:53.425849781 +0000 UTC m=+314.692186114" watchObservedRunningTime="2026-05-26 19:45:53.427227407 +0000 UTC m=+314.693563739"
May 26 19:46:16.062378 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:16.062343    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8645bcd494-qw29n"]
May 26 19:46:16.065753 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:16.065737    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-qw29n"
May 26 19:46:16.068188 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:16.068168    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 26 19:46:16.068554 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:16.068536    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 26 19:46:16.068627 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:16.068543    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 26 19:46:16.068627 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:16.068612    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x9dkm\""
May 26 19:46:16.068725 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:16.068627    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 26 19:46:16.081986 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:16.081961    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8645bcd494-qw29n"]
May 26 19:46:16.112373 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:16.112345    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba5cf066-4569-454e-8f4a-67eb491ce8e7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8645bcd494-qw29n\" (UID: \"ba5cf066-4569-454e-8f4a-67eb491ce8e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-qw29n"
May 26 19:46:16.112483 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:16.112391    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhn6w\" (UniqueName: \"kubernetes.io/projected/ba5cf066-4569-454e-8f4a-67eb491ce8e7-kube-api-access-dhn6w\") pod \"opendatahub-operator-controller-manager-8645bcd494-qw29n\" (UID: \"ba5cf066-4569-454e-8f4a-67eb491ce8e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-qw29n"
May 26 19:46:16.112483 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:16.112420    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba5cf066-4569-454e-8f4a-67eb491ce8e7-webhook-cert\") pod \"opendatahub-operator-controller-manager-8645bcd494-qw29n\" (UID: \"ba5cf066-4569-454e-8f4a-67eb491ce8e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-qw29n"
May 26 19:46:16.213474 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:16.213440    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dhn6w\" (UniqueName: \"kubernetes.io/projected/ba5cf066-4569-454e-8f4a-67eb491ce8e7-kube-api-access-dhn6w\") pod \"opendatahub-operator-controller-manager-8645bcd494-qw29n\" (UID: \"ba5cf066-4569-454e-8f4a-67eb491ce8e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-qw29n"
May 26 19:46:16.213634 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:16.213483    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba5cf066-4569-454e-8f4a-67eb491ce8e7-webhook-cert\") pod \"opendatahub-operator-controller-manager-8645bcd494-qw29n\" (UID: \"ba5cf066-4569-454e-8f4a-67eb491ce8e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-qw29n"
May 26 19:46:16.213634 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:16.213552    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba5cf066-4569-454e-8f4a-67eb491ce8e7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8645bcd494-qw29n\" (UID: \"ba5cf066-4569-454e-8f4a-67eb491ce8e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-qw29n"
May 26 19:46:16.215914 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:16.215889    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ba5cf066-4569-454e-8f4a-67eb491ce8e7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8645bcd494-qw29n\" (UID: \"ba5cf066-4569-454e-8f4a-67eb491ce8e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-qw29n"
May 26 19:46:16.216023 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:16.215926    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ba5cf066-4569-454e-8f4a-67eb491ce8e7-webhook-cert\") pod \"opendatahub-operator-controller-manager-8645bcd494-qw29n\" (UID: \"ba5cf066-4569-454e-8f4a-67eb491ce8e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-qw29n"
May 26 19:46:16.222495 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:16.222470    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhn6w\" (UniqueName: \"kubernetes.io/projected/ba5cf066-4569-454e-8f4a-67eb491ce8e7-kube-api-access-dhn6w\") pod \"opendatahub-operator-controller-manager-8645bcd494-qw29n\" (UID: \"ba5cf066-4569-454e-8f4a-67eb491ce8e7\") " pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-qw29n"
May 26 19:46:16.376452 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:16.376367    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-qw29n"
May 26 19:46:16.512147 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:16.512111    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8645bcd494-qw29n"]
May 26 19:46:16.515541 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:46:16.515501    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba5cf066_4569_454e_8f4a_67eb491ce8e7.slice/crio-eb152cc5cb68d86d725817fa480d3f792e1fb92fbde471b0465bbf0e20b31ea1 WatchSource:0}: Error finding container eb152cc5cb68d86d725817fa480d3f792e1fb92fbde471b0465bbf0e20b31ea1: Status 404 returned error can't find the container with id eb152cc5cb68d86d725817fa480d3f792e1fb92fbde471b0465bbf0e20b31ea1
May 26 19:46:17.480719 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:17.480676    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-qw29n" event={"ID":"ba5cf066-4569-454e-8f4a-67eb491ce8e7","Type":"ContainerStarted","Data":"eb152cc5cb68d86d725817fa480d3f792e1fb92fbde471b0465bbf0e20b31ea1"}
May 26 19:46:19.488385 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:19.488349    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-qw29n" event={"ID":"ba5cf066-4569-454e-8f4a-67eb491ce8e7","Type":"ContainerStarted","Data":"eecb6349b22c68a0242eb3e571ae522ca75cbc35eaa72d8e3962c40cc98f5c12"}
May 26 19:46:19.488791 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:19.488459    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-qw29n"
May 26 19:46:19.507738 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:19.507691    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-qw29n" podStartSLOduration=1.048091406 podStartE2EDuration="3.507677438s" podCreationTimestamp="2026-05-26 19:46:16 +0000 UTC" firstStartedPulling="2026-05-26 19:46:16.517206457 +0000 UTC m=+337.783542767" lastFinishedPulling="2026-05-26 19:46:18.976792483 +0000 UTC m=+340.243128799" observedRunningTime="2026-05-26 19:46:19.506414767 +0000 UTC m=+340.772751100" watchObservedRunningTime="2026-05-26 19:46:19.507677438 +0000 UTC m=+340.774013768"
May 26 19:46:21.062540 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.062498    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8"]
May 26 19:46:21.066176 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.066152    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8"
May 26 19:46:21.069623 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.069594    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 26 19:46:21.069778 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.069746    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 26 19:46:21.069917 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.069900    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 26 19:46:21.070002 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.069905    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-67hmc\""
May 26 19:46:21.070002 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.069988    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 26 19:46:21.070102 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.070051    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 26 19:46:21.078946 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.078921    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8"]
May 26 19:46:21.158428 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.158385    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15ddd942-b89a-4fe2-be53-55962d4bf54c-cert\") pod \"lws-controller-manager-7c7d59fbcb-k2hq8\" (UID: \"15ddd942-b89a-4fe2-be53-55962d4bf54c\") " pod="openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8"
May 26 19:46:21.158622 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.158457    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phk9b\" (UniqueName: \"kubernetes.io/projected/15ddd942-b89a-4fe2-be53-55962d4bf54c-kube-api-access-phk9b\") pod \"lws-controller-manager-7c7d59fbcb-k2hq8\" (UID: \"15ddd942-b89a-4fe2-be53-55962d4bf54c\") " pod="openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8"
May 26 19:46:21.158622 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.158526    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/15ddd942-b89a-4fe2-be53-55962d4bf54c-metrics-cert\") pod \"lws-controller-manager-7c7d59fbcb-k2hq8\" (UID: \"15ddd942-b89a-4fe2-be53-55962d4bf54c\") " pod="openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8"
May 26 19:46:21.158622 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.158577    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/15ddd942-b89a-4fe2-be53-55962d4bf54c-manager-config\") pod \"lws-controller-manager-7c7d59fbcb-k2hq8\" (UID: \"15ddd942-b89a-4fe2-be53-55962d4bf54c\") " pod="openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8"
May 26 19:46:21.259870 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.259833    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/15ddd942-b89a-4fe2-be53-55962d4bf54c-metrics-cert\") pod \"lws-controller-manager-7c7d59fbcb-k2hq8\" (UID: \"15ddd942-b89a-4fe2-be53-55962d4bf54c\") " pod="openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8"
May 26 19:46:21.260072 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.259985    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/15ddd942-b89a-4fe2-be53-55962d4bf54c-manager-config\") pod \"lws-controller-manager-7c7d59fbcb-k2hq8\" (UID: \"15ddd942-b89a-4fe2-be53-55962d4bf54c\") " pod="openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8"
May 26 19:46:21.260072 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.260052    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15ddd942-b89a-4fe2-be53-55962d4bf54c-cert\") pod \"lws-controller-manager-7c7d59fbcb-k2hq8\" (UID: \"15ddd942-b89a-4fe2-be53-55962d4bf54c\") " pod="openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8"
May 26 19:46:21.260233 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.260091    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phk9b\" (UniqueName: \"kubernetes.io/projected/15ddd942-b89a-4fe2-be53-55962d4bf54c-kube-api-access-phk9b\") pod \"lws-controller-manager-7c7d59fbcb-k2hq8\" (UID: \"15ddd942-b89a-4fe2-be53-55962d4bf54c\") " pod="openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8"
May 26 19:46:21.260595 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.260573    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/15ddd942-b89a-4fe2-be53-55962d4bf54c-manager-config\") pod \"lws-controller-manager-7c7d59fbcb-k2hq8\" (UID: \"15ddd942-b89a-4fe2-be53-55962d4bf54c\") " pod="openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8"
May 26 19:46:21.262416 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.262385    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/15ddd942-b89a-4fe2-be53-55962d4bf54c-metrics-cert\") pod \"lws-controller-manager-7c7d59fbcb-k2hq8\" (UID: \"15ddd942-b89a-4fe2-be53-55962d4bf54c\") " pod="openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8"
May 26 19:46:21.262567 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.262546    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/15ddd942-b89a-4fe2-be53-55962d4bf54c-cert\") pod \"lws-controller-manager-7c7d59fbcb-k2hq8\" (UID: \"15ddd942-b89a-4fe2-be53-55962d4bf54c\") " pod="openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8"
May 26 19:46:21.267586 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.267564    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phk9b\" (UniqueName: \"kubernetes.io/projected/15ddd942-b89a-4fe2-be53-55962d4bf54c-kube-api-access-phk9b\") pod \"lws-controller-manager-7c7d59fbcb-k2hq8\" (UID: \"15ddd942-b89a-4fe2-be53-55962d4bf54c\") " pod="openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8"
May 26 19:46:21.375108 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.375026    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8"
May 26 19:46:21.506663 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:21.506639    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8"]
May 26 19:46:21.509227 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:46:21.509198    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15ddd942_b89a_4fe2_be53_55962d4bf54c.slice/crio-d62d425fe92cacf560440bb1c43c50a83b84e8d203347be527b334bf2705c371 WatchSource:0}: Error finding container d62d425fe92cacf560440bb1c43c50a83b84e8d203347be527b334bf2705c371: Status 404 returned error can't find the container with id d62d425fe92cacf560440bb1c43c50a83b84e8d203347be527b334bf2705c371
May 26 19:46:22.498995 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:22.498961    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8" event={"ID":"15ddd942-b89a-4fe2-be53-55962d4bf54c","Type":"ContainerStarted","Data":"d62d425fe92cacf560440bb1c43c50a83b84e8d203347be527b334bf2705c371"}
May 26 19:46:26.514101 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:26.514058    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8" event={"ID":"15ddd942-b89a-4fe2-be53-55962d4bf54c","Type":"ContainerStarted","Data":"6af3dc7ae30dbedcf835094a1062c5ae5cfc10cb41acd74a1be29416d1018511"}
May 26 19:46:26.514450 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:26.514125    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8"
May 26 19:46:26.531878 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:26.531827    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8" podStartSLOduration=1.162486478 podStartE2EDuration="5.531813177s" podCreationTimestamp="2026-05-26 19:46:21 +0000 UTC" firstStartedPulling="2026-05-26 19:46:21.510962889 +0000 UTC m=+342.777299214" lastFinishedPulling="2026-05-26 19:46:25.88028959 +0000 UTC m=+347.146625913" observedRunningTime="2026-05-26 19:46:26.530387976 +0000 UTC m=+347.796724307" watchObservedRunningTime="2026-05-26 19:46:26.531813177 +0000 UTC m=+347.798149508"
May 26 19:46:30.493682 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:30.493654    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8645bcd494-qw29n"
May 26 19:46:37.519593 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:46:37.519555    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c7d59fbcb-k2hq8"
May 26 19:47:20.250742 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.250704    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"]
May 26 19:47:20.256633 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.256609    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.259240 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.259208    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 26 19:47:20.259362 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.259259    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
May 26 19:47:20.259362 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.259334    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-x724w\""
May 26 19:47:20.259362 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.259223    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 26 19:47:20.268893 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.268869    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"]
May 26 19:47:20.358904 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.358869    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7385549-3df4-4b2d-98b2-990b4fda4759-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.359077 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.358926    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7385549-3df4-4b2d-98b2-990b4fda4759-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.359077 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.358952    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7385549-3df4-4b2d-98b2-990b4fda4759-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.359077 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.358968    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7385549-3df4-4b2d-98b2-990b4fda4759-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.359077 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.359006    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmmss\" (UniqueName: \"kubernetes.io/projected/b7385549-3df4-4b2d-98b2-990b4fda4759-kube-api-access-vmmss\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.359279 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.359059    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7385549-3df4-4b2d-98b2-990b4fda4759-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.359279 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.359178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7385549-3df4-4b2d-98b2-990b4fda4759-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.359279 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.359228    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7385549-3df4-4b2d-98b2-990b4fda4759-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.359279 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.359262    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7385549-3df4-4b2d-98b2-990b4fda4759-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.459702 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.459667    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7385549-3df4-4b2d-98b2-990b4fda4759-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.459888 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.459705    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7385549-3df4-4b2d-98b2-990b4fda4759-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.459888 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.459738    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7385549-3df4-4b2d-98b2-990b4fda4759-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.459888 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.459804    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7385549-3df4-4b2d-98b2-990b4fda4759-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.459888 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.459837    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7385549-3df4-4b2d-98b2-990b4fda4759-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.459888 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.459862    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7385549-3df4-4b2d-98b2-990b4fda4759-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.460190 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.459926    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vmmss\" (UniqueName: \"kubernetes.io/projected/b7385549-3df4-4b2d-98b2-990b4fda4759-kube-api-access-vmmss\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.460190 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.459957    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7385549-3df4-4b2d-98b2-990b4fda4759-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.460190 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.460138    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7385549-3df4-4b2d-98b2-990b4fda4759-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.460330 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.460185    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7385549-3df4-4b2d-98b2-990b4fda4759-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.460330 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.460186    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7385549-3df4-4b2d-98b2-990b4fda4759-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.460330 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.460285    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b7385549-3df4-4b2d-98b2-990b4fda4759-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.460438 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.460326    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b7385549-3df4-4b2d-98b2-990b4fda4759-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.460685 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.460664    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b7385549-3df4-4b2d-98b2-990b4fda4759-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.462200 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.462170    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b7385549-3df4-4b2d-98b2-990b4fda4759-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.462429 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.462413    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b7385549-3df4-4b2d-98b2-990b4fda4759-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.467537 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.467516    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7385549-3df4-4b2d-98b2-990b4fda4759-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.467757 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.467740    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmmss\" (UniqueName: \"kubernetes.io/projected/b7385549-3df4-4b2d-98b2-990b4fda4759-kube-api-access-vmmss\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5\" (UID: \"b7385549-3df4-4b2d-98b2-990b4fda4759\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.567641 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.567548    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:20.701330 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:20.701302    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"]
May 26 19:47:20.704041 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:47:20.704008    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7385549_3df4_4b2d_98b2_990b4fda4759.slice/crio-9a3de9bfbb093b9bbbd923b56529d2eaa986a951eff73a4f7741066104226ded WatchSource:0}: Error finding container 9a3de9bfbb093b9bbbd923b56529d2eaa986a951eff73a4f7741066104226ded: Status 404 returned error can't find the container with id 9a3de9bfbb093b9bbbd923b56529d2eaa986a951eff73a4f7741066104226ded
May 26 19:47:21.687717 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:21.687675    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5" event={"ID":"b7385549-3df4-4b2d-98b2-990b4fda4759","Type":"ContainerStarted","Data":"9a3de9bfbb093b9bbbd923b56529d2eaa986a951eff73a4f7741066104226ded"}
May 26 19:47:24.463960 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:24.463905    2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 26 19:47:24.464365 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:24.463995    2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 26 19:47:24.464365 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:24.464041    2565 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
May 26 19:47:24.698530 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:24.698497    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5" event={"ID":"b7385549-3df4-4b2d-98b2-990b4fda4759","Type":"ContainerStarted","Data":"b2ba12e8a1e9b9aaa90ace0136ea31b3f51de273817faef03cc20cb6d3a0d56c"}
May 26 19:47:24.718822 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:24.718724    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5" podStartSLOduration=0.961133157 podStartE2EDuration="4.718708779s" podCreationTimestamp="2026-05-26 19:47:20 +0000 UTC" firstStartedPulling="2026-05-26 19:47:20.706025542 +0000 UTC m=+401.972361860" lastFinishedPulling="2026-05-26 19:47:24.463601167 +0000 UTC m=+405.729937482" observedRunningTime="2026-05-26 19:47:24.717974692 +0000 UTC m=+405.984311020" watchObservedRunningTime="2026-05-26 19:47:24.718708779 +0000 UTC m=+405.985045178"
May 26 19:47:25.568678 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:25.568636    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:25.573268 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:25.573242    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:25.702438 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:25.702397    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:25.703355 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:25.703337    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5"
May 26 19:47:33.932248 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:33.932211    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5gjc9"]
May 26 19:47:33.935616 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:33.935598    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5gjc9"
May 26 19:47:33.939101 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:33.939071    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-mqc4k\""
May 26 19:47:33.939262 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:33.939105    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 26 19:47:33.939262 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:33.939074    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 26 19:47:33.946626 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:33.946599    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5gjc9"]
May 26 19:47:34.084590 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:34.084552    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs64d\" (UniqueName: \"kubernetes.io/projected/968950df-da33-4bf6-90a5-765bab861125-kube-api-access-hs64d\") pod \"kuadrant-operator-catalog-5gjc9\" (UID: \"968950df-da33-4bf6-90a5-765bab861125\") " pod="kuadrant-system/kuadrant-operator-catalog-5gjc9"
May 26 19:47:34.185217 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:34.185107    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hs64d\" (UniqueName: \"kubernetes.io/projected/968950df-da33-4bf6-90a5-765bab861125-kube-api-access-hs64d\") pod \"kuadrant-operator-catalog-5gjc9\" (UID: \"968950df-da33-4bf6-90a5-765bab861125\") " pod="kuadrant-system/kuadrant-operator-catalog-5gjc9"
May 26 19:47:34.193899 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:34.193866    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs64d\" (UniqueName: \"kubernetes.io/projected/968950df-da33-4bf6-90a5-765bab861125-kube-api-access-hs64d\") pod \"kuadrant-operator-catalog-5gjc9\" (UID: \"968950df-da33-4bf6-90a5-765bab861125\") " pod="kuadrant-system/kuadrant-operator-catalog-5gjc9"
May 26 19:47:34.248074 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:34.248037    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5gjc9"
May 26 19:47:34.303265 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:34.303235    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5gjc9"]
May 26 19:47:34.380140 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:34.380119    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5gjc9"]
May 26 19:47:34.382724 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:47:34.382695    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod968950df_da33_4bf6_90a5_765bab861125.slice/crio-133003f4371c232bc81d46ec8678df7e611300777f19bb52030b0455a0f5ccfe WatchSource:0}: Error finding container 133003f4371c232bc81d46ec8678df7e611300777f19bb52030b0455a0f5ccfe: Status 404 returned error can't find the container with id 133003f4371c232bc81d46ec8678df7e611300777f19bb52030b0455a0f5ccfe
May 26 19:47:34.512795 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:34.512703    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v9j8l"]
May 26 19:47:34.517682 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:34.517663    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v9j8l"
May 26 19:47:34.523189 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:34.523159    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v9j8l"]
May 26 19:47:34.689622 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:34.689583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z8l7k\" (UniqueName: \"kubernetes.io/projected/91c798e3-51f6-4150-99d3-b7fe00525d42-kube-api-access-z8l7k\") pod \"kuadrant-operator-catalog-v9j8l\" (UID: \"91c798e3-51f6-4150-99d3-b7fe00525d42\") " pod="kuadrant-system/kuadrant-operator-catalog-v9j8l"
May 26 19:47:34.732468 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:34.732430    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5gjc9" event={"ID":"968950df-da33-4bf6-90a5-765bab861125","Type":"ContainerStarted","Data":"133003f4371c232bc81d46ec8678df7e611300777f19bb52030b0455a0f5ccfe"}
May 26 19:47:34.790081 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:34.789993    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-z8l7k\" (UniqueName: \"kubernetes.io/projected/91c798e3-51f6-4150-99d3-b7fe00525d42-kube-api-access-z8l7k\") pod \"kuadrant-operator-catalog-v9j8l\" (UID: \"91c798e3-51f6-4150-99d3-b7fe00525d42\") " pod="kuadrant-system/kuadrant-operator-catalog-v9j8l"
May 26 19:47:34.798103 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:34.798072    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z8l7k\" (UniqueName: \"kubernetes.io/projected/91c798e3-51f6-4150-99d3-b7fe00525d42-kube-api-access-z8l7k\") pod \"kuadrant-operator-catalog-v9j8l\" (UID: \"91c798e3-51f6-4150-99d3-b7fe00525d42\") " pod="kuadrant-system/kuadrant-operator-catalog-v9j8l"
May 26 19:47:34.828828 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:34.828788    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-v9j8l"
May 26 19:47:34.960232 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:34.960198    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-v9j8l"]
May 26 19:47:34.964102 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:47:34.964073    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91c798e3_51f6_4150_99d3_b7fe00525d42.slice/crio-2d46bb9da9c2640bc0eb7c25669d1d3082782b7e32be69c34440f578f85e8ac7 WatchSource:0}: Error finding container 2d46bb9da9c2640bc0eb7c25669d1d3082782b7e32be69c34440f578f85e8ac7: Status 404 returned error can't find the container with id 2d46bb9da9c2640bc0eb7c25669d1d3082782b7e32be69c34440f578f85e8ac7
May 26 19:47:35.737692 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:35.737640    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v9j8l" event={"ID":"91c798e3-51f6-4150-99d3-b7fe00525d42","Type":"ContainerStarted","Data":"2d46bb9da9c2640bc0eb7c25669d1d3082782b7e32be69c34440f578f85e8ac7"}
May 26 19:47:36.742208 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:36.742163    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-v9j8l" event={"ID":"91c798e3-51f6-4150-99d3-b7fe00525d42","Type":"ContainerStarted","Data":"2a278d5538f7a96a10c472513b8dcf66f3dd31ce5560eab87d1bf081e22c5bf1"}
May 26 19:47:36.743510 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:36.743485    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5gjc9" event={"ID":"968950df-da33-4bf6-90a5-765bab861125","Type":"ContainerStarted","Data":"b7f49f798bc8069cbb8fd5cf1c0764d6d58e540ce383f0729fbf5f6b57900b5d"}
May 26 19:47:36.743632 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:36.743578    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-5gjc9" podUID="968950df-da33-4bf6-90a5-765bab861125" containerName="registry-server" containerID="cri-o://b7f49f798bc8069cbb8fd5cf1c0764d6d58e540ce383f0729fbf5f6b57900b5d" gracePeriod=2
May 26 19:47:36.759269 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:36.758638    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-v9j8l" podStartSLOduration=1.119953944 podStartE2EDuration="2.75861717s" podCreationTimestamp="2026-05-26 19:47:34 +0000 UTC" firstStartedPulling="2026-05-26 19:47:34.965546266 +0000 UTC m=+416.231882577" lastFinishedPulling="2026-05-26 19:47:36.604209491 +0000 UTC m=+417.870545803" observedRunningTime="2026-05-26 19:47:36.757287694 +0000 UTC m=+418.023624028" watchObservedRunningTime="2026-05-26 19:47:36.75861717 +0000 UTC m=+418.024953503"
May 26 19:47:36.773315 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:36.773255    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5gjc9" podStartSLOduration=1.5561398579999999 podStartE2EDuration="3.77323706s" podCreationTimestamp="2026-05-26 19:47:33 +0000 UTC" firstStartedPulling="2026-05-26 19:47:34.384011826 +0000 UTC m=+415.650348135" lastFinishedPulling="2026-05-26 19:47:36.601109013 +0000 UTC m=+417.867445337" observedRunningTime="2026-05-26 19:47:36.772292936 +0000 UTC m=+418.038629262" watchObservedRunningTime="2026-05-26 19:47:36.77323706 +0000 UTC m=+418.039573392"
May 26 19:47:37.081813 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:37.081789    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5gjc9"
May 26 19:47:37.211467 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:37.211434    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hs64d\" (UniqueName: \"kubernetes.io/projected/968950df-da33-4bf6-90a5-765bab861125-kube-api-access-hs64d\") pod \"968950df-da33-4bf6-90a5-765bab861125\" (UID: \"968950df-da33-4bf6-90a5-765bab861125\") "
May 26 19:47:37.213641 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:37.213614    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/968950df-da33-4bf6-90a5-765bab861125-kube-api-access-hs64d" (OuterVolumeSpecName: "kube-api-access-hs64d") pod "968950df-da33-4bf6-90a5-765bab861125" (UID: "968950df-da33-4bf6-90a5-765bab861125"). InnerVolumeSpecName "kube-api-access-hs64d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:47:37.312526 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:37.312487    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hs64d\" (UniqueName: \"kubernetes.io/projected/968950df-da33-4bf6-90a5-765bab861125-kube-api-access-hs64d\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:47:37.748205 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:37.748172    2565 generic.go:358] "Generic (PLEG): container finished" podID="968950df-da33-4bf6-90a5-765bab861125" containerID="b7f49f798bc8069cbb8fd5cf1c0764d6d58e540ce383f0729fbf5f6b57900b5d" exitCode=0
May 26 19:47:37.748681 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:37.748237    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5gjc9"
May 26 19:47:37.748681 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:37.748267    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5gjc9" event={"ID":"968950df-da33-4bf6-90a5-765bab861125","Type":"ContainerDied","Data":"b7f49f798bc8069cbb8fd5cf1c0764d6d58e540ce383f0729fbf5f6b57900b5d"}
May 26 19:47:37.748681 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:37.748311    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5gjc9" event={"ID":"968950df-da33-4bf6-90a5-765bab861125","Type":"ContainerDied","Data":"133003f4371c232bc81d46ec8678df7e611300777f19bb52030b0455a0f5ccfe"}
May 26 19:47:37.748681 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:37.748333    2565 scope.go:117] "RemoveContainer" containerID="b7f49f798bc8069cbb8fd5cf1c0764d6d58e540ce383f0729fbf5f6b57900b5d"
May 26 19:47:37.756799 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:37.756757    2565 scope.go:117] "RemoveContainer" containerID="b7f49f798bc8069cbb8fd5cf1c0764d6d58e540ce383f0729fbf5f6b57900b5d"
May 26 19:47:37.757075 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:47:37.757053    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7f49f798bc8069cbb8fd5cf1c0764d6d58e540ce383f0729fbf5f6b57900b5d\": container with ID starting with b7f49f798bc8069cbb8fd5cf1c0764d6d58e540ce383f0729fbf5f6b57900b5d not found: ID does not exist" containerID="b7f49f798bc8069cbb8fd5cf1c0764d6d58e540ce383f0729fbf5f6b57900b5d"
May 26 19:47:37.757155 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:37.757084    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7f49f798bc8069cbb8fd5cf1c0764d6d58e540ce383f0729fbf5f6b57900b5d"} err="failed to get container status \"b7f49f798bc8069cbb8fd5cf1c0764d6d58e540ce383f0729fbf5f6b57900b5d\": rpc error: code = NotFound desc = could not find container \"b7f49f798bc8069cbb8fd5cf1c0764d6d58e540ce383f0729fbf5f6b57900b5d\": container with ID starting with b7f49f798bc8069cbb8fd5cf1c0764d6d58e540ce383f0729fbf5f6b57900b5d not found: ID does not exist"
May 26 19:47:37.764039 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:37.764017    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5gjc9"]
May 26 19:47:37.768566 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:37.768545    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5gjc9"]
May 26 19:47:39.357448 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:39.352995    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="968950df-da33-4bf6-90a5-765bab861125" path="/var/lib/kubelet/pods/968950df-da33-4bf6-90a5-765bab861125/volumes"
May 26 19:47:44.829732 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:44.829677    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-v9j8l"
May 26 19:47:44.830185 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:44.829751    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-v9j8l"
May 26 19:47:44.852099 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:44.852070    2565 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-v9j8l"
May 26 19:47:45.796320 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:47:45.796293    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-v9j8l"
May 26 19:48:07.151496 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:07.151413    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-llv6b"]
May 26 19:48:07.152083 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:07.151807    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968950df-da33-4bf6-90a5-765bab861125" containerName="registry-server"
May 26 19:48:07.152083 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:07.151821    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="968950df-da33-4bf6-90a5-765bab861125" containerName="registry-server"
May 26 19:48:07.152083 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:07.151871    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="968950df-da33-4bf6-90a5-765bab861125" containerName="registry-server"
May 26 19:48:07.157892 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:07.157874    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-llv6b"
May 26 19:48:07.160648 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:07.160629    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4zzlz\""
May 26 19:48:07.167060 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:07.167036    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-llv6b"]
May 26 19:48:07.258373 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:07.258330    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mg4m\" (UniqueName: \"kubernetes.io/projected/e7ae7993-bc4d-4043-98b4-b17438a8bd29-kube-api-access-8mg4m\") pod \"authorino-operator-657f44b778-llv6b\" (UID: \"e7ae7993-bc4d-4043-98b4-b17438a8bd29\") " pod="kuadrant-system/authorino-operator-657f44b778-llv6b"
May 26 19:48:07.359626 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:07.359592    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mg4m\" (UniqueName: \"kubernetes.io/projected/e7ae7993-bc4d-4043-98b4-b17438a8bd29-kube-api-access-8mg4m\") pod \"authorino-operator-657f44b778-llv6b\" (UID: \"e7ae7993-bc4d-4043-98b4-b17438a8bd29\") " pod="kuadrant-system/authorino-operator-657f44b778-llv6b"
May 26 19:48:07.377221 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:07.377189    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mg4m\" (UniqueName: \"kubernetes.io/projected/e7ae7993-bc4d-4043-98b4-b17438a8bd29-kube-api-access-8mg4m\") pod \"authorino-operator-657f44b778-llv6b\" (UID: \"e7ae7993-bc4d-4043-98b4-b17438a8bd29\") " pod="kuadrant-system/authorino-operator-657f44b778-llv6b"
May 26 19:48:07.468297 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:07.468258    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-llv6b"
May 26 19:48:07.602707 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:07.602675    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-llv6b"]
May 26 19:48:07.607017 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:48:07.606978    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ae7993_bc4d_4043_98b4_b17438a8bd29.slice/crio-2e8fc2c908320ba1a0e7295d075f09ae6b1e9f400ba325316a3c08d21e140f3b WatchSource:0}: Error finding container 2e8fc2c908320ba1a0e7295d075f09ae6b1e9f400ba325316a3c08d21e140f3b: Status 404 returned error can't find the container with id 2e8fc2c908320ba1a0e7295d075f09ae6b1e9f400ba325316a3c08d21e140f3b
May 26 19:48:07.843130 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:07.843043    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-llv6b" event={"ID":"e7ae7993-bc4d-4043-98b4-b17438a8bd29","Type":"ContainerStarted","Data":"2e8fc2c908320ba1a0e7295d075f09ae6b1e9f400ba325316a3c08d21e140f3b"}
May 26 19:48:12.862640 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:12.862602    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-llv6b" event={"ID":"e7ae7993-bc4d-4043-98b4-b17438a8bd29","Type":"ContainerStarted","Data":"d8d2be4de0607d852567b883148dd9e7936eb67ef0e333d87be7843eb4b3e4b5"}
May 26 19:48:12.863022 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:12.862724    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-llv6b"
May 26 19:48:12.880301 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:12.880253    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-llv6b" podStartSLOduration=0.70871416 podStartE2EDuration="5.880239643s" podCreationTimestamp="2026-05-26 19:48:07 +0000 UTC" firstStartedPulling="2026-05-26 19:48:07.608910341 +0000 UTC m=+448.875246651" lastFinishedPulling="2026-05-26 19:48:12.780435808 +0000 UTC m=+454.046772134" observedRunningTime="2026-05-26 19:48:12.878293756 +0000 UTC m=+454.144630084" watchObservedRunningTime="2026-05-26 19:48:12.880239643 +0000 UTC m=+454.146575975"
May 26 19:48:16.816123 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:16.816090    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2"]
May 26 19:48:16.819371 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:16.819356    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2"
May 26 19:48:16.822131 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:16.822112    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-b8rpb\""
May 26 19:48:16.830167 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:16.830144    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2"]
May 26 19:48:16.944881 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:16.944842    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a77ef5f9-9b4b-4207-9a30-c03fafaa15d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-pnxh2\" (UID: \"a77ef5f9-9b4b-4207-9a30-c03fafaa15d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2"
May 26 19:48:16.945041 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:16.944889    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d8dgq\" (UniqueName: \"kubernetes.io/projected/a77ef5f9-9b4b-4207-9a30-c03fafaa15d2-kube-api-access-d8dgq\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-pnxh2\" (UID: \"a77ef5f9-9b4b-4207-9a30-c03fafaa15d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2"
May 26 19:48:17.045748 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:17.045663    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a77ef5f9-9b4b-4207-9a30-c03fafaa15d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-pnxh2\" (UID: \"a77ef5f9-9b4b-4207-9a30-c03fafaa15d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2"
May 26 19:48:17.045748 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:17.045712    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d8dgq\" (UniqueName: \"kubernetes.io/projected/a77ef5f9-9b4b-4207-9a30-c03fafaa15d2-kube-api-access-d8dgq\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-pnxh2\" (UID: \"a77ef5f9-9b4b-4207-9a30-c03fafaa15d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2"
May 26 19:48:17.046100 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:17.046077    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a77ef5f9-9b4b-4207-9a30-c03fafaa15d2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-pnxh2\" (UID: \"a77ef5f9-9b4b-4207-9a30-c03fafaa15d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2"
May 26 19:48:17.062973 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:17.062939    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d8dgq\" (UniqueName: \"kubernetes.io/projected/a77ef5f9-9b4b-4207-9a30-c03fafaa15d2-kube-api-access-d8dgq\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-pnxh2\" (UID: \"a77ef5f9-9b4b-4207-9a30-c03fafaa15d2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2"
May 26 19:48:17.129962 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:17.129926    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2"
May 26 19:48:17.481054 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:17.481013    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2"]
May 26 19:48:17.882758 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:17.882683    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2" event={"ID":"a77ef5f9-9b4b-4207-9a30-c03fafaa15d2","Type":"ContainerStarted","Data":"05b8ede2f398775de4586dcdf37e4ca511c461e8d36ba22345f5d0d1ea188b5a"}
May 26 19:48:23.868500 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:23.868467    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-llv6b"
May 26 19:48:23.906307 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:23.906273    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2" event={"ID":"a77ef5f9-9b4b-4207-9a30-c03fafaa15d2","Type":"ContainerStarted","Data":"ac7eb480e91d22d903b5f28586ca4d4fe41262aefea964df5d241e382c654232"}
May 26 19:48:23.906501 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:23.906426    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2"
May 26 19:48:23.925271 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:23.925219    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2" podStartSLOduration=2.495451255 podStartE2EDuration="7.925202614s" podCreationTimestamp="2026-05-26 19:48:16 +0000 UTC" firstStartedPulling="2026-05-26 19:48:17.488587063 +0000 UTC m=+458.754923377" lastFinishedPulling="2026-05-26 19:48:22.918338426 +0000 UTC m=+464.184674736" observedRunningTime="2026-05-26 19:48:23.923999734 +0000 UTC m=+465.190336066" watchObservedRunningTime="2026-05-26 19:48:23.925202614 +0000 UTC m=+465.191538946"
May 26 19:48:34.912566 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:34.912535    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2"
May 26 19:48:36.704817 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.704759    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2"]
May 26 19:48:36.705169 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.705004    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2" podUID="a77ef5f9-9b4b-4207-9a30-c03fafaa15d2" containerName="manager" containerID="cri-o://ac7eb480e91d22d903b5f28586ca4d4fe41262aefea964df5d241e382c654232" gracePeriod=2
May 26 19:48:36.707174 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.707140    2565 status_manager.go:895] "Failed to get status for pod" podUID="a77ef5f9-9b4b-4207-9a30-c03fafaa15d2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-pnxh2\" is forbidden: User \"system:node:ip-10-0-140-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-142.ec2.internal' and this object"
May 26 19:48:36.708422 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.708393    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2"]
May 26 19:48:36.729210 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.729181    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv"]
May 26 19:48:36.729656 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.729636    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a77ef5f9-9b4b-4207-9a30-c03fafaa15d2" containerName="manager"
May 26 19:48:36.729707 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.729660    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="a77ef5f9-9b4b-4207-9a30-c03fafaa15d2" containerName="manager"
May 26 19:48:36.729817 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.729799    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="a77ef5f9-9b4b-4207-9a30-c03fafaa15d2" containerName="manager"
May 26 19:48:36.737958 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.737924    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv"
May 26 19:48:36.740380 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.740345    2565 status_manager.go:895] "Failed to get status for pod" podUID="a77ef5f9-9b4b-4207-9a30-c03fafaa15d2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-pnxh2\" is forbidden: User \"system:node:ip-10-0-140-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-142.ec2.internal' and this object"
May 26 19:48:36.744156 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.744130    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv"]
May 26 19:48:36.770633 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.770604    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f9gk4"]
May 26 19:48:36.774084 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.774054    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f9gk4"
May 26 19:48:36.777539 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.777106    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-jfjw7\""
May 26 19:48:36.777868 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.777822    2565 status_manager.go:895] "Failed to get status for pod" podUID="a77ef5f9-9b4b-4207-9a30-c03fafaa15d2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-pnxh2\" is forbidden: User \"system:node:ip-10-0-140-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-142.ec2.internal' and this object"
May 26 19:48:36.783930 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.783833    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f9gk4"]
May 26 19:48:36.825149 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.825122    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4422632b-bf96-4277-b13d-4af7d39a246a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-98cdv\" (UID: \"4422632b-bf96-4277-b13d-4af7d39a246a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv"
May 26 19:48:36.825234 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.825178    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrxf8\" (UniqueName: \"kubernetes.io/projected/4422632b-bf96-4277-b13d-4af7d39a246a-kube-api-access-qrxf8\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-98cdv\" (UID: \"4422632b-bf96-4277-b13d-4af7d39a246a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv"
May 26 19:48:36.926474 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.926364    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4422632b-bf96-4277-b13d-4af7d39a246a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-98cdv\" (UID: \"4422632b-bf96-4277-b13d-4af7d39a246a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv"
May 26 19:48:36.926474 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.926458    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qrxf8\" (UniqueName: \"kubernetes.io/projected/4422632b-bf96-4277-b13d-4af7d39a246a-kube-api-access-qrxf8\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-98cdv\" (UID: \"4422632b-bf96-4277-b13d-4af7d39a246a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv"
May 26 19:48:36.926653 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.926550    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2d8v\" (UniqueName: \"kubernetes.io/projected/1b8ecc67-367d-498c-b3bc-a256df7b79af-kube-api-access-m2d8v\") pod \"limitador-operator-controller-manager-85c4996f8c-f9gk4\" (UID: \"1b8ecc67-367d-498c-b3bc-a256df7b79af\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f9gk4"
May 26 19:48:36.926843 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.926811    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4422632b-bf96-4277-b13d-4af7d39a246a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-98cdv\" (UID: \"4422632b-bf96-4277-b13d-4af7d39a246a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv"
May 26 19:48:36.935572 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.935550    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrxf8\" (UniqueName: \"kubernetes.io/projected/4422632b-bf96-4277-b13d-4af7d39a246a-kube-api-access-qrxf8\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-98cdv\" (UID: \"4422632b-bf96-4277-b13d-4af7d39a246a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv"
May 26 19:48:36.945226 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.945208    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2"
May 26 19:48:36.947664 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.947634    2565 status_manager.go:895] "Failed to get status for pod" podUID="a77ef5f9-9b4b-4207-9a30-c03fafaa15d2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-pnxh2\" is forbidden: User \"system:node:ip-10-0-140-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-142.ec2.internal' and this object"
May 26 19:48:36.951019 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.950997    2565 generic.go:358] "Generic (PLEG): container finished" podID="a77ef5f9-9b4b-4207-9a30-c03fafaa15d2" containerID="ac7eb480e91d22d903b5f28586ca4d4fe41262aefea964df5d241e382c654232" exitCode=0
May 26 19:48:36.951117 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.951040    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2"
May 26 19:48:36.951117 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.951048    2565 scope.go:117] "RemoveContainer" containerID="ac7eb480e91d22d903b5f28586ca4d4fe41262aefea964df5d241e382c654232"
May 26 19:48:36.953398 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.953373    2565 status_manager.go:895] "Failed to get status for pod" podUID="a77ef5f9-9b4b-4207-9a30-c03fafaa15d2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-pnxh2\" is forbidden: User \"system:node:ip-10-0-140-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-142.ec2.internal' and this object"
May 26 19:48:36.958691 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.958675    2565 scope.go:117] "RemoveContainer" containerID="ac7eb480e91d22d903b5f28586ca4d4fe41262aefea964df5d241e382c654232"
May 26 19:48:36.958949 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:48:36.958929    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac7eb480e91d22d903b5f28586ca4d4fe41262aefea964df5d241e382c654232\": container with ID starting with ac7eb480e91d22d903b5f28586ca4d4fe41262aefea964df5d241e382c654232 not found: ID does not exist" containerID="ac7eb480e91d22d903b5f28586ca4d4fe41262aefea964df5d241e382c654232"
May 26 19:48:36.959002 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:36.958956    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac7eb480e91d22d903b5f28586ca4d4fe41262aefea964df5d241e382c654232"} err="failed to get container status \"ac7eb480e91d22d903b5f28586ca4d4fe41262aefea964df5d241e382c654232\": rpc error: code = NotFound desc = could not find container \"ac7eb480e91d22d903b5f28586ca4d4fe41262aefea964df5d241e382c654232\": container with ID starting with ac7eb480e91d22d903b5f28586ca4d4fe41262aefea964df5d241e382c654232 not found: ID does not exist"
May 26 19:48:37.027883 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:37.027850    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2d8v\" (UniqueName: \"kubernetes.io/projected/1b8ecc67-367d-498c-b3bc-a256df7b79af-kube-api-access-m2d8v\") pod \"limitador-operator-controller-manager-85c4996f8c-f9gk4\" (UID: \"1b8ecc67-367d-498c-b3bc-a256df7b79af\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f9gk4"
May 26 19:48:37.037403 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:37.037374    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2d8v\" (UniqueName: \"kubernetes.io/projected/1b8ecc67-367d-498c-b3bc-a256df7b79af-kube-api-access-m2d8v\") pod \"limitador-operator-controller-manager-85c4996f8c-f9gk4\" (UID: \"1b8ecc67-367d-498c-b3bc-a256df7b79af\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f9gk4"
May 26 19:48:37.079975 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:37.079940    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv"
May 26 19:48:37.090781 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:37.090746    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f9gk4"
May 26 19:48:37.128916 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:37.128879    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a77ef5f9-9b4b-4207-9a30-c03fafaa15d2-extensions-socket-volume\") pod \"a77ef5f9-9b4b-4207-9a30-c03fafaa15d2\" (UID: \"a77ef5f9-9b4b-4207-9a30-c03fafaa15d2\") "
May 26 19:48:37.129060 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:37.128935    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d8dgq\" (UniqueName: \"kubernetes.io/projected/a77ef5f9-9b4b-4207-9a30-c03fafaa15d2-kube-api-access-d8dgq\") pod \"a77ef5f9-9b4b-4207-9a30-c03fafaa15d2\" (UID: \"a77ef5f9-9b4b-4207-9a30-c03fafaa15d2\") "
May 26 19:48:37.129568 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:37.129516    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a77ef5f9-9b4b-4207-9a30-c03fafaa15d2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a77ef5f9-9b4b-4207-9a30-c03fafaa15d2" (UID: "a77ef5f9-9b4b-4207-9a30-c03fafaa15d2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 19:48:37.133409 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:37.132217    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a77ef5f9-9b4b-4207-9a30-c03fafaa15d2-kube-api-access-d8dgq" (OuterVolumeSpecName: "kube-api-access-d8dgq") pod "a77ef5f9-9b4b-4207-9a30-c03fafaa15d2" (UID: "a77ef5f9-9b4b-4207-9a30-c03fafaa15d2"). InnerVolumeSpecName "kube-api-access-d8dgq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:48:37.223451 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:37.223412    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv"]
May 26 19:48:37.226039 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:48:37.226015    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4422632b_bf96_4277_b13d_4af7d39a246a.slice/crio-55a34e28bf15da8c44cbe1d5e61a471ff77dca5dea591e86d29fe5999e7b4f6b WatchSource:0}: Error finding container 55a34e28bf15da8c44cbe1d5e61a471ff77dca5dea591e86d29fe5999e7b4f6b: Status 404 returned error can't find the container with id 55a34e28bf15da8c44cbe1d5e61a471ff77dca5dea591e86d29fe5999e7b4f6b
May 26 19:48:37.229620 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:37.229596    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a77ef5f9-9b4b-4207-9a30-c03fafaa15d2-extensions-socket-volume\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:48:37.229620 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:37.229622    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d8dgq\" (UniqueName: \"kubernetes.io/projected/a77ef5f9-9b4b-4207-9a30-c03fafaa15d2-kube-api-access-d8dgq\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:48:37.244995 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:37.244971    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f9gk4"]
May 26 19:48:37.248279 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:48:37.248256    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b8ecc67_367d_498c_b3bc_a256df7b79af.slice/crio-262e6d952996f2e4f1a3241207fb81cb4948bd67fb686a50fa655886e564e90b WatchSource:0}: Error finding container 262e6d952996f2e4f1a3241207fb81cb4948bd67fb686a50fa655886e564e90b: Status 404 returned error can't find the container with id 262e6d952996f2e4f1a3241207fb81cb4948bd67fb686a50fa655886e564e90b
May 26 19:48:37.267621 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:37.267593    2565 status_manager.go:895] "Failed to get status for pod" podUID="a77ef5f9-9b4b-4207-9a30-c03fafaa15d2" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-pnxh2" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-pnxh2\" is forbidden: User \"system:node:ip-10-0-140-142.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-142.ec2.internal' and this object"
May 26 19:48:37.353160 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:37.353127    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a77ef5f9-9b4b-4207-9a30-c03fafaa15d2" path="/var/lib/kubelet/pods/a77ef5f9-9b4b-4207-9a30-c03fafaa15d2/volumes"
May 26 19:48:37.957014 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:37.956974    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f9gk4" event={"ID":"1b8ecc67-367d-498c-b3bc-a256df7b79af","Type":"ContainerStarted","Data":"262e6d952996f2e4f1a3241207fb81cb4948bd67fb686a50fa655886e564e90b"}
May 26 19:48:37.958458 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:37.958428    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv" event={"ID":"4422632b-bf96-4277-b13d-4af7d39a246a","Type":"ContainerStarted","Data":"2b4f293ac7cb6c373177338ec5147a0d65af1cf9c21dd0e6c89e8794ddf1d01a"}
May 26 19:48:37.958458 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:37.958463    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv" event={"ID":"4422632b-bf96-4277-b13d-4af7d39a246a","Type":"ContainerStarted","Data":"55a34e28bf15da8c44cbe1d5e61a471ff77dca5dea591e86d29fe5999e7b4f6b"}
May 26 19:48:37.958629 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:37.958507    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv"
May 26 19:48:37.978897 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:37.978821    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv" podStartSLOduration=1.978803674 podStartE2EDuration="1.978803674s" podCreationTimestamp="2026-05-26 19:48:36 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:48:37.976898479 +0000 UTC m=+479.243234813" watchObservedRunningTime="2026-05-26 19:48:37.978803674 +0000 UTC m=+479.245140008"
May 26 19:48:38.963872 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:38.963825    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f9gk4" event={"ID":"1b8ecc67-367d-498c-b3bc-a256df7b79af","Type":"ContainerStarted","Data":"f3e7778a244f024022d25bba4229f05f2f99cf6a6eaf0c914bb76bf179beeeda"}
May 26 19:48:38.963872 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:38.963868    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f9gk4"
May 26 19:48:38.981415 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:38.981365    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f9gk4" podStartSLOduration=1.465136794 podStartE2EDuration="2.981350845s" podCreationTimestamp="2026-05-26 19:48:36 +0000 UTC" firstStartedPulling="2026-05-26 19:48:37.25034763 +0000 UTC m=+478.516683941" lastFinishedPulling="2026-05-26 19:48:38.766561678 +0000 UTC m=+480.032897992" observedRunningTime="2026-05-26 19:48:38.979034991 +0000 UTC m=+480.245371324" watchObservedRunningTime="2026-05-26 19:48:38.981350845 +0000 UTC m=+480.247687176"
May 26 19:48:48.966276 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:48.966244    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv"
May 26 19:48:49.970009 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:49.969976    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-f9gk4"
May 26 19:48:52.713300 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:52.713265    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv"]
May 26 19:48:52.713704 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:52.713495    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv" podUID="4422632b-bf96-4277-b13d-4af7d39a246a" containerName="manager" containerID="cri-o://2b4f293ac7cb6c373177338ec5147a0d65af1cf9c21dd0e6c89e8794ddf1d01a" gracePeriod=10
May 26 19:48:52.923194 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:52.923159    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6"]
May 26 19:48:52.925361 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:52.925335    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6"
May 26 19:48:52.940317 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:52.940287    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6"]
May 26 19:48:52.957155 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:52.957127    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv9rp\" (UniqueName: \"kubernetes.io/projected/d442f429-5a18-41fa-979d-c50016a7e8e8-kube-api-access-rv9rp\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8qnt6\" (UID: \"d442f429-5a18-41fa-979d-c50016a7e8e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6"
May 26 19:48:52.957262 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:52.957228    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d442f429-5a18-41fa-979d-c50016a7e8e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8qnt6\" (UID: \"d442f429-5a18-41fa-979d-c50016a7e8e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6"
May 26 19:48:52.967551 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:52.967492    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv"
May 26 19:48:53.021565 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.021523    2565 generic.go:358] "Generic (PLEG): container finished" podID="4422632b-bf96-4277-b13d-4af7d39a246a" containerID="2b4f293ac7cb6c373177338ec5147a0d65af1cf9c21dd0e6c89e8794ddf1d01a" exitCode=0
May 26 19:48:53.021794 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.021593    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv"
May 26 19:48:53.021794 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.021611    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv" event={"ID":"4422632b-bf96-4277-b13d-4af7d39a246a","Type":"ContainerDied","Data":"2b4f293ac7cb6c373177338ec5147a0d65af1cf9c21dd0e6c89e8794ddf1d01a"}
May 26 19:48:53.021794 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.021660    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv" event={"ID":"4422632b-bf96-4277-b13d-4af7d39a246a","Type":"ContainerDied","Data":"55a34e28bf15da8c44cbe1d5e61a471ff77dca5dea591e86d29fe5999e7b4f6b"}
May 26 19:48:53.021794 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.021681    2565 scope.go:117] "RemoveContainer" containerID="2b4f293ac7cb6c373177338ec5147a0d65af1cf9c21dd0e6c89e8794ddf1d01a"
May 26 19:48:53.029929 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.029910    2565 scope.go:117] "RemoveContainer" containerID="2b4f293ac7cb6c373177338ec5147a0d65af1cf9c21dd0e6c89e8794ddf1d01a"
May 26 19:48:53.030184 ip-10-0-140-142 kubenswrapper[2565]: E0526 19:48:53.030165    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b4f293ac7cb6c373177338ec5147a0d65af1cf9c21dd0e6c89e8794ddf1d01a\": container with ID starting with 2b4f293ac7cb6c373177338ec5147a0d65af1cf9c21dd0e6c89e8794ddf1d01a not found: ID does not exist" containerID="2b4f293ac7cb6c373177338ec5147a0d65af1cf9c21dd0e6c89e8794ddf1d01a"
May 26 19:48:53.030232 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.030198    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b4f293ac7cb6c373177338ec5147a0d65af1cf9c21dd0e6c89e8794ddf1d01a"} err="failed to get container status \"2b4f293ac7cb6c373177338ec5147a0d65af1cf9c21dd0e6c89e8794ddf1d01a\": rpc error: code = NotFound desc = could not find container \"2b4f293ac7cb6c373177338ec5147a0d65af1cf9c21dd0e6c89e8794ddf1d01a\": container with ID starting with 2b4f293ac7cb6c373177338ec5147a0d65af1cf9c21dd0e6c89e8794ddf1d01a not found: ID does not exist"
May 26 19:48:53.058565 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.058525    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4422632b-bf96-4277-b13d-4af7d39a246a-extensions-socket-volume\") pod \"4422632b-bf96-4277-b13d-4af7d39a246a\" (UID: \"4422632b-bf96-4277-b13d-4af7d39a246a\") "
May 26 19:48:53.058565 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.058571    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qrxf8\" (UniqueName: \"kubernetes.io/projected/4422632b-bf96-4277-b13d-4af7d39a246a-kube-api-access-qrxf8\") pod \"4422632b-bf96-4277-b13d-4af7d39a246a\" (UID: \"4422632b-bf96-4277-b13d-4af7d39a246a\") "
May 26 19:48:53.058805 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.058706    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rv9rp\" (UniqueName: \"kubernetes.io/projected/d442f429-5a18-41fa-979d-c50016a7e8e8-kube-api-access-rv9rp\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8qnt6\" (UID: \"d442f429-5a18-41fa-979d-c50016a7e8e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6"
May 26 19:48:53.058805 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.058778    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d442f429-5a18-41fa-979d-c50016a7e8e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8qnt6\" (UID: \"d442f429-5a18-41fa-979d-c50016a7e8e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6"
May 26 19:48:53.059037 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.059011    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4422632b-bf96-4277-b13d-4af7d39a246a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "4422632b-bf96-4277-b13d-4af7d39a246a" (UID: "4422632b-bf96-4277-b13d-4af7d39a246a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 19:48:53.059141 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.059122    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d442f429-5a18-41fa-979d-c50016a7e8e8-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8qnt6\" (UID: \"d442f429-5a18-41fa-979d-c50016a7e8e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6"
May 26 19:48:53.060865 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.060845    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4422632b-bf96-4277-b13d-4af7d39a246a-kube-api-access-qrxf8" (OuterVolumeSpecName: "kube-api-access-qrxf8") pod "4422632b-bf96-4277-b13d-4af7d39a246a" (UID: "4422632b-bf96-4277-b13d-4af7d39a246a"). InnerVolumeSpecName "kube-api-access-qrxf8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 19:48:53.070403 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.070375    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv9rp\" (UniqueName: \"kubernetes.io/projected/d442f429-5a18-41fa-979d-c50016a7e8e8-kube-api-access-rv9rp\") pod \"kuadrant-operator-controller-manager-55c7f4c975-8qnt6\" (UID: \"d442f429-5a18-41fa-979d-c50016a7e8e8\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6"
May 26 19:48:53.159446 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.159414    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/4422632b-bf96-4277-b13d-4af7d39a246a-extensions-socket-volume\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:48:53.159446 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.159443    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qrxf8\" (UniqueName: \"kubernetes.io/projected/4422632b-bf96-4277-b13d-4af7d39a246a-kube-api-access-qrxf8\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 19:48:53.235260 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.235173    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6"
May 26 19:48:53.359431 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.359400    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv"]
May 26 19:48:53.368961 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.368936    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-98cdv"]
May 26 19:48:53.381327 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:53.381295    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6"]
May 26 19:48:53.383863 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:48:53.383832    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd442f429_5a18_41fa_979d_c50016a7e8e8.slice/crio-9ec9e0275f9d7aa5920e0813fa780130cc176811171191112eef6228b14d8f08 WatchSource:0}: Error finding container 9ec9e0275f9d7aa5920e0813fa780130cc176811171191112eef6228b14d8f08: Status 404 returned error can't find the container with id 9ec9e0275f9d7aa5920e0813fa780130cc176811171191112eef6228b14d8f08
May 26 19:48:54.027010 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:54.026973    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6" event={"ID":"d442f429-5a18-41fa-979d-c50016a7e8e8","Type":"ContainerStarted","Data":"e084afb3069b34260b270f1b58f3106dd74587978dce665ca9872bf3ab19a03a"}
May 26 19:48:54.027010 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:54.027013    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6" event={"ID":"d442f429-5a18-41fa-979d-c50016a7e8e8","Type":"ContainerStarted","Data":"9ec9e0275f9d7aa5920e0813fa780130cc176811171191112eef6228b14d8f08"}
May 26 19:48:54.027503 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:54.027079    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6"
May 26 19:48:54.045315 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:54.045267    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6" podStartSLOduration=2.045249939 podStartE2EDuration="2.045249939s" podCreationTimestamp="2026-05-26 19:48:52 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 19:48:54.044519348 +0000 UTC m=+495.310855682" watchObservedRunningTime="2026-05-26 19:48:54.045249939 +0000 UTC m=+495.311586272"
May 26 19:48:55.353360 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:48:55.353330    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4422632b-bf96-4277-b13d-4af7d39a246a" path="/var/lib/kubelet/pods/4422632b-bf96-4277-b13d-4af7d39a246a/volumes"
May 26 19:49:05.034488 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:49:05.034450    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6"
May 26 19:50:39.289205 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:39.289174    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/2.log"
May 26 19:50:39.290658 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:39.290635    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/2.log"
May 26 19:50:39.294431 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:39.294403    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/ovn-acl-logging/0.log"
May 26 19:50:39.295786 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:39.295756    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/ovn-acl-logging/0.log"
May 26 19:50:59.157659 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.157578    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"]
May 26 19:50:59.160071 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.157994    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4422632b-bf96-4277-b13d-4af7d39a246a" containerName="manager"
May 26 19:50:59.160071 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.158007    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4422632b-bf96-4277-b13d-4af7d39a246a" containerName="manager"
May 26 19:50:59.160071 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.158072    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="4422632b-bf96-4277-b13d-4af7d39a246a" containerName="manager"
May 26 19:50:59.161000 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.160984    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:50:59.163458 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.163437    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 26 19:50:59.163576 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.163485    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 26 19:50:59.164436 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.164417    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
May 26 19:50:59.164531 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.164449    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-r7z6f\""
May 26 19:50:59.171695 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.171676    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"]
May 26 19:50:59.226184 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.226149    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb282fb-0e04-4bf9-b04b-c5f27702c27a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-64l74\" (UID: \"5bb282fb-0e04-4bf9-b04b-c5f27702c27a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:50:59.226353 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.226192    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrkww\" (UniqueName: \"kubernetes.io/projected/5bb282fb-0e04-4bf9-b04b-c5f27702c27a-kube-api-access-rrkww\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-64l74\" (UID: \"5bb282fb-0e04-4bf9-b04b-c5f27702c27a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:50:59.226353 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.226250    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5bb282fb-0e04-4bf9-b04b-c5f27702c27a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-64l74\" (UID: \"5bb282fb-0e04-4bf9-b04b-c5f27702c27a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:50:59.226353 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.226272    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bb282fb-0e04-4bf9-b04b-c5f27702c27a-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-64l74\" (UID: \"5bb282fb-0e04-4bf9-b04b-c5f27702c27a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:50:59.226353 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.226304    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bb282fb-0e04-4bf9-b04b-c5f27702c27a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-64l74\" (UID: \"5bb282fb-0e04-4bf9-b04b-c5f27702c27a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:50:59.226353 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.226326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bb282fb-0e04-4bf9-b04b-c5f27702c27a-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-64l74\" (UID: \"5bb282fb-0e04-4bf9-b04b-c5f27702c27a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:50:59.327434 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.327393    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb282fb-0e04-4bf9-b04b-c5f27702c27a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-64l74\" (UID: \"5bb282fb-0e04-4bf9-b04b-c5f27702c27a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:50:59.327629 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.327446    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rrkww\" (UniqueName: \"kubernetes.io/projected/5bb282fb-0e04-4bf9-b04b-c5f27702c27a-kube-api-access-rrkww\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-64l74\" (UID: \"5bb282fb-0e04-4bf9-b04b-c5f27702c27a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:50:59.327629 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.327497    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5bb282fb-0e04-4bf9-b04b-c5f27702c27a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-64l74\" (UID: \"5bb282fb-0e04-4bf9-b04b-c5f27702c27a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:50:59.327629 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.327526    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bb282fb-0e04-4bf9-b04b-c5f27702c27a-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-64l74\" (UID: \"5bb282fb-0e04-4bf9-b04b-c5f27702c27a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:50:59.327629 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.327562    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bb282fb-0e04-4bf9-b04b-c5f27702c27a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-64l74\" (UID: \"5bb282fb-0e04-4bf9-b04b-c5f27702c27a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:50:59.327629 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.327595    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bb282fb-0e04-4bf9-b04b-c5f27702c27a-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-64l74\" (UID: \"5bb282fb-0e04-4bf9-b04b-c5f27702c27a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:50:59.328021 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.327986    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5bb282fb-0e04-4bf9-b04b-c5f27702c27a-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-64l74\" (UID: \"5bb282fb-0e04-4bf9-b04b-c5f27702c27a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:50:59.328141 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.328115    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5bb282fb-0e04-4bf9-b04b-c5f27702c27a-model-cache\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-64l74\" (UID: \"5bb282fb-0e04-4bf9-b04b-c5f27702c27a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:50:59.328298 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.328276    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5bb282fb-0e04-4bf9-b04b-c5f27702c27a-home\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-64l74\" (UID: \"5bb282fb-0e04-4bf9-b04b-c5f27702c27a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:50:59.330113 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.330089    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5bb282fb-0e04-4bf9-b04b-c5f27702c27a-dshm\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-64l74\" (UID: \"5bb282fb-0e04-4bf9-b04b-c5f27702c27a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:50:59.330333 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.330315    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5bb282fb-0e04-4bf9-b04b-c5f27702c27a-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-64l74\" (UID: \"5bb282fb-0e04-4bf9-b04b-c5f27702c27a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:50:59.335366 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.335346    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrkww\" (UniqueName: \"kubernetes.io/projected/5bb282fb-0e04-4bf9-b04b-c5f27702c27a-kube-api-access-rrkww\") pod \"e2e-trlp-test-simulated-kserve-84db68679b-64l74\" (UID: \"5bb282fb-0e04-4bf9-b04b-c5f27702c27a\") " pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:50:59.472137 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.472107    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:50:59.607237 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.607209    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"]
May 26 19:50:59.610090 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:50:59.610059    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bb282fb_0e04_4bf9_b04b_c5f27702c27a.slice/crio-b2b779c89c45549a0a9c8bc66a51be1e1e7549fd5c3126c87202c99541f1efe5 WatchSource:0}: Error finding container b2b779c89c45549a0a9c8bc66a51be1e1e7549fd5c3126c87202c99541f1efe5: Status 404 returned error can't find the container with id b2b779c89c45549a0a9c8bc66a51be1e1e7549fd5c3126c87202c99541f1efe5
May 26 19:50:59.611900 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:50:59.611879    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 19:51:00.460449 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:00.460404    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74" event={"ID":"5bb282fb-0e04-4bf9-b04b-c5f27702c27a","Type":"ContainerStarted","Data":"b2b779c89c45549a0a9c8bc66a51be1e1e7549fd5c3126c87202c99541f1efe5"}
May 26 19:51:05.481653 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:05.481615    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74" event={"ID":"5bb282fb-0e04-4bf9-b04b-c5f27702c27a","Type":"ContainerStarted","Data":"0c28d79d5e7991ea84b51e96c2acc41d49796080229ce4a9c57ad1588336860e"}
May 26 19:51:10.501413 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:10.501377    2565 generic.go:358] "Generic (PLEG): container finished" podID="5bb282fb-0e04-4bf9-b04b-c5f27702c27a" containerID="0c28d79d5e7991ea84b51e96c2acc41d49796080229ce4a9c57ad1588336860e" exitCode=0
May 26 19:51:10.501792 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:10.501425    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74" event={"ID":"5bb282fb-0e04-4bf9-b04b-c5f27702c27a","Type":"ContainerDied","Data":"0c28d79d5e7991ea84b51e96c2acc41d49796080229ce4a9c57ad1588336860e"}
May 26 19:51:12.513143 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:12.513108    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74" event={"ID":"5bb282fb-0e04-4bf9-b04b-c5f27702c27a","Type":"ContainerStarted","Data":"e362ec6bd25d914b185b2e465ea4b75fe145aa151c56c15ce5421a485c298147"}
May 26 19:51:12.513535 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:12.513333    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:51:12.531122 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:12.531079    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74" podStartSLOduration=1.57084644 podStartE2EDuration="13.531067617s" podCreationTimestamp="2026-05-26 19:50:59 +0000 UTC" firstStartedPulling="2026-05-26 19:50:59.612040012 +0000 UTC m=+620.878376323" lastFinishedPulling="2026-05-26 19:51:11.57226119 +0000 UTC m=+632.838597500" observedRunningTime="2026-05-26 19:51:12.530894424 +0000 UTC m=+633.797230755" watchObservedRunningTime="2026-05-26 19:51:12.531067617 +0000 UTC m=+633.797403948"
May 26 19:51:14.363659 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.363621    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"]
May 26 19:51:14.367452 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.367427    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:14.369779 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.369745    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 26 19:51:14.375501 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.375477    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"]
May 26 19:51:14.468045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.468010    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc\" (UID: \"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:14.468045 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.468048    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc\" (UID: \"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:14.468242 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.468132    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc\" (UID: \"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:14.468242 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.468196    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t9j7\" (UniqueName: \"kubernetes.io/projected/1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7-kube-api-access-5t9j7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc\" (UID: \"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:14.468242 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.468217    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc\" (UID: \"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:14.468340 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.468267    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc\" (UID: \"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:14.569187 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.569145    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc\" (UID: \"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:14.569363 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.569205    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5t9j7\" (UniqueName: \"kubernetes.io/projected/1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7-kube-api-access-5t9j7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc\" (UID: \"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:14.569363 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.569225    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc\" (UID: \"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:14.569363 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.569271    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc\" (UID: \"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:14.569363 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.569297    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc\" (UID: \"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:14.569363 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.569327    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc\" (UID: \"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:14.569820 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.569791    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc\" (UID: \"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:14.569988 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.569812    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc\" (UID: \"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:14.570107 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.569832    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc\" (UID: \"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:14.571637 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.571615    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc\" (UID: \"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:14.572039 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.572017    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc\" (UID: \"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:14.577284 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.577261    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t9j7\" (UniqueName: \"kubernetes.io/projected/1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7-kube-api-access-5t9j7\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc\" (UID: \"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:14.678544 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.678452    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:14.813078 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:14.813048    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"]
May 26 19:51:14.815159 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:51:14.815132    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fa74cb0_11c8_4db5_8ceb_89c67aa6d1e7.slice/crio-c3a4c741c7e8b533c664ded39ff415e228ec8c961150b3c4b962d25af3fc7997 WatchSource:0}: Error finding container c3a4c741c7e8b533c664ded39ff415e228ec8c961150b3c4b962d25af3fc7997: Status 404 returned error can't find the container with id c3a4c741c7e8b533c664ded39ff415e228ec8c961150b3c4b962d25af3fc7997
May 26 19:51:15.524729 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:15.524685    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc" event={"ID":"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7","Type":"ContainerStarted","Data":"2ffc58dda6aee758025af45c68b526c71c45d087369fb9f3cb5d1b933a6b94b0"}
May 26 19:51:15.525161 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:15.524737    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc" event={"ID":"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7","Type":"ContainerStarted","Data":"c3a4c741c7e8b533c664ded39ff415e228ec8c961150b3c4b962d25af3fc7997"}
May 26 19:51:19.059613 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.059572    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"]
May 26 19:51:19.066977 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.066954    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:19.069437 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.069416    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 26 19:51:19.074690 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.074663    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"]
May 26 19:51:19.217379 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.217347    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35b5ece0-ee34-4c60-8712-6afdee1c14ff-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw\" (UID: \"35b5ece0-ee34-4c60-8712-6afdee1c14ff\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:19.217531 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.217399    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35b5ece0-ee34-4c60-8712-6afdee1c14ff-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw\" (UID: \"35b5ece0-ee34-4c60-8712-6afdee1c14ff\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:19.217531 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.217417    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35b5ece0-ee34-4c60-8712-6afdee1c14ff-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw\" (UID: \"35b5ece0-ee34-4c60-8712-6afdee1c14ff\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:19.217603 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.217532    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6jwd\" (UniqueName: \"kubernetes.io/projected/35b5ece0-ee34-4c60-8712-6afdee1c14ff-kube-api-access-n6jwd\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw\" (UID: \"35b5ece0-ee34-4c60-8712-6afdee1c14ff\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:19.217603 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.217561    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/35b5ece0-ee34-4c60-8712-6afdee1c14ff-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw\" (UID: \"35b5ece0-ee34-4c60-8712-6afdee1c14ff\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:19.217603 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.217589    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35b5ece0-ee34-4c60-8712-6afdee1c14ff-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw\" (UID: \"35b5ece0-ee34-4c60-8712-6afdee1c14ff\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:19.318107 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.318009    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n6jwd\" (UniqueName: \"kubernetes.io/projected/35b5ece0-ee34-4c60-8712-6afdee1c14ff-kube-api-access-n6jwd\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw\" (UID: \"35b5ece0-ee34-4c60-8712-6afdee1c14ff\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:19.318107 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.318052    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/35b5ece0-ee34-4c60-8712-6afdee1c14ff-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw\" (UID: \"35b5ece0-ee34-4c60-8712-6afdee1c14ff\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:19.318107 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.318076    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35b5ece0-ee34-4c60-8712-6afdee1c14ff-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw\" (UID: \"35b5ece0-ee34-4c60-8712-6afdee1c14ff\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:19.318401 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.318115    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35b5ece0-ee34-4c60-8712-6afdee1c14ff-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw\" (UID: \"35b5ece0-ee34-4c60-8712-6afdee1c14ff\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:19.318401 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.318153    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35b5ece0-ee34-4c60-8712-6afdee1c14ff-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw\" (UID: \"35b5ece0-ee34-4c60-8712-6afdee1c14ff\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:19.318401 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.318177    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35b5ece0-ee34-4c60-8712-6afdee1c14ff-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw\" (UID: \"35b5ece0-ee34-4c60-8712-6afdee1c14ff\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:19.318583 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.318557    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/35b5ece0-ee34-4c60-8712-6afdee1c14ff-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw\" (UID: \"35b5ece0-ee34-4c60-8712-6afdee1c14ff\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:19.318640 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.318587    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/35b5ece0-ee34-4c60-8712-6afdee1c14ff-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw\" (UID: \"35b5ece0-ee34-4c60-8712-6afdee1c14ff\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:19.318640 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.318628    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/35b5ece0-ee34-4c60-8712-6afdee1c14ff-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw\" (UID: \"35b5ece0-ee34-4c60-8712-6afdee1c14ff\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:19.320492 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.320461    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/35b5ece0-ee34-4c60-8712-6afdee1c14ff-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw\" (UID: \"35b5ece0-ee34-4c60-8712-6afdee1c14ff\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:19.320718 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.320697    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/35b5ece0-ee34-4c60-8712-6afdee1c14ff-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw\" (UID: \"35b5ece0-ee34-4c60-8712-6afdee1c14ff\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:19.325647 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.325624    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6jwd\" (UniqueName: \"kubernetes.io/projected/35b5ece0-ee34-4c60-8712-6afdee1c14ff-kube-api-access-n6jwd\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw\" (UID: \"35b5ece0-ee34-4c60-8712-6afdee1c14ff\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:19.380015 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.379983    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:19.517209 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.517182    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"]
May 26 19:51:19.518940 ip-10-0-140-142 kubenswrapper[2565]: W0526 19:51:19.518904    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35b5ece0_ee34_4c60_8712_6afdee1c14ff.slice/crio-120d28bb7e8bd967e80307b7c10402bb1e6b6320d3e438112e23e7d580e84a34 WatchSource:0}: Error finding container 120d28bb7e8bd967e80307b7c10402bb1e6b6320d3e438112e23e7d580e84a34: Status 404 returned error can't find the container with id 120d28bb7e8bd967e80307b7c10402bb1e6b6320d3e438112e23e7d580e84a34
May 26 19:51:19.540195 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:19.540168    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw" event={"ID":"35b5ece0-ee34-4c60-8712-6afdee1c14ff","Type":"ContainerStarted","Data":"120d28bb7e8bd967e80307b7c10402bb1e6b6320d3e438112e23e7d580e84a34"}
May 26 19:51:20.546023 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:20.545941    2565 generic.go:358] "Generic (PLEG): container finished" podID="1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7" containerID="2ffc58dda6aee758025af45c68b526c71c45d087369fb9f3cb5d1b933a6b94b0" exitCode=0
May 26 19:51:20.546506 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:20.546014    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc" event={"ID":"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7","Type":"ContainerDied","Data":"2ffc58dda6aee758025af45c68b526c71c45d087369fb9f3cb5d1b933a6b94b0"}
May 26 19:51:20.547569 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:20.547547    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw" event={"ID":"35b5ece0-ee34-4c60-8712-6afdee1c14ff","Type":"ContainerStarted","Data":"4bcf01d2397239986fabdee45db9076ce803d4ae82659782d59926d263bfda2d"}
May 26 19:51:21.553449 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:21.553403    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc" event={"ID":"1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7","Type":"ContainerStarted","Data":"e49338be8b459def80484ee571932ae1b86249e6477f19d6c2cf4c0c479f4a85"}
May 26 19:51:21.553863 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:21.553742    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:21.572183 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:21.572113    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc" podStartSLOduration=7.163913135 podStartE2EDuration="7.572092557s" podCreationTimestamp="2026-05-26 19:51:14 +0000 UTC" firstStartedPulling="2026-05-26 19:51:20.546842374 +0000 UTC m=+641.813178684" lastFinishedPulling="2026-05-26 19:51:20.955021793 +0000 UTC m=+642.221358106" observedRunningTime="2026-05-26 19:51:21.571108163 +0000 UTC m=+642.837444507" watchObservedRunningTime="2026-05-26 19:51:21.572092557 +0000 UTC m=+642.838428889"
May 26 19:51:23.529514 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:23.529474    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-84db68679b-64l74"
May 26 19:51:25.568296 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:25.568262    2565 generic.go:358] "Generic (PLEG): container finished" podID="35b5ece0-ee34-4c60-8712-6afdee1c14ff" containerID="4bcf01d2397239986fabdee45db9076ce803d4ae82659782d59926d263bfda2d" exitCode=0
May 26 19:51:25.568657 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:25.568340    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw" event={"ID":"35b5ece0-ee34-4c60-8712-6afdee1c14ff","Type":"ContainerDied","Data":"4bcf01d2397239986fabdee45db9076ce803d4ae82659782d59926d263bfda2d"}
May 26 19:51:26.574082 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:26.574044    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw" event={"ID":"35b5ece0-ee34-4c60-8712-6afdee1c14ff","Type":"ContainerStarted","Data":"0fc8220d49f559f969fd581e201cc553db8d120d8d447be7c6c0524e753defbd"}
May 26 19:51:26.574459 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:26.574260    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:51:26.592207 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:26.592160    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw" podStartSLOduration=7.335686882 podStartE2EDuration="7.5921473s" podCreationTimestamp="2026-05-26 19:51:19 +0000 UTC" firstStartedPulling="2026-05-26 19:51:25.569011269 +0000 UTC m=+646.835347580" lastFinishedPulling="2026-05-26 19:51:25.825471689 +0000 UTC m=+647.091807998" observedRunningTime="2026-05-26 19:51:26.591168775 +0000 UTC m=+647.857505106" watchObservedRunningTime="2026-05-26 19:51:26.5921473 +0000 UTC m=+647.858483643"
May 26 19:51:32.570087 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:32.570051    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc"
May 26 19:51:37.590981 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:51:37.590942    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw"
May 26 19:55:39.314401 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:55:39.314373    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/2.log"
May 26 19:55:39.316479 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:55:39.316448    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/2.log"
May 26 19:55:39.319679 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:55:39.319663    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/ovn-acl-logging/0.log"
May 26 19:55:39.321701 ip-10-0-140-142 kubenswrapper[2565]: I0526 19:55:39.321684    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/ovn-acl-logging/0.log"
May 26 20:00:00.140673 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:00.140593    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29663760-24rss"]
May 26 20:00:00.144107 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:00.144090    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663760-24rss"
May 26 20:00:00.146514 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:00.146490    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-xn848\""
May 26 20:00:00.157938 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:00.157904    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29663760-24rss"]
May 26 20:00:00.198734 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:00.198685    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-trp7n\" (UniqueName: \"kubernetes.io/projected/c248dc09-b1cc-4c37-96c2-a409d123808d-kube-api-access-trp7n\") pod \"maas-api-key-cleanup-29663760-24rss\" (UID: \"c248dc09-b1cc-4c37-96c2-a409d123808d\") " pod="opendatahub/maas-api-key-cleanup-29663760-24rss"
May 26 20:00:00.299788 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:00.299740    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-trp7n\" (UniqueName: \"kubernetes.io/projected/c248dc09-b1cc-4c37-96c2-a409d123808d-kube-api-access-trp7n\") pod \"maas-api-key-cleanup-29663760-24rss\" (UID: \"c248dc09-b1cc-4c37-96c2-a409d123808d\") " pod="opendatahub/maas-api-key-cleanup-29663760-24rss"
May 26 20:00:00.308762 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:00.308742    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-trp7n\" (UniqueName: \"kubernetes.io/projected/c248dc09-b1cc-4c37-96c2-a409d123808d-kube-api-access-trp7n\") pod \"maas-api-key-cleanup-29663760-24rss\" (UID: \"c248dc09-b1cc-4c37-96c2-a409d123808d\") " pod="opendatahub/maas-api-key-cleanup-29663760-24rss"
May 26 20:00:00.454195 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:00.454155    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663760-24rss"
May 26 20:00:00.589634 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:00.589605    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29663760-24rss"]
May 26 20:00:00.591402 ip-10-0-140-142 kubenswrapper[2565]: W0526 20:00:00.591372    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc248dc09_b1cc_4c37_96c2_a409d123808d.slice/crio-e519af55495492591f6fd699d55a0c773d185601f9c8331935f2b01c7f90b03e WatchSource:0}: Error finding container e519af55495492591f6fd699d55a0c773d185601f9c8331935f2b01c7f90b03e: Status 404 returned error can't find the container with id e519af55495492591f6fd699d55a0c773d185601f9c8331935f2b01c7f90b03e
May 26 20:00:00.593224 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:00.593202    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 20:00:01.380700 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:01.380669    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663760-24rss" event={"ID":"c248dc09-b1cc-4c37-96c2-a409d123808d","Type":"ContainerStarted","Data":"e519af55495492591f6fd699d55a0c773d185601f9c8331935f2b01c7f90b03e"}
May 26 20:00:04.393360 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:04.393320    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663760-24rss" event={"ID":"c248dc09-b1cc-4c37-96c2-a409d123808d","Type":"ContainerStarted","Data":"ca0e16a5674f66bbfb809ffbf01319c4d5c130217c69f46bd255c3388c165015"}
May 26 20:00:04.410544 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:04.410497    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29663760-24rss" podStartSLOduration=1.0798942519999999 podStartE2EDuration="4.410483032s" podCreationTimestamp="2026-05-26 20:00:00 +0000 UTC" firstStartedPulling="2026-05-26 20:00:00.593397966 +0000 UTC m=+1161.859734280" lastFinishedPulling="2026-05-26 20:00:03.923986751 +0000 UTC m=+1165.190323060" observedRunningTime="2026-05-26 20:00:04.408080926 +0000 UTC m=+1165.674417257" watchObservedRunningTime="2026-05-26 20:00:04.410483032 +0000 UTC m=+1165.676819363"
May 26 20:00:05.398075 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:05.397987    2565 generic.go:358] "Generic (PLEG): container finished" podID="c248dc09-b1cc-4c37-96c2-a409d123808d" containerID="ca0e16a5674f66bbfb809ffbf01319c4d5c130217c69f46bd255c3388c165015" exitCode=0
May 26 20:00:05.398075 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:05.398028    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663760-24rss" event={"ID":"c248dc09-b1cc-4c37-96c2-a409d123808d","Type":"ContainerDied","Data":"ca0e16a5674f66bbfb809ffbf01319c4d5c130217c69f46bd255c3388c165015"}
May 26 20:00:06.540324 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:06.540302    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663760-24rss"
May 26 20:00:06.545588 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:06.545568    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-trp7n\" (UniqueName: \"kubernetes.io/projected/c248dc09-b1cc-4c37-96c2-a409d123808d-kube-api-access-trp7n\") pod \"c248dc09-b1cc-4c37-96c2-a409d123808d\" (UID: \"c248dc09-b1cc-4c37-96c2-a409d123808d\") "
May 26 20:00:06.547542 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:06.547523    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c248dc09-b1cc-4c37-96c2-a409d123808d-kube-api-access-trp7n" (OuterVolumeSpecName: "kube-api-access-trp7n") pod "c248dc09-b1cc-4c37-96c2-a409d123808d" (UID: "c248dc09-b1cc-4c37-96c2-a409d123808d"). InnerVolumeSpecName "kube-api-access-trp7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 20:00:06.646545 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:06.646506    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-trp7n\" (UniqueName: \"kubernetes.io/projected/c248dc09-b1cc-4c37-96c2-a409d123808d-kube-api-access-trp7n\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 20:00:07.408959 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:07.408923    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663760-24rss" event={"ID":"c248dc09-b1cc-4c37-96c2-a409d123808d","Type":"ContainerDied","Data":"e519af55495492591f6fd699d55a0c773d185601f9c8331935f2b01c7f90b03e"}
May 26 20:00:07.408959 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:07.408959    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663760-24rss"
May 26 20:00:07.409167 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:07.408963    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e519af55495492591f6fd699d55a0c773d185601f9c8331935f2b01c7f90b03e"
May 26 20:00:39.343119 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:39.343086    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/2.log"
May 26 20:00:39.346274 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:39.346247    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/2.log"
May 26 20:00:39.348973 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:39.348948    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/ovn-acl-logging/0.log"
May 26 20:00:39.352759 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:00:39.352736    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/ovn-acl-logging/0.log"
May 26 20:03:42.172128 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:03:42.172089    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6"]
May 26 20:03:42.173484 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:03:42.172334    2565 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6" podUID="d442f429-5a18-41fa-979d-c50016a7e8e8" containerName="manager" containerID="cri-o://e084afb3069b34260b270f1b58f3106dd74587978dce665ca9872bf3ab19a03a" gracePeriod=10
May 26 20:03:42.431227 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:03:42.431204    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6"
May 26 20:03:42.568125 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:03:42.568092    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv9rp\" (UniqueName: \"kubernetes.io/projected/d442f429-5a18-41fa-979d-c50016a7e8e8-kube-api-access-rv9rp\") pod \"d442f429-5a18-41fa-979d-c50016a7e8e8\" (UID: \"d442f429-5a18-41fa-979d-c50016a7e8e8\") "
May 26 20:03:42.568125 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:03:42.568131    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d442f429-5a18-41fa-979d-c50016a7e8e8-extensions-socket-volume\") pod \"d442f429-5a18-41fa-979d-c50016a7e8e8\" (UID: \"d442f429-5a18-41fa-979d-c50016a7e8e8\") "
May 26 20:03:42.568532 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:03:42.568504    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d442f429-5a18-41fa-979d-c50016a7e8e8-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d442f429-5a18-41fa-979d-c50016a7e8e8" (UID: "d442f429-5a18-41fa-979d-c50016a7e8e8"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 26 20:03:42.570236 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:03:42.570208    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d442f429-5a18-41fa-979d-c50016a7e8e8-kube-api-access-rv9rp" (OuterVolumeSpecName: "kube-api-access-rv9rp") pod "d442f429-5a18-41fa-979d-c50016a7e8e8" (UID: "d442f429-5a18-41fa-979d-c50016a7e8e8"). InnerVolumeSpecName "kube-api-access-rv9rp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 20:03:42.668802 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:03:42.668753    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv9rp\" (UniqueName: \"kubernetes.io/projected/d442f429-5a18-41fa-979d-c50016a7e8e8-kube-api-access-rv9rp\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 20:03:42.668802 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:03:42.668796    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d442f429-5a18-41fa-979d-c50016a7e8e8-extensions-socket-volume\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 20:03:43.161779 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:03:43.161730    2565 generic.go:358] "Generic (PLEG): container finished" podID="d442f429-5a18-41fa-979d-c50016a7e8e8" containerID="e084afb3069b34260b270f1b58f3106dd74587978dce665ca9872bf3ab19a03a" exitCode=0
May 26 20:03:43.161955 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:03:43.161800    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6" event={"ID":"d442f429-5a18-41fa-979d-c50016a7e8e8","Type":"ContainerDied","Data":"e084afb3069b34260b270f1b58f3106dd74587978dce665ca9872bf3ab19a03a"}
May 26 20:03:43.161955 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:03:43.161829    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6" event={"ID":"d442f429-5a18-41fa-979d-c50016a7e8e8","Type":"ContainerDied","Data":"9ec9e0275f9d7aa5920e0813fa780130cc176811171191112eef6228b14d8f08"}
May 26 20:03:43.161955 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:03:43.161833    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6"
May 26 20:03:43.161955 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:03:43.161844    2565 scope.go:117] "RemoveContainer" containerID="e084afb3069b34260b270f1b58f3106dd74587978dce665ca9872bf3ab19a03a"
May 26 20:03:43.170777 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:03:43.170750    2565 scope.go:117] "RemoveContainer" containerID="e084afb3069b34260b270f1b58f3106dd74587978dce665ca9872bf3ab19a03a"
May 26 20:03:43.171043 ip-10-0-140-142 kubenswrapper[2565]: E0526 20:03:43.171023    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e084afb3069b34260b270f1b58f3106dd74587978dce665ca9872bf3ab19a03a\": container with ID starting with e084afb3069b34260b270f1b58f3106dd74587978dce665ca9872bf3ab19a03a not found: ID does not exist" containerID="e084afb3069b34260b270f1b58f3106dd74587978dce665ca9872bf3ab19a03a"
May 26 20:03:43.171082 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:03:43.171052    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e084afb3069b34260b270f1b58f3106dd74587978dce665ca9872bf3ab19a03a"} err="failed to get container status \"e084afb3069b34260b270f1b58f3106dd74587978dce665ca9872bf3ab19a03a\": rpc error: code = NotFound desc = could not find container \"e084afb3069b34260b270f1b58f3106dd74587978dce665ca9872bf3ab19a03a\": container with ID starting with e084afb3069b34260b270f1b58f3106dd74587978dce665ca9872bf3ab19a03a not found: ID does not exist"
May 26 20:03:43.182499 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:03:43.182474    2565 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6"]
May 26 20:03:43.186568 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:03:43.186548    2565 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-8qnt6"]
May 26 20:03:43.354490 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:03:43.354456    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d442f429-5a18-41fa-979d-c50016a7e8e8" path="/var/lib/kubelet/pods/d442f429-5a18-41fa-979d-c50016a7e8e8/volumes"
May 26 20:04:48.265419 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:48.265384    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r25l5"]
May 26 20:04:48.265877 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:48.265816    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c248dc09-b1cc-4c37-96c2-a409d123808d" containerName="cleanup"
May 26 20:04:48.265877 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:48.265831    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c248dc09-b1cc-4c37-96c2-a409d123808d" containerName="cleanup"
May 26 20:04:48.265877 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:48.265847    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d442f429-5a18-41fa-979d-c50016a7e8e8" containerName="manager"
May 26 20:04:48.265877 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:48.265852    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d442f429-5a18-41fa-979d-c50016a7e8e8" containerName="manager"
May 26 20:04:48.266005 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:48.265919    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="d442f429-5a18-41fa-979d-c50016a7e8e8" containerName="manager"
May 26 20:04:48.266005 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:48.265932    2565 memory_manager.go:356] "RemoveStaleState removing state" podUID="c248dc09-b1cc-4c37-96c2-a409d123808d" containerName="cleanup"
May 26 20:04:48.269165 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:48.269149    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r25l5"
May 26 20:04:48.271932 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:48.271910    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-b8rpb\""
May 26 20:04:48.279173 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:48.279153    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r25l5"]
May 26 20:04:48.330490 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:48.330446    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kcxb\" (UniqueName: \"kubernetes.io/projected/d8c9ea99-9f6f-4112-8415-70f99a87dead-kube-api-access-2kcxb\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r25l5\" (UID: \"d8c9ea99-9f6f-4112-8415-70f99a87dead\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r25l5"
May 26 20:04:48.330490 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:48.330491    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8c9ea99-9f6f-4112-8415-70f99a87dead-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r25l5\" (UID: \"d8c9ea99-9f6f-4112-8415-70f99a87dead\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r25l5"
May 26 20:04:48.431942 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:48.431901    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2kcxb\" (UniqueName: \"kubernetes.io/projected/d8c9ea99-9f6f-4112-8415-70f99a87dead-kube-api-access-2kcxb\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r25l5\" (UID: \"d8c9ea99-9f6f-4112-8415-70f99a87dead\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r25l5"
May 26 20:04:48.431942 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:48.431943    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8c9ea99-9f6f-4112-8415-70f99a87dead-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r25l5\" (UID: \"d8c9ea99-9f6f-4112-8415-70f99a87dead\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r25l5"
May 26 20:04:48.432422 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:48.432400    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d8c9ea99-9f6f-4112-8415-70f99a87dead-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r25l5\" (UID: \"d8c9ea99-9f6f-4112-8415-70f99a87dead\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r25l5"
May 26 20:04:48.439980 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:48.439957    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kcxb\" (UniqueName: \"kubernetes.io/projected/d8c9ea99-9f6f-4112-8415-70f99a87dead-kube-api-access-2kcxb\") pod \"kuadrant-operator-controller-manager-55c7f4c975-r25l5\" (UID: \"d8c9ea99-9f6f-4112-8415-70f99a87dead\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r25l5"
May 26 20:04:48.580371 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:48.580276    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r25l5"
May 26 20:04:48.721940 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:48.721914    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r25l5"]
May 26 20:04:48.724511 ip-10-0-140-142 kubenswrapper[2565]: W0526 20:04:48.724484    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8c9ea99_9f6f_4112_8415_70f99a87dead.slice/crio-03d68671e0f87286912d469e0810af82ba6decb9a24f02442ceca7298f4c0158 WatchSource:0}: Error finding container 03d68671e0f87286912d469e0810af82ba6decb9a24f02442ceca7298f4c0158: Status 404 returned error can't find the container with id 03d68671e0f87286912d469e0810af82ba6decb9a24f02442ceca7298f4c0158
May 26 20:04:49.392333 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:49.392291    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r25l5" event={"ID":"d8c9ea99-9f6f-4112-8415-70f99a87dead","Type":"ContainerStarted","Data":"389f714efd21637974eead75c5c99d91ca0326f9f5729c07c92b3bc403bc2c06"}
May 26 20:04:49.392824 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:49.392341    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r25l5" event={"ID":"d8c9ea99-9f6f-4112-8415-70f99a87dead","Type":"ContainerStarted","Data":"03d68671e0f87286912d469e0810af82ba6decb9a24f02442ceca7298f4c0158"}
May 26 20:04:49.392824 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:49.392386    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r25l5"
May 26 20:04:49.408757 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:04:49.408703    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r25l5" podStartSLOduration=1.408687498 podStartE2EDuration="1.408687498s" podCreationTimestamp="2026-05-26 20:04:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 20:04:49.40829711 +0000 UTC m=+1450.674633443" watchObservedRunningTime="2026-05-26 20:04:49.408687498 +0000 UTC m=+1450.675023830"
May 26 20:05:00.397702 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:05:00.397668    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-r25l5"
May 26 20:05:39.369327 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:05:39.369294    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/2.log"
May 26 20:05:39.374437 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:05:39.374410    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/2.log"
May 26 20:05:39.374790 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:05:39.374759    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/ovn-acl-logging/0.log"
May 26 20:05:39.379451 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:05:39.379428    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/ovn-acl-logging/0.log"
May 26 20:10:39.394734 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:10:39.394702    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/2.log"
May 26 20:10:39.399570 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:10:39.399550    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/ovn-acl-logging/0.log"
May 26 20:10:39.400439 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:10:39.400418    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/2.log"
May 26 20:10:39.405482 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:10:39.405464    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/ovn-acl-logging/0.log"
May 26 20:14:32.334249 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:32.334218    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29663760-24rss_c248dc09-b1cc-4c37-96c2-a409d123808d/cleanup/0.log"
May 26 20:14:32.794978 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:32.794939    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8645bcd494-qw29n_ba5cf066-4569-454e-8f4a-67eb491ce8e7/manager/0.log"
May 26 20:14:34.417388 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:34.417355    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-llv6b_e7ae7993-bc4d-4043-98b4-b17438a8bd29/manager/0.log"
May 26 20:14:34.766620 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:34.766587    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-v9j8l_91c798e3-51f6-4150-99d3-b7fe00525d42/registry-server/0.log"
May 26 20:14:34.893233 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:34.893197    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-r25l5_d8c9ea99-9f6f-4112-8415-70f99a87dead/manager/0.log"
May 26 20:14:35.123494 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:35.123412    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-f9gk4_1b8ecc67-367d-498c-b3bc-a256df7b79af/manager/0.log"
May 26 20:14:35.467710 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:35.467678    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5_b7385549-3df4-4b2d-98b2-990b4fda4759/istio-proxy/0.log"
May 26 20:14:36.751504 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:36.751471    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-64l74_5bb282fb-0e04-4bf9-b04b-c5f27702c27a/storage-initializer/0.log"
May 26 20:14:36.758980 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:36.758958    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-84db68679b-64l74_5bb282fb-0e04-4bf9-b04b-c5f27702c27a/main/0.log"
May 26 20:14:36.869298 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:36.869249    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc_1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7/main/0.log"
May 26 20:14:36.875290 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:36.875263    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdcc8szvc_1fa74cb0-11c8-4db5-8ceb-89c67aa6d1e7/storage-initializer/0.log"
May 26 20:14:36.988393 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:36.988347    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw_35b5ece0-ee34-4c60-8712-6afdee1c14ff/main/0.log"
May 26 20:14:36.995445 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:36.995422    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-88mjw_35b5ece0-ee34-4c60-8712-6afdee1c14ff/storage-initializer/0.log"
May 26 20:14:44.669946 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:44.669912    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-b9j9q_8733236d-623f-4def-9571-6a9484c3d756/global-pull-secret-syncer/0.log"
May 26 20:14:44.801102 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:44.801068    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9chd6_fac17afd-7b7a-40b3-87cf-cf4177b5eac9/konnectivity-agent/0.log"
May 26 20:14:44.930838 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:44.930807    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-142.ec2.internal_82baf510049493772726052266fb60af/haproxy/0.log"
May 26 20:14:49.732933 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:49.732889    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-llv6b_e7ae7993-bc4d-4043-98b4-b17438a8bd29/manager/0.log"
May 26 20:14:49.829656 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:49.829622    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-v9j8l_91c798e3-51f6-4150-99d3-b7fe00525d42/registry-server/0.log"
May 26 20:14:49.915554 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:49.915468    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-r25l5_d8c9ea99-9f6f-4112-8415-70f99a87dead/manager/0.log"
May 26 20:14:50.023834 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:50.023798    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-f9gk4_1b8ecc67-367d-498c-b3bc-a256df7b79af/manager/0.log"
May 26 20:14:51.668106 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:51.668070    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-2lt99_04192970-92db-49ab-97ac-7ba829140333/monitoring-plugin/0.log"
May 26 20:14:51.697565 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:51.697534    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6xttm_9ef074d7-7b4b-4a92-a843-cd03295c51ce/node-exporter/0.log"
May 26 20:14:51.715086 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:51.715057    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6xttm_9ef074d7-7b4b-4a92-a843-cd03295c51ce/kube-rbac-proxy/0.log"
May 26 20:14:51.734059 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:51.734034    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6xttm_9ef074d7-7b4b-4a92-a843-cd03295c51ce/init-textfile/0.log"
May 26 20:14:51.984370 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:51.984333    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d/prometheus/0.log"
May 26 20:14:52.003915 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:52.003889    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d/config-reloader/0.log"
May 26 20:14:52.022492 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:52.022460    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d/thanos-sidecar/0.log"
May 26 20:14:52.042386 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:52.042344    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d/kube-rbac-proxy-web/0.log"
May 26 20:14:52.067562 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:52.067530    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d/kube-rbac-proxy/0.log"
May 26 20:14:52.088237 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:52.088208    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d/kube-rbac-proxy-thanos/0.log"
May 26 20:14:52.109445 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:52.109416    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_a4cb5591-f5fb-49f0-8f0d-2c9a51131d9d/init-config-reloader/0.log"
May 26 20:14:52.184337 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:52.184309    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-897nj_f95fd27a-8474-4bfa-b0ce-14c52ed9b01f/prometheus-operator-admission-webhook/0.log"
May 26 20:14:52.281918 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:52.281829    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c64c5896-dklpv_9eef388b-9754-40d7-8922-0d6edd003862/thanos-query/0.log"
May 26 20:14:52.300639 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:52.300611    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c64c5896-dklpv_9eef388b-9754-40d7-8922-0d6edd003862/kube-rbac-proxy-web/0.log"
May 26 20:14:52.319567 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:52.319543    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c64c5896-dklpv_9eef388b-9754-40d7-8922-0d6edd003862/kube-rbac-proxy/0.log"
May 26 20:14:52.338741 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:52.338713    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c64c5896-dklpv_9eef388b-9754-40d7-8922-0d6edd003862/prom-label-proxy/0.log"
May 26 20:14:52.358365 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:52.358343    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c64c5896-dklpv_9eef388b-9754-40d7-8922-0d6edd003862/kube-rbac-proxy-rules/0.log"
May 26 20:14:52.377104 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:52.377076    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5c64c5896-dklpv_9eef388b-9754-40d7-8922-0d6edd003862/kube-rbac-proxy-metrics/0.log"
May 26 20:14:53.322445 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.322412    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"]
May 26 20:14:53.324990 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.324971    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"
May 26 20:14:53.327230 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.327207    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c2zrb\"/\"openshift-service-ca.crt\""
May 26 20:14:53.327348 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.327296    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-c2zrb\"/\"default-dockercfg-nc7w7\""
May 26 20:14:53.328151 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.328134    2565 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-c2zrb\"/\"kube-root-ca.crt\""
May 26 20:14:53.335386 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.335365    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"]
May 26 20:14:53.360516 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.360490    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-zql5r_f3add0f1-c81f-478c-9e05-616b40159287/networking-console-plugin/0.log"
May 26 20:14:53.447309 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.447278    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e84d1d2-b358-43b0-bf16-ca5bc112b87a-lib-modules\") pod \"perf-node-gather-daemonset-bwvkp\" (UID: \"6e84d1d2-b358-43b0-bf16-ca5bc112b87a\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"
May 26 20:14:53.447487 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.447393    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6e84d1d2-b358-43b0-bf16-ca5bc112b87a-podres\") pod \"perf-node-gather-daemonset-bwvkp\" (UID: \"6e84d1d2-b358-43b0-bf16-ca5bc112b87a\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"
May 26 20:14:53.447487 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.447441    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6e84d1d2-b358-43b0-bf16-ca5bc112b87a-proc\") pod \"perf-node-gather-daemonset-bwvkp\" (UID: \"6e84d1d2-b358-43b0-bf16-ca5bc112b87a\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"
May 26 20:14:53.447487 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.447460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xplm8\" (UniqueName: \"kubernetes.io/projected/6e84d1d2-b358-43b0-bf16-ca5bc112b87a-kube-api-access-xplm8\") pod \"perf-node-gather-daemonset-bwvkp\" (UID: \"6e84d1d2-b358-43b0-bf16-ca5bc112b87a\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"
May 26 20:14:53.447487 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.447487    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e84d1d2-b358-43b0-bf16-ca5bc112b87a-sys\") pod \"perf-node-gather-daemonset-bwvkp\" (UID: \"6e84d1d2-b358-43b0-bf16-ca5bc112b87a\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"
May 26 20:14:53.548820 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.548785    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6e84d1d2-b358-43b0-bf16-ca5bc112b87a-podres\") pod \"perf-node-gather-daemonset-bwvkp\" (UID: \"6e84d1d2-b358-43b0-bf16-ca5bc112b87a\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"
May 26 20:14:53.548995 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.548919    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6e84d1d2-b358-43b0-bf16-ca5bc112b87a-proc\") pod \"perf-node-gather-daemonset-bwvkp\" (UID: \"6e84d1d2-b358-43b0-bf16-ca5bc112b87a\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"
May 26 20:14:53.548995 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.548934    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/6e84d1d2-b358-43b0-bf16-ca5bc112b87a-podres\") pod \"perf-node-gather-daemonset-bwvkp\" (UID: \"6e84d1d2-b358-43b0-bf16-ca5bc112b87a\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"
May 26 20:14:53.548995 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.548951    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xplm8\" (UniqueName: \"kubernetes.io/projected/6e84d1d2-b358-43b0-bf16-ca5bc112b87a-kube-api-access-xplm8\") pod \"perf-node-gather-daemonset-bwvkp\" (UID: \"6e84d1d2-b358-43b0-bf16-ca5bc112b87a\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"
May 26 20:14:53.548995 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.548982    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e84d1d2-b358-43b0-bf16-ca5bc112b87a-sys\") pod \"perf-node-gather-daemonset-bwvkp\" (UID: \"6e84d1d2-b358-43b0-bf16-ca5bc112b87a\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"
May 26 20:14:53.548995 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.548984    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/6e84d1d2-b358-43b0-bf16-ca5bc112b87a-proc\") pod \"perf-node-gather-daemonset-bwvkp\" (UID: \"6e84d1d2-b358-43b0-bf16-ca5bc112b87a\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"
May 26 20:14:53.549236 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.549034    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e84d1d2-b358-43b0-bf16-ca5bc112b87a-sys\") pod \"perf-node-gather-daemonset-bwvkp\" (UID: \"6e84d1d2-b358-43b0-bf16-ca5bc112b87a\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"
May 26 20:14:53.549236 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.549035    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e84d1d2-b358-43b0-bf16-ca5bc112b87a-lib-modules\") pod \"perf-node-gather-daemonset-bwvkp\" (UID: \"6e84d1d2-b358-43b0-bf16-ca5bc112b87a\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"
May 26 20:14:53.549236 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.549102    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e84d1d2-b358-43b0-bf16-ca5bc112b87a-lib-modules\") pod \"perf-node-gather-daemonset-bwvkp\" (UID: \"6e84d1d2-b358-43b0-bf16-ca5bc112b87a\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"
May 26 20:14:53.556882 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.556859    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xplm8\" (UniqueName: \"kubernetes.io/projected/6e84d1d2-b358-43b0-bf16-ca5bc112b87a-kube-api-access-xplm8\") pod \"perf-node-gather-daemonset-bwvkp\" (UID: \"6e84d1d2-b358-43b0-bf16-ca5bc112b87a\") " pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"
May 26 20:14:53.635495 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.635403    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"
May 26 20:14:53.763542 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.763516    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"]
May 26 20:14:53.765933 ip-10-0-140-142 kubenswrapper[2565]: W0526 20:14:53.765907    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod6e84d1d2_b358_43b0_bf16_ca5bc112b87a.slice/crio-206e39c13aa37f17274871ec1f1dd8402bccf0d55e6df9a9220f5e0079693abb WatchSource:0}: Error finding container 206e39c13aa37f17274871ec1f1dd8402bccf0d55e6df9a9220f5e0079693abb: Status 404 returned error can't find the container with id 206e39c13aa37f17274871ec1f1dd8402bccf0d55e6df9a9220f5e0079693abb
May 26 20:14:53.767833 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.767812    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 26 20:14:53.957715 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.957688    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/2.log"
May 26 20:14:53.965378 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:53.965356    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-cnsvr_1d2487f3-ae87-4ee7-8960-52fcade87a1a/console-operator/3.log"
May 26 20:14:54.543203 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:54.543170    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp" event={"ID":"6e84d1d2-b358-43b0-bf16-ca5bc112b87a","Type":"ContainerStarted","Data":"8900fc2dc966298a525ec0664002c81ba1469f9e7bd65df589059a46e6490f47"}
May 26 20:14:54.543203 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:54.543209    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp" event={"ID":"6e84d1d2-b358-43b0-bf16-ca5bc112b87a","Type":"ContainerStarted","Data":"206e39c13aa37f17274871ec1f1dd8402bccf0d55e6df9a9220f5e0079693abb"}
May 26 20:14:54.543652 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:54.543325    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"
May 26 20:14:54.560982 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:54.560927    2565 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp" podStartSLOduration=1.560913304 podStartE2EDuration="1.560913304s" podCreationTimestamp="2026-05-26 20:14:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-26 20:14:54.558363793 +0000 UTC m=+2055.824700125" watchObservedRunningTime="2026-05-26 20:14:54.560913304 +0000 UTC m=+2055.827249615"
May 26 20:14:54.898296 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:54.898217    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-4vbkf_7882115c-97f7-489c-8977-948729486766/volume-data-source-validator/0.log"
May 26 20:14:55.681838 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:55.681795    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gvxvz_e65118e0-5ef8-433d-b018-0531067b70aa/dns/0.log"
May 26 20:14:55.701709 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:55.701679    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-gvxvz_e65118e0-5ef8-433d-b018-0531067b70aa/kube-rbac-proxy/0.log"
May 26 20:14:55.806571 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:55.806545    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-bm27c_99700566-adbe-45d2-b160-8bf4530daeb3/dns-node-resolver/0.log"
May 26 20:14:56.274270 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:56.274240    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-574cdc6788-rww48_fbbcb30f-9e23-4892-aee0-75b52283d6b7/registry/0.log"
May 26 20:14:56.333556 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:56.333517    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-mf2pb_e3c2e921-2ac0-4eb4-a114-cfc760676be0/node-ca/0.log"
May 26 20:14:57.107959 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:57.107925    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bd9wz5_b7385549-3df4-4b2d-98b2-990b4fda4759/istio-proxy/0.log"
May 26 20:14:57.862822 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:57.862788    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6s4k2_2cff5eaa-2999-4393-a02f-9df3a3168c4c/serve-healthcheck-canary/0.log"
May 26 20:14:58.391938 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:58.391907    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q5vpf_c20cc0c3-ed86-4f80-935d-5f4b9ce70e51/kube-rbac-proxy/0.log"
May 26 20:14:58.409048 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:58.408967    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q5vpf_c20cc0c3-ed86-4f80-935d-5f4b9ce70e51/exporter/0.log"
May 26 20:14:58.430082 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:14:58.430059    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-q5vpf_c20cc0c3-ed86-4f80-935d-5f4b9ce70e51/extractor/0.log"
May 26 20:15:00.136092 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:00.136057    2565 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29663775-l8qsx"]
May 26 20:15:00.138490 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:00.138469    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663775-l8qsx"
May 26 20:15:00.140957 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:00.140938    2565 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-xn848\""
May 26 20:15:00.146294 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:00.146119    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29663775-l8qsx"]
May 26 20:15:00.315571 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:00.315535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lpck7\" (UniqueName: \"kubernetes.io/projected/541b8532-4d2a-4ce6-b080-56ddec518c19-kube-api-access-lpck7\") pod \"maas-api-key-cleanup-29663775-l8qsx\" (UID: \"541b8532-4d2a-4ce6-b080-56ddec518c19\") " pod="opendatahub/maas-api-key-cleanup-29663775-l8qsx"
May 26 20:15:00.363860 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:00.363830    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29663760-24rss_c248dc09-b1cc-4c37-96c2-a409d123808d/cleanup/0.log"
May 26 20:15:00.416631 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:00.416550    2565 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lpck7\" (UniqueName: \"kubernetes.io/projected/541b8532-4d2a-4ce6-b080-56ddec518c19-kube-api-access-lpck7\") pod \"maas-api-key-cleanup-29663775-l8qsx\" (UID: \"541b8532-4d2a-4ce6-b080-56ddec518c19\") " pod="opendatahub/maas-api-key-cleanup-29663775-l8qsx"
May 26 20:15:00.424505 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:00.424472    2565 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lpck7\" (UniqueName: \"kubernetes.io/projected/541b8532-4d2a-4ce6-b080-56ddec518c19-kube-api-access-lpck7\") pod \"maas-api-key-cleanup-29663775-l8qsx\" (UID: \"541b8532-4d2a-4ce6-b080-56ddec518c19\") " pod="opendatahub/maas-api-key-cleanup-29663775-l8qsx"
May 26 20:15:00.450342 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:00.450312    2565 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663775-l8qsx"
May 26 20:15:00.561306 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:00.561256    2565 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-c2zrb/perf-node-gather-daemonset-bwvkp"
May 26 20:15:00.574282 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:00.574256    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8645bcd494-qw29n_ba5cf066-4569-454e-8f4a-67eb491ce8e7/manager/0.log"
May 26 20:15:00.598626 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:00.598599    2565 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29663775-l8qsx"]
May 26 20:15:00.600484 ip-10-0-140-142 kubenswrapper[2565]: W0526 20:15:00.600457    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod541b8532_4d2a_4ce6_b080_56ddec518c19.slice/crio-c43276e60ed9057d4e2251481151e645a2cc6a9617a34c44d256e9c806b2a0df WatchSource:0}: Error finding container c43276e60ed9057d4e2251481151e645a2cc6a9617a34c44d256e9c806b2a0df: Status 404 returned error can't find the container with id c43276e60ed9057d4e2251481151e645a2cc6a9617a34c44d256e9c806b2a0df
May 26 20:15:01.570884 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:01.570850    2565 generic.go:358] "Generic (PLEG): container finished" podID="541b8532-4d2a-4ce6-b080-56ddec518c19" containerID="47f1683c00f274dd341b3a7d308eeef7bec8889211bc8a612e52f40c8b3b6b62" exitCode=0
May 26 20:15:01.571214 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:01.570928    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663775-l8qsx" event={"ID":"541b8532-4d2a-4ce6-b080-56ddec518c19","Type":"ContainerDied","Data":"47f1683c00f274dd341b3a7d308eeef7bec8889211bc8a612e52f40c8b3b6b62"}
May 26 20:15:01.571214 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:01.570963    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663775-l8qsx" event={"ID":"541b8532-4d2a-4ce6-b080-56ddec518c19","Type":"ContainerStarted","Data":"c43276e60ed9057d4e2251481151e645a2cc6a9617a34c44d256e9c806b2a0df"}
May 26 20:15:01.681020 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:01.680977    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c7d59fbcb-k2hq8_15ddd942-b89a-4fe2-be53-55962d4bf54c/manager/0.log"
May 26 20:15:02.706012 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:02.705989    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663775-l8qsx"
May 26 20:15:02.838738 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:02.838648    2565 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lpck7\" (UniqueName: \"kubernetes.io/projected/541b8532-4d2a-4ce6-b080-56ddec518c19-kube-api-access-lpck7\") pod \"541b8532-4d2a-4ce6-b080-56ddec518c19\" (UID: \"541b8532-4d2a-4ce6-b080-56ddec518c19\") "
May 26 20:15:02.840734 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:02.840708    2565 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/541b8532-4d2a-4ce6-b080-56ddec518c19-kube-api-access-lpck7" (OuterVolumeSpecName: "kube-api-access-lpck7") pod "541b8532-4d2a-4ce6-b080-56ddec518c19" (UID: "541b8532-4d2a-4ce6-b080-56ddec518c19"). InnerVolumeSpecName "kube-api-access-lpck7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 26 20:15:02.940034 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:02.940005    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lpck7\" (UniqueName: \"kubernetes.io/projected/541b8532-4d2a-4ce6-b080-56ddec518c19-kube-api-access-lpck7\") on node \"ip-10-0-140-142.ec2.internal\" DevicePath \"\""
May 26 20:15:03.579838 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:03.579798    2565 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29663775-l8qsx" event={"ID":"541b8532-4d2a-4ce6-b080-56ddec518c19","Type":"ContainerDied","Data":"c43276e60ed9057d4e2251481151e645a2cc6a9617a34c44d256e9c806b2a0df"}
May 26 20:15:03.579838 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:03.579822    2565 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29663775-l8qsx"
May 26 20:15:03.579838 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:03.579837    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c43276e60ed9057d4e2251481151e645a2cc6a9617a34c44d256e9c806b2a0df"
May 26 20:15:06.513214 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:06.513172    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-qc2wq_ef306df5-e9fa-457e-b43b-6664145a0912/kube-storage-version-migrator-operator/1.log"
May 26 20:15:06.515036 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:06.515012    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-qc2wq_ef306df5-e9fa-457e-b43b-6664145a0912/kube-storage-version-migrator-operator/0.log"
May 26 20:15:07.756521 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:07.756489    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qv6dg_32a4562d-8bef-44cb-8028-3cb8087dbe94/kube-multus-additional-cni-plugins/0.log"
May 26 20:15:07.775167 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:07.775144    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qv6dg_32a4562d-8bef-44cb-8028-3cb8087dbe94/egress-router-binary-copy/0.log"
May 26 20:15:07.793053 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:07.793017    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qv6dg_32a4562d-8bef-44cb-8028-3cb8087dbe94/cni-plugins/0.log"
May 26 20:15:07.810188 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:07.810157    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qv6dg_32a4562d-8bef-44cb-8028-3cb8087dbe94/bond-cni-plugin/0.log"
May 26 20:15:07.833186 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:07.833151    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qv6dg_32a4562d-8bef-44cb-8028-3cb8087dbe94/routeoverride-cni/0.log"
May 26 20:15:07.852700 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:07.852671    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qv6dg_32a4562d-8bef-44cb-8028-3cb8087dbe94/whereabouts-cni-bincopy/0.log"
May 26 20:15:07.870120 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:07.870095    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qv6dg_32a4562d-8bef-44cb-8028-3cb8087dbe94/whereabouts-cni/0.log"
May 26 20:15:07.956780 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:07.956738    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-wvhzl_22348da8-918f-4a01-99e8-2423faf20c80/kube-multus/0.log"
May 26 20:15:08.053748 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:08.053664    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-twnct_5b513a26-7609-4fa6-b6ac-ae939b6d6436/network-metrics-daemon/0.log"
May 26 20:15:08.069753 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:08.069714    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-twnct_5b513a26-7609-4fa6-b6ac-ae939b6d6436/kube-rbac-proxy/0.log"
May 26 20:15:09.359810 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:09.359750    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/ovn-controller/0.log"
May 26 20:15:09.374067 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:09.374041    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/ovn-acl-logging/0.log"
May 26 20:15:09.393228 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:09.393199    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/ovn-acl-logging/1.log"
May 26 20:15:09.412904 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:09.412875    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/kube-rbac-proxy-node/0.log"
May 26 20:15:09.432407 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:09.432378    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/kube-rbac-proxy-ovn-metrics/0.log"
May 26 20:15:09.448592 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:09.448560    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/northd/0.log"
May 26 20:15:09.466627 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:09.466600    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/nbdb/0.log"
May 26 20:15:09.484610 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:09.484588    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/sbdb/0.log"
May 26 20:15:09.651680 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:09.651603    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-w942w_fb90f68b-f7c0-4406-a24f-4387c42ac7b8/ovnkube-controller/0.log"
May 26 20:15:10.705275 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:10.705244    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7f44b6dd87-5nhgx_3c9ea837-661c-4532-a6a3-fd15ba706497/check-endpoints/0.log"
May 26 20:15:10.726162 ip-10-0-140-142 kubenswrapper[2565]: I0526 20:15:10.726136    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-dbnpx_c9b9e277-d07d-4630-9d88-f2fad67bc7e9/network-check-target-container/0.log"