May 25 01:02:21.026638 ip-10-0-134-192 systemd[1]: Starting Kubernetes Kubelet...
May 25 01:02:21.488800 ip-10-0-134-192 kubenswrapper[2558]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 01:02:21.488800 ip-10-0-134-192 kubenswrapper[2558]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 25 01:02:21.488800 ip-10-0-134-192 kubenswrapper[2558]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 01:02:21.488800 ip-10-0-134-192 kubenswrapper[2558]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 25 01:02:21.488800 ip-10-0-134-192 kubenswrapper[2558]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 25 01:02:21.490488 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.490397    2558 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 25 01:02:21.498047 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498026    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 01:02:21.498047 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498044    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 01:02:21.498047 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498048    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 01:02:21.498047 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498051    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 01:02:21.498207 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498055    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 01:02:21.498207 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498059    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 01:02:21.498207 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498062    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 01:02:21.498207 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498065    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 01:02:21.498207 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498068    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 01:02:21.498207 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498071    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 01:02:21.498207 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498073    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 01:02:21.498207 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498076    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 01:02:21.498207 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498078    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 01:02:21.498207 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498081    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 01:02:21.498207 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498083    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 01:02:21.498207 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498086    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 01:02:21.498207 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498088    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 01:02:21.498207 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498091    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 01:02:21.498207 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498094    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 01:02:21.498207 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498096    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 01:02:21.498207 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498099    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 01:02:21.498207 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498101    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 01:02:21.498207 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498104    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 01:02:21.498207 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498106    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 01:02:21.498692 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498109    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 01:02:21.498692 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498115    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 01:02:21.498692 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498117    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 01:02:21.498692 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498120    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 01:02:21.498692 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498123    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 01:02:21.498692 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498126    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 01:02:21.498692 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498128    2558 feature_gate.go:328] unrecognized feature gate: Example
May 25 01:02:21.498692 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498131    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 01:02:21.498692 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498133    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 01:02:21.498692 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498136    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 01:02:21.498692 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498138    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 01:02:21.498692 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498141    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 01:02:21.498692 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498143    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 01:02:21.498692 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498146    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 01:02:21.498692 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498149    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 01:02:21.498692 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498151    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 01:02:21.498692 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498154    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 01:02:21.498692 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498156    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 01:02:21.498692 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498159    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 01:02:21.499152 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498161    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 01:02:21.499152 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498164    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 01:02:21.499152 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498166    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 01:02:21.499152 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498169    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 01:02:21.499152 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498172    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 01:02:21.499152 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498174    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 01:02:21.499152 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498177    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 01:02:21.499152 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498180    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 01:02:21.499152 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498182    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 01:02:21.499152 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498185    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 01:02:21.499152 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498188    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 01:02:21.499152 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498190    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 01:02:21.499152 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498193    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 01:02:21.499152 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498195    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 25 01:02:21.499152 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498197    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 01:02:21.499152 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498200    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 01:02:21.499152 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498202    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 01:02:21.499152 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498205    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 01:02:21.499152 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498207    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 01:02:21.499152 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498210    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 01:02:21.499649 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498213    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 01:02:21.499649 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498215    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 01:02:21.499649 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498218    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 01:02:21.499649 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498221    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 01:02:21.499649 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498223    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 01:02:21.499649 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498227    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 01:02:21.499649 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498232    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 01:02:21.499649 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498235    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 01:02:21.499649 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498237    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 01:02:21.499649 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498240    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 01:02:21.499649 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498243    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 01:02:21.499649 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498245    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 01:02:21.499649 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498249    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 01:02:21.499649 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498253    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 01:02:21.499649 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498257    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 01:02:21.499649 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498261    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 01:02:21.499649 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498264    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 01:02:21.499649 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498267    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 01:02:21.499649 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498270    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 01:02:21.500143 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498272    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 01:02:21.500143 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498275    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 01:02:21.500143 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498277    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 01:02:21.500143 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.498280    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 01:02:21.500143 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499540    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 01:02:21.500143 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499548    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 01:02:21.500143 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499551    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 01:02:21.500143 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499554    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 01:02:21.500143 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499557    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 01:02:21.500143 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499561    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 01:02:21.500143 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499564    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 01:02:21.500143 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499567    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 01:02:21.500143 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499571    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 01:02:21.500143 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499574    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 01:02:21.500143 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499577    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 01:02:21.500143 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499579    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 01:02:21.500143 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499582    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 01:02:21.500143 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499585    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 01:02:21.500143 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499587    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 01:02:21.500143 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499591    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 01:02:21.500625 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499595    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 01:02:21.500625 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499598    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 01:02:21.500625 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499601    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 01:02:21.500625 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499604    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 01:02:21.500625 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499607    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 01:02:21.500625 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499609    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 01:02:21.500625 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499613    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 01:02:21.500625 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499617    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 01:02:21.500625 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499620    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 01:02:21.500625 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499623    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 01:02:21.500625 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499626    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 01:02:21.500625 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499628    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 01:02:21.500625 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499631    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 01:02:21.500625 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499634    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 01:02:21.500625 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499636    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 25 01:02:21.500625 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499639    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 01:02:21.500625 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499641    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 01:02:21.500625 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499643    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 01:02:21.500625 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499647    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 01:02:21.500625 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499650    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 01:02:21.501124 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499653    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 01:02:21.501124 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499655    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 01:02:21.501124 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499658    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 01:02:21.501124 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499661    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 01:02:21.501124 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499663    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 01:02:21.501124 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499666    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 01:02:21.501124 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499669    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 01:02:21.501124 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499672    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 01:02:21.501124 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499674    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 01:02:21.501124 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499677    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 01:02:21.501124 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499679    2558 feature_gate.go:328] unrecognized feature gate: Example
May 25 01:02:21.501124 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499683    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 01:02:21.501124 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499685    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 01:02:21.501124 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499688    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 01:02:21.501124 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499691    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 01:02:21.501124 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499693    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 01:02:21.501124 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499695    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 01:02:21.501124 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499698    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 01:02:21.501124 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499700    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 01:02:21.501124 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499703    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 01:02:21.501614 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499705    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 01:02:21.501614 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499708    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 01:02:21.501614 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499711    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 01:02:21.501614 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499714    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 01:02:21.501614 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499717    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 01:02:21.501614 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499719    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 01:02:21.501614 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499722    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 01:02:21.501614 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499724    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 01:02:21.501614 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499726    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 01:02:21.501614 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499729    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 01:02:21.501614 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499731    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 01:02:21.501614 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499734    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 01:02:21.501614 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499736    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 01:02:21.501614 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499738    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 01:02:21.501614 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499741    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 01:02:21.501614 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499743    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 01:02:21.501614 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499746    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 01:02:21.501614 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499749    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 01:02:21.501614 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499751    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 01:02:21.501614 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499755    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499758    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499760    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499763    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499766    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499768    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499771    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499773    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499776    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499778    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.499781    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500512    2558 flags.go:64] FLAG: --address="0.0.0.0"
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500521    2558 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500528    2558 flags.go:64] FLAG: --anonymous-auth="true"
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500532    2558 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500537    2558 flags.go:64] FLAG: --authentication-token-webhook="false"
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500540    2558 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500544    2558 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500548    2558 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500551    2558 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500554    2558 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 25 01:02:21.502088 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500558    2558 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500561    2558 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500564    2558 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500567    2558 flags.go:64] FLAG: --cgroup-root=""
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500570    2558 flags.go:64] FLAG: --cgroups-per-qos="true"
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500572    2558 flags.go:64] FLAG: --client-ca-file=""
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500575    2558 flags.go:64] FLAG: --cloud-config=""
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500578    2558 flags.go:64] FLAG: --cloud-provider="external"
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500581    2558 flags.go:64] FLAG: --cluster-dns="[]"
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500585    2558 flags.go:64] FLAG: --cluster-domain=""
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500588    2558 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500591    2558 flags.go:64] FLAG: --config-dir=""
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500594    2558 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500597    2558 flags.go:64] FLAG: --container-log-max-files="5"
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500601    2558 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500604    2558 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500607    2558 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500610    2558 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500614    2558 flags.go:64] FLAG: --contention-profiling="false"
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500617    2558 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500619    2558 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500623    2558 flags.go:64] FLAG: --cpu-manager-policy="none"
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500626    2558 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500630    2558 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500633    2558 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 25 01:02:21.502603 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500636    2558 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500639    2558 flags.go:64] FLAG: --enable-load-reader="false"
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500642    2558 flags.go:64] FLAG: --enable-server="true"
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500645    2558 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500653    2558 flags.go:64] FLAG: --event-burst="100"
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500656    2558 flags.go:64] FLAG: --event-qps="50"
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500659    2558 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500662    2558 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500665    2558 flags.go:64] FLAG: --eviction-hard=""
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500669    2558 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500672    2558 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500675    2558 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500678    2558 flags.go:64] FLAG: --eviction-soft=""
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500681    2558 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500684    2558 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500687    2558 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500690    2558 flags.go:64] FLAG: --experimental-mounter-path=""
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500693    2558 flags.go:64] FLAG: --fail-cgroupv1="false"
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500695    2558 flags.go:64] FLAG: --fail-swap-on="true"
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500698    2558 flags.go:64] FLAG: --feature-gates=""
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500707    2558 flags.go:64] FLAG: --file-check-frequency="20s"
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500710    2558 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500713    2558 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500716    2558 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500719    2558 flags.go:64] FLAG: --healthz-port="10248"
May 25 01:02:21.503207 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500722    2558 flags.go:64] FLAG: --help="false"
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500725    2558 flags.go:64] FLAG: --hostname-override="ip-10-0-134-192.ec2.internal"
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500728    2558 flags.go:64] FLAG: --housekeeping-interval="10s"
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500731    2558 flags.go:64] FLAG: --http-check-frequency="20s"
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500734    2558 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500737    2558 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500741    2558 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500743    2558 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500746    2558 flags.go:64] FLAG: --image-service-endpoint=""
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500749    2558 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500752    2558 flags.go:64] FLAG: --kube-api-burst="100"
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500755    2558 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500758    2558 flags.go:64] FLAG: --kube-api-qps="50"
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500761    2558 flags.go:64] FLAG: --kube-reserved=""
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500764    2558 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500767    2558 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500770    2558 flags.go:64] FLAG: --kubelet-cgroups=""
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500772    2558 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500775    2558 flags.go:64] FLAG: --lock-file=""
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500778    2558 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500780    2558 flags.go:64] FLAG: --log-flush-frequency="5s"
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500784    2558 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500789    2558 flags.go:64] FLAG: --log-json-split-stream="false"
May 25 01:02:21.503827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500792    2558 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500794    2558 flags.go:64] FLAG: --log-text-split-stream="false"
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500797    2558 flags.go:64] FLAG: --logging-format="text"
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500800    2558 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500803    2558 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500806    2558 flags.go:64] FLAG: --manifest-url=""
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500809    2558 flags.go:64] FLAG: --manifest-url-header=""
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500813    2558 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500816    2558 flags.go:64] FLAG: --max-open-files="1000000"
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500820    2558 flags.go:64] FLAG: --max-pods="110"
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500823    2558 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500826    2558 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500829    2558 flags.go:64] FLAG: --memory-manager-policy="None"
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500832    2558 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500835    2558 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500838    2558 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500841    2558 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500848    2558 flags.go:64] FLAG: --node-status-max-images="50"
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500851    2558 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500854    2558 flags.go:64] FLAG: --oom-score-adj="-999"
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500857    2558 flags.go:64] FLAG: --pod-cidr=""
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500860    2558 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500866    2558 flags.go:64] FLAG: --pod-manifest-path=""
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500869    2558 flags.go:64] FLAG: --pod-max-pids="-1"
May 25 01:02:21.504428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500872    2558 flags.go:64] FLAG: --pods-per-core="0"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500875    2558 flags.go:64] FLAG: --port="10250"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500878    2558 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500881    2558 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-074730dcf02de5231"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500884    2558 flags.go:64] FLAG: --qos-reserved=""
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500887    2558 flags.go:64] FLAG: --read-only-port="10255"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500890    2558 flags.go:64] FLAG: --register-node="true"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500893    2558 flags.go:64] FLAG: --register-schedulable="true"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500896    2558 flags.go:64] FLAG: --register-with-taints=""
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500900    2558 flags.go:64] FLAG: --registry-burst="10"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500902    2558 flags.go:64] FLAG: --registry-qps="5"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500905    2558 flags.go:64] FLAG: --reserved-cpus=""
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500908    2558 flags.go:64] FLAG: --reserved-memory=""
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500912    2558 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500915    2558 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500920    2558 flags.go:64] FLAG: --rotate-certificates="false"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500923    2558 flags.go:64] FLAG: --rotate-server-certificates="false"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500926    2558 flags.go:64] FLAG: --runonce="false"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500928    2558 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500931    2558 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500934    2558 flags.go:64] FLAG: --seccomp-default="false"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500937    2558 flags.go:64] FLAG: --serialize-image-pulls="true"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500941    2558 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500944    2558 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500948    2558 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500950    2558 flags.go:64] FLAG: --storage-driver-password="root"
May 25 01:02:21.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500953    2558 flags.go:64] FLAG: --storage-driver-secure="false"
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500956    2558 flags.go:64] FLAG: --storage-driver-table="stats"
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500959    2558 flags.go:64] FLAG: --storage-driver-user="root"
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500962    2558 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500965    2558 flags.go:64] FLAG: --sync-frequency="1m0s"
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500968    2558 flags.go:64] FLAG: --system-cgroups=""
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500971    2558 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500976    2558 flags.go:64] FLAG: --system-reserved-cgroup=""
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500987    2558 flags.go:64] FLAG: --tls-cert-file=""
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500991    2558 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500994    2558 flags.go:64] FLAG: --tls-min-version=""
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.500997    2558 flags.go:64] FLAG: --tls-private-key-file=""
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.501000    2558 flags.go:64] FLAG: --topology-manager-policy="none"
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.501003    2558 flags.go:64] FLAG: --topology-manager-policy-options=""
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.501006    2558 flags.go:64] FLAG: --topology-manager-scope="container"
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.501008    2558 flags.go:64] FLAG: --v="2"
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.501013    2558 flags.go:64] FLAG: --version="false"
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.501016    2558 flags.go:64] FLAG: --vmodule=""
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.501020    2558 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.501023    2558 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501113    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501118    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501122    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501124    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 01:02:21.505630 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501127    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 01:02:21.506226 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501130    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 01:02:21.506226 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501133    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 01:02:21.506226 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501136    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 01:02:21.506226 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501139    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 01:02:21.506226 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501142    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 01:02:21.506226 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501144    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 01:02:21.506226 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501147    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 01:02:21.506226 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501149    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 01:02:21.506226 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501152    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 01:02:21.506226 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501154    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 01:02:21.506226 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501157    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 01:02:21.506226 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501160    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 01:02:21.506226 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501163    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 01:02:21.506226 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501166    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 01:02:21.506226 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501169    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 01:02:21.506226 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501171    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 01:02:21.506226 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501174    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 01:02:21.506226 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501176    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 01:02:21.506226 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501179    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 01:02:21.506704 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501181    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 01:02:21.506704 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501184    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 01:02:21.506704 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501186    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 01:02:21.506704 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501188    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 01:02:21.506704 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501191    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 01:02:21.506704 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501194    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 01:02:21.506704 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501196    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 01:02:21.506704 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501200    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 01:02:21.506704 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501203    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 01:02:21.506704 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501207    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 01:02:21.506704 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501210    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 01:02:21.506704 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501213    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 01:02:21.506704 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501215    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 01:02:21.506704 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501218    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 01:02:21.506704 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501220    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 01:02:21.506704 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501223    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 01:02:21.506704 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501225    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 01:02:21.506704 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501228    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 01:02:21.506704 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501231    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 01:02:21.507174 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501233    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 01:02:21.507174 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501236    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 01:02:21.507174 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501238    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 01:02:21.507174 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501241    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 01:02:21.507174 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501244    2558 feature_gate.go:328] unrecognized feature gate: Example
May 25 01:02:21.507174 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501246    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 01:02:21.507174 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501249    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 01:02:21.507174 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501251    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 01:02:21.507174 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501254    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 01:02:21.507174 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501256    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 01:02:21.507174 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501259    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 01:02:21.507174 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501261    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 01:02:21.507174 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501264    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 01:02:21.507174 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501266    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 25 01:02:21.507174 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501268    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 01:02:21.507174 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501271    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 01:02:21.507174 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501273    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 01:02:21.507174 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501276    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 01:02:21.507174 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501278    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 01:02:21.507174 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501280    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 01:02:21.507760 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501283    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 01:02:21.507760 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501285    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 01:02:21.507760 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501288    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 01:02:21.507760 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501291    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 01:02:21.507760 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501293    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 01:02:21.507760 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501295    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 01:02:21.507760 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501298    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 01:02:21.507760 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501300    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 01:02:21.507760 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501303    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 01:02:21.507760 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501305    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 01:02:21.507760 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501308    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 01:02:21.507760 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501310    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 01:02:21.507760 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501312    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 01:02:21.507760 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501315    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 01:02:21.507760 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501317    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 01:02:21.507760 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501320    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 01:02:21.507760 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501341    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 01:02:21.507760 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501345    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 01:02:21.507760 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501348    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 01:02:21.508222 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501351    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 01:02:21.508222 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501353    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 01:02:21.508222 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501356    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 01:02:21.508222 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.501358    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 01:02:21.508222 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.502314    2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 01:02:21.509225 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.509205    2558 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 25 01:02:21.509263 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.509227    2558 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 25 01:02:21.509295 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509277    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 01:02:21.509295 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509282    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 01:02:21.509295 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509286    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 01:02:21.509295 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509289    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 01:02:21.509295 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509293    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 01:02:21.509295 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509295    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 01:02:21.509295 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509298    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 01:02:21.509486 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509301    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 01:02:21.509486 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509304    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 01:02:21.509486 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509307    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 01:02:21.509486 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509310    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 01:02:21.509486 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509312    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 01:02:21.509486 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509315    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 01:02:21.509486 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509318    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 01:02:21.509486 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509320    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 01:02:21.509486 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509339    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 01:02:21.509486 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509343    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 01:02:21.509486 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509346    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 01:02:21.509486 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509348    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 01:02:21.509486 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509351    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 01:02:21.509486 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509354    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 01:02:21.509486 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509356    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 01:02:21.509486 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509359    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 01:02:21.509486 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509361    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 01:02:21.509486 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509364    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 01:02:21.509486 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509367    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 01:02:21.509486 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509370    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 01:02:21.509983 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509373    2558 feature_gate.go:328] unrecognized feature gate: Example
May 25 01:02:21.509983 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509376    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 01:02:21.509983 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509378    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 01:02:21.509983 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509381    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 01:02:21.509983 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509384    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 01:02:21.509983 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509387    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 01:02:21.509983 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509391    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 01:02:21.509983 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509396    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 01:02:21.509983 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509399    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 01:02:21.509983 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509402    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 01:02:21.509983 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509405    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 01:02:21.509983 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509408    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 01:02:21.509983 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509411    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 01:02:21.509983 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509414    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 01:02:21.509983 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509416    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 01:02:21.509983 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509419    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 01:02:21.509983 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509422    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 01:02:21.509983 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509424    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 01:02:21.509983 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509428    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 01:02:21.510467 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509430    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 01:02:21.510467 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509432    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 01:02:21.510467 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509435    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 01:02:21.510467 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509438    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 01:02:21.510467 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509440    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 01:02:21.510467 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509443    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 01:02:21.510467 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509445    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 01:02:21.510467 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509448    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 01:02:21.510467 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509451    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 01:02:21.510467 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509453    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 01:02:21.510467 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509455    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 01:02:21.510467 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509458    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 01:02:21.510467 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509461    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 01:02:21.510467 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509464    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 01:02:21.510467 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509467    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 01:02:21.510467 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509469    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 01:02:21.510467 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509472    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 01:02:21.510467 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509475    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 01:02:21.510467 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509478    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 01:02:21.510467 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509480    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 01:02:21.510967 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509483    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 01:02:21.510967 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509485    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 25 01:02:21.510967 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509488    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 01:02:21.510967 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509491    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 01:02:21.510967 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509494    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 01:02:21.510967 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509496    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 01:02:21.510967 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509499    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 01:02:21.510967 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509502    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 01:02:21.510967 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509504    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 01:02:21.510967 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509507    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 01:02:21.510967 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509509    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 01:02:21.510967 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509512    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 01:02:21.510967 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509514    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 01:02:21.510967 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509517    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 01:02:21.510967 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509519    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 01:02:21.510967 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509522    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 01:02:21.510967 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509525    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 01:02:21.510967 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509529    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 01:02:21.510967 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509531    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 01:02:21.510967 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509534    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 01:02:21.511547 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.509539    2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 01:02:21.511547 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509652    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 25 01:02:21.511547 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509658    2558 feature_gate.go:328] unrecognized feature gate: Example2
May 25 01:02:21.511547 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509661    2558 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 25 01:02:21.511547 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509665    2558 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 25 01:02:21.511547 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509668    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 25 01:02:21.511547 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509671    2558 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 25 01:02:21.511547 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509673    2558 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 25 01:02:21.511547 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509676    2558 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 25 01:02:21.511547 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509679    2558 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 25 01:02:21.511547 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509683    2558 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 25 01:02:21.511547 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509687    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 25 01:02:21.511547 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509690    2558 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 25 01:02:21.511547 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509693    2558 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 25 01:02:21.511547 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509696    2558 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 25 01:02:21.511929 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509699    2558 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 25 01:02:21.511929 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509702    2558 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 25 01:02:21.511929 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509704    2558 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 25 01:02:21.511929 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509707    2558 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 25 01:02:21.511929 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509710    2558 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 25 01:02:21.511929 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509712    2558 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 25 01:02:21.511929 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509715    2558 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 25 01:02:21.511929 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509717    2558 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 25 01:02:21.511929 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509720    2558 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 25 01:02:21.511929 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509723    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 25 01:02:21.511929 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509725    2558 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 25 01:02:21.511929 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509728    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 25 01:02:21.511929 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509731    2558 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 25 01:02:21.511929 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509733    2558 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 25 01:02:21.511929 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509736    2558 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 25 01:02:21.511929 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509738    2558 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 25 01:02:21.511929 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509741    2558 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 25 01:02:21.511929 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509743    2558 feature_gate.go:328] unrecognized feature gate: DualReplica
May 25 01:02:21.511929 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509745    2558 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 25 01:02:21.511929 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509748    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 25 01:02:21.512442 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509750    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 25 01:02:21.512442 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509753    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 25 01:02:21.512442 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509756    2558 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 25 01:02:21.512442 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509759    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 25 01:02:21.512442 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509762    2558 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 25 01:02:21.512442 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509764    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 25 01:02:21.512442 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509768    2558 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 25 01:02:21.512442 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509770    2558 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 25 01:02:21.512442 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509773    2558 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 25 01:02:21.512442 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509775    2558 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 25 01:02:21.512442 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509778    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 25 01:02:21.512442 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509780    2558 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 25 01:02:21.512442 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509782    2558 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 25 01:02:21.512442 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509785    2558 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 25 01:02:21.512442 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509787    2558 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 25 01:02:21.512442 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509790    2558 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 25 01:02:21.512442 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509792    2558 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 25 01:02:21.512442 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509795    2558 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 25 01:02:21.512442 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509797    2558 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 25 01:02:21.512906 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509799    2558 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 25 01:02:21.512906 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509802    2558 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 25 01:02:21.512906 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509804    2558 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 25 01:02:21.512906 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509807    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 25 01:02:21.512906 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509809    2558 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 25 01:02:21.512906 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509812    2558 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 25 01:02:21.512906 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509814    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 25 01:02:21.512906 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509817    2558 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 25 01:02:21.512906 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509819    2558 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 25 01:02:21.512906 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509822    2558 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 25 01:02:21.512906 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509824    2558 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 25 01:02:21.512906 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509827    2558 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 25 01:02:21.512906 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509829    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 25 01:02:21.512906 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509832    2558 feature_gate.go:328] unrecognized feature gate: Example
May 25 01:02:21.512906 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509835    2558 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 25 01:02:21.512906 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509837    2558 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 25 01:02:21.512906 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509840    2558 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 25 01:02:21.512906 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509843    2558 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 25 01:02:21.512906 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509846    2558 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 25 01:02:21.512906 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509849    2558 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 25 01:02:21.513409 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509851    2558 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 25 01:02:21.513409 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509854    2558 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 25 01:02:21.513409 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509857    2558 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 25 01:02:21.513409 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509859    2558 feature_gate.go:328] unrecognized feature gate: NewOLM
May 25 01:02:21.513409 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509862    2558 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 25 01:02:21.513409 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509864    2558 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 25 01:02:21.513409 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509866    2558 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 25 01:02:21.513409 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509869    2558 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 25 01:02:21.513409 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509871    2558 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 25 01:02:21.513409 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509874    2558 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 25 01:02:21.513409 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509876    2558 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 25 01:02:21.513409 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509879    2558 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 25 01:02:21.513409 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:21.509882    2558 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 25 01:02:21.513409 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.509887    2558 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 25 01:02:21.513409 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.510724    2558 server.go:962] "Client rotation is on, will bootstrap in background"
May 25 01:02:21.514393 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.514379    2558 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 25 01:02:21.515535 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.515525    2558 server.go:1019] "Starting client certificate rotation"
May 25 01:02:21.515646 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.515629    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 25 01:02:21.515682 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.515671    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 25 01:02:21.543507 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.543487    2558 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 25 01:02:21.545390 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.545371    2558 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 25 01:02:21.567288 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.567264    2558 log.go:25] "Validated CRI v1 runtime API"
May 25 01:02:21.573902 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.573884    2558 log.go:25] "Validated CRI v1 image API"
May 25 01:02:21.574873 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.574853    2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 25 01:02:21.575465 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.575450    2558 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 25 01:02:21.583404 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.583377    2558 fs.go:135] Filesystem UUIDs: map[75fef98e-ac0a-4d50-b5de-231993f499dc:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 a03dbf39-b0f7-4968-9e63-57b98c68eb38:/dev/nvme0n1p3]
May 25 01:02:21.583444 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.583408    2558 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 25 01:02:21.587731 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.587630    2558 manager.go:217] Machine: {Timestamp:2026-05-25 01:02:21.587135257 +0000 UTC m=+0.456794588 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099048 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2acc3ba1d83079fe0712ec37d38660 SystemUUID:ec2acc3b-a1d8-3079-fe07-12ec37d38660 BootID:2a3c421c-36a3-4913-bdb9-7b106ee5c534 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:29:a1:d4:c2:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:29:a1:d4:c2:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:4a:7d:00:34:0a:ef Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 25 01:02:21.588598 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.588586    2558 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 25 01:02:21.588717 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.588705    2558 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 25 01:02:21.590859 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.590832    2558 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 25 01:02:21.590993 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.590864    2558 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-192.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 25 01:02:21.591039 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.591003    2558 topology_manager.go:138] "Creating topology manager with none policy"
May 25 01:02:21.591039 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.591011    2558 container_manager_linux.go:306] "Creating device plugin manager"
May 25 01:02:21.591039 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.591018    2558 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 25 01:02:21.591892 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.591882    2558 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 25 01:02:21.593883 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.593873    2558 state_mem.go:36] "Initialized new in-memory state store"
May 25 01:02:21.594164 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.594154    2558 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 25 01:02:21.596945 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.596936    2558 kubelet.go:491] "Attempting to sync node with API server"
May 25 01:02:21.596990 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.596950    2558 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 25 01:02:21.596990 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.596962    2558 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 25 01:02:21.596990 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.596971    2558 kubelet.go:397] "Adding apiserver pod source"
May 25 01:02:21.596990 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.596987    2558 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 25 01:02:21.597896 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.597879    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lwkhs"
May 25 01:02:21.598227 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.598216    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 25 01:02:21.598274 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.598235    2558 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 25 01:02:21.601675 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.601654    2558 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 25 01:02:21.603868 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.603854    2558 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 25 01:02:21.604340 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.604302    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lwkhs"
May 25 01:02:21.606125 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.606113    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 25 01:02:21.606163 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.606132    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 25 01:02:21.606163 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.606138    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 25 01:02:21.606163 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.606143    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 25 01:02:21.606163 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.606151    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 25 01:02:21.606163 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.606157    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 25 01:02:21.606163 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.606162    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 25 01:02:21.606385 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.606168    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 25 01:02:21.606385 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.606200    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 25 01:02:21.606385 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.606207    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 25 01:02:21.606385 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.606215    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 25 01:02:21.606385 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.606221    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 25 01:02:21.607255 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.607244    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 25 01:02:21.607255 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.607254    2558 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 25 01:02:21.611052 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.611028    2558 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 01:02:21.611160 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.611139    2558 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 25 01:02:21.611224 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.611204    2558 server.go:1295] "Started kubelet"
May 25 01:02:21.611866 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.611783    2558 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 25 01:02:21.612365 ip-10-0-134-192 systemd[1]: Started Kubernetes Kubelet.
May 25 01:02:21.613268 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.612916    2558 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 25 01:02:21.613268 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.613172    2558 server_v1.go:47] "podresources" method="list" useActivePods=true
May 25 01:02:21.619552 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.619533    2558 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 25 01:02:21.619834 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.619814    2558 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 01:02:21.620356 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.620343    2558 server.go:317] "Adding debug handlers to kubelet server"
May 25 01:02:21.622033 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.622017    2558 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-192.ec2.internal" not found
May 25 01:02:21.624209 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:21.624187    2558 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 25 01:02:21.627153 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.627133    2558 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 25 01:02:21.627240 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.627217    2558 volume_manager.go:295] "The desired_state_of_world populator starts"
May 25 01:02:21.627240 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.627232    2558 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 25 01:02:21.627370 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.627221    2558 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 25 01:02:21.627370 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.627318    2558 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 25 01:02:21.627446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.627405    2558 reconstruct.go:97] "Volume reconstruction finished"
May 25 01:02:21.627446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.627413    2558 reconciler.go:26] "Reconciler: start to sync state"
May 25 01:02:21.627930 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.627917    2558 factory.go:55] Registering systemd factory
May 25 01:02:21.628002 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.627968    2558 factory.go:223] Registration of the systemd container factory successfully
May 25 01:02:21.628169 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:21.628133    2558 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-192.ec2.internal\" not found"
May 25 01:02:21.628169 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.628158    2558 factory.go:153] Registering CRI-O factory
May 25 01:02:21.628314 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.628180    2558 factory.go:223] Registration of the crio container factory successfully
May 25 01:02:21.628314 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.628269    2558 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 25 01:02:21.628314 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.628286    2558 factory.go:103] Registering Raw factory
May 25 01:02:21.628314 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.628295    2558 manager.go:1196] Started watching for new ooms in manager
May 25 01:02:21.628901 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.628878    2558 manager.go:319] Starting recovery of all containers
May 25 01:02:21.630006 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.629984    2558 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 01:02:21.635320 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:21.635298    2558 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-192.ec2.internal\" not found" node="ip-10-0-134-192.ec2.internal"
May 25 01:02:21.638157 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.638139    2558 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-192.ec2.internal" not found
May 25 01:02:21.640511 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.640496    2558 manager.go:324] Recovery completed
May 25 01:02:21.644677 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.644665    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 01:02:21.646872 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.646857    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-192.ec2.internal" event="NodeHasSufficientMemory"
May 25 01:02:21.646929 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.646883    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-192.ec2.internal" event="NodeHasNoDiskPressure"
May 25 01:02:21.646929 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.646893    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-192.ec2.internal" event="NodeHasSufficientPID"
May 25 01:02:21.647381 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.647367    2558 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 25 01:02:21.647381 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.647379    2558 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 25 01:02:21.647448 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.647396    2558 state_mem.go:36] "Initialized new in-memory state store"
May 25 01:02:21.651509 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.651497    2558 policy_none.go:49] "None policy: Start"
May 25 01:02:21.651554 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.651514    2558 memory_manager.go:186] "Starting memorymanager" policy="None"
May 25 01:02:21.651554 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.651524    2558 state_mem.go:35] "Initializing new in-memory state store"
May 25 01:02:21.711011 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.698280    2558 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-192.ec2.internal" not found
May 25 01:02:21.711011 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.704909    2558 manager.go:341] "Starting Device Plugin manager"
May 25 01:02:21.711011 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:21.704989    2558 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 25 01:02:21.711011 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.705001    2558 server.go:85] "Starting device plugin registration server"
May 25 01:02:21.711011 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.705195    2558 eviction_manager.go:189] "Eviction manager: starting control loop"
May 25 01:02:21.711011 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.705205    2558 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 25 01:02:21.711011 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.705312    2558 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 25 01:02:21.711011 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.705433    2558 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 25 01:02:21.711011 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.705447    2558 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 25 01:02:21.711011 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:21.705870    2558 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 25 01:02:21.711011 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:21.705909    2558 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-192.ec2.internal\" not found"
May 25 01:02:21.750121 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.750062    2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 25 01:02:21.751454 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.751437    2558 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 25 01:02:21.751508 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.751465    2558 status_manager.go:230] "Starting to sync pod status with apiserver"
May 25 01:02:21.751508 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.751488    2558 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 25 01:02:21.751508 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.751500    2558 kubelet.go:2451] "Starting kubelet main sync loop"
May 25 01:02:21.751633 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:21.751547    2558 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 25 01:02:21.753784 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.753766    2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 01:02:21.805469 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.805446    2558 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 25 01:02:21.806716 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.806696    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-192.ec2.internal" event="NodeHasSufficientMemory"
May 25 01:02:21.806803 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.806728    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-192.ec2.internal" event="NodeHasNoDiskPressure"
May 25 01:02:21.806803 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.806744    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-192.ec2.internal" event="NodeHasSufficientPID"
May 25 01:02:21.806803 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.806772    2558 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-192.ec2.internal"
May 25 01:02:21.815399 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.815374    2558 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-192.ec2.internal"
May 25 01:02:21.815494 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:21.815401    2558 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-192.ec2.internal\": node \"ip-10-0-134-192.ec2.internal\" not found"
May 25 01:02:21.851998 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.851973    2558 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-192.ec2.internal"]
May 25 01:02:21.856503 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.856487    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal"
May 25 01:02:21.856584 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.856487    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-192.ec2.internal"
May 25 01:02:21.883864 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.883843    2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal"
May 25 01:02:21.888361 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.888347    2558 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-192.ec2.internal"
May 25 01:02:21.897171 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.897151    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 25 01:02:21.900678 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:21.900665    2558 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 25 01:02:22.028055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.027964    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1f1143e08f8b1e7ddea0e097e6000e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal\" (UID: \"d1f1143e08f8b1e7ddea0e097e6000e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal"
May 25 01:02:22.028055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.027999    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1f1143e08f8b1e7ddea0e097e6000e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal\" (UID: \"d1f1143e08f8b1e7ddea0e097e6000e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal"
May 25 01:02:22.028055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.028017    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc4742061d692c5e7a76b30e593408e2-config\") pod \"kube-apiserver-proxy-ip-10-0-134-192.ec2.internal\" (UID: \"dc4742061d692c5e7a76b30e593408e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-192.ec2.internal"
May 25 01:02:22.128348 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.128291    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1f1143e08f8b1e7ddea0e097e6000e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal\" (UID: \"d1f1143e08f8b1e7ddea0e097e6000e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal"
May 25 01:02:22.128348 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.128348    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1f1143e08f8b1e7ddea0e097e6000e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal\" (UID: \"d1f1143e08f8b1e7ddea0e097e6000e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal"
May 25 01:02:22.128558 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.128374    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc4742061d692c5e7a76b30e593408e2-config\") pod \"kube-apiserver-proxy-ip-10-0-134-192.ec2.internal\" (UID: \"dc4742061d692c5e7a76b30e593408e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-192.ec2.internal"
May 25 01:02:22.128558 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.128406    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d1f1143e08f8b1e7ddea0e097e6000e4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal\" (UID: \"d1f1143e08f8b1e7ddea0e097e6000e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal"
May 25 01:02:22.128558 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.128415    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d1f1143e08f8b1e7ddea0e097e6000e4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal\" (UID: \"d1f1143e08f8b1e7ddea0e097e6000e4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal"
May 25 01:02:22.128558 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.128414    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/dc4742061d692c5e7a76b30e593408e2-config\") pod \"kube-apiserver-proxy-ip-10-0-134-192.ec2.internal\" (UID: \"dc4742061d692c5e7a76b30e593408e2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-192.ec2.internal"
May 25 01:02:22.200395 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.200345    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal"
May 25 01:02:22.204306 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.204289    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-192.ec2.internal"
May 25 01:02:22.515621 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.515527    2558 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 25 01:02:22.516301 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.515760    2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 01:02:22.516301 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.515761    2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 01:02:22.516301 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.515767    2558 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 25 01:02:22.597862 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.597819    2558 apiserver.go:52] "Watching apiserver"
May 25 01:02:22.606182 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.606153    2558 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 25 01:02:22.606182 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.606154    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-24 00:57:21 +0000 UTC" deadline="2027-12-20 19:56:25.991340572 +0000 UTC"
May 25 01:02:22.606182 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.606183    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13794h54m3.385161344s"
May 25 01:02:22.607043 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.607024    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-8lvf6","kube-system/kube-apiserver-proxy-ip-10-0-134-192.ec2.internal","openshift-image-registry/node-ca-zzq7t","openshift-multus/multus-additional-cni-plugins-qbdkp","openshift-multus/network-metrics-daemon-tsh68","openshift-ovn-kubernetes/ovnkube-node-489fr","kube-system/konnectivity-agent-wcggc","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs","openshift-cluster-node-tuning-operator/tuned-8kfgx","openshift-dns/node-resolver-ww4sb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal","openshift-multus/multus-7xh9r","openshift-network-diagnostics/network-check-target-86fcn"]
May 25 01:02:22.611557 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.611537    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8lvf6"
May 25 01:02:22.613671 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.613653    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zzq7t"
May 25 01:02:22.614374 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.614354    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 25 01:02:22.614374 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.614365    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 25 01:02:22.614546 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.614464    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-t8xcl\""
May 25 01:02:22.614608 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.614595    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 25 01:02:22.615845 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.615819    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.618358 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.615880    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:22.618358 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:22.616495    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsh68" podUID="0c53f430-328a-4e17-b089-976b8d399f7c"
May 25 01:02:22.618358 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.616521    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 25 01:02:22.618358 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.617461    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-g8bhk\""
May 25 01:02:22.618358 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.617466    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 25 01:02:22.618358 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.617632    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 25 01:02:22.619281 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.619256    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 25 01:02:22.619415 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.619373    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 25 01:02:22.619554 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.619532    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 25 01:02:22.619613 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.619587    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6wtc8\""
May 25 01:02:22.619667 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.619592    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 25 01:02:22.620031 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.620013    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 25 01:02:22.620389 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.620367    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.622581 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.622561    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 25 01:02:22.622764 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.622747    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 25 01:02:22.622898 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.622876    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 25 01:02:22.622990 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.622917    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 25 01:02:22.623052 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.622669    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 25 01:02:22.623543 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.623525    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wcggc"
May 25 01:02:22.624050 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.624033    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rgczj\""
May 25 01:02:22.624133 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.624038    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 25 01:02:22.625751 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.625733    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 25 01:02:22.625968 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.625950    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 25 01:02:22.626055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.626034    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hq8pn\""
May 25 01:02:22.627517 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.627498    2558 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 25 01:02:22.628247 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.628231    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.628352 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.628307    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.630164 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630148    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-run-ovn\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.630245 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630171    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf495452-67dc-4f05-acdb-be8bc6bbc7ef-host-slash\") pod \"iptables-alerter-8lvf6\" (UID: \"bf495452-67dc-4f05-acdb-be8bc6bbc7ef\") " pod="openshift-network-operator/iptables-alerter-8lvf6"
May 25 01:02:22.630245 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630188    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-system-cni-dir\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.630245 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630206    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-var-lib-kubelet\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.630245 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630223    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0713f95-73bc-45ec-8ca9-6a112c922be2-device-dir\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.630245 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630239    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2840b59-ac22-4a30-a93d-14f69e48bfce-ovnkube-config\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.630507 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630286    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-etc-kubernetes\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.630507 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630318    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-etc-sysctl-d\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.630507 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630364    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-kubelet\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.630507 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630388    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2840b59-ac22-4a30-a93d-14f69e48bfce-ovn-node-metrics-cert\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.630507 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630416    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.630507 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630441    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-sys\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.630507 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630464    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-slash\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.630817 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630505    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-etc-openvswitch\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.630817 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630542    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.630817 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630574    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/591fa1dd-4784-4b01-9144-9bdeab02f6df-serviceca\") pod \"node-ca-zzq7t\" (UID: \"591fa1dd-4784-4b01-9144-9bdeab02f6df\") " pod="openshift-image-registry/node-ca-zzq7t"
May 25 01:02:22.630817 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630609    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bqjnd\" (UniqueName: \"kubernetes.io/projected/581441ba-b208-4147-8ab3-3fe653ea341f-kube-api-access-bqjnd\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.630817 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630635    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/591fa1dd-4784-4b01-9144-9bdeab02f6df-host\") pod \"node-ca-zzq7t\" (UID: \"591fa1dd-4784-4b01-9144-9bdeab02f6df\") " pod="openshift-image-registry/node-ca-zzq7t"
May 25 01:02:22.630817 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630665    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-var-lib-openvswitch\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.630817 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630703    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prs8h\" (UniqueName: \"kubernetes.io/projected/d2840b59-ac22-4a30-a93d-14f69e48bfce-kube-api-access-prs8h\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.630817 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630732    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/581441ba-b208-4147-8ab3-3fe653ea341f-tmp\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.630817 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630758    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9e31f2a1-0497-41d1-9c61-6d4dfb24caf6-konnectivity-ca\") pod \"konnectivity-agent-wcggc\" (UID: \"9e31f2a1-0497-41d1-9c61-6d4dfb24caf6\") " pod="kube-system/konnectivity-agent-wcggc"
May 25 01:02:22.630817 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630770    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 25 01:02:22.630817 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630786    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-log-socket\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.630817 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630796    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ww4sb"
May 25 01:02:22.630817 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630801    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 25 01:02:22.630817 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630809    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-cni-netd\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.631446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630832    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bf495452-67dc-4f05-acdb-be8bc6bbc7ef-iptables-alerter-script\") pod \"iptables-alerter-8lvf6\" (UID: \"bf495452-67dc-4f05-acdb-be8bc6bbc7ef\") " pod="openshift-network-operator/iptables-alerter-8lvf6"
May 25 01:02:22.631446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630850    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 25 01:02:22.631446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630862    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-lib-modules\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.631446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630885    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0713f95-73bc-45ec-8ca9-6a112c922be2-etc-selinux\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.631446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630941    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-systemd-units\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.631446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630965    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-run-ovn-kubernetes\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.631446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.630993    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-269ct\" (UniqueName: \"kubernetes.io/projected/bf495452-67dc-4f05-acdb-be8bc6bbc7ef-kube-api-access-269ct\") pod \"iptables-alerter-8lvf6\" (UID: \"bf495452-67dc-4f05-acdb-be8bc6bbc7ef\") " pod="openshift-network-operator/iptables-alerter-8lvf6"
May 25 01:02:22.631446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631019    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4x79\" (UniqueName: \"kubernetes.io/projected/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-kube-api-access-b4x79\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.631446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631064    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9e31f2a1-0497-41d1-9c61-6d4dfb24caf6-agent-certs\") pod \"konnectivity-agent-wcggc\" (UID: \"9e31f2a1-0497-41d1-9c61-6d4dfb24caf6\") " pod="kube-system/konnectivity-agent-wcggc"
May 25 01:02:22.631446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631085    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 25 01:02:22.631446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631025    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fq9zz\""
May 25 01:02:22.631446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631106    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qss6c\" (UniqueName: \"kubernetes.io/projected/f0713f95-73bc-45ec-8ca9-6a112c922be2-kube-api-access-qss6c\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.631446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631085    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 25 01:02:22.631446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631172    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-node-log\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.631446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631194    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-p9kr2\""
May 25 01:02:22.631446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631212    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-cni-bin\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.631446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631237    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2840b59-ac22-4a30-a93d-14f69e48bfce-ovnkube-script-lib\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.631446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631271    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs\") pod \"network-metrics-daemon-tsh68\" (UID: \"0c53f430-328a-4e17-b089-976b8d399f7c\") " pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:22.631446 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631298    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/581441ba-b208-4147-8ab3-3fe653ea341f-etc-tuned\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.632074 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631358    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0713f95-73bc-45ec-8ca9-6a112c922be2-registration-dir\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.632074 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631385    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0713f95-73bc-45ec-8ca9-6a112c922be2-sys-fs\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.632074 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631424    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0713f95-73bc-45ec-8ca9-6a112c922be2-socket-dir\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.632074 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631445    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-run\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.632074 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631467    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-host\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.632074 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631490    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrh8q\" (UniqueName: \"kubernetes.io/projected/591fa1dd-4784-4b01-9144-9bdeab02f6df-kube-api-access-lrh8q\") pod \"node-ca-zzq7t\" (UID: \"591fa1dd-4784-4b01-9144-9bdeab02f6df\") " pod="openshift-image-registry/node-ca-zzq7t"
May 25 01:02:22.632074 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631513    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-run-systemd\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.632074 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631538    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-run-openvswitch\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.632074 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631560    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.632074 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631583    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqzn7\" (UniqueName: \"kubernetes.io/projected/0c53f430-328a-4e17-b089-976b8d399f7c-kube-api-access-vqzn7\") pod \"network-metrics-daemon-tsh68\" (UID: \"0c53f430-328a-4e17-b089-976b8d399f7c\") " pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:22.632074 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631611    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-etc-systemd\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.632074 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631626    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-run-netns\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.632074 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631646    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-os-release\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.632074 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631670    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-cni-binary-copy\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.632074 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631683    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.632074 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631708    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-etc-sysctl-conf\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.632567 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631754    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-etc-sysconfig\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.632567 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631794    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0713f95-73bc-45ec-8ca9-6a112c922be2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.632567 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631813    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-etc-modprobe-d\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.632567 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631834    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2840b59-ac22-4a30-a93d-14f69e48bfce-env-overrides\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.632567 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.631848    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-cnibin\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.633076 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.633059    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.633483 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.633463    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-q58qf\""
May 25 01:02:22.633731 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.633712    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 25 01:02:22.633828 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.633813    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 25 01:02:22.635353 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.635317    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-wv4d5\""
May 25 01:02:22.635495 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.635473    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:22.635588 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:22.635569    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86fcn" podUID="1515b563-e1a3-4af0-9ac4-c57292fbd9c3"
May 25 01:02:22.635650 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.635486    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 25 01:02:22.641242 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.641224    2558 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 25 01:02:22.667664 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.667644    2558 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gdjlq"
May 25 01:02:22.679709 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.679687    2558 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gdjlq"
May 25 01:02:22.728314 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.728286    2558 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 25 01:02:22.730114 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:22.730080    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc4742061d692c5e7a76b30e593408e2.slice/crio-3c7e2edf217ad115ae50ec39351d777fc69d313c074e5963cd6d959b506af92c WatchSource:0}: Error finding container 3c7e2edf217ad115ae50ec39351d777fc69d313c074e5963cd6d959b506af92c: Status 404 returned error can't find the container with id 3c7e2edf217ad115ae50ec39351d777fc69d313c074e5963cd6d959b506af92c
May 25 01:02:22.732038 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732010    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lrh8q\" (UniqueName: \"kubernetes.io/projected/591fa1dd-4784-4b01-9144-9bdeab02f6df-kube-api-access-lrh8q\") pod \"node-ca-zzq7t\" (UID: \"591fa1dd-4784-4b01-9144-9bdeab02f6df\") " pod="openshift-image-registry/node-ca-zzq7t"
May 25 01:02:22.732142 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732055    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-run-systemd\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.732142 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732081    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-run-openvswitch\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.732142 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732109    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.732142 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732134    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-run-systemd\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.732361 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732136    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vqzn7\" (UniqueName: \"kubernetes.io/projected/0c53f430-328a-4e17-b089-976b8d399f7c-kube-api-access-vqzn7\") pod \"network-metrics-daemon-tsh68\" (UID: \"0c53f430-328a-4e17-b089-976b8d399f7c\") " pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:22.732361 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732192    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-etc-systemd\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.732361 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732201    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-run-openvswitch\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.732361 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732220    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-run-netns\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.732361 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732249    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e02977c4-1dc9-49ff-831d-d1f05f9e58c9-tmp-dir\") pod \"node-resolver-ww4sb\" (UID: \"e02977c4-1dc9-49ff-831d-d1f05f9e58c9\") " pod="openshift-dns/node-resolver-ww4sb"
May 25 01:02:22.732361 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732275    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-host-run-k8s-cni-cncf-io\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.732361 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732300    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-multus-conf-dir\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.732361 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732344    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-os-release\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.732728 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732370    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-cni-binary-copy\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.732728 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732395    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.732728 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732421    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-etc-sysctl-conf\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.732728 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732443    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-run-netns\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.732728 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732445    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-etc-sysconfig\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.732728 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732477    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0713f95-73bc-45ec-8ca9-6a112c922be2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.732728 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732493    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-etc-sysconfig\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.732728 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732503    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-etc-modprobe-d\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.732728 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732421    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-etc-systemd\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.732728 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732534    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2840b59-ac22-4a30-a93d-14f69e48bfce-env-overrides\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.732728 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732569    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-cnibin\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.732728 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732591    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/f0713f95-73bc-45ec-8ca9-6a112c922be2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.732728 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732596    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-system-cni-dir\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.732728 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732623    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-host-run-multus-certs\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.732728 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732651    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-run-ovn\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.733449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732737    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-etc-modprobe-d\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.733449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732807    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.733449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732870    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf495452-67dc-4f05-acdb-be8bc6bbc7ef-host-slash\") pod \"iptables-alerter-8lvf6\" (UID: \"bf495452-67dc-4f05-acdb-be8bc6bbc7ef\") " pod="openshift-network-operator/iptables-alerter-8lvf6"
May 25 01:02:22.733449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732888    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-os-release\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.733449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732898    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-system-cni-dir\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.733449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732928    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e02977c4-1dc9-49ff-831d-d1f05f9e58c9-hosts-file\") pod \"node-resolver-ww4sb\" (UID: \"e02977c4-1dc9-49ff-831d-d1f05f9e58c9\") " pod="openshift-dns/node-resolver-ww4sb"
May 25 01:02:22.733449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.732952    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/882c948a-ae67-41c4-81a0-f3fb8871aaa5-multus-daemon-config\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.733449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733006    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-multus-cni-dir\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.733449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733031    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-multus-socket-dir-parent\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.733449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733055    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-host-var-lib-cni-multus\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.733449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733057    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-cni-binary-copy\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.733449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733083    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-var-lib-kubelet\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.733449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733107    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-cnibin\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.733449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733130    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0713f95-73bc-45ec-8ca9-6a112c922be2-device-dir\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.733449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733196    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2840b59-ac22-4a30-a93d-14f69e48bfce-ovnkube-config\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.733449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733218    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-etc-kubernetes\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.733449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733257    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-etc-sysctl-d\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.734220 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733281    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-kubelet\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.734220 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733305    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2840b59-ac22-4a30-a93d-14f69e48bfce-ovn-node-metrics-cert\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.734220 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733347    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.734220 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733373    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-host-var-lib-cni-bin\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.734220 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733381    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.734220 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733399    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-etc-kubernetes\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.734220 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733423    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t89b9\" (UniqueName: \"kubernetes.io/projected/882c948a-ae67-41c4-81a0-f3fb8871aaa5-kube-api-access-t89b9\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.734220 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733448    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-sys\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.734220 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733455    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/f0713f95-73bc-45ec-8ca9-6a112c922be2-device-dir\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.734220 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733471    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-slash\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.734220 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733530    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/d2840b59-ac22-4a30-a93d-14f69e48bfce-env-overrides\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.734220 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733552    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-run-ovn\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.734220 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733589    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-cnibin\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.734220 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733588    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-etc-sysctl-d\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.734220 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733628    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-kubelet\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.734220 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733632    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bf495452-67dc-4f05-acdb-be8bc6bbc7ef-host-slash\") pod \"iptables-alerter-8lvf6\" (UID: \"bf495452-67dc-4f05-acdb-be8bc6bbc7ef\") " pod="openshift-network-operator/iptables-alerter-8lvf6"
May 25 01:02:22.734220 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733668    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-system-cni-dir\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.734985 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733710    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-etc-openvswitch\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.734985 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733742    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.734985 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733772    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/591fa1dd-4784-4b01-9144-9bdeab02f6df-serviceca\") pod \"node-ca-zzq7t\" (UID: \"591fa1dd-4784-4b01-9144-9bdeab02f6df\") " pod="openshift-image-registry/node-ca-zzq7t"
May 25 01:02:22.734985 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733800    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bqjnd\" (UniqueName: \"kubernetes.io/projected/581441ba-b208-4147-8ab3-3fe653ea341f-kube-api-access-bqjnd\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.734985 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733824    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/591fa1dd-4784-4b01-9144-9bdeab02f6df-host\") pod \"node-ca-zzq7t\" (UID: \"591fa1dd-4784-4b01-9144-9bdeab02f6df\") " pod="openshift-image-registry/node-ca-zzq7t"
May 25 01:02:22.734985 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733848    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-var-lib-openvswitch\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.734985 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733848    2558 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 25 01:02:22.734985 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733878    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-prs8h\" (UniqueName: \"kubernetes.io/projected/d2840b59-ac22-4a30-a93d-14f69e48bfce-kube-api-access-prs8h\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.734985 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733910    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb5bk\" (UniqueName: \"kubernetes.io/projected/e02977c4-1dc9-49ff-831d-d1f05f9e58c9-kube-api-access-bb5bk\") pod \"node-resolver-ww4sb\" (UID: \"e02977c4-1dc9-49ff-831d-d1f05f9e58c9\") " pod="openshift-dns/node-resolver-ww4sb"
May 25 01:02:22.734985 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.733943    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-hostroot\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.734985 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734049    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/581441ba-b208-4147-8ab3-3fe653ea341f-tmp\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.734985 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734081    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9e31f2a1-0497-41d1-9c61-6d4dfb24caf6-konnectivity-ca\") pod \"konnectivity-agent-wcggc\" (UID: \"9e31f2a1-0497-41d1-9c61-6d4dfb24caf6\") " pod="kube-system/konnectivity-agent-wcggc"
May 25 01:02:22.734985 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734109    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-log-socket\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.734985 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734125    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-var-lib-kubelet\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.734985 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734135    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-cni-netd\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.734985 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734163    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bf495452-67dc-4f05-acdb-be8bc6bbc7ef-iptables-alerter-script\") pod \"iptables-alerter-8lvf6\" (UID: \"bf495452-67dc-4f05-acdb-be8bc6bbc7ef\") " pod="openshift-network-operator/iptables-alerter-8lvf6"
May 25 01:02:22.734985 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734192    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6gnz\" (UniqueName: \"kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz\") pod \"network-check-target-86fcn\" (UID: \"1515b563-e1a3-4af0-9ac4-c57292fbd9c3\") " pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:22.735767 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734223    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-lib-modules\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.735767 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734248    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/882c948a-ae67-41c4-81a0-f3fb8871aaa5-cni-binary-copy\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.735767 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734250    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-tuning-conf-dir\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.735767 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734276    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0713f95-73bc-45ec-8ca9-6a112c922be2-etc-selinux\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.735767 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734310    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-etc-kubernetes\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.735767 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734316    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-systemd-units\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.735767 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734367    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-run-ovn-kubernetes\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.735767 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734082    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/d2840b59-ac22-4a30-a93d-14f69e48bfce-ovnkube-config\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.735767 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734455    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-slash\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.735767 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734459    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-cni-netd\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.735767 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734491    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-etc-openvswitch\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.735767 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734498    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-log-socket\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.735767 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734526    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.735767 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734539    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-run-ovn-kubernetes\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.735767 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734608    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-lib-modules\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.735767 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.734891    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/591fa1dd-4784-4b01-9144-9bdeab02f6df-serviceca\") pod \"node-ca-zzq7t\" (UID: \"591fa1dd-4784-4b01-9144-9bdeab02f6df\") " pod="openshift-image-registry/node-ca-zzq7t"
May 25 01:02:22.735767 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.735026    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/f0713f95-73bc-45ec-8ca9-6a112c922be2-etc-selinux\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.736792 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.735086    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-systemd-units\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.736792 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.735143    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-269ct\" (UniqueName: \"kubernetes.io/projected/bf495452-67dc-4f05-acdb-be8bc6bbc7ef-kube-api-access-269ct\") pod \"iptables-alerter-8lvf6\" (UID: \"bf495452-67dc-4f05-acdb-be8bc6bbc7ef\") " pod="openshift-network-operator/iptables-alerter-8lvf6"
May 25 01:02:22.736792 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.735149    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-var-lib-openvswitch\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.736792 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.735193    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-sys\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.736792 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.735221    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b4x79\" (UniqueName: \"kubernetes.io/projected/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-kube-api-access-b4x79\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.736792 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.735259    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/591fa1dd-4784-4b01-9144-9bdeab02f6df-host\") pod \"node-ca-zzq7t\" (UID: \"591fa1dd-4784-4b01-9144-9bdeab02f6df\") " pod="openshift-image-registry/node-ca-zzq7t"
May 25 01:02:22.736792 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.735302    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-etc-sysctl-conf\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.736792 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.735477    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9e31f2a1-0497-41d1-9c61-6d4dfb24caf6-konnectivity-ca\") pod \"konnectivity-agent-wcggc\" (UID: \"9e31f2a1-0497-41d1-9c61-6d4dfb24caf6\") " pod="kube-system/konnectivity-agent-wcggc"
May 25 01:02:22.736792 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.735571    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-host-var-lib-kubelet\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.736792 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.735606    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9e31f2a1-0497-41d1-9c61-6d4dfb24caf6-agent-certs\") pod \"konnectivity-agent-wcggc\" (UID: \"9e31f2a1-0497-41d1-9c61-6d4dfb24caf6\") " pod="kube-system/konnectivity-agent-wcggc"
May 25 01:02:22.736792 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.735630    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bf495452-67dc-4f05-acdb-be8bc6bbc7ef-iptables-alerter-script\") pod \"iptables-alerter-8lvf6\" (UID: \"bf495452-67dc-4f05-acdb-be8bc6bbc7ef\") " pod="openshift-network-operator/iptables-alerter-8lvf6"
May 25 01:02:22.736792 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.735754    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qss6c\" (UniqueName: \"kubernetes.io/projected/f0713f95-73bc-45ec-8ca9-6a112c922be2-kube-api-access-qss6c\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.736792 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.736142    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-node-log\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.736792 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.736171    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-cni-bin\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.736792 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.736195    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2840b59-ac22-4a30-a93d-14f69e48bfce-ovnkube-script-lib\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.736792 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.736218    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs\") pod \"network-metrics-daemon-tsh68\" (UID: \"0c53f430-328a-4e17-b089-976b8d399f7c\") " pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:22.736792 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.736243    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-host-run-netns\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.737599 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.736264    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/581441ba-b208-4147-8ab3-3fe653ea341f-etc-tuned\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.737599 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.736289    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0713f95-73bc-45ec-8ca9-6a112c922be2-registration-dir\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.737599 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.736313    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0713f95-73bc-45ec-8ca9-6a112c922be2-sys-fs\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.737599 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.736361    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-os-release\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.737599 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.736385    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0713f95-73bc-45ec-8ca9-6a112c922be2-socket-dir\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.737599 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.736406    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-run\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.737599 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.736427    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-host\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.737599 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.736515    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-host\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.737599 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:22.736598    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:22.737599 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:22.736667    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs podName:0c53f430-328a-4e17-b089-976b8d399f7c nodeName:}" failed. No retries permitted until 2026-05-25 01:02:23.23663349 +0000 UTC m=+2.106292808 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs") pod "network-metrics-daemon-tsh68" (UID: "0c53f430-328a-4e17-b089-976b8d399f7c") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:22.737599 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.736757    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/d2840b59-ac22-4a30-a93d-14f69e48bfce-ovnkube-script-lib\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.737599 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.736813    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-node-log\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.737599 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.736848    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d2840b59-ac22-4a30-a93d-14f69e48bfce-host-cni-bin\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.737599 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.737169    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/f0713f95-73bc-45ec-8ca9-6a112c922be2-registration-dir\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.737599 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.737156    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/581441ba-b208-4147-8ab3-3fe653ea341f-run\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.737599 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.737224    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/f0713f95-73bc-45ec-8ca9-6a112c922be2-sys-fs\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.737599 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.737288    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/f0713f95-73bc-45ec-8ca9-6a112c922be2-socket-dir\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.738847 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.738302    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/d2840b59-ac22-4a30-a93d-14f69e48bfce-ovn-node-metrics-cert\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.738847 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.738499    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 01:02:22.738847 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.738502    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/581441ba-b208-4147-8ab3-3fe653ea341f-tmp\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.739984 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.739960    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/581441ba-b208-4147-8ab3-3fe653ea341f-etc-tuned\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.740490 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.740474    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9e31f2a1-0497-41d1-9c61-6d4dfb24caf6-agent-certs\") pod \"konnectivity-agent-wcggc\" (UID: \"9e31f2a1-0497-41d1-9c61-6d4dfb24caf6\") " pod="kube-system/konnectivity-agent-wcggc"
May 25 01:02:22.744066 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.743955    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrh8q\" (UniqueName: \"kubernetes.io/projected/591fa1dd-4784-4b01-9144-9bdeab02f6df-kube-api-access-lrh8q\") pod \"node-ca-zzq7t\" (UID: \"591fa1dd-4784-4b01-9144-9bdeab02f6df\") " pod="openshift-image-registry/node-ca-zzq7t"
May 25 01:02:22.744066 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.744007    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqzn7\" (UniqueName: \"kubernetes.io/projected/0c53f430-328a-4e17-b089-976b8d399f7c-kube-api-access-vqzn7\") pod \"network-metrics-daemon-tsh68\" (UID: \"0c53f430-328a-4e17-b089-976b8d399f7c\") " pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:22.745484 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.745458    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-269ct\" (UniqueName: \"kubernetes.io/projected/bf495452-67dc-4f05-acdb-be8bc6bbc7ef-kube-api-access-269ct\") pod \"iptables-alerter-8lvf6\" (UID: \"bf495452-67dc-4f05-acdb-be8bc6bbc7ef\") " pod="openshift-network-operator/iptables-alerter-8lvf6"
May 25 01:02:22.746205 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.746180    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bqjnd\" (UniqueName: \"kubernetes.io/projected/581441ba-b208-4147-8ab3-3fe653ea341f-kube-api-access-bqjnd\") pod \"tuned-8kfgx\" (UID: \"581441ba-b208-4147-8ab3-3fe653ea341f\") " pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.746500 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.746482    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qss6c\" (UniqueName: \"kubernetes.io/projected/f0713f95-73bc-45ec-8ca9-6a112c922be2-kube-api-access-qss6c\") pod \"aws-ebs-csi-driver-node-j98hs\" (UID: \"f0713f95-73bc-45ec-8ca9-6a112c922be2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:22.746567 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.746513    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prs8h\" (UniqueName: \"kubernetes.io/projected/d2840b59-ac22-4a30-a93d-14f69e48bfce-kube-api-access-prs8h\") pod \"ovnkube-node-489fr\" (UID: \"d2840b59-ac22-4a30-a93d-14f69e48bfce\") " pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.746844 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.746823    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4x79\" (UniqueName: \"kubernetes.io/projected/2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154-kube-api-access-b4x79\") pod \"multus-additional-cni-plugins-qbdkp\" (UID: \"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154\") " pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.747107 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.747094    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8kfgx"
May 25 01:02:22.756897 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.756777    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8kfgx" event={"ID":"581441ba-b208-4147-8ab3-3fe653ea341f","Type":"ContainerStarted","Data":"2bf32e13980d4ef66502f66f9da8a4ed78894ae2f003bb7ea5c328886edb4591"}
May 25 01:02:22.757720 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.757689    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal" event={"ID":"d1f1143e08f8b1e7ddea0e097e6000e4","Type":"ContainerStarted","Data":"e5e47dad8c6862d2fa2d84cc3a812bedae7ea11f0fa3f4da8160c599fc25926b"}
May 25 01:02:22.761281 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.758791    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-192.ec2.internal" event={"ID":"dc4742061d692c5e7a76b30e593408e2","Type":"ContainerStarted","Data":"3c7e2edf217ad115ae50ec39351d777fc69d313c074e5963cd6d959b506af92c"}
May 25 01:02:22.837083 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.836981    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6gnz\" (UniqueName: \"kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz\") pod \"network-check-target-86fcn\" (UID: \"1515b563-e1a3-4af0-9ac4-c57292fbd9c3\") " pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:22.837083 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837031    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/882c948a-ae67-41c4-81a0-f3fb8871aaa5-cni-binary-copy\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.837083 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837049    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-host-var-lib-kubelet\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.837083 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837076    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-host-run-netns\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.837429 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837092    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-os-release\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.837429 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837111    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e02977c4-1dc9-49ff-831d-d1f05f9e58c9-tmp-dir\") pod \"node-resolver-ww4sb\" (UID: \"e02977c4-1dc9-49ff-831d-d1f05f9e58c9\") " pod="openshift-dns/node-resolver-ww4sb"
May 25 01:02:22.837429 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837133    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-host-run-k8s-cni-cncf-io\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.837429 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837155    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-multus-conf-dir\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.837429 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837155    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-host-var-lib-kubelet\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.837429 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837179    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-host-run-netns\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.837429 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837219    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-multus-conf-dir\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.837429 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837184    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-system-cni-dir\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.837429 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837218    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-host-run-k8s-cni-cncf-io\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.837429 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837240    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-system-cni-dir\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.837429 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837237    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-os-release\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.837429 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837266    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-host-run-multus-certs\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.837429 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837314    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e02977c4-1dc9-49ff-831d-d1f05f9e58c9-hosts-file\") pod \"node-resolver-ww4sb\" (UID: \"e02977c4-1dc9-49ff-831d-d1f05f9e58c9\") " pod="openshift-dns/node-resolver-ww4sb"
May 25 01:02:22.837429 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837349    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-host-run-multus-certs\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.837429 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837371    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e02977c4-1dc9-49ff-831d-d1f05f9e58c9-hosts-file\") pod \"node-resolver-ww4sb\" (UID: \"e02977c4-1dc9-49ff-831d-d1f05f9e58c9\") " pod="openshift-dns/node-resolver-ww4sb"
May 25 01:02:22.837429 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837373    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/882c948a-ae67-41c4-81a0-f3fb8871aaa5-multus-daemon-config\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.837429 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837399    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-multus-cni-dir\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.837429 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837422    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-multus-socket-dir-parent\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.838158 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837444    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-host-var-lib-cni-multus\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.838158 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837470    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-cnibin\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.838158 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837479    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-multus-cni-dir\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.838158 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837485    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-multus-socket-dir-parent\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.838158 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837500    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-host-var-lib-cni-bin\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.838158 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837495    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e02977c4-1dc9-49ff-831d-d1f05f9e58c9-tmp-dir\") pod \"node-resolver-ww4sb\" (UID: \"e02977c4-1dc9-49ff-831d-d1f05f9e58c9\") " pod="openshift-dns/node-resolver-ww4sb"
May 25 01:02:22.838158 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837519    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-host-var-lib-cni-multus\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.838158 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837522    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-cnibin\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.838158 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837544    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-host-var-lib-cni-bin\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.838158 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837583    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-etc-kubernetes\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.838158 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837610    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t89b9\" (UniqueName: \"kubernetes.io/projected/882c948a-ae67-41c4-81a0-f3fb8871aaa5-kube-api-access-t89b9\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.838158 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837621    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-etc-kubernetes\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.838158 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837656    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bb5bk\" (UniqueName: \"kubernetes.io/projected/e02977c4-1dc9-49ff-831d-d1f05f9e58c9-kube-api-access-bb5bk\") pod \"node-resolver-ww4sb\" (UID: \"e02977c4-1dc9-49ff-831d-d1f05f9e58c9\") " pod="openshift-dns/node-resolver-ww4sb"
May 25 01:02:22.838158 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837682    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-hostroot\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.838158 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837737    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/882c948a-ae67-41c4-81a0-f3fb8871aaa5-hostroot\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.838158 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.837901    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/882c948a-ae67-41c4-81a0-f3fb8871aaa5-multus-daemon-config\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.838158 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.838011    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/882c948a-ae67-41c4-81a0-f3fb8871aaa5-cni-binary-copy\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.843043 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:22.843025    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:02:22.843043 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:22.843044    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:02:22.843182 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:22.843053    2558 projected.go:194] Error preparing data for projected volume kube-api-access-v6gnz for pod openshift-network-diagnostics/network-check-target-86fcn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:22.843182 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:22.843116    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz podName:1515b563-e1a3-4af0-9ac4-c57292fbd9c3 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:23.343102275 +0000 UTC m=+2.212761579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-v6gnz" (UniqueName: "kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz") pod "network-check-target-86fcn" (UID: "1515b563-e1a3-4af0-9ac4-c57292fbd9c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:22.846034 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.846012    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t89b9\" (UniqueName: \"kubernetes.io/projected/882c948a-ae67-41c4-81a0-f3fb8871aaa5-kube-api-access-t89b9\") pod \"multus-7xh9r\" (UID: \"882c948a-ae67-41c4-81a0-f3fb8871aaa5\") " pod="openshift-multus/multus-7xh9r"
May 25 01:02:22.846118 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.846050    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb5bk\" (UniqueName: \"kubernetes.io/projected/e02977c4-1dc9-49ff-831d-d1f05f9e58c9-kube-api-access-bb5bk\") pod \"node-resolver-ww4sb\" (UID: \"e02977c4-1dc9-49ff-831d-d1f05f9e58c9\") " pod="openshift-dns/node-resolver-ww4sb"
May 25 01:02:22.937587 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.937552    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8lvf6"
May 25 01:02:22.944482 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:22.944307    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf495452_67dc_4f05_acdb_be8bc6bbc7ef.slice/crio-57c6c1b08a5b9fd6a95e5cf2ea143951a8cac03b3274652d5bcc038c05188a9d WatchSource:0}: Error finding container 57c6c1b08a5b9fd6a95e5cf2ea143951a8cac03b3274652d5bcc038c05188a9d: Status 404 returned error can't find the container with id 57c6c1b08a5b9fd6a95e5cf2ea143951a8cac03b3274652d5bcc038c05188a9d
May 25 01:02:22.953965 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.953950    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-zzq7t"
May 25 01:02:22.960048 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:22.960029    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod591fa1dd_4784_4b01_9144_9bdeab02f6df.slice/crio-49652ca2b8fea2554fc421cc00f4eefd4cd4d3f613aa2caedf29a4d8c0f83e2d WatchSource:0}: Error finding container 49652ca2b8fea2554fc421cc00f4eefd4cd4d3f613aa2caedf29a4d8c0f83e2d: Status 404 returned error can't find the container with id 49652ca2b8fea2554fc421cc00f4eefd4cd4d3f613aa2caedf29a4d8c0f83e2d
May 25 01:02:22.968886 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.968869    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-qbdkp"
May 25 01:02:22.975269 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:22.975250    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bd1f5e3_5de4_4ad7_86a1_b7a3edd30154.slice/crio-3cf4371ce5de71fa6433e3d1e404fa24e07663d309366a31dc46f8b353e28457 WatchSource:0}: Error finding container 3cf4371ce5de71fa6433e3d1e404fa24e07663d309366a31dc46f8b353e28457: Status 404 returned error can't find the container with id 3cf4371ce5de71fa6433e3d1e404fa24e07663d309366a31dc46f8b353e28457
May 25 01:02:22.988864 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:22.988846    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:22.994050 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:22.994031    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2840b59_ac22_4a30_a93d_14f69e48bfce.slice/crio-2320f56ee5c6b7862f42ef144b8e7022beac7ad88db115c00e595dff01b61bb1 WatchSource:0}: Error finding container 2320f56ee5c6b7862f42ef144b8e7022beac7ad88db115c00e595dff01b61bb1: Status 404 returned error can't find the container with id 2320f56ee5c6b7862f42ef144b8e7022beac7ad88db115c00e595dff01b61bb1
May 25 01:02:23.004479 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:23.004455    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-wcggc"
May 25 01:02:23.010385 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:23.010365    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e31f2a1_0497_41d1_9c61_6d4dfb24caf6.slice/crio-5f46eb6b0c09d0431e1eb316085990069d4e6ecfe9db388d6848f1617e59ed16 WatchSource:0}: Error finding container 5f46eb6b0c09d0431e1eb316085990069d4e6ecfe9db388d6848f1617e59ed16: Status 404 returned error can't find the container with id 5f46eb6b0c09d0431e1eb316085990069d4e6ecfe9db388d6848f1617e59ed16
May 25 01:02:23.024733 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:23.024711    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs"
May 25 01:02:23.031998 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:23.031972    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0713f95_73bc_45ec_8ca9_6a112c922be2.slice/crio-0877ea6b646380587ad6d0e3312cd3a200bbf86ebf9d24fbf2f8f21a168208cf WatchSource:0}: Error finding container 0877ea6b646380587ad6d0e3312cd3a200bbf86ebf9d24fbf2f8f21a168208cf: Status 404 returned error can't find the container with id 0877ea6b646380587ad6d0e3312cd3a200bbf86ebf9d24fbf2f8f21a168208cf
May 25 01:02:23.050796 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:23.050775    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ww4sb"
May 25 01:02:23.056396 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:23.056382    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-7xh9r"
May 25 01:02:23.056873 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:23.056857    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode02977c4_1dc9_49ff_831d_d1f05f9e58c9.slice/crio-18884d6199e1c825314c6732b8a92759fea68724545e19e51ad4f7c78553f5d5 WatchSource:0}: Error finding container 18884d6199e1c825314c6732b8a92759fea68724545e19e51ad4f7c78553f5d5: Status 404 returned error can't find the container with id 18884d6199e1c825314c6732b8a92759fea68724545e19e51ad4f7c78553f5d5
May 25 01:02:23.062634 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:02:23.062611    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod882c948a_ae67_41c4_81a0_f3fb8871aaa5.slice/crio-0a09c08ff525c2cc567299752689aa8a7e0762db2c558439ca65ff638aa1a818 WatchSource:0}: Error finding container 0a09c08ff525c2cc567299752689aa8a7e0762db2c558439ca65ff638aa1a818: Status 404 returned error can't find the container with id 0a09c08ff525c2cc567299752689aa8a7e0762db2c558439ca65ff638aa1a818
May 25 01:02:23.240862 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:23.240739    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs\") pod \"network-metrics-daemon-tsh68\" (UID: \"0c53f430-328a-4e17-b089-976b8d399f7c\") " pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:23.241027 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:23.240905    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:23.241027 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:23.240963    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs podName:0c53f430-328a-4e17-b089-976b8d399f7c nodeName:}" failed. No retries permitted until 2026-05-25 01:02:24.240945616 +0000 UTC m=+3.110604937 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs") pod "network-metrics-daemon-tsh68" (UID: "0c53f430-328a-4e17-b089-976b8d399f7c") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:23.441683 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:23.441645    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6gnz\" (UniqueName: \"kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz\") pod \"network-check-target-86fcn\" (UID: \"1515b563-e1a3-4af0-9ac4-c57292fbd9c3\") " pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:23.441859 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:23.441836    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:02:23.441859 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:23.441857    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:02:23.441962 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:23.441869    2558 projected.go:194] Error preparing data for projected volume kube-api-access-v6gnz for pod openshift-network-diagnostics/network-check-target-86fcn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:23.441962 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:23.441930    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz podName:1515b563-e1a3-4af0-9ac4-c57292fbd9c3 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:24.441910758 +0000 UTC m=+3.311570065 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-v6gnz" (UniqueName: "kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz") pod "network-check-target-86fcn" (UID: "1515b563-e1a3-4af0-9ac4-c57292fbd9c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:23.681283 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:23.681184    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 00:57:22 +0000 UTC" deadline="2028-02-25 11:53:33.252192826 +0000 UTC"
May 25 01:02:23.681283 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:23.681226    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15394h51m9.570971081s"
May 25 01:02:23.732435 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:23.732254    2558 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 01:02:23.754995 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:23.754475    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:23.754995 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:23.754588    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86fcn" podUID="1515b563-e1a3-4af0-9ac4-c57292fbd9c3"
May 25 01:02:23.779759 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:23.779722    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ww4sb" event={"ID":"e02977c4-1dc9-49ff-831d-d1f05f9e58c9","Type":"ContainerStarted","Data":"18884d6199e1c825314c6732b8a92759fea68724545e19e51ad4f7c78553f5d5"}
May 25 01:02:23.795255 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:23.795220    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs" event={"ID":"f0713f95-73bc-45ec-8ca9-6a112c922be2","Type":"ContainerStarted","Data":"0877ea6b646380587ad6d0e3312cd3a200bbf86ebf9d24fbf2f8f21a168208cf"}
May 25 01:02:23.801954 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:23.801878    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbdkp" event={"ID":"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154","Type":"ContainerStarted","Data":"3cf4371ce5de71fa6433e3d1e404fa24e07663d309366a31dc46f8b353e28457"}
May 25 01:02:23.806770 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:23.806393    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zzq7t" event={"ID":"591fa1dd-4784-4b01-9144-9bdeab02f6df","Type":"ContainerStarted","Data":"49652ca2b8fea2554fc421cc00f4eefd4cd4d3f613aa2caedf29a4d8c0f83e2d"}
May 25 01:02:23.809162 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:23.809097    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8lvf6" event={"ID":"bf495452-67dc-4f05-acdb-be8bc6bbc7ef","Type":"ContainerStarted","Data":"57c6c1b08a5b9fd6a95e5cf2ea143951a8cac03b3274652d5bcc038c05188a9d"}
May 25 01:02:23.829731 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:23.829695    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7xh9r" event={"ID":"882c948a-ae67-41c4-81a0-f3fb8871aaa5","Type":"ContainerStarted","Data":"0a09c08ff525c2cc567299752689aa8a7e0762db2c558439ca65ff638aa1a818"}
May 25 01:02:23.850944 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:23.850909    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wcggc" event={"ID":"9e31f2a1-0497-41d1-9c61-6d4dfb24caf6","Type":"ContainerStarted","Data":"5f46eb6b0c09d0431e1eb316085990069d4e6ecfe9db388d6848f1617e59ed16"}
May 25 01:02:23.858312 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:23.858281    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-489fr" event={"ID":"d2840b59-ac22-4a30-a93d-14f69e48bfce","Type":"ContainerStarted","Data":"2320f56ee5c6b7862f42ef144b8e7022beac7ad88db115c00e595dff01b61bb1"}
May 25 01:02:24.018243 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:24.018167    2558 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 01:02:24.048680 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:24.048476    2558 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 25 01:02:24.247777 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:24.247743    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs\") pod \"network-metrics-daemon-tsh68\" (UID: \"0c53f430-328a-4e17-b089-976b8d399f7c\") " pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:24.247960 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:24.247889    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:24.247960 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:24.247953    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs podName:0c53f430-328a-4e17-b089-976b8d399f7c nodeName:}" failed. No retries permitted until 2026-05-25 01:02:26.247935188 +0000 UTC m=+5.117594506 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs") pod "network-metrics-daemon-tsh68" (UID: "0c53f430-328a-4e17-b089-976b8d399f7c") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:24.449576 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:24.449492    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6gnz\" (UniqueName: \"kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz\") pod \"network-check-target-86fcn\" (UID: \"1515b563-e1a3-4af0-9ac4-c57292fbd9c3\") " pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:24.450077 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:24.449895    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:02:24.450710 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:24.450245    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:02:24.450710 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:24.450264    2558 projected.go:194] Error preparing data for projected volume kube-api-access-v6gnz for pod openshift-network-diagnostics/network-check-target-86fcn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:24.450710 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:24.450359    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz podName:1515b563-e1a3-4af0-9ac4-c57292fbd9c3 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:26.450312354 +0000 UTC m=+5.319971666 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-v6gnz" (UniqueName: "kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz") pod "network-check-target-86fcn" (UID: "1515b563-e1a3-4af0-9ac4-c57292fbd9c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:24.681755 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:24.681715    2558 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-24 00:57:22 +0000 UTC" deadline="2027-11-26 04:52:55.328406375 +0000 UTC"
May 25 01:02:24.681755 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:24.681752    2558 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13203h50m30.646657232s"
May 25 01:02:24.752722 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:24.752632    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:24.752887 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:24.752787    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsh68" podUID="0c53f430-328a-4e17-b089-976b8d399f7c"
May 25 01:02:25.755124 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:25.755093    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:25.755597 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:25.755223    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86fcn" podUID="1515b563-e1a3-4af0-9ac4-c57292fbd9c3"
May 25 01:02:26.265922 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:26.265881    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs\") pod \"network-metrics-daemon-tsh68\" (UID: \"0c53f430-328a-4e17-b089-976b8d399f7c\") " pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:26.266096 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:26.266056    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:26.266188 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:26.266130    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs podName:0c53f430-328a-4e17-b089-976b8d399f7c nodeName:}" failed. No retries permitted until 2026-05-25 01:02:30.266108732 +0000 UTC m=+9.135768043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs") pod "network-metrics-daemon-tsh68" (UID: "0c53f430-328a-4e17-b089-976b8d399f7c") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:26.468357 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:26.468301    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6gnz\" (UniqueName: \"kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz\") pod \"network-check-target-86fcn\" (UID: \"1515b563-e1a3-4af0-9ac4-c57292fbd9c3\") " pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:26.468549 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:26.468530    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:02:26.468646 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:26.468554    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:02:26.468646 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:26.468566    2558 projected.go:194] Error preparing data for projected volume kube-api-access-v6gnz for pod openshift-network-diagnostics/network-check-target-86fcn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:26.468646 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:26.468624    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz podName:1515b563-e1a3-4af0-9ac4-c57292fbd9c3 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:30.468604979 +0000 UTC m=+9.338264289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-v6gnz" (UniqueName: "kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz") pod "network-check-target-86fcn" (UID: "1515b563-e1a3-4af0-9ac4-c57292fbd9c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:26.752463 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:26.752391    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:26.752607 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:26.752528    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsh68" podUID="0c53f430-328a-4e17-b089-976b8d399f7c"
May 25 01:02:27.752627 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:27.752593    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:27.753106 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:27.752734    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86fcn" podUID="1515b563-e1a3-4af0-9ac4-c57292fbd9c3"
May 25 01:02:28.752702 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:28.752664    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:28.753136 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:28.752813    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsh68" podUID="0c53f430-328a-4e17-b089-976b8d399f7c"
May 25 01:02:29.754736 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:29.754701    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:29.762569 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:29.762531    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86fcn" podUID="1515b563-e1a3-4af0-9ac4-c57292fbd9c3"
May 25 01:02:30.301255 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:30.301207    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs\") pod \"network-metrics-daemon-tsh68\" (UID: \"0c53f430-328a-4e17-b089-976b8d399f7c\") " pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:30.301450 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:30.301381    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:30.301450 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:30.301436    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs podName:0c53f430-328a-4e17-b089-976b8d399f7c nodeName:}" failed. No retries permitted until 2026-05-25 01:02:38.301421345 +0000 UTC m=+17.171080648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs") pod "network-metrics-daemon-tsh68" (UID: "0c53f430-328a-4e17-b089-976b8d399f7c") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:30.395262 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:30.395154    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-dvwzt"]
May 25 01:02:30.398866 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:30.398498    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:30.398866 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:30.398589    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvwzt" podUID="4efbd4c0-45f2-4d23-8f4e-8708d81733c8"
May 25 01:02:30.502659 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:30.502614    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6gnz\" (UniqueName: \"kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz\") pod \"network-check-target-86fcn\" (UID: \"1515b563-e1a3-4af0-9ac4-c57292fbd9c3\") " pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:30.502836 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:30.502752    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-dbus\") pod \"global-pull-secret-syncer-dvwzt\" (UID: \"4efbd4c0-45f2-4d23-8f4e-8708d81733c8\") " pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:30.502836 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:30.502779    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret\") pod \"global-pull-secret-syncer-dvwzt\" (UID: \"4efbd4c0-45f2-4d23-8f4e-8708d81733c8\") " pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:30.502836 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:30.502796    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-kubelet-config\") pod \"global-pull-secret-syncer-dvwzt\" (UID: \"4efbd4c0-45f2-4d23-8f4e-8708d81733c8\") " pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:30.502960 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:30.502940    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:02:30.503006 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:30.502960    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:02:30.503006 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:30.502973    2558 projected.go:194] Error preparing data for projected volume kube-api-access-v6gnz for pod openshift-network-diagnostics/network-check-target-86fcn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:30.503097 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:30.503029    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz podName:1515b563-e1a3-4af0-9ac4-c57292fbd9c3 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:38.503010938 +0000 UTC m=+17.372670248 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-v6gnz" (UniqueName: "kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz") pod "network-check-target-86fcn" (UID: "1515b563-e1a3-4af0-9ac4-c57292fbd9c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:30.603395 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:30.603299    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-dbus\") pod \"global-pull-secret-syncer-dvwzt\" (UID: \"4efbd4c0-45f2-4d23-8f4e-8708d81733c8\") " pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:30.603395 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:30.603378    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret\") pod \"global-pull-secret-syncer-dvwzt\" (UID: \"4efbd4c0-45f2-4d23-8f4e-8708d81733c8\") " pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:30.603613 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:30.603407    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-kubelet-config\") pod \"global-pull-secret-syncer-dvwzt\" (UID: \"4efbd4c0-45f2-4d23-8f4e-8708d81733c8\") " pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:30.603613 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:30.603506    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-kubelet-config\") pod \"global-pull-secret-syncer-dvwzt\" (UID: \"4efbd4c0-45f2-4d23-8f4e-8708d81733c8\") " pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:30.603762 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:30.603738    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-dbus\") pod \"global-pull-secret-syncer-dvwzt\" (UID: \"4efbd4c0-45f2-4d23-8f4e-8708d81733c8\") " pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:30.603864 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:30.603848    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 01:02:30.603923 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:30.603910    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret podName:4efbd4c0-45f2-4d23-8f4e-8708d81733c8 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:31.103890756 +0000 UTC m=+9.973550063 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret") pod "global-pull-secret-syncer-dvwzt" (UID: "4efbd4c0-45f2-4d23-8f4e-8708d81733c8") : object "kube-system"/"original-pull-secret" not registered
May 25 01:02:30.752145 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:30.752102    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:30.752353 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:30.752251    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsh68" podUID="0c53f430-328a-4e17-b089-976b8d399f7c"
May 25 01:02:31.107780 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:31.107742    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret\") pod \"global-pull-secret-syncer-dvwzt\" (UID: \"4efbd4c0-45f2-4d23-8f4e-8708d81733c8\") " pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:31.108171 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:31.107910    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 01:02:31.108171 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:31.107983    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret podName:4efbd4c0-45f2-4d23-8f4e-8708d81733c8 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:32.1079626 +0000 UTC m=+10.977621909 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret") pod "global-pull-secret-syncer-dvwzt" (UID: "4efbd4c0-45f2-4d23-8f4e-8708d81733c8") : object "kube-system"/"original-pull-secret" not registered
May 25 01:02:31.753450 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:31.753409    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:31.753634 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:31.753522    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86fcn" podUID="1515b563-e1a3-4af0-9ac4-c57292fbd9c3"
May 25 01:02:31.753874 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:31.753855    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:31.753975 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:31.753954    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvwzt" podUID="4efbd4c0-45f2-4d23-8f4e-8708d81733c8"
May 25 01:02:32.116166 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:32.116082    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret\") pod \"global-pull-secret-syncer-dvwzt\" (UID: \"4efbd4c0-45f2-4d23-8f4e-8708d81733c8\") " pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:32.116630 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:32.116223    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 01:02:32.116630 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:32.116280    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret podName:4efbd4c0-45f2-4d23-8f4e-8708d81733c8 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:34.116267054 +0000 UTC m=+12.985926362 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret") pod "global-pull-secret-syncer-dvwzt" (UID: "4efbd4c0-45f2-4d23-8f4e-8708d81733c8") : object "kube-system"/"original-pull-secret" not registered
May 25 01:02:32.752532 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:32.752505    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:32.752711 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:32.752627    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsh68" podUID="0c53f430-328a-4e17-b089-976b8d399f7c"
May 25 01:02:33.752687 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:33.752636    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:33.753140 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:33.752740    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86fcn" podUID="1515b563-e1a3-4af0-9ac4-c57292fbd9c3"
May 25 01:02:33.753140 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:33.752644    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:33.753140 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:33.752908    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvwzt" podUID="4efbd4c0-45f2-4d23-8f4e-8708d81733c8"
May 25 01:02:34.129145 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:34.129107    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret\") pod \"global-pull-secret-syncer-dvwzt\" (UID: \"4efbd4c0-45f2-4d23-8f4e-8708d81733c8\") " pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:34.129300 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:34.129237    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 01:02:34.129398 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:34.129308    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret podName:4efbd4c0-45f2-4d23-8f4e-8708d81733c8 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:38.129291957 +0000 UTC m=+16.998951273 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret") pod "global-pull-secret-syncer-dvwzt" (UID: "4efbd4c0-45f2-4d23-8f4e-8708d81733c8") : object "kube-system"/"original-pull-secret" not registered
May 25 01:02:34.752147 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:34.752115    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:34.752361 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:34.752247    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsh68" podUID="0c53f430-328a-4e17-b089-976b8d399f7c"
May 25 01:02:35.752482 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:35.752444    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:35.752933 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:35.752444    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:35.752933 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:35.752564    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvwzt" podUID="4efbd4c0-45f2-4d23-8f4e-8708d81733c8"
May 25 01:02:35.752933 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:35.752676    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86fcn" podUID="1515b563-e1a3-4af0-9ac4-c57292fbd9c3"
May 25 01:02:36.752104 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:36.752073    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:36.752277 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:36.752217    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsh68" podUID="0c53f430-328a-4e17-b089-976b8d399f7c"
May 25 01:02:37.751835 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:37.751805    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:37.752222 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:37.751805    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:37.752222 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:37.751929    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86fcn" podUID="1515b563-e1a3-4af0-9ac4-c57292fbd9c3"
May 25 01:02:37.752222 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:37.752002    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvwzt" podUID="4efbd4c0-45f2-4d23-8f4e-8708d81733c8"
May 25 01:02:38.161277 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:38.161236    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret\") pod \"global-pull-secret-syncer-dvwzt\" (UID: \"4efbd4c0-45f2-4d23-8f4e-8708d81733c8\") " pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:38.161524 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:38.161367    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 01:02:38.161524 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:38.161432    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret podName:4efbd4c0-45f2-4d23-8f4e-8708d81733c8 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:46.161416385 +0000 UTC m=+25.031075691 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret") pod "global-pull-secret-syncer-dvwzt" (UID: "4efbd4c0-45f2-4d23-8f4e-8708d81733c8") : object "kube-system"/"original-pull-secret" not registered
May 25 01:02:38.362798 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:38.362765    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs\") pod \"network-metrics-daemon-tsh68\" (UID: \"0c53f430-328a-4e17-b089-976b8d399f7c\") " pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:38.362966 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:38.362909    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:38.363007 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:38.362982    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs podName:0c53f430-328a-4e17-b089-976b8d399f7c nodeName:}" failed. No retries permitted until 2026-05-25 01:02:54.362964587 +0000 UTC m=+33.232623908 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs") pod "network-metrics-daemon-tsh68" (UID: "0c53f430-328a-4e17-b089-976b8d399f7c") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:38.565073 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:38.565032    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6gnz\" (UniqueName: \"kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz\") pod \"network-check-target-86fcn\" (UID: \"1515b563-e1a3-4af0-9ac4-c57292fbd9c3\") " pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:38.565238 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:38.565192    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:02:38.565238 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:38.565216    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:02:38.565238 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:38.565229    2558 projected.go:194] Error preparing data for projected volume kube-api-access-v6gnz for pod openshift-network-diagnostics/network-check-target-86fcn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:38.565370 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:38.565280    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz podName:1515b563-e1a3-4af0-9ac4-c57292fbd9c3 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:54.565265589 +0000 UTC m=+33.434924897 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-v6gnz" (UniqueName: "kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz") pod "network-check-target-86fcn" (UID: "1515b563-e1a3-4af0-9ac4-c57292fbd9c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:38.752628 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:38.752593    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:38.753081 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:38.752724    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsh68" podUID="0c53f430-328a-4e17-b089-976b8d399f7c"
May 25 01:02:39.752134 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:39.752094    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:39.752295 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:39.752094    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:39.752295 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:39.752205    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86fcn" podUID="1515b563-e1a3-4af0-9ac4-c57292fbd9c3"
May 25 01:02:39.752403 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:39.752303    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvwzt" podUID="4efbd4c0-45f2-4d23-8f4e-8708d81733c8"
May 25 01:02:40.752292 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:40.752260    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:40.752816 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:40.752411    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsh68" podUID="0c53f430-328a-4e17-b089-976b8d399f7c"
May 25 01:02:41.752647 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:41.752614    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:41.753422 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:41.752742    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvwzt" podUID="4efbd4c0-45f2-4d23-8f4e-8708d81733c8"
May 25 01:02:41.753422 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:41.752802    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:41.753422 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:41.752923    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86fcn" podUID="1515b563-e1a3-4af0-9ac4-c57292fbd9c3"
May 25 01:02:42.752133 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:42.752090    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:42.752284 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:42.752260    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsh68" podUID="0c53f430-328a-4e17-b089-976b8d399f7c"
May 25 01:02:42.903193 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:42.903162    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-7xh9r" event={"ID":"882c948a-ae67-41c4-81a0-f3fb8871aaa5","Type":"ContainerStarted","Data":"3268417e510c3cb0642e98ab0d4ccc9fcb495713305ac8569a8959e8b55ff978"}
May 25 01:02:42.905144 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:42.905117    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-489fr" event={"ID":"d2840b59-ac22-4a30-a93d-14f69e48bfce","Type":"ContainerStarted","Data":"60be4c5092de365b6b34188963c0b7769975723bbd078e2000f02e8be279ccd9"}
May 25 01:02:42.910119 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:42.910088    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8kfgx" event={"ID":"581441ba-b208-4147-8ab3-3fe653ea341f","Type":"ContainerStarted","Data":"5e90a1735a79c74cff1a64c0b2045778f861f1687c98e69a57db2d725833df16"}
May 25 01:02:42.911381 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:42.911357    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-192.ec2.internal" event={"ID":"dc4742061d692c5e7a76b30e593408e2","Type":"ContainerStarted","Data":"94cfa255ab957049b6c147e942dbe8db2f486bf6ac2a72ec9b1c64c59c48eb1a"}
May 25 01:02:42.953830 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:42.953423    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-7xh9r" podStartSLOduration=2.916277584 podStartE2EDuration="21.953409796s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="2026-05-25 01:02:23.063975979 +0000 UTC m=+1.933635284" lastFinishedPulling="2026-05-25 01:02:42.101108192 +0000 UTC m=+20.970767496" observedRunningTime="2026-05-25 01:02:42.930242916 +0000 UTC m=+21.799902267" watchObservedRunningTime="2026-05-25 01:02:42.953409796 +0000 UTC m=+21.823069121"
May 25 01:02:42.976812 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:42.976715    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-192.ec2.internal" podStartSLOduration=21.976700016 podStartE2EDuration="21.976700016s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:02:42.97659259 +0000 UTC m=+21.846251917" watchObservedRunningTime="2026-05-25 01:02:42.976700016 +0000 UTC m=+21.846359343"
May 25 01:02:42.977397 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:42.977360    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8kfgx" podStartSLOduration=2.6425009619999997 podStartE2EDuration="21.977350508s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="2026-05-25 01:02:22.755425788 +0000 UTC m=+1.625085105" lastFinishedPulling="2026-05-25 01:02:42.090275341 +0000 UTC m=+20.959934651" observedRunningTime="2026-05-25 01:02:42.956524362 +0000 UTC m=+21.826183688" watchObservedRunningTime="2026-05-25 01:02:42.977350508 +0000 UTC m=+21.847009835"
May 25 01:02:43.752239 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:43.752068    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:43.752411 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:43.752113    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:43.752411 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:43.752304    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86fcn" podUID="1515b563-e1a3-4af0-9ac4-c57292fbd9c3"
May 25 01:02:43.752513 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:43.752416    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvwzt" podUID="4efbd4c0-45f2-4d23-8f4e-8708d81733c8"
May 25 01:02:43.914458 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:43.914419    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-zzq7t" event={"ID":"591fa1dd-4784-4b01-9144-9bdeab02f6df","Type":"ContainerStarted","Data":"38d89b488fc00a1cdb982aba7ebcbdf7105208c0c0f7481ddc8385f0382d1a8a"}
May 25 01:02:43.915708 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:43.915665    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8lvf6" event={"ID":"bf495452-67dc-4f05-acdb-be8bc6bbc7ef","Type":"ContainerStarted","Data":"edfc1282962b7b8a48dc3b61e64e9e018b308b625fcf068955a03e7c5bda79b5"}
May 25 01:02:43.917095 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:43.917069    2558 generic.go:358] "Generic (PLEG): container finished" podID="d1f1143e08f8b1e7ddea0e097e6000e4" containerID="db66eafb935c8c4f220de56145a0c765aa9bdbdd858f18ddc23eef1dece49007" exitCode=0
May 25 01:02:43.917188 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:43.917145    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal" event={"ID":"d1f1143e08f8b1e7ddea0e097e6000e4","Type":"ContainerDied","Data":"db66eafb935c8c4f220de56145a0c765aa9bdbdd858f18ddc23eef1dece49007"}
May 25 01:02:43.918430 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:43.918405    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-wcggc" event={"ID":"9e31f2a1-0497-41d1-9c61-6d4dfb24caf6","Type":"ContainerStarted","Data":"38d97cdc1009e7b672c13d24bb22a1cbc596425dfff65e87161123895103b11e"}
May 25 01:02:43.920796 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:43.920776    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-489fr" event={"ID":"d2840b59-ac22-4a30-a93d-14f69e48bfce","Type":"ContainerStarted","Data":"1508f3ae71e4e32332f252532451ea1e81abd2c85d304f9c6a6e7ab3771b2e6e"}
May 25 01:02:43.920875 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:43.920802    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-489fr" event={"ID":"d2840b59-ac22-4a30-a93d-14f69e48bfce","Type":"ContainerStarted","Data":"05387934ea87f59020120d080d0c040fcbffd4fe34d1e6ef8fb9192abfe6af35"}
May 25 01:02:43.920875 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:43.920811    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-489fr" event={"ID":"d2840b59-ac22-4a30-a93d-14f69e48bfce","Type":"ContainerStarted","Data":"26713f3bce60625b65e30c0a1f6e95570427b7c4f7e3ad71f4c8c36aa8af6b91"}
May 25 01:02:43.920875 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:43.920819    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-489fr" event={"ID":"d2840b59-ac22-4a30-a93d-14f69e48bfce","Type":"ContainerStarted","Data":"0c774265cf63f4afd01efa40db7ac0454013dcbc930a8f1072e67d488ca5eef5"}
May 25 01:02:43.920875 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:43.920827    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-489fr" event={"ID":"d2840b59-ac22-4a30-a93d-14f69e48bfce","Type":"ContainerStarted","Data":"d22d917fb554dc5e66adf7bc6768f17680999c67ee844deed20be1605b7d3166"}
May 25 01:02:43.921838 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:43.921812    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ww4sb" event={"ID":"e02977c4-1dc9-49ff-831d-d1f05f9e58c9","Type":"ContainerStarted","Data":"b4477c7dd6570f86f982f33387f3197d9bb0b0420b584fbd577f44e7a8b37f53"}
May 25 01:02:43.922905 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:43.922888    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs" event={"ID":"f0713f95-73bc-45ec-8ca9-6a112c922be2","Type":"ContainerStarted","Data":"d234af07e8e40de7d2e663f0336c50a5dc8656c9f7203706513b388a7f485506"}
May 25 01:02:43.924012 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:43.923995    2558 generic.go:358] "Generic (PLEG): container finished" podID="2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154" containerID="4790c59d2354221b1ec17768f79be7ea41274831a6235f2d4e637c5c15ed37f0" exitCode=0
May 25 01:02:43.924083 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:43.924020    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbdkp" event={"ID":"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154","Type":"ContainerDied","Data":"4790c59d2354221b1ec17768f79be7ea41274831a6235f2d4e637c5c15ed37f0"}
May 25 01:02:43.936366 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:43.936307    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-zzq7t" podStartSLOduration=3.810300927 podStartE2EDuration="22.936297078s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="2026-05-25 01:02:22.962699712 +0000 UTC m=+1.832359019" lastFinishedPulling="2026-05-25 01:02:42.088695852 +0000 UTC m=+20.958355170" observedRunningTime="2026-05-25 01:02:43.936008517 +0000 UTC m=+22.805667843" watchObservedRunningTime="2026-05-25 01:02:43.936297078 +0000 UTC m=+22.805956404"
May 25 01:02:43.996096 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:43.996060    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-wcggc" podStartSLOduration=3.939383786 podStartE2EDuration="22.99605006s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="2026-05-25 01:02:23.011919032 +0000 UTC m=+1.881578339" lastFinishedPulling="2026-05-25 01:02:42.068585294 +0000 UTC m=+20.938244613" observedRunningTime="2026-05-25 01:02:43.995853587 +0000 UTC m=+22.865512912" watchObservedRunningTime="2026-05-25 01:02:43.99605006 +0000 UTC m=+22.865709385"
May 25 01:02:44.010902 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:44.010843    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-ww4sb" podStartSLOduration=3.974747829 podStartE2EDuration="23.010834297s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="2026-05-25 01:02:23.059628503 +0000 UTC m=+1.929287826" lastFinishedPulling="2026-05-25 01:02:42.095714991 +0000 UTC m=+20.965374294" observedRunningTime="2026-05-25 01:02:44.010420931 +0000 UTC m=+22.880080257" watchObservedRunningTime="2026-05-25 01:02:44.010834297 +0000 UTC m=+22.880493622"
May 25 01:02:44.220044 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:44.219838    2558 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 25 01:02:44.719819 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:44.719719    2558 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-25T01:02:44.21985826Z","UUID":"f102bfb3-be7b-472c-ba3a-7b15039024e1","Handler":null,"Name":"","Endpoint":""}
May 25 01:02:44.723381 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:44.723356    2558 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 25 01:02:44.723381 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:44.723380    2558 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 25 01:02:44.751699 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:44.751669    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:44.751828 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:44.751777    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsh68" podUID="0c53f430-328a-4e17-b089-976b8d399f7c"
May 25 01:02:44.927709 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:44.927661    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs" event={"ID":"f0713f95-73bc-45ec-8ca9-6a112c922be2","Type":"ContainerStarted","Data":"a4083aecb01c2eb7270c4a4ae5eb46df03f48bdd1d968de79fdad569827bd141"}
May 25 01:02:44.930222 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:44.930183    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal" event={"ID":"d1f1143e08f8b1e7ddea0e097e6000e4","Type":"ContainerStarted","Data":"bf5a21bdfff9a84e1dc22b747145e82298e73d6a032d572cce20c45daaec858f"}
May 25 01:02:44.946222 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:44.946173    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-192.ec2.internal" podStartSLOduration=23.946159853 podStartE2EDuration="23.946159853s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:02:44.945883952 +0000 UTC m=+23.815543302" watchObservedRunningTime="2026-05-25 01:02:44.946159853 +0000 UTC m=+23.815819179"
May 25 01:02:44.946395 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:44.946362    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8lvf6" podStartSLOduration=4.8011356769999995 podStartE2EDuration="23.94635591s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="2026-05-25 01:02:22.945907444 +0000 UTC m=+1.815566751" lastFinishedPulling="2026-05-25 01:02:42.091127661 +0000 UTC m=+20.960786984" observedRunningTime="2026-05-25 01:02:44.087498449 +0000 UTC m=+22.957157774" watchObservedRunningTime="2026-05-25 01:02:44.94635591 +0000 UTC m=+23.816015236"
May 25 01:02:45.517126 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:45.516867    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-wcggc"
May 25 01:02:45.517725 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:45.517702    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-wcggc"
May 25 01:02:45.752664 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:45.752166    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:45.752664 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:45.752225    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:45.752664 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:45.752341    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvwzt" podUID="4efbd4c0-45f2-4d23-8f4e-8708d81733c8"
May 25 01:02:45.752664 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:45.752439    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86fcn" podUID="1515b563-e1a3-4af0-9ac4-c57292fbd9c3"
May 25 01:02:45.936763 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:45.936726    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs" event={"ID":"f0713f95-73bc-45ec-8ca9-6a112c922be2","Type":"ContainerStarted","Data":"4357de070ba4dc1387f598b6b2183e726d8e472d213f7b007c182e6f1db50bd8"}
May 25 01:02:45.940052 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:45.940010    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-489fr" event={"ID":"d2840b59-ac22-4a30-a93d-14f69e48bfce","Type":"ContainerStarted","Data":"650035e950d6bae426361fa1f66ae5ee439b98937a7059071af7f6af9b9ffa51"}
May 25 01:02:45.940612 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:45.940504    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-wcggc"
May 25 01:02:45.940917 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:45.940882    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-wcggc"
May 25 01:02:45.956045 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:45.956011    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j98hs" podStartSLOduration=2.672852379 podStartE2EDuration="24.956001095s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="2026-05-25 01:02:23.033439726 +0000 UTC m=+1.903099030" lastFinishedPulling="2026-05-25 01:02:45.316588438 +0000 UTC m=+24.186247746" observedRunningTime="2026-05-25 01:02:45.955901432 +0000 UTC m=+24.825560759" watchObservedRunningTime="2026-05-25 01:02:45.956001095 +0000 UTC m=+24.825660420"
May 25 01:02:46.219643 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:46.219560    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret\") pod \"global-pull-secret-syncer-dvwzt\" (UID: \"4efbd4c0-45f2-4d23-8f4e-8708d81733c8\") " pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:46.219799 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:46.219724    2558 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 25 01:02:46.219861 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:46.219816    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret podName:4efbd4c0-45f2-4d23-8f4e-8708d81733c8 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:02.219793686 +0000 UTC m=+41.089452990 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret") pod "global-pull-secret-syncer-dvwzt" (UID: "4efbd4c0-45f2-4d23-8f4e-8708d81733c8") : object "kube-system"/"original-pull-secret" not registered
May 25 01:02:46.752027 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:46.751995    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:46.752201 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:46.752138    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsh68" podUID="0c53f430-328a-4e17-b089-976b8d399f7c"
May 25 01:02:47.752046 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:47.752018    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:47.752627 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:47.752047    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:47.752627 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:47.752116    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvwzt" podUID="4efbd4c0-45f2-4d23-8f4e-8708d81733c8"
May 25 01:02:47.752627 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:47.752271    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86fcn" podUID="1515b563-e1a3-4af0-9ac4-c57292fbd9c3"
May 25 01:02:48.751965 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:48.751808    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:48.752069 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:48.752042    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsh68" podUID="0c53f430-328a-4e17-b089-976b8d399f7c"
May 25 01:02:48.946146 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:48.946116    2558 generic.go:358] "Generic (PLEG): container finished" podID="2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154" containerID="399d731433bd1d52ace7eb2ea5bf13daf3e5db5ec0d878fb3ade3cbf6c75ac11" exitCode=0
May 25 01:02:48.946797 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:48.946202    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbdkp" event={"ID":"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154","Type":"ContainerDied","Data":"399d731433bd1d52ace7eb2ea5bf13daf3e5db5ec0d878fb3ade3cbf6c75ac11"}
May 25 01:02:48.949369 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:48.949348    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-489fr" event={"ID":"d2840b59-ac22-4a30-a93d-14f69e48bfce","Type":"ContainerStarted","Data":"f1e58144cd8d94212c8862f806ade915b1b2749ba3a2978f42d93fa66e113c4f"}
May 25 01:02:48.949661 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:48.949643    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:48.966671 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:48.966652    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:49.003361 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:49.003282    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-489fr" podStartSLOduration=8.196974924 podStartE2EDuration="28.003272046s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="2026-05-25 01:02:22.995387939 +0000 UTC m=+1.865047243" lastFinishedPulling="2026-05-25 01:02:42.801685058 +0000 UTC m=+21.671344365" observedRunningTime="2026-05-25 01:02:49.002206663 +0000 UTC m=+27.871865988" watchObservedRunningTime="2026-05-25 01:02:49.003272046 +0000 UTC m=+27.872931371"
May 25 01:02:49.752114 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:49.752084    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:49.752355 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:49.752085    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:49.752355 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:49.752205    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86fcn" podUID="1515b563-e1a3-4af0-9ac4-c57292fbd9c3"
May 25 01:02:49.752355 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:49.752264    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvwzt" podUID="4efbd4c0-45f2-4d23-8f4e-8708d81733c8"
May 25 01:02:49.952179 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:49.952150    2558 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 25 01:02:49.952770 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:49.952745    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:49.980429 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:49.980408    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:50.033599 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:50.033454    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-86fcn"]
May 25 01:02:50.033690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:50.033661    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:50.033751 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:50.033735    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86fcn" podUID="1515b563-e1a3-4af0-9ac4-c57292fbd9c3"
May 25 01:02:50.037384 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:50.037364    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tsh68"]
May 25 01:02:50.037507 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:50.037482    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:50.037613 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:50.037578    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsh68" podUID="0c53f430-328a-4e17-b089-976b8d399f7c"
May 25 01:02:50.037948 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:50.037924    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dvwzt"]
May 25 01:02:50.038031 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:50.038008    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:50.038128 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:50.038110    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvwzt" podUID="4efbd4c0-45f2-4d23-8f4e-8708d81733c8"
May 25 01:02:50.905954 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:50.905920    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:02:50.955344 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:50.955295    2558 generic.go:358] "Generic (PLEG): container finished" podID="2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154" containerID="e7b67d76c425cc092585a4faf39dd76e9b6f7a99036c3117bb72763d69955321" exitCode=0
May 25 01:02:50.955744 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:50.955365    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbdkp" event={"ID":"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154","Type":"ContainerDied","Data":"e7b67d76c425cc092585a4faf39dd76e9b6f7a99036c3117bb72763d69955321"}
May 25 01:02:51.753339 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:51.753294    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:51.753475 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:51.753455    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:51.753517 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:51.753488    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsh68" podUID="0c53f430-328a-4e17-b089-976b8d399f7c"
May 25 01:02:51.753517 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:51.753506    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:51.753597 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:51.753579    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvwzt" podUID="4efbd4c0-45f2-4d23-8f4e-8708d81733c8"
May 25 01:02:51.753672 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:51.753652    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86fcn" podUID="1515b563-e1a3-4af0-9ac4-c57292fbd9c3"
May 25 01:02:52.964495 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:52.964457    2558 generic.go:358] "Generic (PLEG): container finished" podID="2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154" containerID="3349973bedc58bea241d214fbf6f1f92e0188f129b46616317af20cc0c00d400" exitCode=0
May 25 01:02:52.965219 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:52.964515    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbdkp" event={"ID":"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154","Type":"ContainerDied","Data":"3349973bedc58bea241d214fbf6f1f92e0188f129b46616317af20cc0c00d400"}
May 25 01:02:53.752006 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:53.751978    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:53.752175 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:53.752112    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:53.752175 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:53.752116    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvwzt" podUID="4efbd4c0-45f2-4d23-8f4e-8708d81733c8"
May 25 01:02:53.752175 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:53.752136    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:53.752363 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:53.752237    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsh68" podUID="0c53f430-328a-4e17-b089-976b8d399f7c"
May 25 01:02:53.752363 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:53.752319    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86fcn" podUID="1515b563-e1a3-4af0-9ac4-c57292fbd9c3"
May 25 01:02:54.378475 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:54.378440    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs\") pod \"network-metrics-daemon-tsh68\" (UID: \"0c53f430-328a-4e17-b089-976b8d399f7c\") " pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:54.378863 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:54.378592    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:54.378863 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:54.378669    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs podName:0c53f430-328a-4e17-b089-976b8d399f7c nodeName:}" failed. No retries permitted until 2026-05-25 01:03:26.37864867 +0000 UTC m=+65.248307981 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs") pod "network-metrics-daemon-tsh68" (UID: "0c53f430-328a-4e17-b089-976b8d399f7c") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 25 01:02:54.579462 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:54.579435    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6gnz\" (UniqueName: \"kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz\") pod \"network-check-target-86fcn\" (UID: \"1515b563-e1a3-4af0-9ac4-c57292fbd9c3\") " pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:54.579707 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:54.579564    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 25 01:02:54.579707 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:54.579578    2558 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 25 01:02:54.579707 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:54.579589    2558 projected.go:194] Error preparing data for projected volume kube-api-access-v6gnz for pod openshift-network-diagnostics/network-check-target-86fcn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:54.579707 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:54.579648    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz podName:1515b563-e1a3-4af0-9ac4-c57292fbd9c3 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:26.579630334 +0000 UTC m=+65.449289644 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-v6gnz" (UniqueName: "kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz") pod "network-check-target-86fcn" (UID: "1515b563-e1a3-4af0-9ac4-c57292fbd9c3") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 25 01:02:55.752474 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:55.752442    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:55.752474 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:55.752476    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:55.753003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:55.752449    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:55.753003 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:55.752555    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-86fcn" podUID="1515b563-e1a3-4af0-9ac4-c57292fbd9c3"
May 25 01:02:55.753003 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:55.752658    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tsh68" podUID="0c53f430-328a-4e17-b089-976b8d399f7c"
May 25 01:02:55.753003 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:55.752722    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-dvwzt" podUID="4efbd4c0-45f2-4d23-8f4e-8708d81733c8"
May 25 01:02:56.496976 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.496946    2558 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-192.ec2.internal" event="NodeReady"
May 25 01:02:56.497160 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.497093    2558 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 25 01:02:56.546154 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.546123    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cjp74"]
May 25 01:02:56.555872 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.555846    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-fmgsh"]
May 25 01:02:56.556022 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.556005    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cjp74"
May 25 01:02:56.559056 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.559032    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-clxvr\""
May 25 01:02:56.559194 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.559033    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 25 01:02:56.559194 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.559042    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cjp74"]
May 25 01:02:56.559194 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.559121    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fmgsh"
May 25 01:02:56.559369 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.559280    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 25 01:02:56.562181 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.562159    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s4fpd\""
May 25 01:02:56.562293 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.562190    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 25 01:02:56.562384 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.562317    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 25 01:02:56.562437 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.562415    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 25 01:02:56.562490 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.562450    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fmgsh"]
May 25 01:02:56.696645 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.696611    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8bl8\" (UniqueName: \"kubernetes.io/projected/2e574b48-0e58-4e0d-b442-d80b423af7e1-kube-api-access-s8bl8\") pod \"dns-default-cjp74\" (UID: \"2e574b48-0e58-4e0d-b442-d80b423af7e1\") " pod="openshift-dns/dns-default-cjp74"
May 25 01:02:56.696827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.696698    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert\") pod \"ingress-canary-fmgsh\" (UID: \"d8561800-5654-4a77-953a-f17255ab14c7\") " pod="openshift-ingress-canary/ingress-canary-fmgsh"
May 25 01:02:56.696827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.696734    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwz6w\" (UniqueName: \"kubernetes.io/projected/d8561800-5654-4a77-953a-f17255ab14c7-kube-api-access-kwz6w\") pod \"ingress-canary-fmgsh\" (UID: \"d8561800-5654-4a77-953a-f17255ab14c7\") " pod="openshift-ingress-canary/ingress-canary-fmgsh"
May 25 01:02:56.696827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.696761    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2e574b48-0e58-4e0d-b442-d80b423af7e1-config-volume\") pod \"dns-default-cjp74\" (UID: \"2e574b48-0e58-4e0d-b442-d80b423af7e1\") " pod="openshift-dns/dns-default-cjp74"
May 25 01:02:56.696827 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.696790    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e574b48-0e58-4e0d-b442-d80b423af7e1-tmp-dir\") pod \"dns-default-cjp74\" (UID: \"2e574b48-0e58-4e0d-b442-d80b423af7e1\") " pod="openshift-dns/dns-default-cjp74"
May 25 01:02:56.697045 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.696865    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls\") pod \"dns-default-cjp74\" (UID: \"2e574b48-0e58-4e0d-b442-d80b423af7e1\") " pod="openshift-dns/dns-default-cjp74"
May 25 01:02:56.798085 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.797661    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s8bl8\" (UniqueName: \"kubernetes.io/projected/2e574b48-0e58-4e0d-b442-d80b423af7e1-kube-api-access-s8bl8\") pod \"dns-default-cjp74\" (UID: \"2e574b48-0e58-4e0d-b442-d80b423af7e1\") " pod="openshift-dns/dns-default-cjp74"
May 25 01:02:56.798085 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.797735    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert\") pod \"ingress-canary-fmgsh\" (UID: \"d8561800-5654-4a77-953a-f17255ab14c7\") " pod="openshift-ingress-canary/ingress-canary-fmgsh"
May 25 01:02:56.798085 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.797770    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwz6w\" (UniqueName: \"kubernetes.io/projected/d8561800-5654-4a77-953a-f17255ab14c7-kube-api-access-kwz6w\") pod \"ingress-canary-fmgsh\" (UID: \"d8561800-5654-4a77-953a-f17255ab14c7\") " pod="openshift-ingress-canary/ingress-canary-fmgsh"
May 25 01:02:56.798085 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.797792    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2e574b48-0e58-4e0d-b442-d80b423af7e1-config-volume\") pod \"dns-default-cjp74\" (UID: \"2e574b48-0e58-4e0d-b442-d80b423af7e1\") " pod="openshift-dns/dns-default-cjp74"
May 25 01:02:56.798085 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.797819    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e574b48-0e58-4e0d-b442-d80b423af7e1-tmp-dir\") pod \"dns-default-cjp74\" (UID: \"2e574b48-0e58-4e0d-b442-d80b423af7e1\") " pod="openshift-dns/dns-default-cjp74"
May 25 01:02:56.798085 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.797872    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls\") pod \"dns-default-cjp74\" (UID: \"2e574b48-0e58-4e0d-b442-d80b423af7e1\") " pod="openshift-dns/dns-default-cjp74"
May 25 01:02:56.798085 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:56.797880    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:02:56.798085 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:56.797942    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert podName:d8561800-5654-4a77-953a-f17255ab14c7 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:57.297927556 +0000 UTC m=+36.167586859 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert") pod "ingress-canary-fmgsh" (UID: "d8561800-5654-4a77-953a-f17255ab14c7") : secret "canary-serving-cert" not found
May 25 01:02:56.798085 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:56.797960    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:02:56.798085 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:56.798015    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls podName:2e574b48-0e58-4e0d-b442-d80b423af7e1 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:57.2979999 +0000 UTC m=+36.167659218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls") pod "dns-default-cjp74" (UID: "2e574b48-0e58-4e0d-b442-d80b423af7e1") : secret "dns-default-metrics-tls" not found
May 25 01:02:56.798905 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.798256    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e574b48-0e58-4e0d-b442-d80b423af7e1-tmp-dir\") pod \"dns-default-cjp74\" (UID: \"2e574b48-0e58-4e0d-b442-d80b423af7e1\") " pod="openshift-dns/dns-default-cjp74"
May 25 01:02:56.798905 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.798385    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2e574b48-0e58-4e0d-b442-d80b423af7e1-config-volume\") pod \"dns-default-cjp74\" (UID: \"2e574b48-0e58-4e0d-b442-d80b423af7e1\") " pod="openshift-dns/dns-default-cjp74"
May 25 01:02:56.811075 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.811052    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8bl8\" (UniqueName: \"kubernetes.io/projected/2e574b48-0e58-4e0d-b442-d80b423af7e1-kube-api-access-s8bl8\") pod \"dns-default-cjp74\" (UID: \"2e574b48-0e58-4e0d-b442-d80b423af7e1\") " pod="openshift-dns/dns-default-cjp74"
May 25 01:02:56.811190 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:56.811132    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwz6w\" (UniqueName: \"kubernetes.io/projected/d8561800-5654-4a77-953a-f17255ab14c7-kube-api-access-kwz6w\") pod \"ingress-canary-fmgsh\" (UID: \"d8561800-5654-4a77-953a-f17255ab14c7\") " pod="openshift-ingress-canary/ingress-canary-fmgsh"
May 25 01:02:57.302254 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:57.302217    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls\") pod \"dns-default-cjp74\" (UID: \"2e574b48-0e58-4e0d-b442-d80b423af7e1\") " pod="openshift-dns/dns-default-cjp74"
May 25 01:02:57.302461 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:57.302296    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert\") pod \"ingress-canary-fmgsh\" (UID: \"d8561800-5654-4a77-953a-f17255ab14c7\") " pod="openshift-ingress-canary/ingress-canary-fmgsh"
May 25 01:02:57.302461 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:57.302398    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:02:57.302461 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:57.302418    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:02:57.302620 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:57.302484    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls podName:2e574b48-0e58-4e0d-b442-d80b423af7e1 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:58.30246094 +0000 UTC m=+37.172120263 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls") pod "dns-default-cjp74" (UID: "2e574b48-0e58-4e0d-b442-d80b423af7e1") : secret "dns-default-metrics-tls" not found
May 25 01:02:57.302620 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:57.302508    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert podName:d8561800-5654-4a77-953a-f17255ab14c7 nodeName:}" failed. No retries permitted until 2026-05-25 01:02:58.30249586 +0000 UTC m=+37.172155191 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert") pod "ingress-canary-fmgsh" (UID: "d8561800-5654-4a77-953a-f17255ab14c7") : secret "canary-serving-cert" not found
May 25 01:02:57.752308 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:57.752272    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:02:57.752308 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:57.752303    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:02:57.752553 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:57.752272    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:02:57.755251 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:57.755229    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 25 01:02:57.756188 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:57.756166    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 25 01:02:57.756353 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:57.756166    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 25 01:02:57.756353 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:57.756217    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f8zp6\""
May 25 01:02:57.756612 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:57.756593    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gc4b2\""
May 25 01:02:57.756730 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:57.756636    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 25 01:02:58.309904 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:58.309744    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert\") pod \"ingress-canary-fmgsh\" (UID: \"d8561800-5654-4a77-953a-f17255ab14c7\") " pod="openshift-ingress-canary/ingress-canary-fmgsh"
May 25 01:02:58.309904 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:58.309894    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:02:58.310232 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:58.309939    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls\") pod \"dns-default-cjp74\" (UID: \"2e574b48-0e58-4e0d-b442-d80b423af7e1\") " pod="openshift-dns/dns-default-cjp74"
May 25 01:02:58.310232 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:58.309955    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert podName:d8561800-5654-4a77-953a-f17255ab14c7 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:00.309939945 +0000 UTC m=+39.179599248 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert") pod "ingress-canary-fmgsh" (UID: "d8561800-5654-4a77-953a-f17255ab14c7") : secret "canary-serving-cert" not found
May 25 01:02:58.310232 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:58.310001    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:02:58.310232 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:02:58.310045    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls podName:2e574b48-0e58-4e0d-b442-d80b423af7e1 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:00.310033289 +0000 UTC m=+39.179692597 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls") pod "dns-default-cjp74" (UID: "2e574b48-0e58-4e0d-b442-d80b423af7e1") : secret "dns-default-metrics-tls" not found
May 25 01:02:58.977557 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:58.977530    2558 generic.go:358] "Generic (PLEG): container finished" podID="2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154" containerID="9f00ec3cb195aeb79dcf2a93071180fc94db5304cafdb1d15960bfdd9d092545" exitCode=0
May 25 01:02:58.977688 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:58.977577    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbdkp" event={"ID":"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154","Type":"ContainerDied","Data":"9f00ec3cb195aeb79dcf2a93071180fc94db5304cafdb1d15960bfdd9d092545"}
May 25 01:02:59.981964 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:59.981935    2558 generic.go:358] "Generic (PLEG): container finished" podID="2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154" containerID="ece06680465e522c61adad201201d7e10a15ff209eb5fa9ce71380a743b54b26" exitCode=0
May 25 01:02:59.982297 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:02:59.981996    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbdkp" event={"ID":"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154","Type":"ContainerDied","Data":"ece06680465e522c61adad201201d7e10a15ff209eb5fa9ce71380a743b54b26"}
May 25 01:03:00.325169 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:00.325090    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert\") pod \"ingress-canary-fmgsh\" (UID: \"d8561800-5654-4a77-953a-f17255ab14c7\") " pod="openshift-ingress-canary/ingress-canary-fmgsh"
May 25 01:03:00.325295 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:00.325201    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls\") pod \"dns-default-cjp74\" (UID: \"2e574b48-0e58-4e0d-b442-d80b423af7e1\") " pod="openshift-dns/dns-default-cjp74"
May 25 01:03:00.325295 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:03:00.325229    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:03:00.325403 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:03:00.325300    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert podName:d8561800-5654-4a77-953a-f17255ab14c7 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:04.325283336 +0000 UTC m=+43.194942639 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert") pod "ingress-canary-fmgsh" (UID: "d8561800-5654-4a77-953a-f17255ab14c7") : secret "canary-serving-cert" not found
May 25 01:03:00.325403 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:03:00.325318    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:03:00.325471 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:03:00.325404    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls podName:2e574b48-0e58-4e0d-b442-d80b423af7e1 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:04.325387365 +0000 UTC m=+43.195046671 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls") pod "dns-default-cjp74" (UID: "2e574b48-0e58-4e0d-b442-d80b423af7e1") : secret "dns-default-metrics-tls" not found
May 25 01:03:00.986309 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:00.986275    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-qbdkp" event={"ID":"2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154","Type":"ContainerStarted","Data":"54499e75f1e2cf734f0457c3f15d4acd9fd6dcb1e7499e9e0b07dea0a779ffbe"}
May 25 01:03:01.010034 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:01.009991    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-qbdkp" podStartSLOduration=4.467519977 podStartE2EDuration="40.009978494s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="2026-05-25 01:02:22.976404748 +0000 UTC m=+1.846064051" lastFinishedPulling="2026-05-25 01:02:58.518863249 +0000 UTC m=+37.388522568" observedRunningTime="2026-05-25 01:03:01.008600192 +0000 UTC m=+39.878259517" watchObservedRunningTime="2026-05-25 01:03:01.009978494 +0000 UTC m=+39.879637817"
May 25 01:03:02.237665 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:02.237630    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret\") pod \"global-pull-secret-syncer-dvwzt\" (UID: \"4efbd4c0-45f2-4d23-8f4e-8708d81733c8\") " pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:03:02.241074 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:02.241044    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4efbd4c0-45f2-4d23-8f4e-8708d81733c8-original-pull-secret\") pod \"global-pull-secret-syncer-dvwzt\" (UID: \"4efbd4c0-45f2-4d23-8f4e-8708d81733c8\") " pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:03:02.273106 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:02.273086    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-dvwzt"
May 25 01:03:02.456865 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:02.456836    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-dvwzt"]
May 25 01:03:02.460036 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:03:02.460010    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4efbd4c0_45f2_4d23_8f4e_8708d81733c8.slice/crio-db5c0ccbb7c715e44ecd85a1f3c31680980aa74aa40af9c610c55cb342da03ae WatchSource:0}: Error finding container db5c0ccbb7c715e44ecd85a1f3c31680980aa74aa40af9c610c55cb342da03ae: Status 404 returned error can't find the container with id db5c0ccbb7c715e44ecd85a1f3c31680980aa74aa40af9c610c55cb342da03ae
May 25 01:03:02.991679 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:02.991644    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dvwzt" event={"ID":"4efbd4c0-45f2-4d23-8f4e-8708d81733c8","Type":"ContainerStarted","Data":"db5c0ccbb7c715e44ecd85a1f3c31680980aa74aa40af9c610c55cb342da03ae"}
May 25 01:03:04.352852 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:04.352818    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert\") pod \"ingress-canary-fmgsh\" (UID: \"d8561800-5654-4a77-953a-f17255ab14c7\") " pod="openshift-ingress-canary/ingress-canary-fmgsh"
May 25 01:03:04.353345 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:04.352900    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls\") pod \"dns-default-cjp74\" (UID: \"2e574b48-0e58-4e0d-b442-d80b423af7e1\") " pod="openshift-dns/dns-default-cjp74"
May 25 01:03:04.353345 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:03:04.352979    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:03:04.353345 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:03:04.352991    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:03:04.353345 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:03:04.353049    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert podName:d8561800-5654-4a77-953a-f17255ab14c7 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:12.353030251 +0000 UTC m=+51.222689556 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert") pod "ingress-canary-fmgsh" (UID: "d8561800-5654-4a77-953a-f17255ab14c7") : secret "canary-serving-cert" not found
May 25 01:03:04.353345 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:03:04.353071    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls podName:2e574b48-0e58-4e0d-b442-d80b423af7e1 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:12.353059254 +0000 UTC m=+51.222718562 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls") pod "dns-default-cjp74" (UID: "2e574b48-0e58-4e0d-b442-d80b423af7e1") : secret "dns-default-metrics-tls" not found
May 25 01:03:07.001540 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:07.001495    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-dvwzt" event={"ID":"4efbd4c0-45f2-4d23-8f4e-8708d81733c8","Type":"ContainerStarted","Data":"aa821ae3aef1949f8018a7b0e5d6ff0dca9c00e394a89f2058a9cb7cb5848e9f"}
May 25 01:03:07.015861 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:07.015815    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-dvwzt" podStartSLOduration=33.048444969 podStartE2EDuration="37.015804417s" podCreationTimestamp="2026-05-25 01:02:30 +0000 UTC" firstStartedPulling="2026-05-25 01:03:02.462122264 +0000 UTC m=+41.331781571" lastFinishedPulling="2026-05-25 01:03:06.429481712 +0000 UTC m=+45.299141019" observedRunningTime="2026-05-25 01:03:07.015479572 +0000 UTC m=+45.885138909" watchObservedRunningTime="2026-05-25 01:03:07.015804417 +0000 UTC m=+45.885463742"
May 25 01:03:12.410847 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:12.410801    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert\") pod \"ingress-canary-fmgsh\" (UID: \"d8561800-5654-4a77-953a-f17255ab14c7\") " pod="openshift-ingress-canary/ingress-canary-fmgsh"
May 25 01:03:12.411397 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:12.410875    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls\") pod \"dns-default-cjp74\" (UID: \"2e574b48-0e58-4e0d-b442-d80b423af7e1\") " pod="openshift-dns/dns-default-cjp74"
May 25 01:03:12.411397 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:03:12.410959    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:03:12.411397 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:03:12.410959    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:03:12.411397 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:03:12.411018    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls podName:2e574b48-0e58-4e0d-b442-d80b423af7e1 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:28.411005027 +0000 UTC m=+67.280664332 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls") pod "dns-default-cjp74" (UID: "2e574b48-0e58-4e0d-b442-d80b423af7e1") : secret "dns-default-metrics-tls" not found
May 25 01:03:12.411397 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:03:12.411031    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert podName:d8561800-5654-4a77-953a-f17255ab14c7 nodeName:}" failed. No retries permitted until 2026-05-25 01:03:28.411025661 +0000 UTC m=+67.280684965 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert") pod "ingress-canary-fmgsh" (UID: "d8561800-5654-4a77-953a-f17255ab14c7") : secret "canary-serving-cert" not found
May 25 01:03:21.969785 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:21.969757    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-489fr"
May 25 01:03:26.399802 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:26.399765    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs\") pod \"network-metrics-daemon-tsh68\" (UID: \"0c53f430-328a-4e17-b089-976b8d399f7c\") " pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:03:26.402152 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:26.402133    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 25 01:03:26.410110 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:03:26.410096    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 25 01:03:26.410193 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:03:26.410182    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs podName:0c53f430-328a-4e17-b089-976b8d399f7c nodeName:}" failed. No retries permitted until 2026-05-25 01:04:30.410160189 +0000 UTC m=+129.279819511 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs") pod "network-metrics-daemon-tsh68" (UID: "0c53f430-328a-4e17-b089-976b8d399f7c") : secret "metrics-daemon-secret" not found
May 25 01:03:26.601058 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:26.601031    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v6gnz\" (UniqueName: \"kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz\") pod \"network-check-target-86fcn\" (UID: \"1515b563-e1a3-4af0-9ac4-c57292fbd9c3\") " pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:03:26.603681 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:26.603663    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 25 01:03:26.613849 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:26.613830    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 25 01:03:26.624058 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:26.624032    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6gnz\" (UniqueName: \"kubernetes.io/projected/1515b563-e1a3-4af0-9ac4-c57292fbd9c3-kube-api-access-v6gnz\") pod \"network-check-target-86fcn\" (UID: \"1515b563-e1a3-4af0-9ac4-c57292fbd9c3\") " pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:03:26.881266 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:26.881243    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-gc4b2\""
May 25 01:03:26.888667 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:26.888650    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:03:27.017693 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:27.017662    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-86fcn"]
May 25 01:03:27.021340 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:03:27.021298    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1515b563_e1a3_4af0_9ac4_c57292fbd9c3.slice/crio-b4c31930c5e5128c362edc33ca869bd081c31032ef80970a120f19a24c83db3f WatchSource:0}: Error finding container b4c31930c5e5128c362edc33ca869bd081c31032ef80970a120f19a24c83db3f: Status 404 returned error can't find the container with id b4c31930c5e5128c362edc33ca869bd081c31032ef80970a120f19a24c83db3f
May 25 01:03:27.037432 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:27.037405    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-86fcn" event={"ID":"1515b563-e1a3-4af0-9ac4-c57292fbd9c3","Type":"ContainerStarted","Data":"b4c31930c5e5128c362edc33ca869bd081c31032ef80970a120f19a24c83db3f"}
May 25 01:03:28.412899 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:28.412859    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert\") pod \"ingress-canary-fmgsh\" (UID: \"d8561800-5654-4a77-953a-f17255ab14c7\") " pod="openshift-ingress-canary/ingress-canary-fmgsh"
May 25 01:03:28.413358 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:28.412959    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls\") pod \"dns-default-cjp74\" (UID: \"2e574b48-0e58-4e0d-b442-d80b423af7e1\") " pod="openshift-dns/dns-default-cjp74"
May 25 01:03:28.413358 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:03:28.413037    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:03:28.413358 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:03:28.413052    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:03:28.413358 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:03:28.413114    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert podName:d8561800-5654-4a77-953a-f17255ab14c7 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:00.413093638 +0000 UTC m=+99.282752947 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert") pod "ingress-canary-fmgsh" (UID: "d8561800-5654-4a77-953a-f17255ab14c7") : secret "canary-serving-cert" not found
May 25 01:03:28.413358 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:03:28.413134    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls podName:2e574b48-0e58-4e0d-b442-d80b423af7e1 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:00.413124198 +0000 UTC m=+99.282783506 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls") pod "dns-default-cjp74" (UID: "2e574b48-0e58-4e0d-b442-d80b423af7e1") : secret "dns-default-metrics-tls" not found
May 25 01:03:31.046822 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:31.046783    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-86fcn" event={"ID":"1515b563-e1a3-4af0-9ac4-c57292fbd9c3","Type":"ContainerStarted","Data":"a9eb182848da717f37ad638504d7ca7c256d4dee8b0b89cbf631266136db1bfa"}
May 25 01:03:31.047209 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:31.046922    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:03:31.064345 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:03:31.064288    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-86fcn" podStartSLOduration=66.964291446 podStartE2EDuration="1m10.064274747s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="2026-05-25 01:03:27.02310216 +0000 UTC m=+65.892761468" lastFinishedPulling="2026-05-25 01:03:30.123085462 +0000 UTC m=+68.992744769" observedRunningTime="2026-05-25 01:03:31.063926002 +0000 UTC m=+69.933585331" watchObservedRunningTime="2026-05-25 01:03:31.064274747 +0000 UTC m=+69.933934073"
May 25 01:04:00.435717 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:00.435661    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert\") pod \"ingress-canary-fmgsh\" (UID: \"d8561800-5654-4a77-953a-f17255ab14c7\") " pod="openshift-ingress-canary/ingress-canary-fmgsh"
May 25 01:04:00.436140 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:00.435735    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls\") pod \"dns-default-cjp74\" (UID: \"2e574b48-0e58-4e0d-b442-d80b423af7e1\") " pod="openshift-dns/dns-default-cjp74"
May 25 01:04:00.436140 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:00.435840    2558 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 25 01:04:00.436140 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:00.435868    2558 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 25 01:04:00.436140 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:00.435913    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert podName:d8561800-5654-4a77-953a-f17255ab14c7 nodeName:}" failed. No retries permitted until 2026-05-25 01:05:04.435895317 +0000 UTC m=+163.305554622 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert") pod "ingress-canary-fmgsh" (UID: "d8561800-5654-4a77-953a-f17255ab14c7") : secret "canary-serving-cert" not found
May 25 01:04:00.436140 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:00.435934    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls podName:2e574b48-0e58-4e0d-b442-d80b423af7e1 nodeName:}" failed. No retries permitted until 2026-05-25 01:05:04.435920372 +0000 UTC m=+163.305579676 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls") pod "dns-default-cjp74" (UID: "2e574b48-0e58-4e0d-b442-d80b423af7e1") : secret "dns-default-metrics-tls" not found
May 25 01:04:02.051774 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:02.051747    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-86fcn"
May 25 01:04:15.693078 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.693046    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j"]
May 25 01:04:15.695921 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.695905    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j"
May 25 01:04:15.698160 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.698139    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 25 01:04:15.698262 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.698199    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 25 01:04:15.698262 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.698256    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 25 01:04:15.699382 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.699361    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8n82s\""
May 25 01:04:15.701487 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.701468    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-85b7cb4646-2kg7w"]
May 25 01:04:15.701580 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.701563    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 25 01:04:15.704402 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.704386    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:15.708733 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.708713    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 25 01:04:15.708974 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.708954    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-j4lpl\""
May 25 01:04:15.709294 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.709277    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 25 01:04:15.709408 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.709348    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 25 01:04:15.709472 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.709418    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 25 01:04:15.709472 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.709413    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 25 01:04:15.709568 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.709478    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 25 01:04:15.709568 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.709283    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j"]
May 25 01:04:15.716977 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.716956    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85b7cb4646-2kg7w"]
May 25 01:04:15.732629 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.732611    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-stats-auth\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:15.732732 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.732663    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-default-certificate\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:15.732732 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.732715    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:15.732819 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.732743    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:15.732819 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.732763    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-pps9j\" (UID: \"9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j"
May 25 01:04:15.732819 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.732792    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8d9k\" (UniqueName: \"kubernetes.io/projected/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-kube-api-access-w8d9k\") pod \"cluster-monitoring-operator-6c75959455-pps9j\" (UID: \"9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j"
May 25 01:04:15.732819 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.732816    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-pps9j\" (UID: \"9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j"
May 25 01:04:15.732948 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.732863    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gflvj\" (UniqueName: \"kubernetes.io/projected/60a10e75-26eb-4497-a652-fe509cb7282c-kube-api-access-gflvj\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:15.833690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.833669    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-default-certificate\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:15.833812 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.833699    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:15.833812 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.833723    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:15.833812 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.833745    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-pps9j\" (UID: \"9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j"
May 25 01:04:15.833986 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:15.833826    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 25 01:04:15.833986 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:15.833849    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle podName:60a10e75-26eb-4497-a652-fe509cb7282c nodeName:}" failed. No retries permitted until 2026-05-25 01:04:16.333828564 +0000 UTC m=+115.203487891 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle") pod "router-default-85b7cb4646-2kg7w" (UID: "60a10e75-26eb-4497-a652-fe509cb7282c") : configmap references non-existent config key: service-ca.crt
May 25 01:04:15.833986 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.833872    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w8d9k\" (UniqueName: \"kubernetes.io/projected/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-kube-api-access-w8d9k\") pod \"cluster-monitoring-operator-6c75959455-pps9j\" (UID: \"9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j"
May 25 01:04:15.833986 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:15.833883    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs podName:60a10e75-26eb-4497-a652-fe509cb7282c nodeName:}" failed. No retries permitted until 2026-05-25 01:04:16.333869798 +0000 UTC m=+115.203529102 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs") pod "router-default-85b7cb4646-2kg7w" (UID: "60a10e75-26eb-4497-a652-fe509cb7282c") : secret "router-metrics-certs-default" not found
May 25 01:04:15.833986 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.833924    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-pps9j\" (UID: \"9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j"
May 25 01:04:15.833986 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.833974    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gflvj\" (UniqueName: \"kubernetes.io/projected/60a10e75-26eb-4497-a652-fe509cb7282c-kube-api-access-gflvj\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:15.834299 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.834011    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-stats-auth\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:15.834299 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:15.834048    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 25 01:04:15.834299 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:15.834117    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls podName:9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d nodeName:}" failed. No retries permitted until 2026-05-25 01:04:16.33410267 +0000 UTC m=+115.203761982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-pps9j" (UID: "9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d") : secret "cluster-monitoring-operator-tls" not found
May 25 01:04:15.834535 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.834515    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-pps9j\" (UID: \"9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j"
May 25 01:04:15.836233 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.836217    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-default-certificate\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:15.836320 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.836305    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-stats-auth\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:15.843076 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.843049    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8d9k\" (UniqueName: \"kubernetes.io/projected/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-kube-api-access-w8d9k\") pod \"cluster-monitoring-operator-6c75959455-pps9j\" (UID: \"9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j"
May 25 01:04:15.843176 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:15.843162    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gflvj\" (UniqueName: \"kubernetes.io/projected/60a10e75-26eb-4497-a652-fe509cb7282c-kube-api-access-gflvj\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:16.338904 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:16.338871    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:16.338904 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:16.338908    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:16.339107 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:16.338939    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-pps9j\" (UID: \"9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j"
May 25 01:04:16.339107 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:16.339032    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 25 01:04:16.339107 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:16.339032    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 25 01:04:16.339107 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:16.339040    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle podName:60a10e75-26eb-4497-a652-fe509cb7282c nodeName:}" failed. No retries permitted until 2026-05-25 01:04:17.339022707 +0000 UTC m=+116.208682021 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle") pod "router-default-85b7cb4646-2kg7w" (UID: "60a10e75-26eb-4497-a652-fe509cb7282c") : configmap references non-existent config key: service-ca.crt
May 25 01:04:16.339107 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:16.339097    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs podName:60a10e75-26eb-4497-a652-fe509cb7282c nodeName:}" failed. No retries permitted until 2026-05-25 01:04:17.33908095 +0000 UTC m=+116.208740256 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs") pod "router-default-85b7cb4646-2kg7w" (UID: "60a10e75-26eb-4497-a652-fe509cb7282c") : secret "router-metrics-certs-default" not found
May 25 01:04:16.339265 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:16.339115    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls podName:9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d nodeName:}" failed. No retries permitted until 2026-05-25 01:04:17.339108547 +0000 UTC m=+116.208767850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-pps9j" (UID: "9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d") : secret "cluster-monitoring-operator-tls" not found
May 25 01:04:17.346698 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:17.346668    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-pps9j\" (UID: \"9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j"
May 25 01:04:17.347101 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:17.346734    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:17.347101 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:17.346752    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:17.347101 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:17.346813    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 25 01:04:17.347101 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:17.346832    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 25 01:04:17.347299 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:17.347150    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls podName:9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d nodeName:}" failed. No retries permitted until 2026-05-25 01:04:19.346861759 +0000 UTC m=+118.216521063 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-pps9j" (UID: "9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d") : secret "cluster-monitoring-operator-tls" not found
May 25 01:04:17.347299 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:17.347180    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs podName:60a10e75-26eb-4497-a652-fe509cb7282c nodeName:}" failed. No retries permitted until 2026-05-25 01:04:19.347165466 +0000 UTC m=+118.216824773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs") pod "router-default-85b7cb4646-2kg7w" (UID: "60a10e75-26eb-4497-a652-fe509cb7282c") : secret "router-metrics-certs-default" not found
May 25 01:04:17.347299 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:17.347197    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle podName:60a10e75-26eb-4497-a652-fe509cb7282c nodeName:}" failed. No retries permitted until 2026-05-25 01:04:19.347187952 +0000 UTC m=+118.216847259 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle") pod "router-default-85b7cb4646-2kg7w" (UID: "60a10e75-26eb-4497-a652-fe509cb7282c") : configmap references non-existent config key: service-ca.crt
May 25 01:04:19.361421 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:19.361375    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:19.361421 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:19.361429    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:19.361841 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:19.361520    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 25 01:04:19.361841 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:19.361555    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle podName:60a10e75-26eb-4497-a652-fe509cb7282c nodeName:}" failed. No retries permitted until 2026-05-25 01:04:23.361537761 +0000 UTC m=+122.231197065 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle") pod "router-default-85b7cb4646-2kg7w" (UID: "60a10e75-26eb-4497-a652-fe509cb7282c") : configmap references non-existent config key: service-ca.crt
May 25 01:04:19.361841 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:19.361591    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs podName:60a10e75-26eb-4497-a652-fe509cb7282c nodeName:}" failed. No retries permitted until 2026-05-25 01:04:23.3615798 +0000 UTC m=+122.231239105 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs") pod "router-default-85b7cb4646-2kg7w" (UID: "60a10e75-26eb-4497-a652-fe509cb7282c") : secret "router-metrics-certs-default" not found
May 25 01:04:19.361841 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:19.361620    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-pps9j\" (UID: \"9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j"
May 25 01:04:19.361841 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:19.361732    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 25 01:04:19.361841 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:19.361769    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls podName:9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d nodeName:}" failed. No retries permitted until 2026-05-25 01:04:23.36176015 +0000 UTC m=+122.231419454 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-pps9j" (UID: "9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d") : secret "cluster-monitoring-operator-tls" not found
May 25 01:04:21.176805 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:21.176775    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ww4sb_e02977c4-1dc9-49ff-831d-d1f05f9e58c9/dns-node-resolver/0.log"
May 25 01:04:21.976359 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:21.976313    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zzq7t_591fa1dd-4784-4b01-9144-9bdeab02f6df/node-ca/0.log"
May 25 01:04:23.391340 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:23.391299    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:23.391744 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:23.391385    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:23.391744 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:23.391424    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-pps9j\" (UID: \"9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j"
May 25 01:04:23.391744 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:23.391464    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle podName:60a10e75-26eb-4497-a652-fe509cb7282c nodeName:}" failed. No retries permitted until 2026-05-25 01:04:31.39144604 +0000 UTC m=+130.261105344 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle") pod "router-default-85b7cb4646-2kg7w" (UID: "60a10e75-26eb-4497-a652-fe509cb7282c") : configmap references non-existent config key: service-ca.crt
May 25 01:04:23.391744 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:23.391518    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 25 01:04:23.391744 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:23.391524    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 25 01:04:23.391744 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:23.391566    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls podName:9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d nodeName:}" failed. No retries permitted until 2026-05-25 01:04:31.391555082 +0000 UTC m=+130.261214390 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-pps9j" (UID: "9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d") : secret "cluster-monitoring-operator-tls" not found
May 25 01:04:23.391744 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:23.391584    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs podName:60a10e75-26eb-4497-a652-fe509cb7282c nodeName:}" failed. No retries permitted until 2026-05-25 01:04:31.391572314 +0000 UTC m=+130.261231619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs") pod "router-default-85b7cb4646-2kg7w" (UID: "60a10e75-26eb-4497-a652-fe509cb7282c") : secret "router-metrics-certs-default" not found
May 25 01:04:25.686515 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.686488    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rlxhg"]
May 25 01:04:25.690304 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.690287    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rlxhg"
May 25 01:04:25.692766 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.692744    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 25 01:04:25.692864 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.692778    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 25 01:04:25.692864 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.692792    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 25 01:04:25.693720 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.693700    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2tz5s\""
May 25 01:04:25.693786 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.693710    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 25 01:04:25.699009 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.698988    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rlxhg"]
May 25 01:04:25.800032 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.800009    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-9x9mx"]
May 25 01:04:25.802675 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.802659    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9x9mx"
May 25 01:04:25.805616 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.805595    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 25 01:04:25.805782 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.805757    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tchkj\""
May 25 01:04:25.805959 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.805945    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 25 01:04:25.805959 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.805950    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 25 01:04:25.806106 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.806088    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 25 01:04:25.810041 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.810020    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/53c7a514-5b75-49d8-b645-8a76c65eadb0-config\") pod \"kube-storage-version-migrator-operator-565644f49-rlxhg\" (UID: \"53c7a514-5b75-49d8-b645-8a76c65eadb0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rlxhg"
May 25 01:04:25.810120 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.810063    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxlrk\" (UniqueName: \"kubernetes.io/projected/53c7a514-5b75-49d8-b645-8a76c65eadb0-kube-api-access-kxlrk\") pod \"kube-storage-version-migrator-operator-565644f49-rlxhg\" (UID: \"53c7a514-5b75-49d8-b645-8a76c65eadb0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rlxhg"
May 25 01:04:25.810120 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.810093    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/53c7a514-5b75-49d8-b645-8a76c65eadb0-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-rlxhg\" (UID: \"53c7a514-5b75-49d8-b645-8a76c65eadb0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rlxhg"
May 25 01:04:25.829190 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.829170    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-9x9mx"]
May 25 01:04:25.911269 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.911251    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68343816-fb65-4e10-86cc-330386cfb2f0-config\") pod \"service-ca-operator-57b5b68b8-9x9mx\" (UID: \"68343816-fb65-4e10-86cc-330386cfb2f0\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9x9mx"
May 25 01:04:25.911380 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.911282    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/53c7a514-5b75-49d8-b645-8a76c65eadb0-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-rlxhg\" (UID: \"53c7a514-5b75-49d8-b645-8a76c65eadb0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rlxhg"
May 25 01:04:25.911380 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.911302    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68343816-fb65-4e10-86cc-330386cfb2f0-serving-cert\") pod \"service-ca-operator-57b5b68b8-9x9mx\" (UID: \"68343816-fb65-4e10-86cc-330386cfb2f0\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9x9mx"
May 25 01:04:25.911456 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.911414    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwfd9\" (UniqueName: \"kubernetes.io/projected/68343816-fb65-4e10-86cc-330386cfb2f0-kube-api-access-mwfd9\") pod \"service-ca-operator-57b5b68b8-9x9mx\" (UID: \"68343816-fb65-4e10-86cc-330386cfb2f0\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9x9mx"
May 25 01:04:25.911456 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.911443    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/53c7a514-5b75-49d8-b645-8a76c65eadb0-config\") pod \"kube-storage-version-migrator-operator-565644f49-rlxhg\" (UID: \"53c7a514-5b75-49d8-b645-8a76c65eadb0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rlxhg"
May 25 01:04:25.911587 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.911568    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kxlrk\" (UniqueName: \"kubernetes.io/projected/53c7a514-5b75-49d8-b645-8a76c65eadb0-kube-api-access-kxlrk\") pod \"kube-storage-version-migrator-operator-565644f49-rlxhg\" (UID: \"53c7a514-5b75-49d8-b645-8a76c65eadb0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rlxhg"
May 25 01:04:25.911896 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.911880    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/53c7a514-5b75-49d8-b645-8a76c65eadb0-config\") pod \"kube-storage-version-migrator-operator-565644f49-rlxhg\" (UID: \"53c7a514-5b75-49d8-b645-8a76c65eadb0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rlxhg"
May 25 01:04:25.913600 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.913583    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/53c7a514-5b75-49d8-b645-8a76c65eadb0-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-rlxhg\" (UID: \"53c7a514-5b75-49d8-b645-8a76c65eadb0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rlxhg"
May 25 01:04:25.920017 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.919999    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxlrk\" (UniqueName: \"kubernetes.io/projected/53c7a514-5b75-49d8-b645-8a76c65eadb0-kube-api-access-kxlrk\") pod \"kube-storage-version-migrator-operator-565644f49-rlxhg\" (UID: \"53c7a514-5b75-49d8-b645-8a76c65eadb0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rlxhg"
May 25 01:04:25.998917 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:25.998870    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rlxhg"
May 25 01:04:26.012644 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:26.012623    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68343816-fb65-4e10-86cc-330386cfb2f0-config\") pod \"service-ca-operator-57b5b68b8-9x9mx\" (UID: \"68343816-fb65-4e10-86cc-330386cfb2f0\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9x9mx"
May 25 01:04:26.012748 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:26.012653    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68343816-fb65-4e10-86cc-330386cfb2f0-serving-cert\") pod \"service-ca-operator-57b5b68b8-9x9mx\" (UID: \"68343816-fb65-4e10-86cc-330386cfb2f0\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9x9mx"
May 25 01:04:26.012748 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:26.012709    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mwfd9\" (UniqueName: \"kubernetes.io/projected/68343816-fb65-4e10-86cc-330386cfb2f0-kube-api-access-mwfd9\") pod \"service-ca-operator-57b5b68b8-9x9mx\" (UID: \"68343816-fb65-4e10-86cc-330386cfb2f0\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9x9mx"
May 25 01:04:26.013171 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:26.013149    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/68343816-fb65-4e10-86cc-330386cfb2f0-config\") pod \"service-ca-operator-57b5b68b8-9x9mx\" (UID: \"68343816-fb65-4e10-86cc-330386cfb2f0\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9x9mx"
May 25 01:04:26.014910 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:26.014887    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/68343816-fb65-4e10-86cc-330386cfb2f0-serving-cert\") pod \"service-ca-operator-57b5b68b8-9x9mx\" (UID: \"68343816-fb65-4e10-86cc-330386cfb2f0\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9x9mx"
May 25 01:04:26.025109 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:26.025086    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwfd9\" (UniqueName: \"kubernetes.io/projected/68343816-fb65-4e10-86cc-330386cfb2f0-kube-api-access-mwfd9\") pod \"service-ca-operator-57b5b68b8-9x9mx\" (UID: \"68343816-fb65-4e10-86cc-330386cfb2f0\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9x9mx"
May 25 01:04:26.110815 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:26.110779    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9x9mx"
May 25 01:04:26.124098 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:26.124069    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rlxhg"]
May 25 01:04:26.126635 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:04:26.126612    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53c7a514_5b75_49d8_b645_8a76c65eadb0.slice/crio-6d5faaf3248c59ef87e30aba7e195e4fa6ff76d201693936e4e74970a36e1324 WatchSource:0}: Error finding container 6d5faaf3248c59ef87e30aba7e195e4fa6ff76d201693936e4e74970a36e1324: Status 404 returned error can't find the container with id 6d5faaf3248c59ef87e30aba7e195e4fa6ff76d201693936e4e74970a36e1324
May 25 01:04:26.144659 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:26.144634    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rlxhg" event={"ID":"53c7a514-5b75-49d8-b645-8a76c65eadb0","Type":"ContainerStarted","Data":"6d5faaf3248c59ef87e30aba7e195e4fa6ff76d201693936e4e74970a36e1324"}
May 25 01:04:26.247688 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:26.247659    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-9x9mx"]
May 25 01:04:26.250812 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:04:26.250778    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68343816_fb65_4e10_86cc_330386cfb2f0.slice/crio-3f3c86b51cdc9408d3600d2b2f2c2587244f480029ba8fc17964d56d4c75b5b3 WatchSource:0}: Error finding container 3f3c86b51cdc9408d3600d2b2f2c2587244f480029ba8fc17964d56d4c75b5b3: Status 404 returned error can't find the container with id 3f3c86b51cdc9408d3600d2b2f2c2587244f480029ba8fc17964d56d4c75b5b3
May 25 01:04:27.148404 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:27.148364    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9x9mx" event={"ID":"68343816-fb65-4e10-86cc-330386cfb2f0","Type":"ContainerStarted","Data":"3f3c86b51cdc9408d3600d2b2f2c2587244f480029ba8fc17964d56d4c75b5b3"}
May 25 01:04:29.154239 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:29.154193    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9x9mx" event={"ID":"68343816-fb65-4e10-86cc-330386cfb2f0","Type":"ContainerStarted","Data":"97c2217c33ab00c84f7d8f463bb9084637e434191fc3f6a0892570b9faa93b5e"}
May 25 01:04:29.155568 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:29.155537    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rlxhg" event={"ID":"53c7a514-5b75-49d8-b645-8a76c65eadb0","Type":"ContainerStarted","Data":"103cd377882988a9bf5abe633c4dda8a9c8418d03172b8486e56a6975d97fb3f"}
May 25 01:04:29.170153 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:29.170114    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9x9mx" podStartSLOduration=2.242995884 podStartE2EDuration="4.170101701s" podCreationTimestamp="2026-05-25 01:04:25 +0000 UTC" firstStartedPulling="2026-05-25 01:04:26.252500908 +0000 UTC m=+125.122160212" lastFinishedPulling="2026-05-25 01:04:28.179606722 +0000 UTC m=+127.049266029" observedRunningTime="2026-05-25 01:04:29.169176164 +0000 UTC m=+128.038835489" watchObservedRunningTime="2026-05-25 01:04:29.170101701 +0000 UTC m=+128.039761038"
May 25 01:04:29.185873 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:29.185822    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rlxhg" podStartSLOduration=2.1371645790000002 podStartE2EDuration="4.185805447s" podCreationTimestamp="2026-05-25 01:04:25 +0000 UTC" firstStartedPulling="2026-05-25 01:04:26.128619216 +0000 UTC m=+124.998278535" lastFinishedPulling="2026-05-25 01:04:28.177260096 +0000 UTC m=+127.046919403" observedRunningTime="2026-05-25 01:04:29.18534612 +0000 UTC m=+128.055005445" watchObservedRunningTime="2026-05-25 01:04:29.185805447 +0000 UTC m=+128.055464774"
May 25 01:04:29.329838 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:29.329807    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-p2ns9"]
May 25 01:04:29.332875 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:29.332859    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-p2ns9"
May 25 01:04:29.335460 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:29.335440    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-stpmq\""
May 25 01:04:29.340116 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:29.340095    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-p2ns9"]
May 25 01:04:29.444461 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:29.444437    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xgz9\" (UniqueName: \"kubernetes.io/projected/e61322b7-0661-427f-8a60-c0f02c798de0-kube-api-access-4xgz9\") pod \"network-check-source-7f44b6dd87-p2ns9\" (UID: \"e61322b7-0661-427f-8a60-c0f02c798de0\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-p2ns9"
May 25 01:04:29.545177 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:29.545144    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4xgz9\" (UniqueName: \"kubernetes.io/projected/e61322b7-0661-427f-8a60-c0f02c798de0-kube-api-access-4xgz9\") pod \"network-check-source-7f44b6dd87-p2ns9\" (UID: \"e61322b7-0661-427f-8a60-c0f02c798de0\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-p2ns9"
May 25 01:04:29.553690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:29.553672    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xgz9\" (UniqueName: \"kubernetes.io/projected/e61322b7-0661-427f-8a60-c0f02c798de0-kube-api-access-4xgz9\") pod \"network-check-source-7f44b6dd87-p2ns9\" (UID: \"e61322b7-0661-427f-8a60-c0f02c798de0\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-p2ns9"
May 25 01:04:29.642063 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:29.642040    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-p2ns9"
May 25 01:04:29.761417 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:29.761387    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-p2ns9"]
May 25 01:04:29.764463 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:04:29.764431    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode61322b7_0661_427f_8a60_c0f02c798de0.slice/crio-5eb2969a306c76727ae388a16eedc7cf9e2da0902b72c3a6269ee3ae4f2cec54 WatchSource:0}: Error finding container 5eb2969a306c76727ae388a16eedc7cf9e2da0902b72c3a6269ee3ae4f2cec54: Status 404 returned error can't find the container with id 5eb2969a306c76727ae388a16eedc7cf9e2da0902b72c3a6269ee3ae4f2cec54
May 25 01:04:30.097387 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:30.097158    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-56w24"]
May 25 01:04:30.100420 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:30.100400    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-56w24"
May 25 01:04:30.103371 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:30.103321    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-ffdvm\""
May 25 01:04:30.103499 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:30.103464    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 25 01:04:30.104368 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:30.104347    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 25 01:04:30.110606 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:30.110585    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-56w24"]
May 25 01:04:30.159064 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:30.159025    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-p2ns9" event={"ID":"e61322b7-0661-427f-8a60-c0f02c798de0","Type":"ContainerStarted","Data":"46108cab052553815ae68fd699a255fc13947c5389a7d2c31d30b6bf44f96382"}
May 25 01:04:30.159064 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:30.159066    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-p2ns9" event={"ID":"e61322b7-0661-427f-8a60-c0f02c798de0","Type":"ContainerStarted","Data":"5eb2969a306c76727ae388a16eedc7cf9e2da0902b72c3a6269ee3ae4f2cec54"}
May 25 01:04:30.175925 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:30.175876    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-p2ns9" podStartSLOduration=1.175859828 podStartE2EDuration="1.175859828s" podCreationTimestamp="2026-05-25 01:04:29 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:04:30.175830331 +0000 UTC m=+129.045489658" watchObservedRunningTime="2026-05-25 01:04:30.175859828 +0000 UTC m=+129.045519153"
May 25 01:04:30.250108 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:30.250065    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qhvf\" (UniqueName: \"kubernetes.io/projected/2ddf7c33-01aa-46fa-8447-9a787e55b30c-kube-api-access-7qhvf\") pod \"migrator-b985f5d89-56w24\" (UID: \"2ddf7c33-01aa-46fa-8447-9a787e55b30c\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-56w24"
May 25 01:04:30.351255 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:30.351171    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qhvf\" (UniqueName: \"kubernetes.io/projected/2ddf7c33-01aa-46fa-8447-9a787e55b30c-kube-api-access-7qhvf\") pod \"migrator-b985f5d89-56w24\" (UID: \"2ddf7c33-01aa-46fa-8447-9a787e55b30c\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-56w24"
May 25 01:04:30.362979 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:30.362946    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qhvf\" (UniqueName: \"kubernetes.io/projected/2ddf7c33-01aa-46fa-8447-9a787e55b30c-kube-api-access-7qhvf\") pod \"migrator-b985f5d89-56w24\" (UID: \"2ddf7c33-01aa-46fa-8447-9a787e55b30c\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-56w24"
May 25 01:04:30.409746 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:30.409702    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-56w24"
May 25 01:04:30.451949 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:30.451913    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs\") pod \"network-metrics-daemon-tsh68\" (UID: \"0c53f430-328a-4e17-b089-976b8d399f7c\") " pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:04:30.452128 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:30.452061    2558 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 25 01:04:30.452128 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:30.452125    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs podName:0c53f430-328a-4e17-b089-976b8d399f7c nodeName:}" failed. No retries permitted until 2026-05-25 01:06:32.452108862 +0000 UTC m=+251.321768166 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs") pod "network-metrics-daemon-tsh68" (UID: "0c53f430-328a-4e17-b089-976b8d399f7c") : secret "metrics-daemon-secret" not found
May 25 01:04:30.541473 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:30.541441    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-56w24"]
May 25 01:04:30.544510 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:04:30.544473    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ddf7c33_01aa_46fa_8447_9a787e55b30c.slice/crio-f062e6af9a1b78b60682045e1e583d906f5ee78019daa38af3d71dac4865ed58 WatchSource:0}: Error finding container f062e6af9a1b78b60682045e1e583d906f5ee78019daa38af3d71dac4865ed58: Status 404 returned error can't find the container with id f062e6af9a1b78b60682045e1e583d906f5ee78019daa38af3d71dac4865ed58
May 25 01:04:31.162264 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:31.162218    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-56w24" event={"ID":"2ddf7c33-01aa-46fa-8447-9a787e55b30c","Type":"ContainerStarted","Data":"f062e6af9a1b78b60682045e1e583d906f5ee78019daa38af3d71dac4865ed58"}
May 25 01:04:31.464151 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:31.464128    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:31.464212 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:31.464164    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:31.464212 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:31.464194    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-pps9j\" (UID: \"9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j"
May 25 01:04:31.464298 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:31.464276    2558 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 25 01:04:31.464372 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:31.464361    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs podName:60a10e75-26eb-4497-a652-fe509cb7282c nodeName:}" failed. No retries permitted until 2026-05-25 01:04:47.464340569 +0000 UTC m=+146.333999873 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs") pod "router-default-85b7cb4646-2kg7w" (UID: "60a10e75-26eb-4497-a652-fe509cb7282c") : secret "router-metrics-certs-default" not found
May 25 01:04:31.464427 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:31.464320    2558 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 25 01:04:31.464427 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:31.464392    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle podName:60a10e75-26eb-4497-a652-fe509cb7282c nodeName:}" failed. No retries permitted until 2026-05-25 01:04:47.464373561 +0000 UTC m=+146.334032891 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle") pod "router-default-85b7cb4646-2kg7w" (UID: "60a10e75-26eb-4497-a652-fe509cb7282c") : configmap references non-existent config key: service-ca.crt
May 25 01:04:31.464427 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:31.464416    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls podName:9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d nodeName:}" failed. No retries permitted until 2026-05-25 01:04:47.464406346 +0000 UTC m=+146.334065655 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-pps9j" (UID: "9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d") : secret "cluster-monitoring-operator-tls" not found
May 25 01:04:32.165544 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.165506    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-56w24" event={"ID":"2ddf7c33-01aa-46fa-8447-9a787e55b30c","Type":"ContainerStarted","Data":"c7de17ccdec43da999f7fbcd4e5021ccf529f04e98cb30122caad16a3eaf8bb5"}
May 25 01:04:32.165544 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.165547    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-56w24" event={"ID":"2ddf7c33-01aa-46fa-8447-9a787e55b30c","Type":"ContainerStarted","Data":"08de7354ccb9a1f173686fea5475be2489dd35cbb0f5812ba750f00fc648f81b"}
May 25 01:04:32.195316 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.195263    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-56w24" podStartSLOduration=1.283808951 podStartE2EDuration="2.195250465s" podCreationTimestamp="2026-05-25 01:04:30 +0000 UTC" firstStartedPulling="2026-05-25 01:04:30.546759745 +0000 UTC m=+129.416419053" lastFinishedPulling="2026-05-25 01:04:31.458201247 +0000 UTC m=+130.327860567" observedRunningTime="2026-05-25 01:04:32.194152564 +0000 UTC m=+131.063811892" watchObservedRunningTime="2026-05-25 01:04:32.195250465 +0000 UTC m=+131.064909815"
May 25 01:04:32.425027 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.424929    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-n2vnl"]
May 25 01:04:32.428013 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.427989    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:32.430861 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.430828    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 25 01:04:32.431010 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.430866    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 25 01:04:32.431010 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.430866    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 25 01:04:32.431567 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.431547    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 25 01:04:32.431668 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.431554    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ljdcr\""
May 25 01:04:32.437745 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.437728    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n2vnl"]
May 25 01:04:32.572831 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.572804    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a204a86-1245-4de2-9735-3cb129c7e636-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n2vnl\" (UID: \"6a204a86-1245-4de2-9735-3cb129c7e636\") " pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:32.572946 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.572862    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6a204a86-1245-4de2-9735-3cb129c7e636-crio-socket\") pod \"insights-runtime-extractor-n2vnl\" (UID: \"6a204a86-1245-4de2-9735-3cb129c7e636\") " pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:32.572946 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.572909    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a204a86-1245-4de2-9735-3cb129c7e636-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n2vnl\" (UID: \"6a204a86-1245-4de2-9735-3cb129c7e636\") " pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:32.573034 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.572968    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwl4d\" (UniqueName: \"kubernetes.io/projected/6a204a86-1245-4de2-9735-3cb129c7e636-kube-api-access-kwl4d\") pod \"insights-runtime-extractor-n2vnl\" (UID: \"6a204a86-1245-4de2-9735-3cb129c7e636\") " pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:32.573065 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.573030    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a204a86-1245-4de2-9735-3cb129c7e636-data-volume\") pod \"insights-runtime-extractor-n2vnl\" (UID: \"6a204a86-1245-4de2-9735-3cb129c7e636\") " pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:32.674029 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.673993    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a204a86-1245-4de2-9735-3cb129c7e636-data-volume\") pod \"insights-runtime-extractor-n2vnl\" (UID: \"6a204a86-1245-4de2-9735-3cb129c7e636\") " pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:32.674149 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.674046    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a204a86-1245-4de2-9735-3cb129c7e636-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n2vnl\" (UID: \"6a204a86-1245-4de2-9735-3cb129c7e636\") " pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:32.674231 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:32.674212    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 25 01:04:32.674266 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.674244    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6a204a86-1245-4de2-9735-3cb129c7e636-crio-socket\") pod \"insights-runtime-extractor-n2vnl\" (UID: \"6a204a86-1245-4de2-9735-3cb129c7e636\") " pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:32.674266 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.674262    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a204a86-1245-4de2-9735-3cb129c7e636-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n2vnl\" (UID: \"6a204a86-1245-4de2-9735-3cb129c7e636\") " pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:32.674364 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:32.674281    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a204a86-1245-4de2-9735-3cb129c7e636-insights-runtime-extractor-tls podName:6a204a86-1245-4de2-9735-3cb129c7e636 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:33.174262869 +0000 UTC m=+132.043922175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a204a86-1245-4de2-9735-3cb129c7e636-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n2vnl" (UID: "6a204a86-1245-4de2-9735-3cb129c7e636") : secret "insights-runtime-extractor-tls" not found
May 25 01:04:32.674425 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.674368    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kwl4d\" (UniqueName: \"kubernetes.io/projected/6a204a86-1245-4de2-9735-3cb129c7e636-kube-api-access-kwl4d\") pod \"insights-runtime-extractor-n2vnl\" (UID: \"6a204a86-1245-4de2-9735-3cb129c7e636\") " pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:32.674425 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.674383    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/6a204a86-1245-4de2-9735-3cb129c7e636-crio-socket\") pod \"insights-runtime-extractor-n2vnl\" (UID: \"6a204a86-1245-4de2-9735-3cb129c7e636\") " pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:32.674425 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.674371    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/6a204a86-1245-4de2-9735-3cb129c7e636-data-volume\") pod \"insights-runtime-extractor-n2vnl\" (UID: \"6a204a86-1245-4de2-9735-3cb129c7e636\") " pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:32.674720 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.674703    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/6a204a86-1245-4de2-9735-3cb129c7e636-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n2vnl\" (UID: \"6a204a86-1245-4de2-9735-3cb129c7e636\") " pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:32.687457 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:32.687403    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwl4d\" (UniqueName: \"kubernetes.io/projected/6a204a86-1245-4de2-9735-3cb129c7e636-kube-api-access-kwl4d\") pod \"insights-runtime-extractor-n2vnl\" (UID: \"6a204a86-1245-4de2-9735-3cb129c7e636\") " pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:33.178287 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:33.178258    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a204a86-1245-4de2-9735-3cb129c7e636-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n2vnl\" (UID: \"6a204a86-1245-4de2-9735-3cb129c7e636\") " pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:33.178673 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:33.178430    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 25 01:04:33.178673 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:33.178487    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a204a86-1245-4de2-9735-3cb129c7e636-insights-runtime-extractor-tls podName:6a204a86-1245-4de2-9735-3cb129c7e636 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:34.178471588 +0000 UTC m=+133.048130894 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a204a86-1245-4de2-9735-3cb129c7e636-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n2vnl" (UID: "6a204a86-1245-4de2-9735-3cb129c7e636") : secret "insights-runtime-extractor-tls" not found
May 25 01:04:34.186296 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:34.186261    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a204a86-1245-4de2-9735-3cb129c7e636-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n2vnl\" (UID: \"6a204a86-1245-4de2-9735-3cb129c7e636\") " pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:34.186692 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:34.186429    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 25 01:04:34.186692 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:34.186495    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a204a86-1245-4de2-9735-3cb129c7e636-insights-runtime-extractor-tls podName:6a204a86-1245-4de2-9735-3cb129c7e636 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:36.186478762 +0000 UTC m=+135.056138065 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a204a86-1245-4de2-9735-3cb129c7e636-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n2vnl" (UID: "6a204a86-1245-4de2-9735-3cb129c7e636") : secret "insights-runtime-extractor-tls" not found
May 25 01:04:36.202272 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:36.202235    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a204a86-1245-4de2-9735-3cb129c7e636-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n2vnl\" (UID: \"6a204a86-1245-4de2-9735-3cb129c7e636\") " pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:36.202670 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:36.202391    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 25 01:04:36.202670 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:36.202456    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a204a86-1245-4de2-9735-3cb129c7e636-insights-runtime-extractor-tls podName:6a204a86-1245-4de2-9735-3cb129c7e636 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:40.202440302 +0000 UTC m=+139.072099606 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a204a86-1245-4de2-9735-3cb129c7e636-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n2vnl" (UID: "6a204a86-1245-4de2-9735-3cb129c7e636") : secret "insights-runtime-extractor-tls" not found
May 25 01:04:40.232930 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:40.232901    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a204a86-1245-4de2-9735-3cb129c7e636-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n2vnl\" (UID: \"6a204a86-1245-4de2-9735-3cb129c7e636\") " pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:40.233361 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:40.233015    2558 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
May 25 01:04:40.233361 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:40.233065    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a204a86-1245-4de2-9735-3cb129c7e636-insights-runtime-extractor-tls podName:6a204a86-1245-4de2-9735-3cb129c7e636 nodeName:}" failed. No retries permitted until 2026-05-25 01:04:48.233051367 +0000 UTC m=+147.102710672 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/6a204a86-1245-4de2-9735-3cb129c7e636-insights-runtime-extractor-tls") pod "insights-runtime-extractor-n2vnl" (UID: "6a204a86-1245-4de2-9735-3cb129c7e636") : secret "insights-runtime-extractor-tls" not found
May 25 01:04:47.489262 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:47.489228    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:47.489736 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:47.489272    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-pps9j\" (UID: \"9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j"
May 25 01:04:47.489736 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:47.489301    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:47.489968 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:47.489948    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60a10e75-26eb-4497-a652-fe509cb7282c-service-ca-bundle\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:47.491784 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:47.491765    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60a10e75-26eb-4497-a652-fe509cb7282c-metrics-certs\") pod \"router-default-85b7cb4646-2kg7w\" (UID: \"60a10e75-26eb-4497-a652-fe509cb7282c\") " pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:47.491912 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:47.491891    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-pps9j\" (UID: \"9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j"
May 25 01:04:47.507019 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:47.506997    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-8n82s\""
May 25 01:04:47.515102 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:47.515088    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j"
May 25 01:04:47.515495 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:47.515466    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-j4lpl\""
May 25 01:04:47.523614 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:47.523584    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:47.647556 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:47.646872    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j"]
May 25 01:04:47.650088 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:04:47.650050    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cc4019e_1b58_4c13_a6ef_ca0b4784bd3d.slice/crio-427595ba07507fc727b283b2fd027f3849a9f362b33ab1995a2e3703ecfc847b WatchSource:0}: Error finding container 427595ba07507fc727b283b2fd027f3849a9f362b33ab1995a2e3703ecfc847b: Status 404 returned error can't find the container with id 427595ba07507fc727b283b2fd027f3849a9f362b33ab1995a2e3703ecfc847b
May 25 01:04:47.664773 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:47.664745    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85b7cb4646-2kg7w"]
May 25 01:04:47.667158 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:04:47.667131    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60a10e75_26eb_4497_a652_fe509cb7282c.slice/crio-5449a71faa9b0a6b94d177e181e5ebc823e50331b79574ad90860e6608d50784 WatchSource:0}: Error finding container 5449a71faa9b0a6b94d177e181e5ebc823e50331b79574ad90860e6608d50784: Status 404 returned error can't find the container with id 5449a71faa9b0a6b94d177e181e5ebc823e50331b79574ad90860e6608d50784
May 25 01:04:48.207698 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:48.207661    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85b7cb4646-2kg7w" event={"ID":"60a10e75-26eb-4497-a652-fe509cb7282c","Type":"ContainerStarted","Data":"9266473b5e54c2acfbc20f9d4e55f0f7edbd83d1233f0d12ddaa3adf932def8c"}
May 25 01:04:48.207857 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:48.207705    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85b7cb4646-2kg7w" event={"ID":"60a10e75-26eb-4497-a652-fe509cb7282c","Type":"ContainerStarted","Data":"5449a71faa9b0a6b94d177e181e5ebc823e50331b79574ad90860e6608d50784"}
May 25 01:04:48.208835 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:48.208811    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j" event={"ID":"9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d","Type":"ContainerStarted","Data":"427595ba07507fc727b283b2fd027f3849a9f362b33ab1995a2e3703ecfc847b"}
May 25 01:04:48.228018 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:48.227967    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-85b7cb4646-2kg7w" podStartSLOduration=33.227949642 podStartE2EDuration="33.227949642s" podCreationTimestamp="2026-05-25 01:04:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:04:48.226772554 +0000 UTC m=+147.096431893" watchObservedRunningTime="2026-05-25 01:04:48.227949642 +0000 UTC m=+147.097608969"
May 25 01:04:48.295337 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:48.295301    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a204a86-1245-4de2-9735-3cb129c7e636-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n2vnl\" (UID: \"6a204a86-1245-4de2-9735-3cb129c7e636\") " pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:48.297680 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:48.297659    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/6a204a86-1245-4de2-9735-3cb129c7e636-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n2vnl\" (UID: \"6a204a86-1245-4de2-9735-3cb129c7e636\") " pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:48.337043 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:48.337024    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n2vnl"
May 25 01:04:48.473266 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:48.473201    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n2vnl"]
May 25 01:04:48.476549 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:04:48.476523    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a204a86_1245_4de2_9735_3cb129c7e636.slice/crio-579d0ade9d3f0dc97fba1ef5edfc6e3ed08b7cc87e877a89eb105b0abdb4dcf6 WatchSource:0}: Error finding container 579d0ade9d3f0dc97fba1ef5edfc6e3ed08b7cc87e877a89eb105b0abdb4dcf6: Status 404 returned error can't find the container with id 579d0ade9d3f0dc97fba1ef5edfc6e3ed08b7cc87e877a89eb105b0abdb4dcf6
May 25 01:04:48.523750 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:48.523728    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:48.525976 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:48.525958    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:49.212178 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:49.212140    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n2vnl" event={"ID":"6a204a86-1245-4de2-9735-3cb129c7e636","Type":"ContainerStarted","Data":"0fe3331c4b43d1b450e9bffcf027fcbe584c85d4117bf18c87603e3f70ca36b6"}
May 25 01:04:49.212178 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:49.212181    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n2vnl" event={"ID":"6a204a86-1245-4de2-9735-3cb129c7e636","Type":"ContainerStarted","Data":"579d0ade9d3f0dc97fba1ef5edfc6e3ed08b7cc87e877a89eb105b0abdb4dcf6"}
May 25 01:04:49.212421 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:49.212348    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:49.213701 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:49.213679    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-85b7cb4646-2kg7w"
May 25 01:04:50.216818 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:50.216783    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j" event={"ID":"9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d","Type":"ContainerStarted","Data":"ce47a7d09d3aca7e3f656b7f31a9090a080b16db2e95577fc9bbb1b440096dea"}
May 25 01:04:50.219890 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:50.219858    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n2vnl" event={"ID":"6a204a86-1245-4de2-9735-3cb129c7e636","Type":"ContainerStarted","Data":"04158b437711454aedf35aa2c3b236de80595c618dc2ca755b490f51d7bb119a"}
May 25 01:04:50.235086 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:50.234910    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-pps9j" podStartSLOduration=32.989888048 podStartE2EDuration="35.234898139s" podCreationTimestamp="2026-05-25 01:04:15 +0000 UTC" firstStartedPulling="2026-05-25 01:04:47.651969714 +0000 UTC m=+146.521629018" lastFinishedPulling="2026-05-25 01:04:49.896979794 +0000 UTC m=+148.766639109" observedRunningTime="2026-05-25 01:04:50.23436171 +0000 UTC m=+149.104021039" watchObservedRunningTime="2026-05-25 01:04:50.234898139 +0000 UTC m=+149.104557466"
May 25 01:04:51.223820 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:51.223768    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n2vnl" event={"ID":"6a204a86-1245-4de2-9735-3cb129c7e636","Type":"ContainerStarted","Data":"4a02122ec4cd97a9439da066b141f6184a038157b13b2f92c848ed4f5d1038f5"}
May 25 01:04:51.243226 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:51.243189    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-n2vnl" podStartSLOduration=16.717966112 podStartE2EDuration="19.243177179s" podCreationTimestamp="2026-05-25 01:04:32 +0000 UTC" firstStartedPulling="2026-05-25 01:04:48.535097018 +0000 UTC m=+147.404756323" lastFinishedPulling="2026-05-25 01:04:51.060308069 +0000 UTC m=+149.929967390" observedRunningTime="2026-05-25 01:04:51.242301923 +0000 UTC m=+150.111961250" watchObservedRunningTime="2026-05-25 01:04:51.243177179 +0000 UTC m=+150.112836531"
May 25 01:04:52.551653 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.551606    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-q2wpj"]
May 25 01:04:52.583779 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.583755    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-q2wpj"]
May 25 01:04:52.583916 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.583861    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q2wpj"
May 25 01:04:52.587737 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.587711    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-f5gwp\""
May 25 01:04:52.587869 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.587765    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 25 01:04:52.587869 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.587766    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 25 01:04:52.662165 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.662132    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-cj62j"]
May 25 01:04:52.680219 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.680194    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t5vz5"]
May 25 01:04:52.680393 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.680370    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-cj62j"
May 25 01:04:52.683129 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.683097    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 25 01:04:52.683264 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.683128    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 25 01:04:52.683264 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.683097    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-2hqgr\""
May 25 01:04:52.694311 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.694292    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-cj62j"]
May 25 01:04:52.694311 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.694314    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t5vz5"]
May 25 01:04:52.694462 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.694426    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t5vz5"
May 25 01:04:52.696874 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.696855    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 25 01:04:52.697001 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.696980    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-nfgsq\""
May 25 01:04:52.731564 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.731542    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bce5b4a2-8f1b-423e-b437-7557cbeb6041-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-q2wpj\" (UID: \"bce5b4a2-8f1b-423e-b437-7557cbeb6041\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q2wpj"
May 25 01:04:52.731656 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.731624    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bce5b4a2-8f1b-423e-b437-7557cbeb6041-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-q2wpj\" (UID: \"bce5b4a2-8f1b-423e-b437-7557cbeb6041\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q2wpj"
May 25 01:04:52.832874 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.832805    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bce5b4a2-8f1b-423e-b437-7557cbeb6041-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-q2wpj\" (UID: \"bce5b4a2-8f1b-423e-b437-7557cbeb6041\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q2wpj"
May 25 01:04:52.832874 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.832839    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/99ce908f-ff7b-45df-9fb3-edf353604b29-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-t5vz5\" (UID: \"99ce908f-ff7b-45df-9fb3-edf353604b29\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t5vz5"
May 25 01:04:52.833010 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.832895    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbnzm\" (UniqueName: \"kubernetes.io/projected/732ec8d3-8185-475a-8a4c-dfbe83a19efa-kube-api-access-xbnzm\") pod \"downloads-57bd96b888-cj62j\" (UID: \"732ec8d3-8185-475a-8a4c-dfbe83a19efa\") " pod="openshift-console/downloads-57bd96b888-cj62j"
May 25 01:04:52.833010 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.832917    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bce5b4a2-8f1b-423e-b437-7557cbeb6041-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-q2wpj\" (UID: \"bce5b4a2-8f1b-423e-b437-7557cbeb6041\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q2wpj"
May 25 01:04:52.833542 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.833520    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bce5b4a2-8f1b-423e-b437-7557cbeb6041-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-q2wpj\" (UID: \"bce5b4a2-8f1b-423e-b437-7557cbeb6041\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q2wpj"
May 25 01:04:52.835479 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.835464    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/bce5b4a2-8f1b-423e-b437-7557cbeb6041-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-q2wpj\" (UID: \"bce5b4a2-8f1b-423e-b437-7557cbeb6041\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q2wpj"
May 25 01:04:52.892427 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.892387    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q2wpj"
May 25 01:04:52.933509 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.933477    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/99ce908f-ff7b-45df-9fb3-edf353604b29-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-t5vz5\" (UID: \"99ce908f-ff7b-45df-9fb3-edf353604b29\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t5vz5"
May 25 01:04:52.933625 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.933559    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xbnzm\" (UniqueName: \"kubernetes.io/projected/732ec8d3-8185-475a-8a4c-dfbe83a19efa-kube-api-access-xbnzm\") pod \"downloads-57bd96b888-cj62j\" (UID: \"732ec8d3-8185-475a-8a4c-dfbe83a19efa\") " pod="openshift-console/downloads-57bd96b888-cj62j"
May 25 01:04:52.936091 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.936027    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/99ce908f-ff7b-45df-9fb3-edf353604b29-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-t5vz5\" (UID: \"99ce908f-ff7b-45df-9fb3-edf353604b29\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t5vz5"
May 25 01:04:52.970292 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.969876    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbnzm\" (UniqueName: \"kubernetes.io/projected/732ec8d3-8185-475a-8a4c-dfbe83a19efa-kube-api-access-xbnzm\") pod \"downloads-57bd96b888-cj62j\" (UID: \"732ec8d3-8185-475a-8a4c-dfbe83a19efa\") " pod="openshift-console/downloads-57bd96b888-cj62j"
May 25 01:04:52.991668 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:52.991635    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-cj62j"
May 25 01:04:53.002432 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:53.002409    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t5vz5"
May 25 01:04:53.032574 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:53.032543    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-q2wpj"]
May 25 01:04:53.035549 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:04:53.035518    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbce5b4a2_8f1b_423e_b437_7557cbeb6041.slice/crio-f2024e84ae5125ab0ab2acce83951bb394438918fbaad1d8fd8684f499b5e01b WatchSource:0}: Error finding container f2024e84ae5125ab0ab2acce83951bb394438918fbaad1d8fd8684f499b5e01b: Status 404 returned error can't find the container with id f2024e84ae5125ab0ab2acce83951bb394438918fbaad1d8fd8684f499b5e01b
May 25 01:04:53.123295 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:53.123264    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-cj62j"]
May 25 01:04:53.126082 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:04:53.126053    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod732ec8d3_8185_475a_8a4c_dfbe83a19efa.slice/crio-070b1a4a3bf355e377bc007cba6c4a51581a5cd24a5c34a4bb8d6260d9101b66 WatchSource:0}: Error finding container 070b1a4a3bf355e377bc007cba6c4a51581a5cd24a5c34a4bb8d6260d9101b66: Status 404 returned error can't find the container with id 070b1a4a3bf355e377bc007cba6c4a51581a5cd24a5c34a4bb8d6260d9101b66
May 25 01:04:53.147954 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:53.147922    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t5vz5"]
May 25 01:04:53.150820 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:04:53.150795    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99ce908f_ff7b_45df_9fb3_edf353604b29.slice/crio-a3618c89a4e01e917db794aea760c16db3e7a55fdf2290577c1919889cef95c2 WatchSource:0}: Error finding container a3618c89a4e01e917db794aea760c16db3e7a55fdf2290577c1919889cef95c2: Status 404 returned error can't find the container with id a3618c89a4e01e917db794aea760c16db3e7a55fdf2290577c1919889cef95c2
May 25 01:04:53.230291 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:53.230251    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t5vz5" event={"ID":"99ce908f-ff7b-45df-9fb3-edf353604b29","Type":"ContainerStarted","Data":"a3618c89a4e01e917db794aea760c16db3e7a55fdf2290577c1919889cef95c2"}
May 25 01:04:53.231352 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:53.231304    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q2wpj" event={"ID":"bce5b4a2-8f1b-423e-b437-7557cbeb6041","Type":"ContainerStarted","Data":"f2024e84ae5125ab0ab2acce83951bb394438918fbaad1d8fd8684f499b5e01b"}
May 25 01:04:53.232176 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:53.232157    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-cj62j" event={"ID":"732ec8d3-8185-475a-8a4c-dfbe83a19efa","Type":"ContainerStarted","Data":"070b1a4a3bf355e377bc007cba6c4a51581a5cd24a5c34a4bb8d6260d9101b66"}
May 25 01:04:54.236557 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:54.236502    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q2wpj" event={"ID":"bce5b4a2-8f1b-423e-b437-7557cbeb6041","Type":"ContainerStarted","Data":"92fc525a079d8b7bbd4aadb530f8e38cdcaeda3f8ef3e27c59d747b325d4d9ba"}
May 25 01:04:54.252294 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:54.252235    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-q2wpj" podStartSLOduration=1.272093887 podStartE2EDuration="2.252217155s" podCreationTimestamp="2026-05-25 01:04:52 +0000 UTC" firstStartedPulling="2026-05-25 01:04:53.037553665 +0000 UTC m=+151.907212982" lastFinishedPulling="2026-05-25 01:04:54.017676945 +0000 UTC m=+152.887336250" observedRunningTime="2026-05-25 01:04:54.25147654 +0000 UTC m=+153.121135865" watchObservedRunningTime="2026-05-25 01:04:54.252217155 +0000 UTC m=+153.121876492"
May 25 01:04:55.241107 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.241071    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t5vz5" event={"ID":"99ce908f-ff7b-45df-9fb3-edf353604b29","Type":"ContainerStarted","Data":"527b752d38b8d39a94aa363d7cf7ef662420343f216abf4e72b5fe4394107257"}
May 25 01:04:55.241589 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.241376    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t5vz5"
May 25 01:04:55.246418 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.246391    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t5vz5"
May 25 01:04:55.259039 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.258999    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-t5vz5" podStartSLOduration=2.014994599 podStartE2EDuration="3.258986883s" podCreationTimestamp="2026-05-25 01:04:52 +0000 UTC" firstStartedPulling="2026-05-25 01:04:53.152597758 +0000 UTC m=+152.022257062" lastFinishedPulling="2026-05-25 01:04:54.396590028 +0000 UTC m=+153.266249346" observedRunningTime="2026-05-25 01:04:55.258060311 +0000 UTC m=+154.127719637" watchObservedRunningTime="2026-05-25 01:04:55.258986883 +0000 UTC m=+154.128646210"
May 25 01:04:55.490461 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.490429    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt"]
May 25 01:04:55.493658 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.493611    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt"
May 25 01:04:55.497415 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.497285    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 25 01:04:55.497415 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.497386    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 25 01:04:55.497415 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.497383    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rzn7d\""
May 25 01:04:55.497652 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.497473    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 25 01:04:55.505003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.504963    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt"]
May 25 01:04:55.656922 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.656888    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cgcdm\" (UniqueName: \"kubernetes.io/projected/f215cb60-b0f0-44e5-962e-b872350bcf3b-kube-api-access-cgcdm\") pod \"prometheus-operator-7779bbdd78-9fqnt\" (UID: \"f215cb60-b0f0-44e5-962e-b872350bcf3b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt"
May 25 01:04:55.657082 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.656955    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f215cb60-b0f0-44e5-962e-b872350bcf3b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-9fqnt\" (UID: \"f215cb60-b0f0-44e5-962e-b872350bcf3b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt"
May 25 01:04:55.657082 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.657045    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f215cb60-b0f0-44e5-962e-b872350bcf3b-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-9fqnt\" (UID: \"f215cb60-b0f0-44e5-962e-b872350bcf3b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt"
May 25 01:04:55.657082 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.657075    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f215cb60-b0f0-44e5-962e-b872350bcf3b-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-9fqnt\" (UID: \"f215cb60-b0f0-44e5-962e-b872350bcf3b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt"
May 25 01:04:55.757778 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.757703    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f215cb60-b0f0-44e5-962e-b872350bcf3b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-9fqnt\" (UID: \"f215cb60-b0f0-44e5-962e-b872350bcf3b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt"
May 25 01:04:55.757916 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.757787    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f215cb60-b0f0-44e5-962e-b872350bcf3b-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-9fqnt\" (UID: \"f215cb60-b0f0-44e5-962e-b872350bcf3b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt"
May 25 01:04:55.757916 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.757818    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f215cb60-b0f0-44e5-962e-b872350bcf3b-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-9fqnt\" (UID: \"f215cb60-b0f0-44e5-962e-b872350bcf3b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt"
May 25 01:04:55.757916 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.757867    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cgcdm\" (UniqueName: \"kubernetes.io/projected/f215cb60-b0f0-44e5-962e-b872350bcf3b-kube-api-access-cgcdm\") pod \"prometheus-operator-7779bbdd78-9fqnt\" (UID: \"f215cb60-b0f0-44e5-962e-b872350bcf3b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt"
May 25 01:04:55.758363 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.758343    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f215cb60-b0f0-44e5-962e-b872350bcf3b-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-9fqnt\" (UID: \"f215cb60-b0f0-44e5-962e-b872350bcf3b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt"
May 25 01:04:55.760888 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.760858    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f215cb60-b0f0-44e5-962e-b872350bcf3b-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-9fqnt\" (UID: \"f215cb60-b0f0-44e5-962e-b872350bcf3b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt"
May 25 01:04:55.760983 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.760911    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f215cb60-b0f0-44e5-962e-b872350bcf3b-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-9fqnt\" (UID: \"f215cb60-b0f0-44e5-962e-b872350bcf3b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt"
May 25 01:04:55.767904 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.767880    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cgcdm\" (UniqueName: \"kubernetes.io/projected/f215cb60-b0f0-44e5-962e-b872350bcf3b-kube-api-access-cgcdm\") pod \"prometheus-operator-7779bbdd78-9fqnt\" (UID: \"f215cb60-b0f0-44e5-962e-b872350bcf3b\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt"
May 25 01:04:55.803486 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.803463    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt"
May 25 01:04:55.931245 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:55.931180    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt"]
May 25 01:04:55.936709 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:04:55.936672    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf215cb60_b0f0_44e5_962e_b872350bcf3b.slice/crio-7245ea91c6044cd0f1f6bb44c3e2756b60f178d19504463ea5b742c535b6fc9e WatchSource:0}: Error finding container 7245ea91c6044cd0f1f6bb44c3e2756b60f178d19504463ea5b742c535b6fc9e: Status 404 returned error can't find the container with id 7245ea91c6044cd0f1f6bb44c3e2756b60f178d19504463ea5b742c535b6fc9e
May 25 01:04:56.244654 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:56.244619    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt" event={"ID":"f215cb60-b0f0-44e5-962e-b872350bcf3b","Type":"ContainerStarted","Data":"7245ea91c6044cd0f1f6bb44c3e2756b60f178d19504463ea5b742c535b6fc9e"}
May 25 01:04:58.252244 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:58.252208    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt" event={"ID":"f215cb60-b0f0-44e5-962e-b872350bcf3b","Type":"ContainerStarted","Data":"677e3ed06ae9e54082125654030b87291c1f91d6b7d4fbefe7f08cdfaccd238c"}
May 25 01:04:58.252244 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:58.252244    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt" event={"ID":"f215cb60-b0f0-44e5-962e-b872350bcf3b","Type":"ContainerStarted","Data":"12627a1af6405bd65068b245a57451872c8f096a9aade62dad6de4751035fe75"}
May 25 01:04:58.269664 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:58.269624    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-9fqnt" podStartSLOduration=1.788798775 podStartE2EDuration="3.269609993s" podCreationTimestamp="2026-05-25 01:04:55 +0000 UTC" firstStartedPulling="2026-05-25 01:04:55.938827406 +0000 UTC m=+154.808486713" lastFinishedPulling="2026-05-25 01:04:57.419638627 +0000 UTC m=+156.289297931" observedRunningTime="2026-05-25 01:04:58.268550691 +0000 UTC m=+157.138210017" watchObservedRunningTime="2026-05-25 01:04:58.269609993 +0000 UTC m=+157.139269320"
May 25 01:04:59.569134 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:59.569093    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cjp74" podUID="2e574b48-0e58-4e0d-b442-d80b423af7e1"
May 25 01:04:59.577294 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:04:59.577262    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-fmgsh" podUID="d8561800-5654-4a77-953a-f17255ab14c7"
May 25 01:04:59.859923 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:59.859844    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-xrlqc"]
May 25 01:04:59.864144 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:59.864122    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:04:59.866883 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:59.866846    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 25 01:04:59.867007 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:59.866881    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9mgnh\""
May 25 01:04:59.867075 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:59.867057    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 25 01:04:59.867146 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:59.867128    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 25 01:04:59.994007 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:59.993975    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/872406f7-ca23-43a5-8d30-9e188a4aad12-node-exporter-wtmp\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:04:59.994144 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:59.994020    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/872406f7-ca23-43a5-8d30-9e188a4aad12-node-exporter-accelerators-collector-config\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:04:59.994144 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:59.994050    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/872406f7-ca23-43a5-8d30-9e188a4aad12-sys\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:04:59.994144 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:59.994102    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/872406f7-ca23-43a5-8d30-9e188a4aad12-root\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:04:59.994144 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:59.994120    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/872406f7-ca23-43a5-8d30-9e188a4aad12-metrics-client-ca\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:04:59.994346 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:59.994181    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/872406f7-ca23-43a5-8d30-9e188a4aad12-node-exporter-tls\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:04:59.994346 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:59.994268    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/872406f7-ca23-43a5-8d30-9e188a4aad12-node-exporter-textfile\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:04:59.994346 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:59.994297    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cwjd\" (UniqueName: \"kubernetes.io/projected/872406f7-ca23-43a5-8d30-9e188a4aad12-kube-api-access-4cwjd\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:04:59.994346 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:04:59.994316    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/872406f7-ca23-43a5-8d30-9e188a4aad12-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.095285 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.095245    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/872406f7-ca23-43a5-8d30-9e188a4aad12-sys\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.095466 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.095293    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/872406f7-ca23-43a5-8d30-9e188a4aad12-root\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.095466 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.095312    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/872406f7-ca23-43a5-8d30-9e188a4aad12-metrics-client-ca\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.095466 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.095377    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/872406f7-ca23-43a5-8d30-9e188a4aad12-node-exporter-tls\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.095466 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.095378    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/872406f7-ca23-43a5-8d30-9e188a4aad12-sys\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.095466 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.095398    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/872406f7-ca23-43a5-8d30-9e188a4aad12-root\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.095466 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.095446    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/872406f7-ca23-43a5-8d30-9e188a4aad12-node-exporter-textfile\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.095780 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.095477    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4cwjd\" (UniqueName: \"kubernetes.io/projected/872406f7-ca23-43a5-8d30-9e188a4aad12-kube-api-access-4cwjd\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.095780 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.095506    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/872406f7-ca23-43a5-8d30-9e188a4aad12-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.095780 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.095532    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/872406f7-ca23-43a5-8d30-9e188a4aad12-node-exporter-wtmp\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.095780 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:05:00.095562    2558 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 25 01:05:00.095780 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.095569    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/872406f7-ca23-43a5-8d30-9e188a4aad12-node-exporter-accelerators-collector-config\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.095780 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:05:00.095636    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872406f7-ca23-43a5-8d30-9e188a4aad12-node-exporter-tls podName:872406f7-ca23-43a5-8d30-9e188a4aad12 nodeName:}" failed. No retries permitted until 2026-05-25 01:05:00.595613309 +0000 UTC m=+159.465272629 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/872406f7-ca23-43a5-8d30-9e188a4aad12-node-exporter-tls") pod "node-exporter-xrlqc" (UID: "872406f7-ca23-43a5-8d30-9e188a4aad12") : secret "node-exporter-tls" not found
May 25 01:05:00.095780 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.095729    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/872406f7-ca23-43a5-8d30-9e188a4aad12-node-exporter-wtmp\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.096135 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.095986    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/872406f7-ca23-43a5-8d30-9e188a4aad12-metrics-client-ca\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.096135 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.096024    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/872406f7-ca23-43a5-8d30-9e188a4aad12-node-exporter-textfile\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.096212 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.096181    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/872406f7-ca23-43a5-8d30-9e188a4aad12-node-exporter-accelerators-collector-config\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.098456 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.098436    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/872406f7-ca23-43a5-8d30-9e188a4aad12-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.104883 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.104860    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cwjd\" (UniqueName: \"kubernetes.io/projected/872406f7-ca23-43a5-8d30-9e188a4aad12-kube-api-access-4cwjd\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.258526 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.258496    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cjp74"
May 25 01:05:00.258700 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.258496    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fmgsh"
May 25 01:05:00.600973 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.600897    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/872406f7-ca23-43a5-8d30-9e188a4aad12-node-exporter-tls\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.603496 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.603469    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/872406f7-ca23-43a5-8d30-9e188a4aad12-node-exporter-tls\") pod \"node-exporter-xrlqc\" (UID: \"872406f7-ca23-43a5-8d30-9e188a4aad12\") " pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.764640 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:05:00.764604    2558 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-tsh68" podUID="0c53f430-328a-4e17-b089-976b8d399f7c"
May 25 01:05:00.773727 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.773694    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-xrlqc"
May 25 01:05:00.783789 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:05:00.783764    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod872406f7_ca23_43a5_8d30_9e188a4aad12.slice/crio-906902bc38d050ad9595691e50ac04fbdd06296c05fe7368c0ec2727f4ca59e1 WatchSource:0}: Error finding container 906902bc38d050ad9595691e50ac04fbdd06296c05fe7368c0ec2727f4ca59e1: Status 404 returned error can't find the container with id 906902bc38d050ad9595691e50ac04fbdd06296c05fe7368c0ec2727f4ca59e1
May 25 01:05:00.953441 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.953406    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 01:05:00.961184 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.961155    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:00.963937 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.963912    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 25 01:05:00.963937 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.963926    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 25 01:05:00.964161 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.963944    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 25 01:05:00.964161 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.964048    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 25 01:05:00.964306 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.964252    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 25 01:05:00.964306 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.964276    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 25 01:05:00.964449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.964351    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s94wh\""
May 25 01:05:00.964610 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.964593    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 25 01:05:00.964843 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.964828    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 25 01:05:00.964942 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.964834    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 25 01:05:00.972235 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:00.972213    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 01:05:01.005866 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.005846    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv9nv\" (UniqueName: \"kubernetes.io/projected/8c8618f3-ca12-46c3-ae7d-b0a13f702325-kube-api-access-tv9nv\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.005992 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.005885    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.005992 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.005912    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.005992 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.005939    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c8618f3-ca12-46c3-ae7d-b0a13f702325-config-out\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.005992 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.005971    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.006184 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.006019    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c8618f3-ca12-46c3-ae7d-b0a13f702325-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.006184 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.006087    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.006184 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.006118    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-web-config\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.006302 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.006181    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.006302 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.006249    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c8618f3-ca12-46c3-ae7d-b0a13f702325-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.006467 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.006299    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-config-volume\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.006467 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.006351    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c8618f3-ca12-46c3-ae7d-b0a13f702325-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.006467 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.006411    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c8618f3-ca12-46c3-ae7d-b0a13f702325-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.106867 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.106839    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.107031 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.106875    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-web-config\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.107031 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.106900    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.107160 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.107102    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c8618f3-ca12-46c3-ae7d-b0a13f702325-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.107160 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.107141    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-config-volume\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.107255 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.107169    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c8618f3-ca12-46c3-ae7d-b0a13f702325-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.107255 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.107198    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c8618f3-ca12-46c3-ae7d-b0a13f702325-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.107255 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.107232    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tv9nv\" (UniqueName: \"kubernetes.io/projected/8c8618f3-ca12-46c3-ae7d-b0a13f702325-kube-api-access-tv9nv\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.107437 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.107268    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.107437 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.107293    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.107437 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.107319    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c8618f3-ca12-46c3-ae7d-b0a13f702325-config-out\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.107437 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.107382    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.107437 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:05:01.107429    2558 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8c8618f3-ca12-46c3-ae7d-b0a13f702325-alertmanager-trusted-ca-bundle podName:8c8618f3-ca12-46c3-ae7d-b0a13f702325 nodeName:}" failed. No retries permitted until 2026-05-25 01:05:01.607397364 +0000 UTC m=+160.477056683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/8c8618f3-ca12-46c3-ae7d-b0a13f702325-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "8c8618f3-ca12-46c3-ae7d-b0a13f702325") : configmap references non-existent config key: ca-bundle.crt
May 25 01:05:01.107682 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.107482    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c8618f3-ca12-46c3-ae7d-b0a13f702325-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.108568 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.108023    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c8618f3-ca12-46c3-ae7d-b0a13f702325-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.108568 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.108159    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c8618f3-ca12-46c3-ae7d-b0a13f702325-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.111723 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.111664    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.114648 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.114626    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c8618f3-ca12-46c3-ae7d-b0a13f702325-config-out\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.115034 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.114990    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.115136 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.115081    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.115136 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.115111    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.115676 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.115648    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.115771 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.115687    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-config-volume\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.115771 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.115726    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-web-config\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.116036 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.115998    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c8618f3-ca12-46c3-ae7d-b0a13f702325-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.118673 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.118653    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv9nv\" (UniqueName: \"kubernetes.io/projected/8c8618f3-ca12-46c3-ae7d-b0a13f702325-kube-api-access-tv9nv\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.263484 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.263405    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xrlqc" event={"ID":"872406f7-ca23-43a5-8d30-9e188a4aad12","Type":"ContainerStarted","Data":"906902bc38d050ad9595691e50ac04fbdd06296c05fe7368c0ec2727f4ca59e1"}
May 25 01:05:01.612051 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.611972    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c8618f3-ca12-46c3-ae7d-b0a13f702325-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.612963 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.612930    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c8618f3-ca12-46c3-ae7d-b0a13f702325-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:01.875143 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:01.875070    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 25 01:05:02.020041 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:02.020002    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 01:05:02.025091 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:05:02.025061    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c8618f3_ca12_46c3_ae7d_b0a13f702325.slice/crio-4d93cec46f5c2dedbb2693dd66c1fb1b64b29fbb5676f830d3ae12defcd20408 WatchSource:0}: Error finding container 4d93cec46f5c2dedbb2693dd66c1fb1b64b29fbb5676f830d3ae12defcd20408: Status 404 returned error can't find the container with id 4d93cec46f5c2dedbb2693dd66c1fb1b64b29fbb5676f830d3ae12defcd20408
May 25 01:05:02.267583 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:02.267552    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c8618f3-ca12-46c3-ae7d-b0a13f702325","Type":"ContainerStarted","Data":"4d93cec46f5c2dedbb2693dd66c1fb1b64b29fbb5676f830d3ae12defcd20408"}
May 25 01:05:02.269099 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:02.269076    2558 generic.go:358] "Generic (PLEG): container finished" podID="872406f7-ca23-43a5-8d30-9e188a4aad12" containerID="51bc86c4f9b6d4d70610bf8ec124ea9b67998aad1b8294b65632feadf079b100" exitCode=0
May 25 01:05:02.269194 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:02.269128    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xrlqc" event={"ID":"872406f7-ca23-43a5-8d30-9e188a4aad12","Type":"ContainerDied","Data":"51bc86c4f9b6d4d70610bf8ec124ea9b67998aad1b8294b65632feadf079b100"}
May 25 01:05:02.935048 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:02.935014    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-66df74b965-7bltj"]
May 25 01:05:02.939222 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:02.939195    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:02.943363 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:02.943042    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 25 01:05:02.943363 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:02.943153    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 25 01:05:02.943363 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:02.943175    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-ffmlcl0ts05ca\""
May 25 01:05:02.943363 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:02.943182    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 25 01:05:02.943363 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:02.943293    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-8v9dt\""
May 25 01:05:02.943695 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:02.943496    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 25 01:05:02.943695 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:02.943680    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 25 01:05:02.956008 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:02.955973    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66df74b965-7bltj"]
May 25 01:05:03.024734 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.024699    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e90ea4ee-5033-4484-b881-1f6653edc085-secret-thanos-querier-tls\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.024891 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.024747    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnqrl\" (UniqueName: \"kubernetes.io/projected/e90ea4ee-5033-4484-b881-1f6653edc085-kube-api-access-pnqrl\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.024891 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.024783    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e90ea4ee-5033-4484-b881-1f6653edc085-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.024891 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.024835    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e90ea4ee-5033-4484-b881-1f6653edc085-secret-grpc-tls\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.024891 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.024853    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e90ea4ee-5033-4484-b881-1f6653edc085-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.025104 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.024909    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e90ea4ee-5033-4484-b881-1f6653edc085-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.025104 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.024950    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e90ea4ee-5033-4484-b881-1f6653edc085-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.025104 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.024973    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e90ea4ee-5033-4484-b881-1f6653edc085-metrics-client-ca\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.126274 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.126242    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e90ea4ee-5033-4484-b881-1f6653edc085-secret-grpc-tls\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.126274 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.126276    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e90ea4ee-5033-4484-b881-1f6653edc085-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.126498 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.126369    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e90ea4ee-5033-4484-b881-1f6653edc085-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.126498 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.126437    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e90ea4ee-5033-4484-b881-1f6653edc085-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.126498 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.126465    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e90ea4ee-5033-4484-b881-1f6653edc085-metrics-client-ca\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.126637 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.126545    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e90ea4ee-5033-4484-b881-1f6653edc085-secret-thanos-querier-tls\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.126637 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.126576    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pnqrl\" (UniqueName: \"kubernetes.io/projected/e90ea4ee-5033-4484-b881-1f6653edc085-kube-api-access-pnqrl\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.126637 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.126610    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e90ea4ee-5033-4484-b881-1f6653edc085-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.128003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.127236    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e90ea4ee-5033-4484-b881-1f6653edc085-metrics-client-ca\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.129675 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.129625    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/e90ea4ee-5033-4484-b881-1f6653edc085-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.129779 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.129738    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e90ea4ee-5033-4484-b881-1f6653edc085-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.129870 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.129849    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e90ea4ee-5033-4484-b881-1f6653edc085-secret-grpc-tls\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.130215 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.130174    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e90ea4ee-5033-4484-b881-1f6653edc085-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.130215 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.130194    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/e90ea4ee-5033-4484-b881-1f6653edc085-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.130510 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.130487    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/e90ea4ee-5033-4484-b881-1f6653edc085-secret-thanos-querier-tls\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.135844 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.135822    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnqrl\" (UniqueName: \"kubernetes.io/projected/e90ea4ee-5033-4484-b881-1f6653edc085-kube-api-access-pnqrl\") pod \"thanos-querier-66df74b965-7bltj\" (UID: \"e90ea4ee-5033-4484-b881-1f6653edc085\") " pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.249501 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.249468    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:03.274195 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.274162    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xrlqc" event={"ID":"872406f7-ca23-43a5-8d30-9e188a4aad12","Type":"ContainerStarted","Data":"37dc34d644024967b29f9aa4f823d5d3d09cd7b736d5eec0bc0799cba7193dfc"}
May 25 01:05:03.274354 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.274205    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-xrlqc" event={"ID":"872406f7-ca23-43a5-8d30-9e188a4aad12","Type":"ContainerStarted","Data":"0808c46ec9133ea133853aa4923cc62726c875eb4f23cab9c07ec2f0024489c3"}
May 25 01:05:03.276056 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.276031    2558 generic.go:358] "Generic (PLEG): container finished" podID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerID="dbebc04d89f5306e2358fa8746e0044b332e6e2fa5acc3701bfa424d3bef9287" exitCode=0
May 25 01:05:03.276158 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.276084    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c8618f3-ca12-46c3-ae7d-b0a13f702325","Type":"ContainerDied","Data":"dbebc04d89f5306e2358fa8746e0044b332e6e2fa5acc3701bfa424d3bef9287"}
May 25 01:05:03.294932 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.294887    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-xrlqc" podStartSLOduration=3.298559404 podStartE2EDuration="4.294873611s" podCreationTimestamp="2026-05-25 01:04:59 +0000 UTC" firstStartedPulling="2026-05-25 01:05:00.785506664 +0000 UTC m=+159.655165969" lastFinishedPulling="2026-05-25 01:05:01.781820868 +0000 UTC m=+160.651480176" observedRunningTime="2026-05-25 01:05:03.292797271 +0000 UTC m=+162.162456598" watchObservedRunningTime="2026-05-25 01:05:03.294873611 +0000 UTC m=+162.164532937"
May 25 01:05:03.404756 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:03.404721    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-66df74b965-7bltj"]
May 25 01:05:03.407295 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:05:03.407268    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode90ea4ee_5033_4484_b881_1f6653edc085.slice/crio-dcc4e09a21b9b3ee1f046a10be4e5e972ac6b16adb84bb7eb5df8f059b1f2328 WatchSource:0}: Error finding container dcc4e09a21b9b3ee1f046a10be4e5e972ac6b16adb84bb7eb5df8f059b1f2328: Status 404 returned error can't find the container with id dcc4e09a21b9b3ee1f046a10be4e5e972ac6b16adb84bb7eb5df8f059b1f2328
May 25 01:05:04.282405 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:04.282317    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66df74b965-7bltj" event={"ID":"e90ea4ee-5033-4484-b881-1f6653edc085","Type":"ContainerStarted","Data":"dcc4e09a21b9b3ee1f046a10be4e5e972ac6b16adb84bb7eb5df8f059b1f2328"}
May 25 01:05:04.439873 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:04.439835    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert\") pod \"ingress-canary-fmgsh\" (UID: \"d8561800-5654-4a77-953a-f17255ab14c7\") " pod="openshift-ingress-canary/ingress-canary-fmgsh"
May 25 01:05:04.440066 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:04.439919    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls\") pod \"dns-default-cjp74\" (UID: \"2e574b48-0e58-4e0d-b442-d80b423af7e1\") " pod="openshift-dns/dns-default-cjp74"
May 25 01:05:04.444407 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:04.444373    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e574b48-0e58-4e0d-b442-d80b423af7e1-metrics-tls\") pod \"dns-default-cjp74\" (UID: \"2e574b48-0e58-4e0d-b442-d80b423af7e1\") " pod="openshift-dns/dns-default-cjp74"
May 25 01:05:04.444521 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:04.444477    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d8561800-5654-4a77-953a-f17255ab14c7-cert\") pod \"ingress-canary-fmgsh\" (UID: \"d8561800-5654-4a77-953a-f17255ab14c7\") " pod="openshift-ingress-canary/ingress-canary-fmgsh"
May 25 01:05:04.464143 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:04.464117    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-clxvr\""
May 25 01:05:04.465061 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:04.465038    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s4fpd\""
May 25 01:05:04.470292 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:04.470270    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cjp74"
May 25 01:05:04.470415 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:04.470297    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-fmgsh"
May 25 01:05:04.673741 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:04.673609    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cjp74"]
May 25 01:05:04.705947 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:04.705535    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-fmgsh"]
May 25 01:05:05.022993 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:05:05.022958    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e574b48_0e58_4e0d_b442_d80b423af7e1.slice/crio-eea59aff2e57c1cec85eaa240ec1880ccd0449de289a1e82348dbf02608654cf WatchSource:0}: Error finding container eea59aff2e57c1cec85eaa240ec1880ccd0449de289a1e82348dbf02608654cf: Status 404 returned error can't find the container with id eea59aff2e57c1cec85eaa240ec1880ccd0449de289a1e82348dbf02608654cf
May 25 01:05:05.286406 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:05.286301    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cjp74" event={"ID":"2e574b48-0e58-4e0d-b442-d80b423af7e1","Type":"ContainerStarted","Data":"eea59aff2e57c1cec85eaa240ec1880ccd0449de289a1e82348dbf02608654cf"}
May 25 01:05:05.617530 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:05:05.617457    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8561800_5654_4a77_953a_f17255ab14c7.slice/crio-eb0a55a0d05ae4c9b295f35445ac9138562fbbc9b9aa5258410851a5f06a51c7 WatchSource:0}: Error finding container eb0a55a0d05ae4c9b295f35445ac9138562fbbc9b9aa5258410851a5f06a51c7: Status 404 returned error can't find the container with id eb0a55a0d05ae4c9b295f35445ac9138562fbbc9b9aa5258410851a5f06a51c7
May 25 01:05:06.179691 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.177498    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 01:05:06.181991 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.181969    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.187567 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.186556    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cvckx\""
May 25 01:05:06.187567 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.186591    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 25 01:05:06.187567 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.186765    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 25 01:05:06.187567 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.186809    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 25 01:05:06.187567 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.187004    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 25 01:05:06.187567 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.187186    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 25 01:05:06.187567 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.187394    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 25 01:05:06.187978 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.187638    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 25 01:05:06.187978 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.187830    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 25 01:05:06.187978 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.187920    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 25 01:05:06.188190 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.188169    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 25 01:05:06.188254 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.188222    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 25 01:05:06.188348 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.188173    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fipsp5fc47pr3\""
May 25 01:05:06.188405 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.188385    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 25 01:05:06.189415 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.189223    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 25 01:05:06.198209 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.198168    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 01:05:06.257690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.256809    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.257690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.256875    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-config-out\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.257690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.256911    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.257690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.256945    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.257690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.256975    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.257690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.257002    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.257690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.257027    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.257690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.257086    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.257690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.257111    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.257690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.257140    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.257690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.257163    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.257690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.257192    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.257690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.257221    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-config\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.257690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.257242    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.257690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.257281    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.257690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.257310    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhxft\" (UniqueName: \"kubernetes.io/projected/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-kube-api-access-xhxft\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.261131 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.260989    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-web-config\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.261131 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.261062    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.294842 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.294804    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66df74b965-7bltj" event={"ID":"e90ea4ee-5033-4484-b881-1f6653edc085","Type":"ContainerStarted","Data":"8b68e808dc981c476eb0900e2710bce4820251016a767306798d21e9fc4a8d34"}
May 25 01:05:06.295259 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.294854    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66df74b965-7bltj" event={"ID":"e90ea4ee-5033-4484-b881-1f6653edc085","Type":"ContainerStarted","Data":"ba87abee8c7ef89e18d5bdd595057f32fad12bdd2f296128cad324289d21e903"}
May 25 01:05:06.295259 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.294872    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66df74b965-7bltj" event={"ID":"e90ea4ee-5033-4484-b881-1f6653edc085","Type":"ContainerStarted","Data":"c6c7acde9983d809794086fb95ad8597176b525415d000a977e3582832e5e92a"}
May 25 01:05:06.302402 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.302367    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c8618f3-ca12-46c3-ae7d-b0a13f702325","Type":"ContainerStarted","Data":"0677e0edfd78ced0d86ba92c9cb4fea0c761c4e31fc7d11912efb0614fa669bc"}
May 25 01:05:06.302513 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.302405    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c8618f3-ca12-46c3-ae7d-b0a13f702325","Type":"ContainerStarted","Data":"7ddeb49bccf4850fd5dd762c26cf22a28d7a955aafeb1635db9c5b060b02ec5f"}
May 25 01:05:06.302513 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.302430    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c8618f3-ca12-46c3-ae7d-b0a13f702325","Type":"ContainerStarted","Data":"1abdddfa4bb516da659fe49ce3dc13f747416798c1e489038a67310693664a56"}
May 25 01:05:06.302513 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.302442    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c8618f3-ca12-46c3-ae7d-b0a13f702325","Type":"ContainerStarted","Data":"3a2e57a42125a7dd705a3c2a11dda2cc04d58b811a42930b9135335eb053618a"}
May 25 01:05:06.302513 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.302455    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c8618f3-ca12-46c3-ae7d-b0a13f702325","Type":"ContainerStarted","Data":"775919bbf2c06205a29b1ba7e4d144cccaa71d1e94fed19fe654603f69bce5b8"}
May 25 01:05:06.306559 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.306513    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fmgsh" event={"ID":"d8561800-5654-4a77-953a-f17255ab14c7","Type":"ContainerStarted","Data":"eb0a55a0d05ae4c9b295f35445ac9138562fbbc9b9aa5258410851a5f06a51c7"}
May 25 01:05:06.364055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.362539    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.364055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.362588    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.364055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.362618    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.364055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.362648    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.364055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.362677    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-config\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.364055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.362711    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.364055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.362739    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.364055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.362775    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xhxft\" (UniqueName: \"kubernetes.io/projected/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-kube-api-access-xhxft\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.364055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.362809    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-web-config\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.364055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.362875    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.364055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.362926    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.364055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.362982    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-config-out\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.364055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.363019    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.364055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.363054    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.364055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.363087    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.364055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.363114    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.364055 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.363139    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.365436 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.363209    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.366190 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.366158    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.367902 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.367714    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.368190 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.368090    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.376132 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.376104    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.376291 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.376256    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.376604 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.376580    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-config-out\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.376708 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.376684    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.377216 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.376776    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.377216 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.377049    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.377216 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.377173    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.377447 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.377380    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.377447 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.377424    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.385308 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.385284    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.388510 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.388006    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.389109 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.389049    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-web-config\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.389583 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.389556    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.391177 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.391157    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-config\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.396588 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.396527    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhxft\" (UniqueName: \"kubernetes.io/projected/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-kube-api-access-xhxft\") pod \"prometheus-k8s-0\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:06.502412 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:06.501912    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:13.752073 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:13.751986    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:05:14.220933 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:14.220904    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 01:05:14.576750 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:05:14.576710    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fc7b440_ca4c_44d9_b65c_5c3b95b111aa.slice/crio-005192148d28cfb5ebee8e09c2703b9f7ddb81d9e0f86164c07795435ac43491 WatchSource:0}: Error finding container 005192148d28cfb5ebee8e09c2703b9f7ddb81d9e0f86164c07795435ac43491: Status 404 returned error can't find the container with id 005192148d28cfb5ebee8e09c2703b9f7ddb81d9e0f86164c07795435ac43491
May 25 01:05:15.337783 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:15.337739    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-fmgsh" event={"ID":"d8561800-5654-4a77-953a-f17255ab14c7","Type":"ContainerStarted","Data":"71a8b2a5d46ffd218cf5725a58a0c08d3818166e149c9a1fb393b135ab2536cd"}
May 25 01:05:15.341229 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:15.341200    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66df74b965-7bltj" event={"ID":"e90ea4ee-5033-4484-b881-1f6653edc085","Type":"ContainerStarted","Data":"b0f846260a9a741cfae861eb0885776cf9a3224f84ee2013843291ebae231e95"}
May 25 01:05:15.341397 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:15.341232    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66df74b965-7bltj" event={"ID":"e90ea4ee-5033-4484-b881-1f6653edc085","Type":"ContainerStarted","Data":"85d3dcc375c885b4deb220e828f9f641df531411b6bab5eaeb49b55e12aa4a32"}
May 25 01:05:15.341397 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:15.341246    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-66df74b965-7bltj" event={"ID":"e90ea4ee-5033-4484-b881-1f6653edc085","Type":"ContainerStarted","Data":"eaacfd080f563b242aaee73cfa1f020f06265eac68214879bc200b897ceffacd"}
May 25 01:05:15.341727 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:15.341703    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:15.343088 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:15.343060    2558 generic.go:358] "Generic (PLEG): container finished" podID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerID="6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d" exitCode=0
May 25 01:05:15.343179 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:15.343090    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa","Type":"ContainerDied","Data":"6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d"}
May 25 01:05:15.343179 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:15.343120    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa","Type":"ContainerStarted","Data":"005192148d28cfb5ebee8e09c2703b9f7ddb81d9e0f86164c07795435ac43491"}
May 25 01:05:15.344986 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:15.344913    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-cj62j" event={"ID":"732ec8d3-8185-475a-8a4c-dfbe83a19efa","Type":"ContainerStarted","Data":"7256cb2139b68712d74c6b94681258933166a5f42423e5ed9955baa8c239a61b"}
May 25 01:05:15.345183 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:15.345165    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-cj62j"
May 25 01:05:15.348811 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:15.348792    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-66df74b965-7bltj"
May 25 01:05:15.349966 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:15.349944    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c8618f3-ca12-46c3-ae7d-b0a13f702325","Type":"ContainerStarted","Data":"76300ebc55b6834bfa9c4979b693c162799288f67bf472b92af752328ba9f9b6"}
May 25 01:05:15.351267 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:15.351249    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-cj62j"
May 25 01:05:15.351746 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:15.351725    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cjp74" event={"ID":"2e574b48-0e58-4e0d-b442-d80b423af7e1","Type":"ContainerStarted","Data":"f2832ab83c96369fec9ea1b214d307a24ed783d19ffa0ad4a8076211af22c932"}
May 25 01:05:15.351815 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:15.351755    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cjp74" event={"ID":"2e574b48-0e58-4e0d-b442-d80b423af7e1","Type":"ContainerStarted","Data":"be58729baa576f009cbf1319e5c33d69c735f2e2625b6973b5266123762c01c0"}
May 25 01:05:15.351937 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:15.351921    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cjp74"
May 25 01:05:15.354430 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:15.354389    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-fmgsh" podStartSLOduration=130.382790718 podStartE2EDuration="2m19.354375037s" podCreationTimestamp="2026-05-25 01:02:56 +0000 UTC" firstStartedPulling="2026-05-25 01:05:05.663210249 +0000 UTC m=+164.532869556" lastFinishedPulling="2026-05-25 01:05:14.634794558 +0000 UTC m=+173.504453875" observedRunningTime="2026-05-25 01:05:15.3532784 +0000 UTC m=+174.222937708" watchObservedRunningTime="2026-05-25 01:05:15.354375037 +0000 UTC m=+174.224034364"
May 25 01:05:15.369858 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:15.369808    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-cj62j" podStartSLOduration=1.873621711 podStartE2EDuration="23.369793432s" podCreationTimestamp="2026-05-25 01:04:52 +0000 UTC" firstStartedPulling="2026-05-25 01:04:53.12774109 +0000 UTC m=+151.997400398" lastFinishedPulling="2026-05-25 01:05:14.623912798 +0000 UTC m=+173.493572119" observedRunningTime="2026-05-25 01:05:15.367992393 +0000 UTC m=+174.237651721" watchObservedRunningTime="2026-05-25 01:05:15.369793432 +0000 UTC m=+174.239452760"
May 25 01:05:15.390972 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:15.390915    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-66df74b965-7bltj" podStartSLOduration=2.214670581 podStartE2EDuration="13.390899018s" podCreationTimestamp="2026-05-25 01:05:02 +0000 UTC" firstStartedPulling="2026-05-25 01:05:03.409648741 +0000 UTC m=+162.279308044" lastFinishedPulling="2026-05-25 01:05:14.585877163 +0000 UTC m=+173.455536481" observedRunningTime="2026-05-25 01:05:15.38922612 +0000 UTC m=+174.258885447" watchObservedRunningTime="2026-05-25 01:05:15.390899018 +0000 UTC m=+174.260558344"
May 25 01:05:15.418379 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:15.417124    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.861347514 podStartE2EDuration="15.417106302s" podCreationTimestamp="2026-05-25 01:05:00 +0000 UTC" firstStartedPulling="2026-05-25 01:05:02.027474275 +0000 UTC m=+160.897133579" lastFinishedPulling="2026-05-25 01:05:14.583233046 +0000 UTC m=+173.452892367" observedRunningTime="2026-05-25 01:05:15.414383046 +0000 UTC m=+174.284042375" watchObservedRunningTime="2026-05-25 01:05:15.417106302 +0000 UTC m=+174.286765629"
May 25 01:05:20.376924 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:20.376889    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa","Type":"ContainerStarted","Data":"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3"}
May 25 01:05:20.376924 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:20.376926    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa","Type":"ContainerStarted","Data":"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191"}
May 25 01:05:20.377520 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:20.376937    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa","Type":"ContainerStarted","Data":"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb"}
May 25 01:05:20.377520 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:20.376946    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa","Type":"ContainerStarted","Data":"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0"}
May 25 01:05:20.377520 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:20.376961    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa","Type":"ContainerStarted","Data":"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4"}
May 25 01:05:20.377520 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:20.376970    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa","Type":"ContainerStarted","Data":"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5"}
May 25 01:05:20.405122 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:20.405066    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=10.468341905 podStartE2EDuration="14.40504851s" podCreationTimestamp="2026-05-25 01:05:06 +0000 UTC" firstStartedPulling="2026-05-25 01:05:15.344565011 +0000 UTC m=+174.214224326" lastFinishedPulling="2026-05-25 01:05:19.281271626 +0000 UTC m=+178.150930931" observedRunningTime="2026-05-25 01:05:20.403660208 +0000 UTC m=+179.273319571" watchObservedRunningTime="2026-05-25 01:05:20.40504851 +0000 UTC m=+179.274707837"
May 25 01:05:20.406147 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:20.406100    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-cjp74" podStartSLOduration=134.848910838 podStartE2EDuration="2m24.406085224s" podCreationTimestamp="2026-05-25 01:02:56 +0000 UTC" firstStartedPulling="2026-05-25 01:05:05.025929175 +0000 UTC m=+163.895588483" lastFinishedPulling="2026-05-25 01:05:14.583103553 +0000 UTC m=+173.452762869" observedRunningTime="2026-05-25 01:05:15.471560581 +0000 UTC m=+174.341219907" watchObservedRunningTime="2026-05-25 01:05:20.406085224 +0000 UTC m=+179.275744550"
May 25 01:05:21.502507 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:21.502474    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:05:25.362997 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:25.362968    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cjp74"
May 25 01:05:34.601425 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:34.601389    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85b7cb4646-2kg7w_60a10e75-26eb-4497-a652-fe509cb7282c/router/0.log"
May 25 01:05:34.627291 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:34.627267    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fmgsh_d8561800-5654-4a77-953a-f17255ab14c7/serve-healthcheck-canary/0.log"
May 25 01:05:39.436107 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:39.436071    2558 generic.go:358] "Generic (PLEG): container finished" podID="68343816-fb65-4e10-86cc-330386cfb2f0" containerID="97c2217c33ab00c84f7d8f463bb9084637e434191fc3f6a0892570b9faa93b5e" exitCode=0
May 25 01:05:39.436550 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:39.436131    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9x9mx" event={"ID":"68343816-fb65-4e10-86cc-330386cfb2f0","Type":"ContainerDied","Data":"97c2217c33ab00c84f7d8f463bb9084637e434191fc3f6a0892570b9faa93b5e"}
May 25 01:05:39.436550 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:39.436440    2558 scope.go:117] "RemoveContainer" containerID="97c2217c33ab00c84f7d8f463bb9084637e434191fc3f6a0892570b9faa93b5e"
May 25 01:05:40.441013 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:40.440978    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-9x9mx" event={"ID":"68343816-fb65-4e10-86cc-330386cfb2f0","Type":"ContainerStarted","Data":"83a34c10c6cf3f11ed1bb0846f5604d4d620cacc7cfafe3b02db7afff047073e"}
May 25 01:05:49.472037 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:49.472005    2558 generic.go:358] "Generic (PLEG): container finished" podID="53c7a514-5b75-49d8-b645-8a76c65eadb0" containerID="103cd377882988a9bf5abe633c4dda8a9c8418d03172b8486e56a6975d97fb3f" exitCode=0
May 25 01:05:49.472479 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:49.472086    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rlxhg" event={"ID":"53c7a514-5b75-49d8-b645-8a76c65eadb0","Type":"ContainerDied","Data":"103cd377882988a9bf5abe633c4dda8a9c8418d03172b8486e56a6975d97fb3f"}
May 25 01:05:49.472479 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:49.472457    2558 scope.go:117] "RemoveContainer" containerID="103cd377882988a9bf5abe633c4dda8a9c8418d03172b8486e56a6975d97fb3f"
May 25 01:05:50.477030 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:05:50.476998    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-rlxhg" event={"ID":"53c7a514-5b75-49d8-b645-8a76c65eadb0","Type":"ContainerStarted","Data":"ff0fe6a37d9388bc0177a503acdbe47193a4426b0ea627c6f5f79259eca7e777"}
May 25 01:06:06.502855 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:06.502818    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:06.518901 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:06.518879    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:06.535899 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:06.535877    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:20.201089 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:20.201054    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 01:06:20.201562 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:20.201519    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="alertmanager" containerID="cri-o://775919bbf2c06205a29b1ba7e4d144cccaa71d1e94fed19fe654603f69bce5b8" gracePeriod=120
May 25 01:06:20.201562 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:20.201547    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="kube-rbac-proxy" containerID="cri-o://7ddeb49bccf4850fd5dd762c26cf22a28d7a955aafeb1635db9c5b060b02ec5f" gracePeriod=120
May 25 01:06:20.201701 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:20.201529    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="prom-label-proxy" containerID="cri-o://76300ebc55b6834bfa9c4979b693c162799288f67bf472b92af752328ba9f9b6" gracePeriod=120
May 25 01:06:20.201701 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:20.201559    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="kube-rbac-proxy-metric" containerID="cri-o://0677e0edfd78ced0d86ba92c9cb4fea0c761c4e31fc7d11912efb0614fa669bc" gracePeriod=120
May 25 01:06:20.201701 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:20.201585    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="kube-rbac-proxy-web" containerID="cri-o://1abdddfa4bb516da659fe49ce3dc13f747416798c1e489038a67310693664a56" gracePeriod=120
May 25 01:06:20.201837 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:20.201690    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="config-reloader" containerID="cri-o://3a2e57a42125a7dd705a3c2a11dda2cc04d58b811a42930b9135335eb053618a" gracePeriod=120
May 25 01:06:20.566479 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:20.566396    2558 generic.go:358] "Generic (PLEG): container finished" podID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerID="76300ebc55b6834bfa9c4979b693c162799288f67bf472b92af752328ba9f9b6" exitCode=0
May 25 01:06:20.566479 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:20.566422    2558 generic.go:358] "Generic (PLEG): container finished" podID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerID="7ddeb49bccf4850fd5dd762c26cf22a28d7a955aafeb1635db9c5b060b02ec5f" exitCode=0
May 25 01:06:20.566479 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:20.566428    2558 generic.go:358] "Generic (PLEG): container finished" podID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerID="3a2e57a42125a7dd705a3c2a11dda2cc04d58b811a42930b9135335eb053618a" exitCode=0
May 25 01:06:20.566479 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:20.566433    2558 generic.go:358] "Generic (PLEG): container finished" podID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerID="775919bbf2c06205a29b1ba7e4d144cccaa71d1e94fed19fe654603f69bce5b8" exitCode=0
May 25 01:06:20.566479 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:20.566468    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c8618f3-ca12-46c3-ae7d-b0a13f702325","Type":"ContainerDied","Data":"76300ebc55b6834bfa9c4979b693c162799288f67bf472b92af752328ba9f9b6"}
May 25 01:06:20.566739 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:20.566508    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c8618f3-ca12-46c3-ae7d-b0a13f702325","Type":"ContainerDied","Data":"7ddeb49bccf4850fd5dd762c26cf22a28d7a955aafeb1635db9c5b060b02ec5f"}
May 25 01:06:20.566739 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:20.566521    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c8618f3-ca12-46c3-ae7d-b0a13f702325","Type":"ContainerDied","Data":"3a2e57a42125a7dd705a3c2a11dda2cc04d58b811a42930b9135335eb053618a"}
May 25 01:06:20.566739 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:20.566536    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c8618f3-ca12-46c3-ae7d-b0a13f702325","Type":"ContainerDied","Data":"775919bbf2c06205a29b1ba7e4d144cccaa71d1e94fed19fe654603f69bce5b8"}
May 25 01:06:21.442270 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.442248    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:21.575081 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.575000    2558 generic.go:358] "Generic (PLEG): container finished" podID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerID="0677e0edfd78ced0d86ba92c9cb4fea0c761c4e31fc7d11912efb0614fa669bc" exitCode=0
May 25 01:06:21.575081 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.575031    2558 generic.go:358] "Generic (PLEG): container finished" podID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerID="1abdddfa4bb516da659fe49ce3dc13f747416798c1e489038a67310693664a56" exitCode=0
May 25 01:06:21.575258 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.575088    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c8618f3-ca12-46c3-ae7d-b0a13f702325","Type":"ContainerDied","Data":"0677e0edfd78ced0d86ba92c9cb4fea0c761c4e31fc7d11912efb0614fa669bc"}
May 25 01:06:21.575258 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.575118    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:21.575258 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.575139    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c8618f3-ca12-46c3-ae7d-b0a13f702325","Type":"ContainerDied","Data":"1abdddfa4bb516da659fe49ce3dc13f747416798c1e489038a67310693664a56"}
May 25 01:06:21.575258 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.575156    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c8618f3-ca12-46c3-ae7d-b0a13f702325","Type":"ContainerDied","Data":"4d93cec46f5c2dedbb2693dd66c1fb1b64b29fbb5676f830d3ae12defcd20408"}
May 25 01:06:21.575258 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.575176    2558 scope.go:117] "RemoveContainer" containerID="76300ebc55b6834bfa9c4979b693c162799288f67bf472b92af752328ba9f9b6"
May 25 01:06:21.582584 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.582566    2558 scope.go:117] "RemoveContainer" containerID="0677e0edfd78ced0d86ba92c9cb4fea0c761c4e31fc7d11912efb0614fa669bc"
May 25 01:06:21.589019 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.589001    2558 scope.go:117] "RemoveContainer" containerID="7ddeb49bccf4850fd5dd762c26cf22a28d7a955aafeb1635db9c5b060b02ec5f"
May 25 01:06:21.594970 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.594955    2558 scope.go:117] "RemoveContainer" containerID="1abdddfa4bb516da659fe49ce3dc13f747416798c1e489038a67310693664a56"
May 25 01:06:21.601228 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.601213    2558 scope.go:117] "RemoveContainer" containerID="3a2e57a42125a7dd705a3c2a11dda2cc04d58b811a42930b9135335eb053618a"
May 25 01:06:21.607388 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.607374    2558 scope.go:117] "RemoveContainer" containerID="775919bbf2c06205a29b1ba7e4d144cccaa71d1e94fed19fe654603f69bce5b8"
May 25 01:06:21.613579 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.613562    2558 scope.go:117] "RemoveContainer" containerID="dbebc04d89f5306e2358fa8746e0044b332e6e2fa5acc3701bfa424d3bef9287"
May 25 01:06:21.613738 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.613723    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-kube-rbac-proxy\") pod \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") "
May 25 01:06:21.613790 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.613762    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-config-volume\") pod \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") "
May 25 01:06:21.613790 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.613785    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-cluster-tls-config\") pod \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") "
May 25 01:06:21.613867 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.613801    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c8618f3-ca12-46c3-ae7d-b0a13f702325-tls-assets\") pod \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") "
May 25 01:06:21.613867 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.613827    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tv9nv\" (UniqueName: \"kubernetes.io/projected/8c8618f3-ca12-46c3-ae7d-b0a13f702325-kube-api-access-tv9nv\") pod \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") "
May 25 01:06:21.613867 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.613848    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") "
May 25 01:06:21.614009 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.613876    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c8618f3-ca12-46c3-ae7d-b0a13f702325-alertmanager-trusted-ca-bundle\") pod \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") "
May 25 01:06:21.614009 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.613904    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-kube-rbac-proxy-web\") pod \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") "
May 25 01:06:21.614692 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.614664    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c8618f3-ca12-46c3-ae7d-b0a13f702325-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8c8618f3-ca12-46c3-ae7d-b0a13f702325" (UID: "8c8618f3-ca12-46c3-ae7d-b0a13f702325"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:06:21.614929 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.614907    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c8618f3-ca12-46c3-ae7d-b0a13f702325-alertmanager-main-db\") pod \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") "
May 25 01:06:21.615013 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.614962    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-main-tls\") pod \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") "
May 25 01:06:21.615078 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.615014    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c8618f3-ca12-46c3-ae7d-b0a13f702325-metrics-client-ca\") pod \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") "
May 25 01:06:21.615078 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.615047    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c8618f3-ca12-46c3-ae7d-b0a13f702325-config-out\") pod \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") "
May 25 01:06:21.615180 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.615105    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-web-config\") pod \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\" (UID: \"8c8618f3-ca12-46c3-ae7d-b0a13f702325\") "
May 25 01:06:21.615467 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.615443    2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c8618f3-ca12-46c3-ae7d-b0a13f702325-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:21.615969 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.615941    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c8618f3-ca12-46c3-ae7d-b0a13f702325-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8c8618f3-ca12-46c3-ae7d-b0a13f702325" (UID: "8c8618f3-ca12-46c3-ae7d-b0a13f702325"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:06:21.616394 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.616369    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c8618f3-ca12-46c3-ae7d-b0a13f702325-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8c8618f3-ca12-46c3-ae7d-b0a13f702325" (UID: "8c8618f3-ca12-46c3-ae7d-b0a13f702325"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:06:21.616669 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.616639    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8c8618f3-ca12-46c3-ae7d-b0a13f702325" (UID: "8c8618f3-ca12-46c3-ae7d-b0a13f702325"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:06:21.617156 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.617133    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-config-volume" (OuterVolumeSpecName: "config-volume") pod "8c8618f3-ca12-46c3-ae7d-b0a13f702325" (UID: "8c8618f3-ca12-46c3-ae7d-b0a13f702325"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:06:21.617408 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.617207    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c8618f3-ca12-46c3-ae7d-b0a13f702325-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8c8618f3-ca12-46c3-ae7d-b0a13f702325" (UID: "8c8618f3-ca12-46c3-ae7d-b0a13f702325"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:06:21.617649 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.617608    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8c8618f3-ca12-46c3-ae7d-b0a13f702325" (UID: "8c8618f3-ca12-46c3-ae7d-b0a13f702325"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:06:21.617894 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.617858    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c8618f3-ca12-46c3-ae7d-b0a13f702325-kube-api-access-tv9nv" (OuterVolumeSpecName: "kube-api-access-tv9nv") pod "8c8618f3-ca12-46c3-ae7d-b0a13f702325" (UID: "8c8618f3-ca12-46c3-ae7d-b0a13f702325"). InnerVolumeSpecName "kube-api-access-tv9nv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:06:21.618202 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.618176    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8c8618f3-ca12-46c3-ae7d-b0a13f702325" (UID: "8c8618f3-ca12-46c3-ae7d-b0a13f702325"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:06:21.618716 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.618687    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8c8618f3-ca12-46c3-ae7d-b0a13f702325" (UID: "8c8618f3-ca12-46c3-ae7d-b0a13f702325"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:06:21.619904 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.619884    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c8618f3-ca12-46c3-ae7d-b0a13f702325-config-out" (OuterVolumeSpecName: "config-out") pod "8c8618f3-ca12-46c3-ae7d-b0a13f702325" (UID: "8c8618f3-ca12-46c3-ae7d-b0a13f702325"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:06:21.621720 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.621696    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8c8618f3-ca12-46c3-ae7d-b0a13f702325" (UID: "8c8618f3-ca12-46c3-ae7d-b0a13f702325"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:06:21.629538 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.629522    2558 scope.go:117] "RemoveContainer" containerID="76300ebc55b6834bfa9c4979b693c162799288f67bf472b92af752328ba9f9b6"
May 25 01:06:21.629587 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.629519    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-web-config" (OuterVolumeSpecName: "web-config") pod "8c8618f3-ca12-46c3-ae7d-b0a13f702325" (UID: "8c8618f3-ca12-46c3-ae7d-b0a13f702325"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:06:21.629790 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:06:21.629771    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"76300ebc55b6834bfa9c4979b693c162799288f67bf472b92af752328ba9f9b6\": container with ID starting with 76300ebc55b6834bfa9c4979b693c162799288f67bf472b92af752328ba9f9b6 not found: ID does not exist" containerID="76300ebc55b6834bfa9c4979b693c162799288f67bf472b92af752328ba9f9b6"
May 25 01:06:21.629831 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.629796    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76300ebc55b6834bfa9c4979b693c162799288f67bf472b92af752328ba9f9b6"} err="failed to get container status \"76300ebc55b6834bfa9c4979b693c162799288f67bf472b92af752328ba9f9b6\": rpc error: code = NotFound desc = could not find container \"76300ebc55b6834bfa9c4979b693c162799288f67bf472b92af752328ba9f9b6\": container with ID starting with 76300ebc55b6834bfa9c4979b693c162799288f67bf472b92af752328ba9f9b6 not found: ID does not exist"
May 25 01:06:21.629831 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.629825    2558 scope.go:117] "RemoveContainer" containerID="0677e0edfd78ced0d86ba92c9cb4fea0c761c4e31fc7d11912efb0614fa669bc"
May 25 01:06:21.630052 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:06:21.630034    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0677e0edfd78ced0d86ba92c9cb4fea0c761c4e31fc7d11912efb0614fa669bc\": container with ID starting with 0677e0edfd78ced0d86ba92c9cb4fea0c761c4e31fc7d11912efb0614fa669bc not found: ID does not exist" containerID="0677e0edfd78ced0d86ba92c9cb4fea0c761c4e31fc7d11912efb0614fa669bc"
May 25 01:06:21.630115 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.630063    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0677e0edfd78ced0d86ba92c9cb4fea0c761c4e31fc7d11912efb0614fa669bc"} err="failed to get container status \"0677e0edfd78ced0d86ba92c9cb4fea0c761c4e31fc7d11912efb0614fa669bc\": rpc error: code = NotFound desc = could not find container \"0677e0edfd78ced0d86ba92c9cb4fea0c761c4e31fc7d11912efb0614fa669bc\": container with ID starting with 0677e0edfd78ced0d86ba92c9cb4fea0c761c4e31fc7d11912efb0614fa669bc not found: ID does not exist"
May 25 01:06:21.630115 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.630087    2558 scope.go:117] "RemoveContainer" containerID="7ddeb49bccf4850fd5dd762c26cf22a28d7a955aafeb1635db9c5b060b02ec5f"
May 25 01:06:21.630388 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:06:21.630347    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7ddeb49bccf4850fd5dd762c26cf22a28d7a955aafeb1635db9c5b060b02ec5f\": container with ID starting with 7ddeb49bccf4850fd5dd762c26cf22a28d7a955aafeb1635db9c5b060b02ec5f not found: ID does not exist" containerID="7ddeb49bccf4850fd5dd762c26cf22a28d7a955aafeb1635db9c5b060b02ec5f"
May 25 01:06:21.630388 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.630376    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ddeb49bccf4850fd5dd762c26cf22a28d7a955aafeb1635db9c5b060b02ec5f"} err="failed to get container status \"7ddeb49bccf4850fd5dd762c26cf22a28d7a955aafeb1635db9c5b060b02ec5f\": rpc error: code = NotFound desc = could not find container \"7ddeb49bccf4850fd5dd762c26cf22a28d7a955aafeb1635db9c5b060b02ec5f\": container with ID starting with 7ddeb49bccf4850fd5dd762c26cf22a28d7a955aafeb1635db9c5b060b02ec5f not found: ID does not exist"
May 25 01:06:21.630505 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.630392    2558 scope.go:117] "RemoveContainer" containerID="1abdddfa4bb516da659fe49ce3dc13f747416798c1e489038a67310693664a56"
May 25 01:06:21.630623 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:06:21.630603    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1abdddfa4bb516da659fe49ce3dc13f747416798c1e489038a67310693664a56\": container with ID starting with 1abdddfa4bb516da659fe49ce3dc13f747416798c1e489038a67310693664a56 not found: ID does not exist" containerID="1abdddfa4bb516da659fe49ce3dc13f747416798c1e489038a67310693664a56"
May 25 01:06:21.630660 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.630631    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1abdddfa4bb516da659fe49ce3dc13f747416798c1e489038a67310693664a56"} err="failed to get container status \"1abdddfa4bb516da659fe49ce3dc13f747416798c1e489038a67310693664a56\": rpc error: code = NotFound desc = could not find container \"1abdddfa4bb516da659fe49ce3dc13f747416798c1e489038a67310693664a56\": container with ID starting with 1abdddfa4bb516da659fe49ce3dc13f747416798c1e489038a67310693664a56 not found: ID does not exist"
May 25 01:06:21.630660 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.630653    2558 scope.go:117] "RemoveContainer" containerID="3a2e57a42125a7dd705a3c2a11dda2cc04d58b811a42930b9135335eb053618a"
May 25 01:06:21.630849 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:06:21.630829    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a2e57a42125a7dd705a3c2a11dda2cc04d58b811a42930b9135335eb053618a\": container with ID starting with 3a2e57a42125a7dd705a3c2a11dda2cc04d58b811a42930b9135335eb053618a not found: ID does not exist" containerID="3a2e57a42125a7dd705a3c2a11dda2cc04d58b811a42930b9135335eb053618a"
May 25 01:06:21.630884 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.630855    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a2e57a42125a7dd705a3c2a11dda2cc04d58b811a42930b9135335eb053618a"} err="failed to get container status \"3a2e57a42125a7dd705a3c2a11dda2cc04d58b811a42930b9135335eb053618a\": rpc error: code = NotFound desc = could not find container \"3a2e57a42125a7dd705a3c2a11dda2cc04d58b811a42930b9135335eb053618a\": container with ID starting with 3a2e57a42125a7dd705a3c2a11dda2cc04d58b811a42930b9135335eb053618a not found: ID does not exist"
May 25 01:06:21.630884 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.630869    2558 scope.go:117] "RemoveContainer" containerID="775919bbf2c06205a29b1ba7e4d144cccaa71d1e94fed19fe654603f69bce5b8"
May 25 01:06:21.631067 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:06:21.631051    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"775919bbf2c06205a29b1ba7e4d144cccaa71d1e94fed19fe654603f69bce5b8\": container with ID starting with 775919bbf2c06205a29b1ba7e4d144cccaa71d1e94fed19fe654603f69bce5b8 not found: ID does not exist" containerID="775919bbf2c06205a29b1ba7e4d144cccaa71d1e94fed19fe654603f69bce5b8"
May 25 01:06:21.631108 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.631070    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"775919bbf2c06205a29b1ba7e4d144cccaa71d1e94fed19fe654603f69bce5b8"} err="failed to get container status \"775919bbf2c06205a29b1ba7e4d144cccaa71d1e94fed19fe654603f69bce5b8\": rpc error: code = NotFound desc = could not find container \"775919bbf2c06205a29b1ba7e4d144cccaa71d1e94fed19fe654603f69bce5b8\": container with ID starting with 775919bbf2c06205a29b1ba7e4d144cccaa71d1e94fed19fe654603f69bce5b8 not found: ID does not exist"
May 25 01:06:21.631108 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.631082    2558 scope.go:117] "RemoveContainer" containerID="dbebc04d89f5306e2358fa8746e0044b332e6e2fa5acc3701bfa424d3bef9287"
May 25 01:06:21.631296 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:06:21.631278    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbebc04d89f5306e2358fa8746e0044b332e6e2fa5acc3701bfa424d3bef9287\": container with ID starting with dbebc04d89f5306e2358fa8746e0044b332e6e2fa5acc3701bfa424d3bef9287 not found: ID does not exist" containerID="dbebc04d89f5306e2358fa8746e0044b332e6e2fa5acc3701bfa424d3bef9287"
May 25 01:06:21.631379 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.631304    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbebc04d89f5306e2358fa8746e0044b332e6e2fa5acc3701bfa424d3bef9287"} err="failed to get container status \"dbebc04d89f5306e2358fa8746e0044b332e6e2fa5acc3701bfa424d3bef9287\": rpc error: code = NotFound desc = could not find container \"dbebc04d89f5306e2358fa8746e0044b332e6e2fa5acc3701bfa424d3bef9287\": container with ID starting with dbebc04d89f5306e2358fa8746e0044b332e6e2fa5acc3701bfa424d3bef9287 not found: ID does not exist"
May 25 01:06:21.631379 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.631343    2558 scope.go:117] "RemoveContainer" containerID="76300ebc55b6834bfa9c4979b693c162799288f67bf472b92af752328ba9f9b6"
May 25 01:06:21.631556 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.631539    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"76300ebc55b6834bfa9c4979b693c162799288f67bf472b92af752328ba9f9b6"} err="failed to get container status \"76300ebc55b6834bfa9c4979b693c162799288f67bf472b92af752328ba9f9b6\": rpc error: code = NotFound desc = could not find container \"76300ebc55b6834bfa9c4979b693c162799288f67bf472b92af752328ba9f9b6\": container with ID starting with 76300ebc55b6834bfa9c4979b693c162799288f67bf472b92af752328ba9f9b6 not found: ID does not exist"
May 25 01:06:21.631601 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.631557    2558 scope.go:117] "RemoveContainer" containerID="0677e0edfd78ced0d86ba92c9cb4fea0c761c4e31fc7d11912efb0614fa669bc"
May 25 01:06:21.631735 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.631720    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0677e0edfd78ced0d86ba92c9cb4fea0c761c4e31fc7d11912efb0614fa669bc"} err="failed to get container status \"0677e0edfd78ced0d86ba92c9cb4fea0c761c4e31fc7d11912efb0614fa669bc\": rpc error: code = NotFound desc = could not find container \"0677e0edfd78ced0d86ba92c9cb4fea0c761c4e31fc7d11912efb0614fa669bc\": container with ID starting with 0677e0edfd78ced0d86ba92c9cb4fea0c761c4e31fc7d11912efb0614fa669bc not found: ID does not exist"
May 25 01:06:21.631837 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.631735    2558 scope.go:117] "RemoveContainer" containerID="7ddeb49bccf4850fd5dd762c26cf22a28d7a955aafeb1635db9c5b060b02ec5f"
May 25 01:06:21.631892 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.631879    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7ddeb49bccf4850fd5dd762c26cf22a28d7a955aafeb1635db9c5b060b02ec5f"} err="failed to get container status \"7ddeb49bccf4850fd5dd762c26cf22a28d7a955aafeb1635db9c5b060b02ec5f\": rpc error: code = NotFound desc = could not find container \"7ddeb49bccf4850fd5dd762c26cf22a28d7a955aafeb1635db9c5b060b02ec5f\": container with ID starting with 7ddeb49bccf4850fd5dd762c26cf22a28d7a955aafeb1635db9c5b060b02ec5f not found: ID does not exist"
May 25 01:06:21.631931 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.631895    2558 scope.go:117] "RemoveContainer" containerID="1abdddfa4bb516da659fe49ce3dc13f747416798c1e489038a67310693664a56"
May 25 01:06:21.632082 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.632063    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1abdddfa4bb516da659fe49ce3dc13f747416798c1e489038a67310693664a56"} err="failed to get container status \"1abdddfa4bb516da659fe49ce3dc13f747416798c1e489038a67310693664a56\": rpc error: code = NotFound desc = could not find container \"1abdddfa4bb516da659fe49ce3dc13f747416798c1e489038a67310693664a56\": container with ID starting with 1abdddfa4bb516da659fe49ce3dc13f747416798c1e489038a67310693664a56 not found: ID does not exist"
May 25 01:06:21.632146 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.632084    2558 scope.go:117] "RemoveContainer" containerID="3a2e57a42125a7dd705a3c2a11dda2cc04d58b811a42930b9135335eb053618a"
May 25 01:06:21.632284 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.632270    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a2e57a42125a7dd705a3c2a11dda2cc04d58b811a42930b9135335eb053618a"} err="failed to get container status \"3a2e57a42125a7dd705a3c2a11dda2cc04d58b811a42930b9135335eb053618a\": rpc error: code = NotFound desc = could not find container \"3a2e57a42125a7dd705a3c2a11dda2cc04d58b811a42930b9135335eb053618a\": container with ID starting with 3a2e57a42125a7dd705a3c2a11dda2cc04d58b811a42930b9135335eb053618a not found: ID does not exist"
May 25 01:06:21.632398 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.632284    2558 scope.go:117] "RemoveContainer" containerID="775919bbf2c06205a29b1ba7e4d144cccaa71d1e94fed19fe654603f69bce5b8"
May 25 01:06:21.632516 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.632499    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"775919bbf2c06205a29b1ba7e4d144cccaa71d1e94fed19fe654603f69bce5b8"} err="failed to get container status \"775919bbf2c06205a29b1ba7e4d144cccaa71d1e94fed19fe654603f69bce5b8\": rpc error: code = NotFound desc = could not find container \"775919bbf2c06205a29b1ba7e4d144cccaa71d1e94fed19fe654603f69bce5b8\": container with ID starting with 775919bbf2c06205a29b1ba7e4d144cccaa71d1e94fed19fe654603f69bce5b8 not found: ID does not exist"
May 25 01:06:21.632552 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.632517    2558 scope.go:117] "RemoveContainer" containerID="dbebc04d89f5306e2358fa8746e0044b332e6e2fa5acc3701bfa424d3bef9287"
May 25 01:06:21.632690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.632674    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbebc04d89f5306e2358fa8746e0044b332e6e2fa5acc3701bfa424d3bef9287"} err="failed to get container status \"dbebc04d89f5306e2358fa8746e0044b332e6e2fa5acc3701bfa424d3bef9287\": rpc error: code = NotFound desc = could not find container \"dbebc04d89f5306e2358fa8746e0044b332e6e2fa5acc3701bfa424d3bef9287\": container with ID starting with dbebc04d89f5306e2358fa8746e0044b332e6e2fa5acc3701bfa424d3bef9287 not found: ID does not exist"
May 25 01:06:21.715784 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.715765    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:21.715874 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.715786    2558 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-config-volume\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:21.715874 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.715797    2558 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-cluster-tls-config\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:21.715874 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.715806    2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c8618f3-ca12-46c3-ae7d-b0a13f702325-tls-assets\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:21.715874 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.715815    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tv9nv\" (UniqueName: \"kubernetes.io/projected/8c8618f3-ca12-46c3-ae7d-b0a13f702325-kube-api-access-tv9nv\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:21.715874 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.715823    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:21.715874 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.715833    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:21.715874 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.715841    2558 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c8618f3-ca12-46c3-ae7d-b0a13f702325-alertmanager-main-db\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:21.715874 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.715850    2558 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-secret-alertmanager-main-tls\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:21.715874 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.715858    2558 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c8618f3-ca12-46c3-ae7d-b0a13f702325-metrics-client-ca\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:21.715874 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.715868    2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c8618f3-ca12-46c3-ae7d-b0a13f702325-config-out\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:21.715874 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.715876    2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c8618f3-ca12-46c3-ae7d-b0a13f702325-web-config\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:21.893401 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.893343    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 01:06:21.898954 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.898933    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 01:06:21.930801 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.930779    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 01:06:21.931071 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.931058    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="kube-rbac-proxy"
May 25 01:06:21.931116 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.931073    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="kube-rbac-proxy"
May 25 01:06:21.931116 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.931083    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="alertmanager"
May 25 01:06:21.931116 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.931088    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="alertmanager"
May 25 01:06:21.931116 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.931096    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="init-config-reloader"
May 25 01:06:21.931116 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.931102    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="init-config-reloader"
May 25 01:06:21.931116 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.931111    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="kube-rbac-proxy-metric"
May 25 01:06:21.931116 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.931116    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="kube-rbac-proxy-metric"
May 25 01:06:21.931309 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.931125    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="prom-label-proxy"
May 25 01:06:21.931309 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.931130    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="prom-label-proxy"
May 25 01:06:21.931309 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.931136    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="config-reloader"
May 25 01:06:21.931309 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.931141    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="config-reloader"
May 25 01:06:21.931309 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.931151    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="kube-rbac-proxy-web"
May 25 01:06:21.931309 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.931156    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="kube-rbac-proxy-web"
May 25 01:06:21.931309 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.931208    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="config-reloader"
May 25 01:06:21.931309 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.931218    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="kube-rbac-proxy"
May 25 01:06:21.931309 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.931228    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="kube-rbac-proxy-metric"
May 25 01:06:21.931309 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.931234    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="kube-rbac-proxy-web"
May 25 01:06:21.931309 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.931241    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="prom-label-proxy"
May 25 01:06:21.931309 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.931247    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" containerName="alertmanager"
May 25 01:06:21.936467 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.936450    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:21.940179 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.939900    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 25 01:06:21.940179 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.939919    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 25 01:06:21.940179 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.939949    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 25 01:06:21.940179 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.939900    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 25 01:06:21.940179 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.940060    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-s94wh\""
May 25 01:06:21.940179 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.940061    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 25 01:06:21.940179 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.940143    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 25 01:06:21.940179 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.940151    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 25 01:06:21.940665 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.940643    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 25 01:06:21.944735 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.944620    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 25 01:06:21.948484 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:21.948465    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 01:06:22.019078 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.019046    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a35ba9f-0a9f-4722-9270-4107938e4e20-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.019233 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.019108    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh7mh\" (UniqueName: \"kubernetes.io/projected/7a35ba9f-0a9f-4722-9270-4107938e4e20-kube-api-access-mh7mh\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.019233 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.019137    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.019233 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.019157    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a35ba9f-0a9f-4722-9270-4107938e4e20-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.019233 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.019177    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.019233 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.019208    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.019449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.019289    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7a35ba9f-0a9f-4722-9270-4107938e4e20-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.019449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.019317    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-config-volume\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.019449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.019363    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7a35ba9f-0a9f-4722-9270-4107938e4e20-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.019449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.019378    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7a35ba9f-0a9f-4722-9270-4107938e4e20-config-out\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.019449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.019395    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.019449 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.019420    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-web-config\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.019623 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.019483    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.120195 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.120168    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7a35ba9f-0a9f-4722-9270-4107938e4e20-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.120195 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.120196    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-config-volume\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.120426 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.120214    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7a35ba9f-0a9f-4722-9270-4107938e4e20-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.120426 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.120233    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7a35ba9f-0a9f-4722-9270-4107938e4e20-config-out\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.120426 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.120396    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.120573 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.120442    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-web-config\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.120573 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.120506    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.120704 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.120678    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7a35ba9f-0a9f-4722-9270-4107938e4e20-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.121795 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.120780    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a35ba9f-0a9f-4722-9270-4107938e4e20-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.122031 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.122012    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mh7mh\" (UniqueName: \"kubernetes.io/projected/7a35ba9f-0a9f-4722-9270-4107938e4e20-kube-api-access-mh7mh\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.122276 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.122111    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7a35ba9f-0a9f-4722-9270-4107938e4e20-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.122403 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.122217    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.122549 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.122533    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a35ba9f-0a9f-4722-9270-4107938e4e20-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.123351 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.123301    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.123525 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.123505    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.123665 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.123246    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7a35ba9f-0a9f-4722-9270-4107938e4e20-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.123735 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.123444    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7a35ba9f-0a9f-4722-9270-4107938e4e20-config-out\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.123735 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.123534    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.123735 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.123557    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7a35ba9f-0a9f-4722-9270-4107938e4e20-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.123735 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.123711    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.124123 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.124039    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-web-config\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.124123 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.124163    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-config-volume\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.125624 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.125598    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.125831 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.125814    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.125986 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.125971    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7a35ba9f-0a9f-4722-9270-4107938e4e20-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.130261 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.130239    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh7mh\" (UniqueName: \"kubernetes.io/projected/7a35ba9f-0a9f-4722-9270-4107938e4e20-kube-api-access-mh7mh\") pod \"alertmanager-main-0\" (UID: \"7a35ba9f-0a9f-4722-9270-4107938e4e20\") " pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.247510 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.247484    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 25 01:06:22.381609 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.381581    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 25 01:06:22.384593 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:06:22.384568    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a35ba9f_0a9f_4722_9270_4107938e4e20.slice/crio-c2c8f3241ee2e20e9ba10681b6d10d733bc3e23f0e62b25930efc21bed9931e2 WatchSource:0}: Error finding container c2c8f3241ee2e20e9ba10681b6d10d733bc3e23f0e62b25930efc21bed9931e2: Status 404 returned error can't find the container with id c2c8f3241ee2e20e9ba10681b6d10d733bc3e23f0e62b25930efc21bed9931e2
May 25 01:06:22.579274 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.579206    2558 generic.go:358] "Generic (PLEG): container finished" podID="7a35ba9f-0a9f-4722-9270-4107938e4e20" containerID="a771553f296f425c0d681ae7ed313bc7014690fa6d623b8b31709a7922f32e21" exitCode=0
May 25 01:06:22.579600 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.579265    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a35ba9f-0a9f-4722-9270-4107938e4e20","Type":"ContainerDied","Data":"a771553f296f425c0d681ae7ed313bc7014690fa6d623b8b31709a7922f32e21"}
May 25 01:06:22.579600 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:22.579295    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a35ba9f-0a9f-4722-9270-4107938e4e20","Type":"ContainerStarted","Data":"c2c8f3241ee2e20e9ba10681b6d10d733bc3e23f0e62b25930efc21bed9931e2"}
May 25 01:06:23.584719 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:23.584635    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a35ba9f-0a9f-4722-9270-4107938e4e20","Type":"ContainerStarted","Data":"c0bee5d18168f23dc8e8e51fc0eff452d8bf6f6615d178969a63af67950ee21a"}
May 25 01:06:23.584719 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:23.584673    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a35ba9f-0a9f-4722-9270-4107938e4e20","Type":"ContainerStarted","Data":"88562de08706c8cd9431e3bbe6034d63b4dfc09d41e633af1a9ab0318b92dfcd"}
May 25 01:06:23.584719 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:23.584683    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a35ba9f-0a9f-4722-9270-4107938e4e20","Type":"ContainerStarted","Data":"44827f131aa80e0f03b60b753d8c2a8b9a535ee267d73671c0a54a7002af06aa"}
May 25 01:06:23.584719 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:23.584691    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a35ba9f-0a9f-4722-9270-4107938e4e20","Type":"ContainerStarted","Data":"5bd1812719a6b2acf88e6479774883843a57786891dbc5909370a52e51921dd7"}
May 25 01:06:23.584719 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:23.584699    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a35ba9f-0a9f-4722-9270-4107938e4e20","Type":"ContainerStarted","Data":"6c7d814efc4098599107e8d45edc15e3ed139869d7eecf2a8cd2c3cc4d628b8d"}
May 25 01:06:23.584719 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:23.584706    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7a35ba9f-0a9f-4722-9270-4107938e4e20","Type":"ContainerStarted","Data":"ff6d4ddd6131dbcfcb4b7243b7f8dae0c30bad05658720fe41cbbb39f9fe5450"}
May 25 01:06:23.611695 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:23.611652    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.61164096 podStartE2EDuration="2.61164096s" podCreationTimestamp="2026-05-25 01:06:21 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:06:23.61030486 +0000 UTC m=+242.479964186" watchObservedRunningTime="2026-05-25 01:06:23.61164096 +0000 UTC m=+242.481300285"
May 25 01:06:23.755762 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:23.755729    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c8618f3-ca12-46c3-ae7d-b0a13f702325" path="/var/lib/kubelet/pods/8c8618f3-ca12-46c3-ae7d-b0a13f702325/volumes"
May 25 01:06:24.532167 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.532134    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 01:06:24.532648 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.532614    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="prometheus" containerID="cri-o://6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5" gracePeriod=600
May 25 01:06:24.532805 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.532654    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="config-reloader" containerID="cri-o://fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4" gracePeriod=600
May 25 01:06:24.532805 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.532659    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="thanos-sidecar" containerID="cri-o://1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0" gracePeriod=600
May 25 01:06:24.532805 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.532691    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="kube-rbac-proxy-web" containerID="cri-o://51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb" gracePeriod=600
May 25 01:06:24.532805 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.532633    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="kube-rbac-proxy" containerID="cri-o://24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191" gracePeriod=600
May 25 01:06:24.532805 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.532667    2558 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="kube-rbac-proxy-thanos" containerID="cri-o://b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3" gracePeriod=600
May 25 01:06:24.782833 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.782774    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:24.950526 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.950493    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-configmap-serving-certs-ca-bundle\") pod \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") "
May 25 01:06:24.950526 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.950529    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-prometheus-k8s-tls\") pod \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") "
May 25 01:06:24.950760 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.950557    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-thanos-prometheus-http-client-file\") pod \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") "
May 25 01:06:24.950760 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.950576    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-config\") pod \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") "
May 25 01:06:24.950760 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.950603    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-kube-rbac-proxy\") pod \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") "
May 25 01:06:24.950760 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.950635    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-prometheus-k8s-rulefiles-0\") pod \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") "
May 25 01:06:24.950760 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.950672    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") "
May 25 01:06:24.950760 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.950703    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-config-out\") pod \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") "
May 25 01:06:24.950760 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.950744    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-configmap-kubelet-serving-ca-bundle\") pod \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") "
May 25 01:06:24.951081 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.950770    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-prometheus-k8s-db\") pod \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") "
May 25 01:06:24.951081 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.950799    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-configmap-metrics-client-ca\") pod \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") "
May 25 01:06:24.951081 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.950824    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-metrics-client-certs\") pod \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") "
May 25 01:06:24.951081 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.950849    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-tls-assets\") pod \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") "
May 25 01:06:24.951081 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.950875    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-web-config\") pod \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") "
May 25 01:06:24.951081 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.950911    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-grpc-tls\") pod \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") "
May 25 01:06:24.951081 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.950929    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" (UID: "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:06:24.951081 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.950939    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") "
May 25 01:06:24.951081 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.951043    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xhxft\" (UniqueName: \"kubernetes.io/projected/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-kube-api-access-xhxft\") pod \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") "
May 25 01:06:24.951081 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.951078    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-prometheus-trusted-ca-bundle\") pod \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\" (UID: \"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa\") "
May 25 01:06:24.951565 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.951386    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:24.951701 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.951673    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" (UID: "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:06:24.952739 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.952711    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" (UID: "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:06:24.953770 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.953402    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" (UID: "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:06:24.953770 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.953431    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" (UID: "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:06:24.953770 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.953514    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" (UID: "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:06:24.953770 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.953537    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" (UID: "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:06:24.954038 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.953781    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" (UID: "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:06:24.954038 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.953826    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-config" (OuterVolumeSpecName: "config") pod "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" (UID: "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:06:24.954038 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.953861    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" (UID: "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 25 01:06:24.954038 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.953881    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" (UID: "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:06:24.954777 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.954740    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" (UID: "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:06:24.954880 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.954777    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-kube-api-access-xhxft" (OuterVolumeSpecName: "kube-api-access-xhxft") pod "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" (UID: "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa"). InnerVolumeSpecName "kube-api-access-xhxft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:06:24.955589 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.955567    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" (UID: "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:06:24.955796 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.955773    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" (UID: "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:06:24.955876 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.955831    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" (UID: "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:06:24.956249 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.956229    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-config-out" (OuterVolumeSpecName: "config-out") pod "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" (UID: "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 25 01:06:24.966565 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:24.966546    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-web-config" (OuterVolumeSpecName: "web-config") pod "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" (UID: "1fc7b440-ca4c-44d9-b65c-5c3b95b111aa"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 25 01:06:25.052748 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.052668    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:25.052748 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.052707    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-prometheus-k8s-db\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:25.052748 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.052718    2558 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-configmap-metrics-client-ca\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:25.052748 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.052729    2558 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-metrics-client-certs\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:25.052748 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.052739    2558 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-tls-assets\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:25.052748 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.052748    2558 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-web-config\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:25.052748 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.052756    2558 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-grpc-tls\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:25.053066 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.052765    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:25.053066 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.052774    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xhxft\" (UniqueName: \"kubernetes.io/projected/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-kube-api-access-xhxft\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:25.053066 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.052782    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:25.053066 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.052791    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:25.053066 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.052799    2558 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:25.053066 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.052807    2558 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-config\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:25.053066 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.052816    2558 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-kube-rbac-proxy\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:25.053066 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.052825    2558 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:25.053066 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.052833    2558 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:25.053066 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.052842    2558 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa-config-out\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:06:25.593609 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.593574    2558 generic.go:358] "Generic (PLEG): container finished" podID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerID="b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3" exitCode=0
May 25 01:06:25.593609 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.593602    2558 generic.go:358] "Generic (PLEG): container finished" podID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerID="24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191" exitCode=0
May 25 01:06:25.593609 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.593611    2558 generic.go:358] "Generic (PLEG): container finished" podID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerID="51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb" exitCode=0
May 25 01:06:25.593788 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.593619    2558 generic.go:358] "Generic (PLEG): container finished" podID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerID="1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0" exitCode=0
May 25 01:06:25.593788 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.593626    2558 generic.go:358] "Generic (PLEG): container finished" podID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerID="fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4" exitCode=0
May 25 01:06:25.593788 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.593633    2558 generic.go:358] "Generic (PLEG): container finished" podID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerID="6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5" exitCode=0
May 25 01:06:25.593788 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.593654    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa","Type":"ContainerDied","Data":"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3"}
May 25 01:06:25.593788 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.593698    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.593788 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.593711    2558 scope.go:117] "RemoveContainer" containerID="b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3"
May 25 01:06:25.593994 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.593698    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa","Type":"ContainerDied","Data":"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191"}
May 25 01:06:25.593994 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.593838    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa","Type":"ContainerDied","Data":"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb"}
May 25 01:06:25.593994 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.593857    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa","Type":"ContainerDied","Data":"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0"}
May 25 01:06:25.593994 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.593871    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa","Type":"ContainerDied","Data":"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4"}
May 25 01:06:25.593994 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.593889    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa","Type":"ContainerDied","Data":"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5"}
May 25 01:06:25.593994 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.593897    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"1fc7b440-ca4c-44d9-b65c-5c3b95b111aa","Type":"ContainerDied","Data":"005192148d28cfb5ebee8e09c2703b9f7ddb81d9e0f86164c07795435ac43491"}
May 25 01:06:25.604274 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.604257    2558 scope.go:117] "RemoveContainer" containerID="24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191"
May 25 01:06:25.610986 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.610971    2558 scope.go:117] "RemoveContainer" containerID="51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb"
May 25 01:06:25.617510 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.617414    2558 scope.go:117] "RemoveContainer" containerID="1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0"
May 25 01:06:25.618662 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.618645    2558 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 01:06:25.622949 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.622931    2558 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 01:06:25.625180 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.625166    2558 scope.go:117] "RemoveContainer" containerID="fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4"
May 25 01:06:25.631492 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.631477    2558 scope.go:117] "RemoveContainer" containerID="6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5"
May 25 01:06:25.637979 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.637964    2558 scope.go:117] "RemoveContainer" containerID="6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d"
May 25 01:06:25.644155 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.644138    2558 scope.go:117] "RemoveContainer" containerID="b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3"
May 25 01:06:25.644420 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:06:25.644402    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3\": container with ID starting with b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3 not found: ID does not exist" containerID="b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3"
May 25 01:06:25.644467 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.644428    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3"} err="failed to get container status \"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3\": rpc error: code = NotFound desc = could not find container \"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3\": container with ID starting with b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3 not found: ID does not exist"
May 25 01:06:25.644467 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.644445    2558 scope.go:117] "RemoveContainer" containerID="24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191"
May 25 01:06:25.644690 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:06:25.644673    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191\": container with ID starting with 24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191 not found: ID does not exist" containerID="24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191"
May 25 01:06:25.644760 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.644699    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191"} err="failed to get container status \"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191\": rpc error: code = NotFound desc = could not find container \"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191\": container with ID starting with 24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191 not found: ID does not exist"
May 25 01:06:25.644760 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.644721    2558 scope.go:117] "RemoveContainer" containerID="51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb"
May 25 01:06:25.644944 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:06:25.644927    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb\": container with ID starting with 51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb not found: ID does not exist" containerID="51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb"
May 25 01:06:25.644984 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.644950    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb"} err="failed to get container status \"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb\": rpc error: code = NotFound desc = could not find container \"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb\": container with ID starting with 51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb not found: ID does not exist"
May 25 01:06:25.644984 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.644965    2558 scope.go:117] "RemoveContainer" containerID="1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0"
May 25 01:06:25.645166 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:06:25.645153    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0\": container with ID starting with 1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0 not found: ID does not exist" containerID="1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0"
May 25 01:06:25.645204 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.645170    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0"} err="failed to get container status \"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0\": rpc error: code = NotFound desc = could not find container \"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0\": container with ID starting with 1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0 not found: ID does not exist"
May 25 01:06:25.645204 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.645182    2558 scope.go:117] "RemoveContainer" containerID="fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4"
May 25 01:06:25.645411 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:06:25.645395    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4\": container with ID starting with fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4 not found: ID does not exist" containerID="fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4"
May 25 01:06:25.645477 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.645420    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4"} err="failed to get container status \"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4\": rpc error: code = NotFound desc = could not find container \"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4\": container with ID starting with fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4 not found: ID does not exist"
May 25 01:06:25.645477 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.645442    2558 scope.go:117] "RemoveContainer" containerID="6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5"
May 25 01:06:25.645665 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:06:25.645651    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5\": container with ID starting with 6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5 not found: ID does not exist" containerID="6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5"
May 25 01:06:25.645701 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.645670    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5"} err="failed to get container status \"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5\": rpc error: code = NotFound desc = could not find container \"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5\": container with ID starting with 6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5 not found: ID does not exist"
May 25 01:06:25.645701 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.645683    2558 scope.go:117] "RemoveContainer" containerID="6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d"
May 25 01:06:25.645875 ip-10-0-134-192 kubenswrapper[2558]: E0525 01:06:25.645860    2558 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d\": container with ID starting with 6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d not found: ID does not exist" containerID="6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d"
May 25 01:06:25.645980 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.645883    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d"} err="failed to get container status \"6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d\": rpc error: code = NotFound desc = could not find container \"6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d\": container with ID starting with 6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d not found: ID does not exist"
May 25 01:06:25.645980 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.645902    2558 scope.go:117] "RemoveContainer" containerID="b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3"
May 25 01:06:25.646113 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.646097    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3"} err="failed to get container status \"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3\": rpc error: code = NotFound desc = could not find container \"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3\": container with ID starting with b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3 not found: ID does not exist"
May 25 01:06:25.646162 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.646113    2558 scope.go:117] "RemoveContainer" containerID="24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191"
May 25 01:06:25.646303 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.646287    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191"} err="failed to get container status \"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191\": rpc error: code = NotFound desc = could not find container \"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191\": container with ID starting with 24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191 not found: ID does not exist"
May 25 01:06:25.646374 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.646303    2558 scope.go:117] "RemoveContainer" containerID="51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb"
May 25 01:06:25.646518 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.646495    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb"} err="failed to get container status \"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb\": rpc error: code = NotFound desc = could not find container \"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb\": container with ID starting with 51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb not found: ID does not exist"
May 25 01:06:25.646574 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.646523    2558 scope.go:117] "RemoveContainer" containerID="1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0"
May 25 01:06:25.646736 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.646720    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0"} err="failed to get container status \"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0\": rpc error: code = NotFound desc = could not find container \"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0\": container with ID starting with 1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0 not found: ID does not exist"
May 25 01:06:25.646781 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.646736    2558 scope.go:117] "RemoveContainer" containerID="fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4"
May 25 01:06:25.646893 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.646881    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4"} err="failed to get container status \"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4\": rpc error: code = NotFound desc = could not find container \"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4\": container with ID starting with fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4 not found: ID does not exist"
May 25 01:06:25.646938 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.646893    2558 scope.go:117] "RemoveContainer" containerID="6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5"
May 25 01:06:25.647052 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.647038    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5"} err="failed to get container status \"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5\": rpc error: code = NotFound desc = could not find container \"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5\": container with ID starting with 6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5 not found: ID does not exist"
May 25 01:06:25.647052 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.647050    2558 scope.go:117] "RemoveContainer" containerID="6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d"
May 25 01:06:25.647215 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.647201    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d"} err="failed to get container status \"6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d\": rpc error: code = NotFound desc = could not find container \"6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d\": container with ID starting with 6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d not found: ID does not exist"
May 25 01:06:25.647259 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.647215    2558 scope.go:117] "RemoveContainer" containerID="b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3"
May 25 01:06:25.647474 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.647453    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3"} err="failed to get container status \"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3\": rpc error: code = NotFound desc = could not find container \"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3\": container with ID starting with b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3 not found: ID does not exist"
May 25 01:06:25.647523 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.647475    2558 scope.go:117] "RemoveContainer" containerID="24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191"
May 25 01:06:25.647660 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.647645    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191"} err="failed to get container status \"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191\": rpc error: code = NotFound desc = could not find container \"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191\": container with ID starting with 24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191 not found: ID does not exist"
May 25 01:06:25.647705 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.647661    2558 scope.go:117] "RemoveContainer" containerID="51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb"
May 25 01:06:25.647853 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.647834    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb"} err="failed to get container status \"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb\": rpc error: code = NotFound desc = could not find container \"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb\": container with ID starting with 51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb not found: ID does not exist"
May 25 01:06:25.647853 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.647852    2558 scope.go:117] "RemoveContainer" containerID="1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0"
May 25 01:06:25.648106 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.648090    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0"} err="failed to get container status \"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0\": rpc error: code = NotFound desc = could not find container \"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0\": container with ID starting with 1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0 not found: ID does not exist"
May 25 01:06:25.648161 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.648106    2558 scope.go:117] "RemoveContainer" containerID="fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4"
May 25 01:06:25.648295 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.648277    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4"} err="failed to get container status \"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4\": rpc error: code = NotFound desc = could not find container \"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4\": container with ID starting with fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4 not found: ID does not exist"
May 25 01:06:25.648375 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.648296    2558 scope.go:117] "RemoveContainer" containerID="6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5"
May 25 01:06:25.648605 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.648548    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5"} err="failed to get container status \"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5\": rpc error: code = NotFound desc = could not find container \"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5\": container with ID starting with 6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5 not found: ID does not exist"
May 25 01:06:25.648605 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.648570    2558 scope.go:117] "RemoveContainer" containerID="6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d"
May 25 01:06:25.648836 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.648809    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d"} err="failed to get container status \"6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d\": rpc error: code = NotFound desc = could not find container \"6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d\": container with ID starting with 6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d not found: ID does not exist"
May 25 01:06:25.648836 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.648830    2558 scope.go:117] "RemoveContainer" containerID="b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3"
May 25 01:06:25.649155 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.649130    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3"} err="failed to get container status \"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3\": rpc error: code = NotFound desc = could not find container \"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3\": container with ID starting with b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3 not found: ID does not exist"
May 25 01:06:25.649214 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.649158    2558 scope.go:117] "RemoveContainer" containerID="24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191"
May 25 01:06:25.649509 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.649487    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191"} err="failed to get container status \"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191\": rpc error: code = NotFound desc = could not find container \"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191\": container with ID starting with 24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191 not found: ID does not exist"
May 25 01:06:25.649509 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.649508    2558 scope.go:117] "RemoveContainer" containerID="51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb"
May 25 01:06:25.649711 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.649693    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb"} err="failed to get container status \"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb\": rpc error: code = NotFound desc = could not find container \"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb\": container with ID starting with 51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb not found: ID does not exist"
May 25 01:06:25.649772 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.649712    2558 scope.go:117] "RemoveContainer" containerID="1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0"
May 25 01:06:25.649914 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.649891    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0"} err="failed to get container status \"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0\": rpc error: code = NotFound desc = could not find container \"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0\": container with ID starting with 1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0 not found: ID does not exist"
May 25 01:06:25.649978 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.649914    2558 scope.go:117] "RemoveContainer" containerID="fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4"
May 25 01:06:25.650121 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.650102    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4"} err="failed to get container status \"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4\": rpc error: code = NotFound desc = could not find container \"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4\": container with ID starting with fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4 not found: ID does not exist"
May 25 01:06:25.650182 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.650120    2558 scope.go:117] "RemoveContainer" containerID="6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5"
May 25 01:06:25.650408 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.650387    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5"} err="failed to get container status \"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5\": rpc error: code = NotFound desc = could not find container \"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5\": container with ID starting with 6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5 not found: ID does not exist"
May 25 01:06:25.650487 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.650408    2558 scope.go:117] "RemoveContainer" containerID="6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d"
May 25 01:06:25.650643 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.650628    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d"} err="failed to get container status \"6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d\": rpc error: code = NotFound desc = could not find container \"6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d\": container with ID starting with 6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d not found: ID does not exist"
May 25 01:06:25.650643 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.650642    2558 scope.go:117] "RemoveContainer" containerID="b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3"
May 25 01:06:25.650854 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.650838    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3"} err="failed to get container status \"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3\": rpc error: code = NotFound desc = could not find container \"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3\": container with ID starting with b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3 not found: ID does not exist"
May 25 01:06:25.650917 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.650854    2558 scope.go:117] "RemoveContainer" containerID="24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191"
May 25 01:06:25.651041 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651021    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191"} err="failed to get container status \"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191\": rpc error: code = NotFound desc = could not find container \"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191\": container with ID starting with 24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191 not found: ID does not exist"
May 25 01:06:25.651041 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651040    2558 scope.go:117] "RemoveContainer" containerID="51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb"
May 25 01:06:25.651136 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651080    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 01:06:25.651240 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651221    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb"} err="failed to get container status \"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb\": rpc error: code = NotFound desc = could not find container \"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb\": container with ID starting with 51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb not found: ID does not exist"
May 25 01:06:25.651300 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651239    2558 scope.go:117] "RemoveContainer" containerID="1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0"
May 25 01:06:25.651435 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651419    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0"} err="failed to get container status \"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0\": rpc error: code = NotFound desc = could not find container \"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0\": container with ID starting with 1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0 not found: ID does not exist"
May 25 01:06:25.651488 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651434    2558 scope.go:117] "RemoveContainer" containerID="fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4"
May 25 01:06:25.651532 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651516    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="thanos-sidecar"
May 25 01:06:25.651579 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651532    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="thanos-sidecar"
May 25 01:06:25.651579 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651544    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="kube-rbac-proxy-thanos"
May 25 01:06:25.651579 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651553    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="kube-rbac-proxy-thanos"
May 25 01:06:25.651579 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651571    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="init-config-reloader"
May 25 01:06:25.651579 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651580    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="init-config-reloader"
May 25 01:06:25.651809 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651597    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="config-reloader"
May 25 01:06:25.651809 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651606    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="config-reloader"
May 25 01:06:25.651809 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651618    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4"} err="failed to get container status \"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4\": rpc error: code = NotFound desc = could not find container \"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4\": container with ID starting with fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4 not found: ID does not exist"
May 25 01:06:25.651809 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651627    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="kube-rbac-proxy"
May 25 01:06:25.651809 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651632    2558 scope.go:117] "RemoveContainer" containerID="6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5"
May 25 01:06:25.651809 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651636    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="kube-rbac-proxy"
May 25 01:06:25.651809 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651647    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="prometheus"
May 25 01:06:25.651809 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651655    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="prometheus"
May 25 01:06:25.651809 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651663    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="kube-rbac-proxy-web"
May 25 01:06:25.651809 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651672    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="kube-rbac-proxy-web"
May 25 01:06:25.651809 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651744    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="config-reloader"
May 25 01:06:25.651809 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651757    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="kube-rbac-proxy-thanos"
May 25 01:06:25.651809 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651769    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="thanos-sidecar"
May 25 01:06:25.651809 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651781    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="prometheus"
May 25 01:06:25.651809 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651799    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="kube-rbac-proxy-web"
May 25 01:06:25.651809 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651809    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" containerName="kube-rbac-proxy"
May 25 01:06:25.652595 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651778    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5"} err="failed to get container status \"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5\": rpc error: code = NotFound desc = could not find container \"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5\": container with ID starting with 6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5 not found: ID does not exist"
May 25 01:06:25.652595 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.651866    2558 scope.go:117] "RemoveContainer" containerID="6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d"
May 25 01:06:25.652595 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.652020    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d"} err="failed to get container status \"6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d\": rpc error: code = NotFound desc = could not find container \"6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d\": container with ID starting with 6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d not found: ID does not exist"
May 25 01:06:25.652595 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.652038    2558 scope.go:117] "RemoveContainer" containerID="b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3"
May 25 01:06:25.652595 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.652242    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3"} err="failed to get container status \"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3\": rpc error: code = NotFound desc = could not find container \"b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3\": container with ID starting with b6e22360a7a67fdc7c22ad8a502aeb357148192797fc18dbe2842eb18ee1a6e3 not found: ID does not exist"
May 25 01:06:25.652595 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.652254    2558 scope.go:117] "RemoveContainer" containerID="24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191"
May 25 01:06:25.652595 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.652452    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191"} err="failed to get container status \"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191\": rpc error: code = NotFound desc = could not find container \"24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191\": container with ID starting with 24684c9cfb3fd412667db381bc4c297c69870a73cd10499cc7d389dcb47cc191 not found: ID does not exist"
May 25 01:06:25.652595 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.652466    2558 scope.go:117] "RemoveContainer" containerID="51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb"
May 25 01:06:25.652954 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.652629    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb"} err="failed to get container status \"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb\": rpc error: code = NotFound desc = could not find container \"51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb\": container with ID starting with 51feca7f7ae127e5078e1405ca77e366276a8064484acc92263dcd0c70f0fedb not found: ID does not exist"
May 25 01:06:25.652954 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.652646    2558 scope.go:117] "RemoveContainer" containerID="1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0"
May 25 01:06:25.652954 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.652813    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0"} err="failed to get container status \"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0\": rpc error: code = NotFound desc = could not find container \"1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0\": container with ID starting with 1a16e97652519c9437408e605e0f0173e915547c92b48ca243887576cc8c8ec0 not found: ID does not exist"
May 25 01:06:25.652954 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.652830    2558 scope.go:117] "RemoveContainer" containerID="fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4"
May 25 01:06:25.653133 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.653017    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4"} err="failed to get container status \"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4\": rpc error: code = NotFound desc = could not find container \"fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4\": container with ID starting with fb2444849ce7910fdeb94f226cc1259cd03a3bbe68b50775293c183f6354b3c4 not found: ID does not exist"
May 25 01:06:25.653133 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.653029    2558 scope.go:117] "RemoveContainer" containerID="6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5"
May 25 01:06:25.653226 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.653193    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5"} err="failed to get container status \"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5\": rpc error: code = NotFound desc = could not find container \"6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5\": container with ID starting with 6c32f25421c3ac95fa204faa57a74a343cd0dd7904a8b9f4b7253e22e03309c5 not found: ID does not exist"
May 25 01:06:25.653226 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.653215    2558 scope.go:117] "RemoveContainer" containerID="6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d"
May 25 01:06:25.653442 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.653423    2558 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d"} err="failed to get container status \"6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d\": rpc error: code = NotFound desc = could not find container \"6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d\": container with ID starting with 6b409a53c170aea80fcd0852b6057a840be78082e4f96fbe8d05016a180cd05d not found: ID does not exist"
May 25 01:06:25.657773 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.657754    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.660292 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.660264    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 25 01:06:25.660292 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.660286    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 25 01:06:25.660546 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.660528    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 25 01:06:25.660618 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.660587    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 25 01:06:25.660618 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.660529    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 25 01:06:25.660748 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.660733    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 25 01:06:25.660823 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.660806    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-fipsp5fc47pr3\""
May 25 01:06:25.661032 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.661018    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 25 01:06:25.661069 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.661034    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 25 01:06:25.661069 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.661024    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 25 01:06:25.661303 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.661288    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 25 01:06:25.661532 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.661517    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 25 01:06:25.661595 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.661570    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cvckx\""
May 25 01:06:25.665289 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.665270    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 25 01:06:25.667675 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.667658    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 01:06:25.668690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.668671    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 25 01:06:25.756060 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.756034    2558 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1fc7b440-ca4c-44d9-b65c-5c3b95b111aa" path="/var/lib/kubelet/pods/1fc7b440-ca4c-44d9-b65c-5c3b95b111aa/volumes"
May 25 01:06:25.758319 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.758294    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.758453 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.758346    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.758453 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.758372    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6pc8\" (UniqueName: \"kubernetes.io/projected/fd994856-e117-4498-93bb-6b7b08adb869-kube-api-access-k6pc8\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.758453 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.758390    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd994856-e117-4498-93bb-6b7b08adb869-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.758453 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.758442    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-config\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.758634 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.758477    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.758634 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.758516    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd994856-e117-4498-93bb-6b7b08adb869-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.758634 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.758557    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.758634 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.758580    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.758808 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.758651    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fd994856-e117-4498-93bb-6b7b08adb869-config-out\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.758808 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.758735    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd994856-e117-4498-93bb-6b7b08adb869-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.758808 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.758770    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fd994856-e117-4498-93bb-6b7b08adb869-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.758935 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.758810    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.758935 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.758838    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fd994856-e117-4498-93bb-6b7b08adb869-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.758935 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.758863    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.759063 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.758930    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd994856-e117-4498-93bb-6b7b08adb869-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.759063 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.758960    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fd994856-e117-4498-93bb-6b7b08adb869-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.759063 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.758998    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-web-config\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.859889 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.859822    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.859889 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.859860    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.859889 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.859878    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-k6pc8\" (UniqueName: \"kubernetes.io/projected/fd994856-e117-4498-93bb-6b7b08adb869-kube-api-access-k6pc8\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.859889 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.859894    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd994856-e117-4498-93bb-6b7b08adb869-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.860424 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.859916    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-config\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.860424 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.859941    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.860424 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.859973    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd994856-e117-4498-93bb-6b7b08adb869-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.860424 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.860004    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.860424 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.860027    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.860424 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.860073    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fd994856-e117-4498-93bb-6b7b08adb869-config-out\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.860424 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.860108    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd994856-e117-4498-93bb-6b7b08adb869-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.860424 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.860133    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fd994856-e117-4498-93bb-6b7b08adb869-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.860424 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.860169    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.860424 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.860195    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fd994856-e117-4498-93bb-6b7b08adb869-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.860424 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.860220    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.860424 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.860261    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd994856-e117-4498-93bb-6b7b08adb869-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.860424 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.860291    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fd994856-e117-4498-93bb-6b7b08adb869-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.860424 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.860348    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-web-config\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.861100 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.860887    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fd994856-e117-4498-93bb-6b7b08adb869-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.861100 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.861002    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd994856-e117-4498-93bb-6b7b08adb869-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.863156 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.862489    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd994856-e117-4498-93bb-6b7b08adb869-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.863156 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.862796    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/fd994856-e117-4498-93bb-6b7b08adb869-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.863156 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.863000    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fd994856-e117-4498-93bb-6b7b08adb869-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.863475 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.863412    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-web-config\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.864122 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.864083    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-config\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.864632 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.864605    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.864843 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.864799    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.865583 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.865307    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.865583 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.865375    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.865583 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.865523    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.865796 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.865706    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.866148 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.866112    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/fd994856-e117-4498-93bb-6b7b08adb869-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.866258 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.866236    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/fd994856-e117-4498-93bb-6b7b08adb869-config-out\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.866659 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.866639    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/fd994856-e117-4498-93bb-6b7b08adb869-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.867215 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.867195    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/fd994856-e117-4498-93bb-6b7b08adb869-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.868197 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.868176    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6pc8\" (UniqueName: \"kubernetes.io/projected/fd994856-e117-4498-93bb-6b7b08adb869-kube-api-access-k6pc8\") pod \"prometheus-k8s-0\" (UID: \"fd994856-e117-4498-93bb-6b7b08adb869\") " pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:25.967383 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:25.967361    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:26.108964 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:26.108934    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 25 01:06:26.112153 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:06:26.112116    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd994856_e117_4498_93bb_6b7b08adb869.slice/crio-125040db384b454718a9a61e53484ee83b418a7de9db5ee145672f0d4ba36e3c WatchSource:0}: Error finding container 125040db384b454718a9a61e53484ee83b418a7de9db5ee145672f0d4ba36e3c: Status 404 returned error can't find the container with id 125040db384b454718a9a61e53484ee83b418a7de9db5ee145672f0d4ba36e3c
May 25 01:06:26.598279 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:26.598245    2558 generic.go:358] "Generic (PLEG): container finished" podID="fd994856-e117-4498-93bb-6b7b08adb869" containerID="b1f9e18a32a672ad0c85d642f6998de64af5ce94a3e9a4a26eb1535c77890299" exitCode=0
May 25 01:06:26.598433 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:26.598350    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd994856-e117-4498-93bb-6b7b08adb869","Type":"ContainerDied","Data":"b1f9e18a32a672ad0c85d642f6998de64af5ce94a3e9a4a26eb1535c77890299"}
May 25 01:06:26.598433 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:26.598388    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd994856-e117-4498-93bb-6b7b08adb869","Type":"ContainerStarted","Data":"125040db384b454718a9a61e53484ee83b418a7de9db5ee145672f0d4ba36e3c"}
May 25 01:06:27.607371 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:27.607313    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd994856-e117-4498-93bb-6b7b08adb869","Type":"ContainerStarted","Data":"c02c1c765883b3ff310a25931ca5cbd168d76e034f14f86f4dabba2b04459902"}
May 25 01:06:27.607371 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:27.607371    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd994856-e117-4498-93bb-6b7b08adb869","Type":"ContainerStarted","Data":"2aa7faabdb4e7390b42ff4ef469c91518dde90164632aa4bbf8291e0acbf39d0"}
May 25 01:06:27.607774 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:27.607381    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd994856-e117-4498-93bb-6b7b08adb869","Type":"ContainerStarted","Data":"39da6276f97dc4f0f7152004d42f19de44ab0d27187af86a7765903e2060ce5c"}
May 25 01:06:27.607774 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:27.607390    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd994856-e117-4498-93bb-6b7b08adb869","Type":"ContainerStarted","Data":"e2106604b9aee290d0199f6651764a3e196eeafb578c92366c49d8b17058d9c1"}
May 25 01:06:27.607774 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:27.607397    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd994856-e117-4498-93bb-6b7b08adb869","Type":"ContainerStarted","Data":"d1dcf71f0d2f1b4dd098ec08cc702e6e97560c83d3db706e2c889467b6b4501b"}
May 25 01:06:27.607774 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:27.607406    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"fd994856-e117-4498-93bb-6b7b08adb869","Type":"ContainerStarted","Data":"fbc4f3ba20d3784cc547860345b07f2fd6febeaae21934cc17767afc0b714275"}
May 25 01:06:27.634304 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:27.634260    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.63424594 podStartE2EDuration="2.63424594s" podCreationTimestamp="2026-05-25 01:06:25 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:06:27.632371863 +0000 UTC m=+246.502031189" watchObservedRunningTime="2026-05-25 01:06:27.63424594 +0000 UTC m=+246.503905264"
May 25 01:06:30.968489 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:30.968451    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:06:32.513730 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:32.513696    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs\") pod \"network-metrics-daemon-tsh68\" (UID: \"0c53f430-328a-4e17-b089-976b8d399f7c\") " pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:06:32.516143 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:32.516122    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0c53f430-328a-4e17-b089-976b8d399f7c-metrics-certs\") pod \"network-metrics-daemon-tsh68\" (UID: \"0c53f430-328a-4e17-b089-976b8d399f7c\") " pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:06:32.656254 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:32.656232    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f8zp6\""
May 25 01:06:32.663364 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:32.663344    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tsh68"
May 25 01:06:32.789709 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:32.789689    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tsh68"]
May 25 01:06:32.792356 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:06:32.792312    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c53f430_328a_4e17_b089_976b8d399f7c.slice/crio-0a111856b3192fab192ae83dd3f891d2f6fd85a7ed2e8702ac1a448631ea8e5e WatchSource:0}: Error finding container 0a111856b3192fab192ae83dd3f891d2f6fd85a7ed2e8702ac1a448631ea8e5e: Status 404 returned error can't find the container with id 0a111856b3192fab192ae83dd3f891d2f6fd85a7ed2e8702ac1a448631ea8e5e
May 25 01:06:33.627606 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:33.627570    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tsh68" event={"ID":"0c53f430-328a-4e17-b089-976b8d399f7c","Type":"ContainerStarted","Data":"0a111856b3192fab192ae83dd3f891d2f6fd85a7ed2e8702ac1a448631ea8e5e"}
May 25 01:06:34.632164 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:34.632128    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tsh68" event={"ID":"0c53f430-328a-4e17-b089-976b8d399f7c","Type":"ContainerStarted","Data":"dc15015b991025122409b57d5dc10bdb6bc812f0dd3ba2f5ab5837baea9502a3"}
May 25 01:06:34.632164 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:34.632170    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tsh68" event={"ID":"0c53f430-328a-4e17-b089-976b8d399f7c","Type":"ContainerStarted","Data":"1f22825be71c242811300738d20cd0a201d89259fb1ee5138491cdb946c9fdc8"}
May 25 01:06:34.661317 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:06:34.661266    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tsh68" podStartSLOduration=252.808055207 podStartE2EDuration="4m13.66125135s" podCreationTimestamp="2026-05-25 01:02:21 +0000 UTC" firstStartedPulling="2026-05-25 01:06:32.794591628 +0000 UTC m=+251.664250936" lastFinishedPulling="2026-05-25 01:06:33.647787772 +0000 UTC m=+252.517447079" observedRunningTime="2026-05-25 01:06:34.660379678 +0000 UTC m=+253.530039001" watchObservedRunningTime="2026-05-25 01:06:34.66125135 +0000 UTC m=+253.530910684"
May 25 01:07:21.650128 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:07:21.650104    2558 kubelet.go:1628] "Image garbage collection succeeded"
May 25 01:07:25.968118 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:07:25.968078    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:07:25.985026 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:07:25.984996    2558 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:07:26.801022 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:07:26.800985    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 25 01:09:49.031165 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:49.031082    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6588b9546d-gtwzc"]
May 25 01:09:49.034597 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:49.034577    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-gtwzc"
May 25 01:09:49.037450 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:49.037429    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 25 01:09:49.037569 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:49.037540    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 25 01:09:49.037678 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:49.037657    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-79wbd\""
May 25 01:09:49.037748 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:49.037701    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 25 01:09:49.037810 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:49.037793    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 25 01:09:49.069527 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:49.069500    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6588b9546d-gtwzc"]
May 25 01:09:49.171751 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:49.171711    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6588b9546d-gtwzc\" (UID: \"c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-gtwzc"
May 25 01:09:49.171940 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:49.171763    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sftsb\" (UniqueName: \"kubernetes.io/projected/c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7-kube-api-access-sftsb\") pod \"opendatahub-operator-controller-manager-6588b9546d-gtwzc\" (UID: \"c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-gtwzc"
May 25 01:09:49.171940 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:49.171796    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6588b9546d-gtwzc\" (UID: \"c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-gtwzc"
May 25 01:09:49.272255 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:49.272219    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6588b9546d-gtwzc\" (UID: \"c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-gtwzc"
May 25 01:09:49.272470 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:49.272263    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sftsb\" (UniqueName: \"kubernetes.io/projected/c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7-kube-api-access-sftsb\") pod \"opendatahub-operator-controller-manager-6588b9546d-gtwzc\" (UID: \"c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-gtwzc"
May 25 01:09:49.272470 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:49.272287    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6588b9546d-gtwzc\" (UID: \"c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-gtwzc"
May 25 01:09:49.275053 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:49.275026    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6588b9546d-gtwzc\" (UID: \"c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-gtwzc"
May 25 01:09:49.275172 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:49.275038    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6588b9546d-gtwzc\" (UID: \"c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-gtwzc"
May 25 01:09:49.287852 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:49.287792    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sftsb\" (UniqueName: \"kubernetes.io/projected/c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7-kube-api-access-sftsb\") pod \"opendatahub-operator-controller-manager-6588b9546d-gtwzc\" (UID: \"c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7\") " pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-gtwzc"
May 25 01:09:49.344895 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:49.344861    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-gtwzc"
May 25 01:09:49.491451 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:49.491424    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6588b9546d-gtwzc"]
May 25 01:09:49.492908 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:09:49.492885    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9d11fec_3fe7_4fdf_9d2a_6b448c174bc7.slice/crio-df84d380f2c66999f86fed175bb6292cd6955ad732332c43fad4d65f738aaee2 WatchSource:0}: Error finding container df84d380f2c66999f86fed175bb6292cd6955ad732332c43fad4d65f738aaee2: Status 404 returned error can't find the container with id df84d380f2c66999f86fed175bb6292cd6955ad732332c43fad4d65f738aaee2
May 25 01:09:49.494539 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:49.494519    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 01:09:50.212281 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:50.212220    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-gtwzc" event={"ID":"c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7","Type":"ContainerStarted","Data":"df84d380f2c66999f86fed175bb6292cd6955ad732332c43fad4d65f738aaee2"}
May 25 01:09:52.221314 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:52.221276    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-gtwzc" event={"ID":"c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7","Type":"ContainerStarted","Data":"6c0d8bf62cfa93766d5272a6ecc1daf784132c3bce080c8de27b6609a06cbbd4"}
May 25 01:09:52.221826 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:52.221359    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-gtwzc"
May 25 01:09:52.246034 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:09:52.245983    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-gtwzc" podStartSLOduration=1.8331227220000001 podStartE2EDuration="4.245967578s" podCreationTimestamp="2026-05-25 01:09:48 +0000 UTC" firstStartedPulling="2026-05-25 01:09:49.494645742 +0000 UTC m=+448.364305046" lastFinishedPulling="2026-05-25 01:09:51.907490599 +0000 UTC m=+450.777149902" observedRunningTime="2026-05-25 01:09:52.24423078 +0000 UTC m=+451.113890106" watchObservedRunningTime="2026-05-25 01:09:52.245967578 +0000 UTC m=+451.115626902"
May 25 01:10:01.059375 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.059340    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx"]
May 25 01:10:01.062953 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.062935    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx"
May 25 01:10:01.065584 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.065549    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 25 01:10:01.066630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.066611    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 25 01:10:01.066630 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.066619    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-6nk8g\""
May 25 01:10:01.066772 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.066641    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 25 01:10:01.066772 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.066662    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 25 01:10:01.066772 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.066694    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 25 01:10:01.074961 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.074937    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx"]
May 25 01:10:01.184150 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.184114    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c48b36c-0d2d-49f9-932b-88ddeeae610b-cert\") pod \"lws-controller-manager-8556845d74-tzbxx\" (UID: \"8c48b36c-0d2d-49f9-932b-88ddeeae610b\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx"
May 25 01:10:01.184347 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.184158    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8c48b36c-0d2d-49f9-932b-88ddeeae610b-manager-config\") pod \"lws-controller-manager-8556845d74-tzbxx\" (UID: \"8c48b36c-0d2d-49f9-932b-88ddeeae610b\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx"
May 25 01:10:01.184347 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.184219    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phqtb\" (UniqueName: \"kubernetes.io/projected/8c48b36c-0d2d-49f9-932b-88ddeeae610b-kube-api-access-phqtb\") pod \"lws-controller-manager-8556845d74-tzbxx\" (UID: \"8c48b36c-0d2d-49f9-932b-88ddeeae610b\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx"
May 25 01:10:01.184347 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.184270    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8c48b36c-0d2d-49f9-932b-88ddeeae610b-metrics-cert\") pod \"lws-controller-manager-8556845d74-tzbxx\" (UID: \"8c48b36c-0d2d-49f9-932b-88ddeeae610b\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx"
May 25 01:10:01.285201 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.285169    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c48b36c-0d2d-49f9-932b-88ddeeae610b-cert\") pod \"lws-controller-manager-8556845d74-tzbxx\" (UID: \"8c48b36c-0d2d-49f9-932b-88ddeeae610b\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx"
May 25 01:10:01.285201 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.285211    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8c48b36c-0d2d-49f9-932b-88ddeeae610b-manager-config\") pod \"lws-controller-manager-8556845d74-tzbxx\" (UID: \"8c48b36c-0d2d-49f9-932b-88ddeeae610b\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx"
May 25 01:10:01.285470 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.285352    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-phqtb\" (UniqueName: \"kubernetes.io/projected/8c48b36c-0d2d-49f9-932b-88ddeeae610b-kube-api-access-phqtb\") pod \"lws-controller-manager-8556845d74-tzbxx\" (UID: \"8c48b36c-0d2d-49f9-932b-88ddeeae610b\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx"
May 25 01:10:01.285470 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.285407    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8c48b36c-0d2d-49f9-932b-88ddeeae610b-metrics-cert\") pod \"lws-controller-manager-8556845d74-tzbxx\" (UID: \"8c48b36c-0d2d-49f9-932b-88ddeeae610b\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx"
May 25 01:10:01.285966 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.285946    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8c48b36c-0d2d-49f9-932b-88ddeeae610b-manager-config\") pod \"lws-controller-manager-8556845d74-tzbxx\" (UID: \"8c48b36c-0d2d-49f9-932b-88ddeeae610b\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx"
May 25 01:10:01.287975 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.287956    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8c48b36c-0d2d-49f9-932b-88ddeeae610b-cert\") pod \"lws-controller-manager-8556845d74-tzbxx\" (UID: \"8c48b36c-0d2d-49f9-932b-88ddeeae610b\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx"
May 25 01:10:01.288119 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.288099    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8c48b36c-0d2d-49f9-932b-88ddeeae610b-metrics-cert\") pod \"lws-controller-manager-8556845d74-tzbxx\" (UID: \"8c48b36c-0d2d-49f9-932b-88ddeeae610b\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx"
May 25 01:10:01.293367 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.293344    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-phqtb\" (UniqueName: \"kubernetes.io/projected/8c48b36c-0d2d-49f9-932b-88ddeeae610b-kube-api-access-phqtb\") pod \"lws-controller-manager-8556845d74-tzbxx\" (UID: \"8c48b36c-0d2d-49f9-932b-88ddeeae610b\") " pod="openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx"
May 25 01:10:01.372549 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.372452    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx"
May 25 01:10:01.505282 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:01.505260    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx"]
May 25 01:10:01.507973 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:10:01.507944    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c48b36c_0d2d_49f9_932b_88ddeeae610b.slice/crio-bab865708ccc6fb88718df7e0695e41b34e72e247652e912dcf92606d241770a WatchSource:0}: Error finding container bab865708ccc6fb88718df7e0695e41b34e72e247652e912dcf92606d241770a: Status 404 returned error can't find the container with id bab865708ccc6fb88718df7e0695e41b34e72e247652e912dcf92606d241770a
May 25 01:10:02.254551 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:02.254513    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx" event={"ID":"8c48b36c-0d2d-49f9-932b-88ddeeae610b","Type":"ContainerStarted","Data":"bab865708ccc6fb88718df7e0695e41b34e72e247652e912dcf92606d241770a"}
May 25 01:10:03.226267 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:03.226230    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6588b9546d-gtwzc"
May 25 01:10:05.266257 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:05.266223    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx" event={"ID":"8c48b36c-0d2d-49f9-932b-88ddeeae610b","Type":"ContainerStarted","Data":"538c1da3b0a337f22b5c06b762410ecdbc52448a3d0f0c290cb3ad1789b071b0"}
May 25 01:10:05.266638 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:05.266356    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx"
May 25 01:10:05.296277 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:05.296215    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx" podStartSLOduration=0.640572757 podStartE2EDuration="4.296197367s" podCreationTimestamp="2026-05-25 01:10:01 +0000 UTC" firstStartedPulling="2026-05-25 01:10:01.510342462 +0000 UTC m=+460.380001778" lastFinishedPulling="2026-05-25 01:10:05.165967067 +0000 UTC m=+464.035626388" observedRunningTime="2026-05-25 01:10:05.295496899 +0000 UTC m=+464.165156226" watchObservedRunningTime="2026-05-25 01:10:05.296197367 +0000 UTC m=+464.165856694"
May 25 01:10:06.934784 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:06.934755    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-56b48c6bb9-8tpnx"]
May 25 01:10:06.938265 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:06.938243    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-8tpnx"
May 25 01:10:06.940568 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:06.940550    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-n7ksq\""
May 25 01:10:06.941350 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:06.941313    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 25 01:10:06.941412 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:06.941344    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 25 01:10:06.949265 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:06.949239    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-56b48c6bb9-8tpnx"]
May 25 01:10:07.034486 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:07.034438    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38a34f53-7050-4db2-9404-08a3b32e51b1-tls-certs\") pod \"kube-auth-proxy-56b48c6bb9-8tpnx\" (UID: \"38a34f53-7050-4db2-9404-08a3b32e51b1\") " pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-8tpnx"
May 25 01:10:07.034673 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:07.034524    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38a34f53-7050-4db2-9404-08a3b32e51b1-tmp\") pod \"kube-auth-proxy-56b48c6bb9-8tpnx\" (UID: \"38a34f53-7050-4db2-9404-08a3b32e51b1\") " pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-8tpnx"
May 25 01:10:07.034673 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:07.034551    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7mf2c\" (UniqueName: \"kubernetes.io/projected/38a34f53-7050-4db2-9404-08a3b32e51b1-kube-api-access-7mf2c\") pod \"kube-auth-proxy-56b48c6bb9-8tpnx\" (UID: \"38a34f53-7050-4db2-9404-08a3b32e51b1\") " pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-8tpnx"
May 25 01:10:07.135779 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:07.135752    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38a34f53-7050-4db2-9404-08a3b32e51b1-tmp\") pod \"kube-auth-proxy-56b48c6bb9-8tpnx\" (UID: \"38a34f53-7050-4db2-9404-08a3b32e51b1\") " pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-8tpnx"
May 25 01:10:07.135779 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:07.135783    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7mf2c\" (UniqueName: \"kubernetes.io/projected/38a34f53-7050-4db2-9404-08a3b32e51b1-kube-api-access-7mf2c\") pod \"kube-auth-proxy-56b48c6bb9-8tpnx\" (UID: \"38a34f53-7050-4db2-9404-08a3b32e51b1\") " pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-8tpnx"
May 25 01:10:07.136041 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:07.135840    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38a34f53-7050-4db2-9404-08a3b32e51b1-tls-certs\") pod \"kube-auth-proxy-56b48c6bb9-8tpnx\" (UID: \"38a34f53-7050-4db2-9404-08a3b32e51b1\") " pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-8tpnx"
May 25 01:10:07.138256 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:07.138231    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/38a34f53-7050-4db2-9404-08a3b32e51b1-tmp\") pod \"kube-auth-proxy-56b48c6bb9-8tpnx\" (UID: \"38a34f53-7050-4db2-9404-08a3b32e51b1\") " pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-8tpnx"
May 25 01:10:07.138387 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:07.138366    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/38a34f53-7050-4db2-9404-08a3b32e51b1-tls-certs\") pod \"kube-auth-proxy-56b48c6bb9-8tpnx\" (UID: \"38a34f53-7050-4db2-9404-08a3b32e51b1\") " pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-8tpnx"
May 25 01:10:07.144133 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:07.144106    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7mf2c\" (UniqueName: \"kubernetes.io/projected/38a34f53-7050-4db2-9404-08a3b32e51b1-kube-api-access-7mf2c\") pod \"kube-auth-proxy-56b48c6bb9-8tpnx\" (UID: \"38a34f53-7050-4db2-9404-08a3b32e51b1\") " pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-8tpnx"
May 25 01:10:07.248244 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:07.248148    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-8tpnx"
May 25 01:10:07.376064 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:07.376037    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-56b48c6bb9-8tpnx"]
May 25 01:10:07.378692 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:10:07.378670    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38a34f53_7050_4db2_9404_08a3b32e51b1.slice/crio-0dcdcf93167d27b4ad7b30aa5107b8391fe4377bab30fde71e87fc41d957fa43 WatchSource:0}: Error finding container 0dcdcf93167d27b4ad7b30aa5107b8391fe4377bab30fde71e87fc41d957fa43: Status 404 returned error can't find the container with id 0dcdcf93167d27b4ad7b30aa5107b8391fe4377bab30fde71e87fc41d957fa43
May 25 01:10:08.277935 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:08.277888    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-8tpnx" event={"ID":"38a34f53-7050-4db2-9404-08a3b32e51b1","Type":"ContainerStarted","Data":"0dcdcf93167d27b4ad7b30aa5107b8391fe4377bab30fde71e87fc41d957fa43"}
May 25 01:10:10.286494 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:10.286409    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-8tpnx" event={"ID":"38a34f53-7050-4db2-9404-08a3b32e51b1","Type":"ContainerStarted","Data":"a527393298f5e372eece23a806d9f5b210a80873ab8a0acb208d786ca3738abc"}
May 25 01:10:10.307912 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:10.307861    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-56b48c6bb9-8tpnx" podStartSLOduration=1.712102531 podStartE2EDuration="4.307846115s" podCreationTimestamp="2026-05-25 01:10:06 +0000 UTC" firstStartedPulling="2026-05-25 01:10:07.380542543 +0000 UTC m=+466.250201849" lastFinishedPulling="2026-05-25 01:10:09.976286128 +0000 UTC m=+468.845945433" observedRunningTime="2026-05-25 01:10:10.306354954 +0000 UTC m=+469.176014280" watchObservedRunningTime="2026-05-25 01:10:10.307846115 +0000 UTC m=+469.177505442"
May 25 01:10:16.271400 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:10:16.271363    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-8556845d74-tzbxx"
May 25 01:11:58.575239 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:11:58.575209    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fhrjf"]
May 25 01:11:58.578652 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:11:58.578637    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fhrjf"
May 25 01:11:58.581942 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:11:58.581912    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
May 25 01:11:58.582061 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:11:58.582022    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-cr74r\""
May 25 01:11:58.582839 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:11:58.582811    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
May 25 01:11:58.582839 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:11:58.582829    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 25 01:11:58.582965 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:11:58.582821    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 25 01:11:58.586484 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:11:58.586466    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fhrjf"]
May 25 01:11:58.676717 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:11:58.676690    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/360d24fe-24a3-404e-899c-a1666ef501f5-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-fhrjf\" (UID: \"360d24fe-24a3-404e-899c-a1666ef501f5\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fhrjf"
May 25 01:11:58.676846 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:11:58.676720    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj8s7\" (UniqueName: \"kubernetes.io/projected/360d24fe-24a3-404e-899c-a1666ef501f5-kube-api-access-vj8s7\") pod \"kuadrant-console-plugin-6cb54b5c86-fhrjf\" (UID: \"360d24fe-24a3-404e-899c-a1666ef501f5\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fhrjf"
May 25 01:11:58.676846 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:11:58.676774    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/360d24fe-24a3-404e-899c-a1666ef501f5-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-fhrjf\" (UID: \"360d24fe-24a3-404e-899c-a1666ef501f5\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fhrjf"
May 25 01:11:58.777547 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:11:58.777519    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/360d24fe-24a3-404e-899c-a1666ef501f5-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-fhrjf\" (UID: \"360d24fe-24a3-404e-899c-a1666ef501f5\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fhrjf"
May 25 01:11:58.777668 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:11:58.777601    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/360d24fe-24a3-404e-899c-a1666ef501f5-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-fhrjf\" (UID: \"360d24fe-24a3-404e-899c-a1666ef501f5\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fhrjf"
May 25 01:11:58.777668 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:11:58.777630    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vj8s7\" (UniqueName: \"kubernetes.io/projected/360d24fe-24a3-404e-899c-a1666ef501f5-kube-api-access-vj8s7\") pod \"kuadrant-console-plugin-6cb54b5c86-fhrjf\" (UID: \"360d24fe-24a3-404e-899c-a1666ef501f5\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fhrjf"
May 25 01:11:58.778298 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:11:58.778243    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/360d24fe-24a3-404e-899c-a1666ef501f5-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-fhrjf\" (UID: \"360d24fe-24a3-404e-899c-a1666ef501f5\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fhrjf"
May 25 01:11:58.780088 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:11:58.780066    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/360d24fe-24a3-404e-899c-a1666ef501f5-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-fhrjf\" (UID: \"360d24fe-24a3-404e-899c-a1666ef501f5\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fhrjf"
May 25 01:11:58.788993 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:11:58.788971    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj8s7\" (UniqueName: \"kubernetes.io/projected/360d24fe-24a3-404e-899c-a1666ef501f5-kube-api-access-vj8s7\") pod \"kuadrant-console-plugin-6cb54b5c86-fhrjf\" (UID: \"360d24fe-24a3-404e-899c-a1666ef501f5\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fhrjf"
May 25 01:11:58.895760 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:11:58.895702    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fhrjf"
May 25 01:11:59.022211 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:11:59.022188    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fhrjf"]
May 25 01:11:59.024475 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:11:59.024449    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod360d24fe_24a3_404e_899c_a1666ef501f5.slice/crio-b1ceed6f6610f41327cc1bc26a12508a252d29765a8af4cf4cecdf2479f83816 WatchSource:0}: Error finding container b1ceed6f6610f41327cc1bc26a12508a252d29765a8af4cf4cecdf2479f83816: Status 404 returned error can't find the container with id b1ceed6f6610f41327cc1bc26a12508a252d29765a8af4cf4cecdf2479f83816
May 25 01:11:59.644228 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:11:59.644193    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fhrjf" event={"ID":"360d24fe-24a3-404e-899c-a1666ef501f5","Type":"ContainerStarted","Data":"b1ceed6f6610f41327cc1bc26a12508a252d29765a8af4cf4cecdf2479f83816"}
May 25 01:12:22.734390 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:12:22.734353    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fhrjf" event={"ID":"360d24fe-24a3-404e-899c-a1666ef501f5","Type":"ContainerStarted","Data":"9bf12fae36e857cfe1ebc9870bbeb0050459186070cca44333ece88340185a7e"}
May 25 01:12:22.750894 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:12:22.750846    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-fhrjf" podStartSLOduration=1.409286521 podStartE2EDuration="24.75083354s" podCreationTimestamp="2026-05-25 01:11:58 +0000 UTC" firstStartedPulling="2026-05-25 01:11:59.026118749 +0000 UTC m=+577.895778053" lastFinishedPulling="2026-05-25 01:12:22.367665765 +0000 UTC m=+601.237325072" observedRunningTime="2026-05-25 01:12:22.750484888 +0000 UTC m=+601.620144217" watchObservedRunningTime="2026-05-25 01:12:22.75083354 +0000 UTC m=+601.620492867"
May 25 01:12:52.818941 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:12:52.818906    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:12:52.851752 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:12:52.851720    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:12:52.851752 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:12:52.851750    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:12:52.851957 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:12:52.851839    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-trmtk"
May 25 01:12:52.854155 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:12:52.854132    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 25 01:12:52.960044 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:12:52.960011    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmsqr\" (UniqueName: \"kubernetes.io/projected/bc255e45-c0e8-4796-a59e-1a33c49892ed-kube-api-access-mmsqr\") pod \"limitador-limitador-78c99df468-trmtk\" (UID: \"bc255e45-c0e8-4796-a59e-1a33c49892ed\") " pod="kuadrant-system/limitador-limitador-78c99df468-trmtk"
May 25 01:12:52.960203 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:12:52.960048    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bc255e45-c0e8-4796-a59e-1a33c49892ed-config-file\") pod \"limitador-limitador-78c99df468-trmtk\" (UID: \"bc255e45-c0e8-4796-a59e-1a33c49892ed\") " pod="kuadrant-system/limitador-limitador-78c99df468-trmtk"
May 25 01:12:53.061135 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:12:53.061098    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mmsqr\" (UniqueName: \"kubernetes.io/projected/bc255e45-c0e8-4796-a59e-1a33c49892ed-kube-api-access-mmsqr\") pod \"limitador-limitador-78c99df468-trmtk\" (UID: \"bc255e45-c0e8-4796-a59e-1a33c49892ed\") " pod="kuadrant-system/limitador-limitador-78c99df468-trmtk"
May 25 01:12:53.061306 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:12:53.061143    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bc255e45-c0e8-4796-a59e-1a33c49892ed-config-file\") pod \"limitador-limitador-78c99df468-trmtk\" (UID: \"bc255e45-c0e8-4796-a59e-1a33c49892ed\") " pod="kuadrant-system/limitador-limitador-78c99df468-trmtk"
May 25 01:12:53.061800 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:12:53.061778    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bc255e45-c0e8-4796-a59e-1a33c49892ed-config-file\") pod \"limitador-limitador-78c99df468-trmtk\" (UID: \"bc255e45-c0e8-4796-a59e-1a33c49892ed\") " pod="kuadrant-system/limitador-limitador-78c99df468-trmtk"
May 25 01:12:53.068913 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:12:53.068893    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmsqr\" (UniqueName: \"kubernetes.io/projected/bc255e45-c0e8-4796-a59e-1a33c49892ed-kube-api-access-mmsqr\") pod \"limitador-limitador-78c99df468-trmtk\" (UID: \"bc255e45-c0e8-4796-a59e-1a33c49892ed\") " pod="kuadrant-system/limitador-limitador-78c99df468-trmtk"
May 25 01:12:53.161786 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:12:53.161717    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-trmtk"
May 25 01:12:53.294076 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:12:53.294042    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:12:53.296378 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:12:53.296349    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc255e45_c0e8_4796_a59e_1a33c49892ed.slice/crio-fa8154dc8eac34bc1d9eb73066c0243343334b4a1d4135ecedb765cfe3c7020d WatchSource:0}: Error finding container fa8154dc8eac34bc1d9eb73066c0243343334b4a1d4135ecedb765cfe3c7020d: Status 404 returned error can't find the container with id fa8154dc8eac34bc1d9eb73066c0243343334b4a1d4135ecedb765cfe3c7020d
May 25 01:12:53.843208 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:12:53.843165    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-trmtk" event={"ID":"bc255e45-c0e8-4796-a59e-1a33c49892ed","Type":"ContainerStarted","Data":"fa8154dc8eac34bc1d9eb73066c0243343334b4a1d4135ecedb765cfe3c7020d"}
May 25 01:12:55.851778 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:12:55.851739    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-trmtk" event={"ID":"bc255e45-c0e8-4796-a59e-1a33c49892ed","Type":"ContainerStarted","Data":"b5a10d1ee7c13a992c90a8d1068bee3ea7272774be093af7f9ed4055cc06cf63"}
May 25 01:12:55.852148 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:12:55.851805    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-trmtk"
May 25 01:12:55.866707 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:12:55.866656    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-trmtk" podStartSLOduration=1.447942254 podStartE2EDuration="3.866641981s" podCreationTimestamp="2026-05-25 01:12:52 +0000 UTC" firstStartedPulling="2026-05-25 01:12:53.298253562 +0000 UTC m=+632.167912866" lastFinishedPulling="2026-05-25 01:12:55.716953285 +0000 UTC m=+634.586612593" observedRunningTime="2026-05-25 01:12:55.864973943 +0000 UTC m=+634.734633270" watchObservedRunningTime="2026-05-25 01:12:55.866641981 +0000 UTC m=+634.736301307"
May 25 01:13:06.855598 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:13:06.855567    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-trmtk"
May 25 01:14:08.360035 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:08.360001    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:14:31.025292 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:31.025254    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:14:42.879698 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:42.879669    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"]
May 25 01:14:42.883202 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:42.883180    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:42.885399 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:42.885370    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 25 01:14:42.885516 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:42.885477    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 25 01:14:42.886428 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:42.886411    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-2lx8d\""
May 25 01:14:42.886520 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:42.886445    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 25 01:14:42.892989 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:42.892959    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"]
May 25 01:14:43.000187 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.000157    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61f08b22-3f1f-47eb-8042-4d32482d9902-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc\" (UID: \"61f08b22-3f1f-47eb-8042-4d32482d9902\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:43.000187 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.000190    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61f08b22-3f1f-47eb-8042-4d32482d9902-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc\" (UID: \"61f08b22-3f1f-47eb-8042-4d32482d9902\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:43.000389 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.000212    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61f08b22-3f1f-47eb-8042-4d32482d9902-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc\" (UID: \"61f08b22-3f1f-47eb-8042-4d32482d9902\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:43.000389 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.000283    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61f08b22-3f1f-47eb-8042-4d32482d9902-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc\" (UID: \"61f08b22-3f1f-47eb-8042-4d32482d9902\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:43.000389 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.000351    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61f08b22-3f1f-47eb-8042-4d32482d9902-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc\" (UID: \"61f08b22-3f1f-47eb-8042-4d32482d9902\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:43.000484 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.000421    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbl58\" (UniqueName: \"kubernetes.io/projected/61f08b22-3f1f-47eb-8042-4d32482d9902-kube-api-access-gbl58\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc\" (UID: \"61f08b22-3f1f-47eb-8042-4d32482d9902\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:43.101775 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.101747    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61f08b22-3f1f-47eb-8042-4d32482d9902-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc\" (UID: \"61f08b22-3f1f-47eb-8042-4d32482d9902\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:43.101775 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.101784    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61f08b22-3f1f-47eb-8042-4d32482d9902-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc\" (UID: \"61f08b22-3f1f-47eb-8042-4d32482d9902\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:43.102000 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.101981    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61f08b22-3f1f-47eb-8042-4d32482d9902-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc\" (UID: \"61f08b22-3f1f-47eb-8042-4d32482d9902\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:43.102067 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.102049    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61f08b22-3f1f-47eb-8042-4d32482d9902-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc\" (UID: \"61f08b22-3f1f-47eb-8042-4d32482d9902\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:43.102118 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.102078    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61f08b22-3f1f-47eb-8042-4d32482d9902-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc\" (UID: \"61f08b22-3f1f-47eb-8042-4d32482d9902\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:43.102161 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.102137    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gbl58\" (UniqueName: \"kubernetes.io/projected/61f08b22-3f1f-47eb-8042-4d32482d9902-kube-api-access-gbl58\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc\" (UID: \"61f08b22-3f1f-47eb-8042-4d32482d9902\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:43.102208 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.102188    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61f08b22-3f1f-47eb-8042-4d32482d9902-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc\" (UID: \"61f08b22-3f1f-47eb-8042-4d32482d9902\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:43.102347 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.102304    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61f08b22-3f1f-47eb-8042-4d32482d9902-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc\" (UID: \"61f08b22-3f1f-47eb-8042-4d32482d9902\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:43.102425 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.102309    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61f08b22-3f1f-47eb-8042-4d32482d9902-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc\" (UID: \"61f08b22-3f1f-47eb-8042-4d32482d9902\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:43.104287 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.104265    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61f08b22-3f1f-47eb-8042-4d32482d9902-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc\" (UID: \"61f08b22-3f1f-47eb-8042-4d32482d9902\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:43.104402 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.104351    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61f08b22-3f1f-47eb-8042-4d32482d9902-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc\" (UID: \"61f08b22-3f1f-47eb-8042-4d32482d9902\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:43.109429 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.109413    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbl58\" (UniqueName: \"kubernetes.io/projected/61f08b22-3f1f-47eb-8042-4d32482d9902-kube-api-access-gbl58\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc\" (UID: \"61f08b22-3f1f-47eb-8042-4d32482d9902\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:43.194012 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.193986    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:43.330394 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.330363    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"]
May 25 01:14:43.333515 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:14:43.333481    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61f08b22_3f1f_47eb_8042_4d32482d9902.slice/crio-41b1203418c9f086111c003f75a8d75f7db0a216754c1bcaf2f2023f6488be48 WatchSource:0}: Error finding container 41b1203418c9f086111c003f75a8d75f7db0a216754c1bcaf2f2023f6488be48: Status 404 returned error can't find the container with id 41b1203418c9f086111c003f75a8d75f7db0a216754c1bcaf2f2023f6488be48
May 25 01:14:43.503810 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:43.503736    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:14:44.221607 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:44.221560    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc" event={"ID":"61f08b22-3f1f-47eb-8042-4d32482d9902","Type":"ContainerStarted","Data":"41b1203418c9f086111c003f75a8d75f7db0a216754c1bcaf2f2023f6488be48"}
May 25 01:14:47.097621 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:47.097586    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:14:50.245543 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:50.245507    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc" event={"ID":"61f08b22-3f1f-47eb-8042-4d32482d9902","Type":"ContainerStarted","Data":"2c94ee514394e7759d2d42ed551a6232c82927cf5f964c8b0685f637657fec06"}
May 25 01:14:51.997701 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:51.997668    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:14:55.263216 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:55.263135    2558 generic.go:358] "Generic (PLEG): container finished" podID="61f08b22-3f1f-47eb-8042-4d32482d9902" containerID="2c94ee514394e7759d2d42ed551a6232c82927cf5f964c8b0685f637657fec06" exitCode=0
May 25 01:14:55.263581 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:55.263210    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc" event={"ID":"61f08b22-3f1f-47eb-8042-4d32482d9902","Type":"ContainerDied","Data":"2c94ee514394e7759d2d42ed551a6232c82927cf5f964c8b0685f637657fec06"}
May 25 01:14:55.263885 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:55.263868    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 01:14:56.200593 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:56.200559    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:14:57.271285 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:57.271245    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc" event={"ID":"61f08b22-3f1f-47eb-8042-4d32482d9902","Type":"ContainerStarted","Data":"23d138e6fee38c0e41c8d7aba4efaf9fd6503c2410ec37d292d56b6b30da59c8"}
May 25 01:14:57.271724 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:57.271502    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:14:57.289294 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:14:57.289244    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc" podStartSLOduration=2.339777998 podStartE2EDuration="15.289224763s" podCreationTimestamp="2026-05-25 01:14:42 +0000 UTC" firstStartedPulling="2026-05-25 01:14:43.335190069 +0000 UTC m=+742.204849377" lastFinishedPulling="2026-05-25 01:14:56.284636835 +0000 UTC m=+755.154296142" observedRunningTime="2026-05-25 01:14:57.287487577 +0000 UTC m=+756.157146916" watchObservedRunningTime="2026-05-25 01:14:57.289224763 +0000 UTC m=+756.158884134"
May 25 01:15:00.137835 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:00.137797    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29661195-k4dzk"]
May 25 01:15:00.142540 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:00.142519    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29661195-k4dzk"
May 25 01:15:00.145192 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:00.145168    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-blz4s\""
May 25 01:15:00.146796 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:00.146771    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29661195-k4dzk"]
May 25 01:15:00.253950 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:00.253916    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4vd5\" (UniqueName: \"kubernetes.io/projected/bd254da9-554e-48d1-b9e2-09132f9f8cbc-kube-api-access-c4vd5\") pod \"maas-api-key-cleanup-29661195-k4dzk\" (UID: \"bd254da9-554e-48d1-b9e2-09132f9f8cbc\") " pod="opendatahub/maas-api-key-cleanup-29661195-k4dzk"
May 25 01:15:00.355354 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:00.355295    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c4vd5\" (UniqueName: \"kubernetes.io/projected/bd254da9-554e-48d1-b9e2-09132f9f8cbc-kube-api-access-c4vd5\") pod \"maas-api-key-cleanup-29661195-k4dzk\" (UID: \"bd254da9-554e-48d1-b9e2-09132f9f8cbc\") " pod="opendatahub/maas-api-key-cleanup-29661195-k4dzk"
May 25 01:15:00.362848 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:00.362818    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4vd5\" (UniqueName: \"kubernetes.io/projected/bd254da9-554e-48d1-b9e2-09132f9f8cbc-kube-api-access-c4vd5\") pod \"maas-api-key-cleanup-29661195-k4dzk\" (UID: \"bd254da9-554e-48d1-b9e2-09132f9f8cbc\") " pod="opendatahub/maas-api-key-cleanup-29661195-k4dzk"
May 25 01:15:00.453774 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:00.453741    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29661195-k4dzk"
May 25 01:15:00.582004 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:00.581975    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29661195-k4dzk"]
May 25 01:15:00.585256 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:15:00.585228    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd254da9_554e_48d1_b9e2_09132f9f8cbc.slice/crio-0215ff5a27eeb7bb4def67282683a33b78115c88335246dd9e05e58067fa3b51 WatchSource:0}: Error finding container 0215ff5a27eeb7bb4def67282683a33b78115c88335246dd9e05e58067fa3b51: Status 404 returned error can't find the container with id 0215ff5a27eeb7bb4def67282683a33b78115c88335246dd9e05e58067fa3b51
May 25 01:15:01.286234 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:01.286200    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29661195-k4dzk" event={"ID":"bd254da9-554e-48d1-b9e2-09132f9f8cbc","Type":"ContainerStarted","Data":"0215ff5a27eeb7bb4def67282683a33b78115c88335246dd9e05e58067fa3b51"}
May 25 01:15:04.299908 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:04.299880    2558 generic.go:358] "Generic (PLEG): container finished" podID="bd254da9-554e-48d1-b9e2-09132f9f8cbc" containerID="e03fa147bc4416b04ba395d7f60c154db6a3fcb5d26fd126fc36a6826a6ee147" exitCode=0
May 25 01:15:04.300238 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:04.299963    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29661195-k4dzk" event={"ID":"bd254da9-554e-48d1-b9e2-09132f9f8cbc","Type":"ContainerDied","Data":"e03fa147bc4416b04ba395d7f60c154db6a3fcb5d26fd126fc36a6826a6ee147"}
May 25 01:15:05.431596 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:05.431572    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29661195-k4dzk"
May 25 01:15:05.604320 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:05.604226    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4vd5\" (UniqueName: \"kubernetes.io/projected/bd254da9-554e-48d1-b9e2-09132f9f8cbc-kube-api-access-c4vd5\") pod \"bd254da9-554e-48d1-b9e2-09132f9f8cbc\" (UID: \"bd254da9-554e-48d1-b9e2-09132f9f8cbc\") "
May 25 01:15:05.606636 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:05.606605    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd254da9-554e-48d1-b9e2-09132f9f8cbc-kube-api-access-c4vd5" (OuterVolumeSpecName: "kube-api-access-c4vd5") pod "bd254da9-554e-48d1-b9e2-09132f9f8cbc" (UID: "bd254da9-554e-48d1-b9e2-09132f9f8cbc"). InnerVolumeSpecName "kube-api-access-c4vd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:15:05.705712 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:05.705679    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4vd5\" (UniqueName: \"kubernetes.io/projected/bd254da9-554e-48d1-b9e2-09132f9f8cbc-kube-api-access-c4vd5\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:15:06.307826 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:06.307792    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29661195-k4dzk" event={"ID":"bd254da9-554e-48d1-b9e2-09132f9f8cbc","Type":"ContainerDied","Data":"0215ff5a27eeb7bb4def67282683a33b78115c88335246dd9e05e58067fa3b51"}
May 25 01:15:06.307826 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:06.307829    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0215ff5a27eeb7bb4def67282683a33b78115c88335246dd9e05e58067fa3b51"
May 25 01:15:06.307826 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:06.307802    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29661195-k4dzk"
May 25 01:15:08.287464 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:08.287435    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc"
May 25 01:15:53.489143 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:15:53.489058    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:16:03.896109 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:16:03.896077    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:16:12.996613 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:16:12.996575    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:16:22.793529 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:16:22.793493    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:16:31.694278 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:16:31.694241    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:16:41.992267 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:16:41.992237    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:17:53.291462 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:17:53.291427    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:18:09.790032 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:18:09.790003    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:18:47.991605 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:18:47.991524    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:19:03.992740 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:19:03.992704    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:19:18.399385 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:19:18.399352    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:19:34.592562 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:19:34.592524    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:20:32.902649 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:20:32.902569    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:20:41.499533 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:20:41.499504    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:20:58.104251 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:20:58.104217    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:21:07.813929 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:21:07.813901    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:21:24.532809 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:21:24.532778    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:21:32.620251 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:21:32.620215    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:22:05.206989 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:22:05.206904    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:22:13.520217 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:22:13.520184    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:22:22.202720 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:22:22.202683    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:22:31.013887 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:22:31.013858    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:22:38.196681 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:22:38.196649    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:22:56.403079 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:22:56.403047    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:23:08.802231 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:23:08.802190    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:23:55.691027 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:23:55.690988    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:24:01.402470 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:24:01.402432    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:24:07.894868 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:24:07.894833    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:24:15.851570 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:24:15.851537    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:24:25.391014 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:24:25.390981    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:24:33.393173 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:24:33.393138    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:24:42.594615 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:24:42.594537    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:24:50.287511 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:24:50.287479    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:24:59.199540 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:24:59.199504    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:25:08.097091 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:25:08.097046    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:25:16.897168 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:25:16.897136    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:25:25.293300 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:25:25.293261    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:25:34.393965 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:25:34.393930    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:25:42.795421 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:25:42.795390    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:25:51.194426 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:25:51.194393    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:25:59.196368 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:25:59.196321    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:26:08.903179 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:26:08.903140    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:26:18.407582 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:26:18.407500    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:28:34.307924 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:28:34.307879    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:28:39.999726 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:28:39.999693    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:29:06.793937 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:29:06.793904    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:29:13.301729 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:29:13.301656    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:29:22.006489 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:29:22.006453    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:29:32.896976 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:29:32.896944    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:29:42.297116 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:29:42.297086    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:29:53.089519 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:29:53.089483    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:30:00.136669 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:00.136630    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29661210-gv99h"]
May 25 01:30:00.137042 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:00.136988    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd254da9-554e-48d1-b9e2-09132f9f8cbc" containerName="cleanup"
May 25 01:30:00.137042 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:00.136999    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd254da9-554e-48d1-b9e2-09132f9f8cbc" containerName="cleanup"
May 25 01:30:00.137125 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:00.137092    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="bd254da9-554e-48d1-b9e2-09132f9f8cbc" containerName="cleanup"
May 25 01:30:00.140137 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:00.140121    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29661210-gv99h"
May 25 01:30:00.142424 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:00.142392    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-blz4s\""
May 25 01:30:00.153866 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:00.153842    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29661210-gv99h"]
May 25 01:30:00.207150 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:00.207114    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrtjq\" (UniqueName: \"kubernetes.io/projected/71cdb97b-af2f-401d-b5cd-5e21041aaf56-kube-api-access-xrtjq\") pod \"maas-api-key-cleanup-29661210-gv99h\" (UID: \"71cdb97b-af2f-401d-b5cd-5e21041aaf56\") " pod="opendatahub/maas-api-key-cleanup-29661210-gv99h"
May 25 01:30:00.307833 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:00.307798    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrtjq\" (UniqueName: \"kubernetes.io/projected/71cdb97b-af2f-401d-b5cd-5e21041aaf56-kube-api-access-xrtjq\") pod \"maas-api-key-cleanup-29661210-gv99h\" (UID: \"71cdb97b-af2f-401d-b5cd-5e21041aaf56\") " pod="opendatahub/maas-api-key-cleanup-29661210-gv99h"
May 25 01:30:00.316720 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:00.316692    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrtjq\" (UniqueName: \"kubernetes.io/projected/71cdb97b-af2f-401d-b5cd-5e21041aaf56-kube-api-access-xrtjq\") pod \"maas-api-key-cleanup-29661210-gv99h\" (UID: \"71cdb97b-af2f-401d-b5cd-5e21041aaf56\") " pod="opendatahub/maas-api-key-cleanup-29661210-gv99h"
May 25 01:30:00.450439 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:00.450407    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29661210-gv99h"
May 25 01:30:00.581871 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:00.581848    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29661210-gv99h"]
May 25 01:30:00.584091 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:30:00.584063    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71cdb97b_af2f_401d_b5cd_5e21041aaf56.slice/crio-009424e54ea7ce1900529144800852351c4567b9ae67432341f572d32c4871c6 WatchSource:0}: Error finding container 009424e54ea7ce1900529144800852351c4567b9ae67432341f572d32c4871c6: Status 404 returned error can't find the container with id 009424e54ea7ce1900529144800852351c4567b9ae67432341f572d32c4871c6
May 25 01:30:00.585883 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:00.585868    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 01:30:00.707820 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:00.707744    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:30:01.331697 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:01.331662    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29661210-gv99h" event={"ID":"71cdb97b-af2f-401d-b5cd-5e21041aaf56","Type":"ContainerStarted","Data":"b72d6fd75439f42a79609b730c0b05ef68181939d8dc5d46576a2225f338a785"}
May 25 01:30:01.331697 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:01.331698    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29661210-gv99h" event={"ID":"71cdb97b-af2f-401d-b5cd-5e21041aaf56","Type":"ContainerStarted","Data":"009424e54ea7ce1900529144800852351c4567b9ae67432341f572d32c4871c6"}
May 25 01:30:01.348467 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:01.348422    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29661210-gv99h" podStartSLOduration=1.348406975 podStartE2EDuration="1.348406975s" podCreationTimestamp="2026-05-25 01:30:00 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:30:01.346986989 +0000 UTC m=+1660.216646319" watchObservedRunningTime="2026-05-25 01:30:01.348406975 +0000 UTC m=+1660.218066301"
May 25 01:30:02.336293 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:02.336254    2558 generic.go:358] "Generic (PLEG): container finished" podID="71cdb97b-af2f-401d-b5cd-5e21041aaf56" containerID="b72d6fd75439f42a79609b730c0b05ef68181939d8dc5d46576a2225f338a785" exitCode=0
May 25 01:30:02.336707 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:02.336370    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29661210-gv99h" event={"ID":"71cdb97b-af2f-401d-b5cd-5e21041aaf56","Type":"ContainerDied","Data":"b72d6fd75439f42a79609b730c0b05ef68181939d8dc5d46576a2225f338a785"}
May 25 01:30:03.469110 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:03.469085    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29661210-gv99h"
May 25 01:30:03.535426 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:03.535392    2558 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrtjq\" (UniqueName: \"kubernetes.io/projected/71cdb97b-af2f-401d-b5cd-5e21041aaf56-kube-api-access-xrtjq\") pod \"71cdb97b-af2f-401d-b5cd-5e21041aaf56\" (UID: \"71cdb97b-af2f-401d-b5cd-5e21041aaf56\") "
May 25 01:30:03.537584 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:03.537556    2558 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/71cdb97b-af2f-401d-b5cd-5e21041aaf56-kube-api-access-xrtjq" (OuterVolumeSpecName: "kube-api-access-xrtjq") pod "71cdb97b-af2f-401d-b5cd-5e21041aaf56" (UID: "71cdb97b-af2f-401d-b5cd-5e21041aaf56"). InnerVolumeSpecName "kube-api-access-xrtjq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 25 01:30:03.636528 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:03.636442    2558 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrtjq\" (UniqueName: \"kubernetes.io/projected/71cdb97b-af2f-401d-b5cd-5e21041aaf56-kube-api-access-xrtjq\") on node \"ip-10-0-134-192.ec2.internal\" DevicePath \"\""
May 25 01:30:04.344740 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:04.344707    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29661210-gv99h" event={"ID":"71cdb97b-af2f-401d-b5cd-5e21041aaf56","Type":"ContainerDied","Data":"009424e54ea7ce1900529144800852351c4567b9ae67432341f572d32c4871c6"}
May 25 01:30:04.344740 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:04.344738    2558 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="009424e54ea7ce1900529144800852351c4567b9ae67432341f572d32c4871c6"
May 25 01:30:04.344740 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:04.344738    2558 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29661210-gv99h"
May 25 01:30:11.394934 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:11.394900    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:30:19.602505 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:19.602468    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:30:31.291669 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:31.291634    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:30:39.905376 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:30:39.905265    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:31:14.895249 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:31:14.895210    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:31:57.401724 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:31:57.401692    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:32:05.893713 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:32:05.893672    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:32:15.696760 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:32:15.696671    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:32:24.094937 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:32:24.094906    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:32:32.093745 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:32:32.093713    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:32:45.413003 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:32:45.412965    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:32:54.404713 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:32:54.404682    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:33:00.196381 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:33:00.196346    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:33:09.402353 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:33:09.402296    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:33:17.909246 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:33:17.909214    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:33:26.391030 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:33:26.390999    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:33:37.291284 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:33:37.291243    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:33:54.197642 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:33:54.197557    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:34:02.594416 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:34:02.594380    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:34:11.796652 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:34:11.796624    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:34:20.094181 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:34:20.094141    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:34:37.299120 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:34:37.299089    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:34:45.593550 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:34:45.593512    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:34:54.992270 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:34:54.992237    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:35:02.091267 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:35:02.091235    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:35:11.296808 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:35:11.296725    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:35:19.896777 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:35:19.896741    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:35:29.293758 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:35:29.293724    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:35:40.291014 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:35:40.290983    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:35:50.293161 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:35:50.293125    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:35:59.899850 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:35:59.899817    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:36:09.306576 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:36:09.306545    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:36:15.401947 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:36:15.401912    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:36:21.402079 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:36:21.402046    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:36:25.799369 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:36:25.799320    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:36:32.194825 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:36:32.194788    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:36:49.602664 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:36:49.602585    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:36:58.295477 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:36:58.295442    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:37:05.790868 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:37:05.790835    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:37:10.895283 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:37:10.895244    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:37:18.302689 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:37:18.302654    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:37:39.693885 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:37:39.693847    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:37:50.604628 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:37:50.604597    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-trmtk"]
May 25 01:37:59.091347 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:37:59.091301    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29661195-k4dzk_bd254da9-554e-48d1-b9e2-09132f9f8cbc/cleanup/0.log"
May 25 01:37:59.195200 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:37:59.195173    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29661210-gv99h_71cdb97b-af2f-401d-b5cd-5e21041aaf56/cleanup/0.log"
May 25 01:37:59.520579 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:37:59.520549    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6588b9546d-gtwzc_c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7/manager/0.log"
May 25 01:38:01.355035 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:01.355001    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-fhrjf_360d24fe-24a3-404e-899c-a1666ef501f5/kuadrant-console-plugin/0.log"
May 25 01:38:01.685650 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:01.685620    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-trmtk_bc255e45-c0e8-4796-a59e-1a33c49892ed/limitador/0.log"
May 25 01:38:02.325498 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:02.325464    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56b48c6bb9-8tpnx_38a34f53-7050-4db2-9404-08a3b32e51b1/kube-auth-proxy/0.log"
May 25 01:38:02.738213 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:02.738186    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85b7cb4646-2kg7w_60a10e75-26eb-4497-a652-fe509cb7282c/router/0.log"
May 25 01:38:03.066229 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:03.066155    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc_61f08b22-3f1f-47eb-8042-4d32482d9902/main/0.log"
May 25 01:38:03.071994 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:03.071964    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-8g5nc_61f08b22-3f1f-47eb-8042-4d32482d9902/storage-initializer/0.log"
May 25 01:38:07.589753 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:07.589715    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5jj4g/must-gather-cxg5c"]
May 25 01:38:07.590130 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:07.590116    2558 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="71cdb97b-af2f-401d-b5cd-5e21041aaf56" containerName="cleanup"
May 25 01:38:07.590173 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:07.590133    2558 state_mem.go:107] "Deleted CPUSet assignment" podUID="71cdb97b-af2f-401d-b5cd-5e21041aaf56" containerName="cleanup"
May 25 01:38:07.590224 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:07.590212    2558 memory_manager.go:356] "RemoveStaleState removing state" podUID="71cdb97b-af2f-401d-b5cd-5e21041aaf56" containerName="cleanup"
May 25 01:38:07.593661 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:07.593641    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5jj4g/must-gather-cxg5c"
May 25 01:38:07.596078 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:07.596057    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5jj4g\"/\"kube-root-ca.crt\""
May 25 01:38:07.596184 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:07.596140    2558 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5jj4g\"/\"openshift-service-ca.crt\""
May 25 01:38:07.596910 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:07.596890    2558 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5jj4g\"/\"default-dockercfg-mcntr\""
May 25 01:38:07.611897 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:07.611877    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5jj4g/must-gather-cxg5c"]
May 25 01:38:07.639600 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:07.639576    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsdbh\" (UniqueName: \"kubernetes.io/projected/f284fceb-4420-4fec-a622-fcf68d915b60-kube-api-access-hsdbh\") pod \"must-gather-cxg5c\" (UID: \"f284fceb-4420-4fec-a622-fcf68d915b60\") " pod="openshift-must-gather-5jj4g/must-gather-cxg5c"
May 25 01:38:07.639723 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:07.639666    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f284fceb-4420-4fec-a622-fcf68d915b60-must-gather-output\") pod \"must-gather-cxg5c\" (UID: \"f284fceb-4420-4fec-a622-fcf68d915b60\") " pod="openshift-must-gather-5jj4g/must-gather-cxg5c"
May 25 01:38:07.740451 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:07.740431    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hsdbh\" (UniqueName: \"kubernetes.io/projected/f284fceb-4420-4fec-a622-fcf68d915b60-kube-api-access-hsdbh\") pod \"must-gather-cxg5c\" (UID: \"f284fceb-4420-4fec-a622-fcf68d915b60\") " pod="openshift-must-gather-5jj4g/must-gather-cxg5c"
May 25 01:38:07.740554 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:07.740483    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f284fceb-4420-4fec-a622-fcf68d915b60-must-gather-output\") pod \"must-gather-cxg5c\" (UID: \"f284fceb-4420-4fec-a622-fcf68d915b60\") " pod="openshift-must-gather-5jj4g/must-gather-cxg5c"
May 25 01:38:07.740785 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:07.740770    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/f284fceb-4420-4fec-a622-fcf68d915b60-must-gather-output\") pod \"must-gather-cxg5c\" (UID: \"f284fceb-4420-4fec-a622-fcf68d915b60\") " pod="openshift-must-gather-5jj4g/must-gather-cxg5c"
May 25 01:38:07.748802 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:07.748781    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsdbh\" (UniqueName: \"kubernetes.io/projected/f284fceb-4420-4fec-a622-fcf68d915b60-kube-api-access-hsdbh\") pod \"must-gather-cxg5c\" (UID: \"f284fceb-4420-4fec-a622-fcf68d915b60\") " pod="openshift-must-gather-5jj4g/must-gather-cxg5c"
May 25 01:38:07.903354 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:07.903260    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5jj4g/must-gather-cxg5c"
May 25 01:38:08.030510 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:08.030484    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5jj4g/must-gather-cxg5c"]
May 25 01:38:08.032280 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:38:08.032253    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf284fceb_4420_4fec_a622_fcf68d915b60.slice/crio-04096493a55fa4b1623ad07827afeb4b2714098117442596ed9e853bf04380de WatchSource:0}: Error finding container 04096493a55fa4b1623ad07827afeb4b2714098117442596ed9e853bf04380de: Status 404 returned error can't find the container with id 04096493a55fa4b1623ad07827afeb4b2714098117442596ed9e853bf04380de
May 25 01:38:08.033903 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:08.033888    2558 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 25 01:38:08.989661 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:08.989627    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jj4g/must-gather-cxg5c" event={"ID":"f284fceb-4420-4fec-a622-fcf68d915b60","Type":"ContainerStarted","Data":"2670ec7fbce89f2921b4e7926c9d348ae8c065f04af2abf14205154961ee6602"}
May 25 01:38:08.989661 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:08.989667    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jj4g/must-gather-cxg5c" event={"ID":"f284fceb-4420-4fec-a622-fcf68d915b60","Type":"ContainerStarted","Data":"04096493a55fa4b1623ad07827afeb4b2714098117442596ed9e853bf04380de"}
May 25 01:38:09.995584 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:09.995502    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jj4g/must-gather-cxg5c" event={"ID":"f284fceb-4420-4fec-a622-fcf68d915b60","Type":"ContainerStarted","Data":"82f07f9a74fb6564571cdc4645afdea1ce72d60bd60b0db4a68d4352d2a8a356"}
May 25 01:38:10.010711 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:10.010650    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-5jj4g/must-gather-cxg5c" podStartSLOduration=2.252722843 podStartE2EDuration="3.010633212s" podCreationTimestamp="2026-05-25 01:38:07 +0000 UTC" firstStartedPulling="2026-05-25 01:38:08.0340112 +0000 UTC m=+2146.903670503" lastFinishedPulling="2026-05-25 01:38:08.791921568 +0000 UTC m=+2147.661580872" observedRunningTime="2026-05-25 01:38:10.009155131 +0000 UTC m=+2148.878814457" watchObservedRunningTime="2026-05-25 01:38:10.010633212 +0000 UTC m=+2148.880292539"
May 25 01:38:10.436882 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:10.436854    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-dvwzt_4efbd4c0-45f2-4d23-8f4e-8708d81733c8/global-pull-secret-syncer/0.log"
May 25 01:38:10.542016 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:10.541973    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-wcggc_9e31f2a1-0497-41d1-9c61-6d4dfb24caf6/konnectivity-agent/0.log"
May 25 01:38:10.591570 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:10.591528    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-192.ec2.internal_dc4742061d692c5e7a76b30e593408e2/haproxy/0.log"
May 25 01:38:14.755880 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:14.755841    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-fhrjf_360d24fe-24a3-404e-899c-a1666ef501f5/kuadrant-console-plugin/0.log"
May 25 01:38:14.888008 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:14.887965    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-trmtk_bc255e45-c0e8-4796-a59e-1a33c49892ed/limitador/0.log"
May 25 01:38:16.398651 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:16.398616    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a35ba9f-0a9f-4722-9270-4107938e4e20/alertmanager/0.log"
May 25 01:38:16.420933 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:16.420895    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a35ba9f-0a9f-4722-9270-4107938e4e20/config-reloader/0.log"
May 25 01:38:16.441517 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:16.441441    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a35ba9f-0a9f-4722-9270-4107938e4e20/kube-rbac-proxy-web/0.log"
May 25 01:38:16.461968 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:16.461858    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a35ba9f-0a9f-4722-9270-4107938e4e20/kube-rbac-proxy/0.log"
May 25 01:38:16.482585 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:16.482559    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a35ba9f-0a9f-4722-9270-4107938e4e20/kube-rbac-proxy-metric/0.log"
May 25 01:38:16.505542 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:16.505437    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a35ba9f-0a9f-4722-9270-4107938e4e20/prom-label-proxy/0.log"
May 25 01:38:16.526277 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:16.526211    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_7a35ba9f-0a9f-4722-9270-4107938e4e20/init-config-reloader/0.log"
May 25 01:38:16.567036 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:16.567002    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-pps9j_9cc4019e-1b58-4c13-a6ef-ca0b4784bd3d/cluster-monitoring-operator/0.log"
May 25 01:38:16.876682 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:16.876597    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xrlqc_872406f7-ca23-43a5-8d30-9e188a4aad12/node-exporter/0.log"
May 25 01:38:16.898908 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:16.898874    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xrlqc_872406f7-ca23-43a5-8d30-9e188a4aad12/kube-rbac-proxy/0.log"
May 25 01:38:16.922102 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:16.922074    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-xrlqc_872406f7-ca23-43a5-8d30-9e188a4aad12/init-textfile/0.log"
May 25 01:38:17.036694 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:17.036663    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fd994856-e117-4498-93bb-6b7b08adb869/prometheus/0.log"
May 25 01:38:17.070749 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:17.070716    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fd994856-e117-4498-93bb-6b7b08adb869/config-reloader/0.log"
May 25 01:38:17.094707 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:17.094657    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fd994856-e117-4498-93bb-6b7b08adb869/thanos-sidecar/0.log"
May 25 01:38:17.114372 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:17.114346    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fd994856-e117-4498-93bb-6b7b08adb869/kube-rbac-proxy-web/0.log"
May 25 01:38:17.134924 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:17.134853    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fd994856-e117-4498-93bb-6b7b08adb869/kube-rbac-proxy/0.log"
May 25 01:38:17.155801 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:17.155773    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fd994856-e117-4498-93bb-6b7b08adb869/kube-rbac-proxy-thanos/0.log"
May 25 01:38:17.175690 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:17.175664    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_fd994856-e117-4498-93bb-6b7b08adb869/init-config-reloader/0.log"
May 25 01:38:17.203804 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:17.203761    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-9fqnt_f215cb60-b0f0-44e5-962e-b872350bcf3b/prometheus-operator/0.log"
May 25 01:38:17.219759 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:17.219730    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-9fqnt_f215cb60-b0f0-44e5-962e-b872350bcf3b/kube-rbac-proxy/0.log"
May 25 01:38:17.260035 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:17.260005    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-t5vz5_99ce908f-ff7b-45df-9fb3-edf353604b29/prometheus-operator-admission-webhook/0.log"
May 25 01:38:17.362176 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:17.362146    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66df74b965-7bltj_e90ea4ee-5033-4484-b881-1f6653edc085/thanos-query/0.log"
May 25 01:38:17.380984 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:17.380954    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66df74b965-7bltj_e90ea4ee-5033-4484-b881-1f6653edc085/kube-rbac-proxy-web/0.log"
May 25 01:38:17.403493 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:17.403412    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66df74b965-7bltj_e90ea4ee-5033-4484-b881-1f6653edc085/kube-rbac-proxy/0.log"
May 25 01:38:17.422360 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:17.422313    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66df74b965-7bltj_e90ea4ee-5033-4484-b881-1f6653edc085/prom-label-proxy/0.log"
May 25 01:38:17.441551 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:17.441517    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66df74b965-7bltj_e90ea4ee-5033-4484-b881-1f6653edc085/kube-rbac-proxy-rules/0.log"
May 25 01:38:17.461263 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:17.461240    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-66df74b965-7bltj_e90ea4ee-5033-4484-b881-1f6653edc085/kube-rbac-proxy-metrics/0.log"
May 25 01:38:18.610545 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:18.610515    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-q2wpj_bce5b4a2-8f1b-423e-b437-7557cbeb6041/networking-console-plugin/0.log"
May 25 01:38:18.835707 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:18.835675    2558 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"]
May 25 01:38:18.841349 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:18.841304    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"
May 25 01:38:18.850750 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:18.850722    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"]
May 25 01:38:18.952288 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:18.952242    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjrgj\" (UniqueName: \"kubernetes.io/projected/0dbe3426-c756-4a8e-8359-a735e83e5e5b-kube-api-access-sjrgj\") pod \"perf-node-gather-daemonset-5m5cn\" (UID: \"0dbe3426-c756-4a8e-8359-a735e83e5e5b\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"
May 25 01:38:18.952490 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:18.952395    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0dbe3426-c756-4a8e-8359-a735e83e5e5b-lib-modules\") pod \"perf-node-gather-daemonset-5m5cn\" (UID: \"0dbe3426-c756-4a8e-8359-a735e83e5e5b\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"
May 25 01:38:18.952556 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:18.952523    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0dbe3426-c756-4a8e-8359-a735e83e5e5b-proc\") pod \"perf-node-gather-daemonset-5m5cn\" (UID: \"0dbe3426-c756-4a8e-8359-a735e83e5e5b\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"
May 25 01:38:18.952703 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:18.952673    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0dbe3426-c756-4a8e-8359-a735e83e5e5b-podres\") pod \"perf-node-gather-daemonset-5m5cn\" (UID: \"0dbe3426-c756-4a8e-8359-a735e83e5e5b\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"
May 25 01:38:18.952788 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:18.952769    2558 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dbe3426-c756-4a8e-8359-a735e83e5e5b-sys\") pod \"perf-node-gather-daemonset-5m5cn\" (UID: \"0dbe3426-c756-4a8e-8359-a735e83e5e5b\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"
May 25 01:38:19.054212 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:19.054176    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0dbe3426-c756-4a8e-8359-a735e83e5e5b-proc\") pod \"perf-node-gather-daemonset-5m5cn\" (UID: \"0dbe3426-c756-4a8e-8359-a735e83e5e5b\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"
May 25 01:38:19.054421 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:19.054270    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0dbe3426-c756-4a8e-8359-a735e83e5e5b-podres\") pod \"perf-node-gather-daemonset-5m5cn\" (UID: \"0dbe3426-c756-4a8e-8359-a735e83e5e5b\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"
May 25 01:38:19.054421 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:19.054279    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0dbe3426-c756-4a8e-8359-a735e83e5e5b-proc\") pod \"perf-node-gather-daemonset-5m5cn\" (UID: \"0dbe3426-c756-4a8e-8359-a735e83e5e5b\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"
May 25 01:38:19.054421 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:19.054310    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dbe3426-c756-4a8e-8359-a735e83e5e5b-sys\") pod \"perf-node-gather-daemonset-5m5cn\" (UID: \"0dbe3426-c756-4a8e-8359-a735e83e5e5b\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"
May 25 01:38:19.054421 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:19.054401    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjrgj\" (UniqueName: \"kubernetes.io/projected/0dbe3426-c756-4a8e-8359-a735e83e5e5b-kube-api-access-sjrgj\") pod \"perf-node-gather-daemonset-5m5cn\" (UID: \"0dbe3426-c756-4a8e-8359-a735e83e5e5b\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"
May 25 01:38:19.054695 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:19.054432    2558 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0dbe3426-c756-4a8e-8359-a735e83e5e5b-lib-modules\") pod \"perf-node-gather-daemonset-5m5cn\" (UID: \"0dbe3426-c756-4a8e-8359-a735e83e5e5b\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"
May 25 01:38:19.054695 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:19.054438    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0dbe3426-c756-4a8e-8359-a735e83e5e5b-podres\") pod \"perf-node-gather-daemonset-5m5cn\" (UID: \"0dbe3426-c756-4a8e-8359-a735e83e5e5b\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"
May 25 01:38:19.054695 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:19.054467    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0dbe3426-c756-4a8e-8359-a735e83e5e5b-sys\") pod \"perf-node-gather-daemonset-5m5cn\" (UID: \"0dbe3426-c756-4a8e-8359-a735e83e5e5b\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"
May 25 01:38:19.054695 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:19.054550    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0dbe3426-c756-4a8e-8359-a735e83e5e5b-lib-modules\") pod \"perf-node-gather-daemonset-5m5cn\" (UID: \"0dbe3426-c756-4a8e-8359-a735e83e5e5b\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"
May 25 01:38:19.062708 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:19.062682    2558 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjrgj\" (UniqueName: \"kubernetes.io/projected/0dbe3426-c756-4a8e-8359-a735e83e5e5b-kube-api-access-sjrgj\") pod \"perf-node-gather-daemonset-5m5cn\" (UID: \"0dbe3426-c756-4a8e-8359-a735e83e5e5b\") " pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"
May 25 01:38:19.156704 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:19.156667    2558 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"
May 25 01:38:19.332849 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:19.332825    2558 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"]
May 25 01:38:19.335105 ip-10-0-134-192 kubenswrapper[2558]: W0525 01:38:19.335068    2558 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0dbe3426_c756_4a8e_8359_a735e83e5e5b.slice/crio-f26aa7f8a11367b1fe6bf37e9ff0362aefe3927ea42473e06b9cd73ba65b878e WatchSource:0}: Error finding container f26aa7f8a11367b1fe6bf37e9ff0362aefe3927ea42473e06b9cd73ba65b878e: Status 404 returned error can't find the container with id f26aa7f8a11367b1fe6bf37e9ff0362aefe3927ea42473e06b9cd73ba65b878e
May 25 01:38:19.691015 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:19.690985    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-cj62j_732ec8d3-8185-475a-8a4c-dfbe83a19efa/download-server/0.log"
May 25 01:38:20.054312 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:20.054276    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn" event={"ID":"0dbe3426-c756-4a8e-8359-a735e83e5e5b","Type":"ContainerStarted","Data":"45865048f5ef226c0bbc8179e7f6f5c0462a4e7cf6ff47f555ad135f17514f02"}
May 25 01:38:20.054312 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:20.054313    2558 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn" event={"ID":"0dbe3426-c756-4a8e-8359-a735e83e5e5b","Type":"ContainerStarted","Data":"f26aa7f8a11367b1fe6bf37e9ff0362aefe3927ea42473e06b9cd73ba65b878e"}
May 25 01:38:20.054588 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:20.054438    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"
May 25 01:38:21.068012 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:21.067985    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cjp74_2e574b48-0e58-4e0d-b442-d80b423af7e1/dns/0.log"
May 25 01:38:21.086843 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:21.086822    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cjp74_2e574b48-0e58-4e0d-b442-d80b423af7e1/kube-rbac-proxy/0.log"
May 25 01:38:21.197095 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:21.197067    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ww4sb_e02977c4-1dc9-49ff-831d-d1f05f9e58c9/dns-node-resolver/0.log"
May 25 01:38:21.712263 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:21.712238    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-zzq7t_591fa1dd-4784-4b01-9144-9bdeab02f6df/node-ca/0.log"
May 25 01:38:22.634550 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:22.634522    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-56b48c6bb9-8tpnx_38a34f53-7050-4db2-9404-08a3b32e51b1/kube-auth-proxy/0.log"
May 25 01:38:22.786684 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:22.786647    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85b7cb4646-2kg7w_60a10e75-26eb-4497-a652-fe509cb7282c/router/0.log"
May 25 01:38:23.330094 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:23.330041    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-fmgsh_d8561800-5654-4a77-953a-f17255ab14c7/serve-healthcheck-canary/0.log"
May 25 01:38:23.926212 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:23.926185    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n2vnl_6a204a86-1245-4de2-9735-3cb129c7e636/kube-rbac-proxy/0.log"
May 25 01:38:23.945212 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:23.945186    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n2vnl_6a204a86-1245-4de2-9735-3cb129c7e636/exporter/0.log"
May 25 01:38:23.964745 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:23.964726    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n2vnl_6a204a86-1245-4de2-9735-3cb129c7e636/extractor/0.log"
May 25 01:38:25.825884 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:25.825856    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29661195-k4dzk_bd254da9-554e-48d1-b9e2-09132f9f8cbc/cleanup/0.log"
May 25 01:38:25.846204 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:25.846182    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29661210-gv99h_71cdb97b-af2f-401d-b5cd-5e21041aaf56/cleanup/0.log"
May 25 01:38:25.965907 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:25.965853    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6588b9546d-gtwzc_c9d11fec-3fe7-4fdf-9d2a-6b448c174bc7/manager/0.log"
May 25 01:38:26.067911 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:26.067883    2558 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn"
May 25 01:38:26.083435 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:26.083345    2558 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-5jj4g/perf-node-gather-daemonset-5m5cn" podStartSLOduration=8.083311615 podStartE2EDuration="8.083311615s" podCreationTimestamp="2026-05-25 01:38:18 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-25 01:38:20.07239302 +0000 UTC m=+2158.942052347" watchObservedRunningTime="2026-05-25 01:38:26.083311615 +0000 UTC m=+2164.952970944"
May 25 01:38:27.175518 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:27.175486    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-8556845d74-tzbxx_8c48b36c-0d2d-49f9-932b-88ddeeae610b/manager/0.log"
May 25 01:38:31.691587 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:31.691559    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-56w24_2ddf7c33-01aa-46fa-8447-9a787e55b30c/migrator/0.log"
May 25 01:38:31.711067 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:31.711046    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-56w24_2ddf7c33-01aa-46fa-8447-9a787e55b30c/graceful-termination/0.log"
May 25 01:38:32.059276 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:32.059199    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-rlxhg_53c7a514-5b75-49d8-b645-8a76c65eadb0/kube-storage-version-migrator-operator/1.log"
May 25 01:38:32.060133 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:32.060114    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-rlxhg_53c7a514-5b75-49d8-b645-8a76c65eadb0/kube-storage-version-migrator-operator/0.log"
May 25 01:38:33.113190 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:33.113156    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-7xh9r_882c948a-ae67-41c4-81a0-f3fb8871aaa5/kube-multus/0.log"
May 25 01:38:33.160057 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:33.160031    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qbdkp_2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154/kube-multus-additional-cni-plugins/0.log"
May 25 01:38:33.180854 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:33.180825    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qbdkp_2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154/egress-router-binary-copy/0.log"
May 25 01:38:33.199467 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:33.199441    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qbdkp_2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154/cni-plugins/0.log"
May 25 01:38:33.218208 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:33.218187    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qbdkp_2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154/bond-cni-plugin/0.log"
May 25 01:38:33.236490 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:33.236470    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qbdkp_2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154/routeoverride-cni/0.log"
May 25 01:38:33.254981 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:33.254956    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qbdkp_2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154/whereabouts-cni-bincopy/0.log"
May 25 01:38:33.275023 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:33.274998    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-qbdkp_2bd1f5e3-5de4-4ad7-86a1-b7a3edd30154/whereabouts-cni/0.log"
May 25 01:38:33.581758 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:33.581734    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tsh68_0c53f430-328a-4e17-b089-976b8d399f7c/network-metrics-daemon/0.log"
May 25 01:38:33.599058 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:33.599030    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tsh68_0c53f430-328a-4e17-b089-976b8d399f7c/kube-rbac-proxy/0.log"
May 25 01:38:34.475797 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:34.475770    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-489fr_d2840b59-ac22-4a30-a93d-14f69e48bfce/ovn-controller/0.log"
May 25 01:38:34.501402 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:34.501372    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-489fr_d2840b59-ac22-4a30-a93d-14f69e48bfce/ovn-acl-logging/0.log"
May 25 01:38:34.518560 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:34.518536    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-489fr_d2840b59-ac22-4a30-a93d-14f69e48bfce/kube-rbac-proxy-node/0.log"
May 25 01:38:34.541057 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:34.541027    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-489fr_d2840b59-ac22-4a30-a93d-14f69e48bfce/kube-rbac-proxy-ovn-metrics/0.log"
May 25 01:38:34.558406 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:34.558383    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-489fr_d2840b59-ac22-4a30-a93d-14f69e48bfce/northd/0.log"
May 25 01:38:34.579818 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:34.579799    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-489fr_d2840b59-ac22-4a30-a93d-14f69e48bfce/nbdb/0.log"
May 25 01:38:34.598307 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:34.598285    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-489fr_d2840b59-ac22-4a30-a93d-14f69e48bfce/sbdb/0.log"
May 25 01:38:34.704342 ip-10-0-134-192 kubenswrapper[2558]: I0525 01:38:34.704301    2558 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-489fr_d2840b59-ac22-4a30-a93d-14f69e48bfce/ovnkube-controller/0.log"