May 21 18:17:34.426778 ip-10-0-129-93 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 21 18:17:34.426791 ip-10-0-129-93 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 21 18:17:34.426800 ip-10-0-129-93 systemd[1]: kubelet.service: Failed with result 'resources'.
May 21 18:17:34.427110 ip-10-0-129-93 systemd[1]: Failed to start Kubernetes Kubelet.
May 21 18:17:44.493112 ip-10-0-129-93 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 21 18:17:44.493133 ip-10-0-129-93 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8b2be6e9f1e1456ab80f051b79dd65e9 --
May 21 18:20:22.964579 ip-10-0-129-93 systemd[1]: Starting Kubernetes Kubelet...
May 21 18:20:23.436984 ip-10-0-129-93 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 18:20:23.436984 ip-10-0-129-93 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 21 18:20:23.436984 ip-10-0-129-93 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 18:20:23.436984 ip-10-0-129-93 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 21 18:20:23.436984 ip-10-0-129-93 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 18:20:23.440001 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.439912    2573 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 21 18:20:23.449472 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449451    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 18:20:23.449472 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449469    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 18:20:23.449472 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449473    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 18:20:23.449567 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449476    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 18:20:23.449567 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449480    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 18:20:23.449567 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449483    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 18:20:23.449567 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449486    2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 18:20:23.449567 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449500    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 18:20:23.449567 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449503    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 18:20:23.449567 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449506    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 18:20:23.449567 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449510    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 18:20:23.449567 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449512    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 18:20:23.449567 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449515    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 18:20:23.449567 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449518    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 18:20:23.449567 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449520    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 18:20:23.449567 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449523    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 18:20:23.449567 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449526    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 18:20:23.449567 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449528    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 18:20:23.449567 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449531    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 18:20:23.449567 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449534    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 18:20:23.449567 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449537    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 18:20:23.449567 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449541    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 18:20:23.450022 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449545    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 18:20:23.450022 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449548    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 18:20:23.450022 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449551    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 18:20:23.450022 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449554    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 18:20:23.450022 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449557    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 18:20:23.450022 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449559    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 18:20:23.450022 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449562    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 18:20:23.450022 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449564    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 18:20:23.450022 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449567    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 18:20:23.450022 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449570    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 18:20:23.450022 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449573    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 18:20:23.450022 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449576    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 18:20:23.450022 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449579    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 18:20:23.450022 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449582    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 18:20:23.450022 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449585    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 18:20:23.450022 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449587    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 18:20:23.450022 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449590    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 18:20:23.450022 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449592    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 18:20:23.450022 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449597    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 18:20:23.450508 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449603    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 18:20:23.450508 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449606    2573 feature_gate.go:328] unrecognized feature gate: Example
May 21 18:20:23.450508 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449608    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 18:20:23.450508 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449611    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 18:20:23.450508 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449614    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 18:20:23.450508 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449617    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 18:20:23.450508 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449620    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 18:20:23.450508 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449622    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 18:20:23.450508 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449625    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 18:20:23.450508 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449627    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 18:20:23.450508 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449630    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 18:20:23.450508 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449632    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 18:20:23.450508 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449635    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 18:20:23.450508 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449637    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 18:20:23.450508 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449641    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 18:20:23.450508 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449643    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 18:20:23.450508 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449646    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 18:20:23.450508 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449649    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 18:20:23.450508 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449651    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 18:20:23.450508 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449654    2573 feature_gate.go:328] unrecognized feature gate: Example2
May 21 18:20:23.450983 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449657    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 18:20:23.450983 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449661    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 18:20:23.450983 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449665    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 18:20:23.450983 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449668    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 18:20:23.450983 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449671    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 18:20:23.450983 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449674    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 18:20:23.450983 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449676    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 18:20:23.450983 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449679    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 18:20:23.450983 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449682    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 18:20:23.450983 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449684    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 18:20:23.450983 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449687    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 18:20:23.450983 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449690    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 18:20:23.450983 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449692    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 18:20:23.450983 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449695    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 18:20:23.450983 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449698    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 18:20:23.450983 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449700    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 18:20:23.450983 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449703    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 18:20:23.450983 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449705    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 18:20:23.450983 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449708    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 18:20:23.451560 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449711    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 18:20:23.451560 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449713    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 18:20:23.451560 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449717    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 18:20:23.451560 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449719    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 18:20:23.451560 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449722    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 18:20:23.451560 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.449724    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 18:20:23.451560 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450127    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 18:20:23.451560 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450134    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 18:20:23.451560 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450137    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 18:20:23.451560 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450140    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 18:20:23.451560 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450143    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 18:20:23.451560 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450146    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 18:20:23.451560 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450149    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 18:20:23.451560 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450152    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 18:20:23.451560 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450155    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 18:20:23.451560 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450157    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 18:20:23.451560 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450160    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 18:20:23.451560 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450163    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 18:20:23.451560 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450165    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 18:20:23.452019 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450168    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 18:20:23.452019 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450170    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 18:20:23.452019 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450173    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 18:20:23.452019 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450175    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 18:20:23.452019 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450178    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 18:20:23.452019 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450180    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 18:20:23.452019 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450184    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 18:20:23.452019 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450186    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 18:20:23.452019 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450189    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 18:20:23.452019 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450191    2573 feature_gate.go:328] unrecognized feature gate: Example2
May 21 18:20:23.452019 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450194    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 18:20:23.452019 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450197    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 18:20:23.452019 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450200    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 18:20:23.452019 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450202    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 18:20:23.452019 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450205    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 18:20:23.452019 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450208    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 18:20:23.452019 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450210    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 18:20:23.452019 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450212    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 18:20:23.452019 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450215    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 18:20:23.452019 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450217    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 18:20:23.452538 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450221    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 18:20:23.452538 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450224    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 18:20:23.452538 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450226    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 18:20:23.452538 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450229    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 18:20:23.452538 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450232    2573 feature_gate.go:328] unrecognized feature gate: Example
May 21 18:20:23.452538 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450234    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 18:20:23.452538 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450237    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 18:20:23.452538 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450239    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 18:20:23.452538 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450242    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 18:20:23.452538 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450244    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 18:20:23.452538 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450247    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 18:20:23.452538 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450250    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 18:20:23.452538 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450253    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 18:20:23.452538 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450255    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 18:20:23.452538 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450258    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 18:20:23.452538 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450260    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 18:20:23.452538 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450263    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 18:20:23.452538 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450266    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 18:20:23.452538 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450270    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 18:20:23.452538 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450274    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 18:20:23.453042 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450277    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 18:20:23.453042 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450280    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 18:20:23.453042 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450283    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 18:20:23.453042 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450285    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 18:20:23.453042 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450288    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 18:20:23.453042 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450291    2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 18:20:23.453042 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450294    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 18:20:23.453042 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450297    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 18:20:23.453042 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450313    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 18:20:23.453042 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450316    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 18:20:23.453042 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450319    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 18:20:23.453042 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450323    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 18:20:23.453042 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450327    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 18:20:23.453042 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450330    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 18:20:23.453042 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450333    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 18:20:23.453042 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450336    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 18:20:23.453042 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450339    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 18:20:23.453042 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450342    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 18:20:23.453042 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450345    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 18:20:23.453042 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450347    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450350    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450353    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450356    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450358    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450361    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450363    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450366    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450368    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450371    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450374    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450376    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450379    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.450382    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451864    2573 flags.go:64] FLAG: --address="0.0.0.0"
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451874    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451881    2573 flags.go:64] FLAG: --anonymous-auth="true"
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451886    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451890    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451894    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451898    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 21 18:20:23.453576 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451904    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451907    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451910    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451914    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451918    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451921    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451925    2573 flags.go:64] FLAG: --cgroup-root=""
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451928    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451930    2573 flags.go:64] FLAG: --client-ca-file=""
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451933    2573 flags.go:64] FLAG: --cloud-config=""
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451936    2573 flags.go:64] FLAG: --cloud-provider="external"
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451939    2573 flags.go:64] FLAG: --cluster-dns="[]"
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451945    2573 flags.go:64] FLAG: --cluster-domain=""
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451948    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451951    2573 flags.go:64] FLAG: --config-dir=""
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451954    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451957    2573 flags.go:64] FLAG: --container-log-max-files="5"
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451961    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451965    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451968    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451972    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451975    2573 flags.go:64] FLAG: --contention-profiling="false"
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451978    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451981    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451984    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
May 21 18:20:23.454085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451988    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451992    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451995    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.451998    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452001    2573 flags.go:64] FLAG: --enable-load-reader="false"
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452004    2573 flags.go:64] FLAG: --enable-server="true"
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452007    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452011    2573 flags.go:64] FLAG: --event-burst="100"
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452014    2573 flags.go:64] FLAG: --event-qps="50"
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452017    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452023    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452026    2573 flags.go:64] FLAG: --eviction-hard=""
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452030    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452033    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452036    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452040    2573 flags.go:64] FLAG: --eviction-soft=""
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452043    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452046    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452049    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452052    2573 flags.go:64] FLAG: --experimental-mounter-path=""
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452055    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452058    2573 flags.go:64] FLAG: --fail-swap-on="true"
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452061    2573 flags.go:64] FLAG: --feature-gates=""
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452065    2573 flags.go:64] FLAG: --file-check-frequency="20s"
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452068    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 21 18:20:23.454781 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452072    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452075    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452078    2573 flags.go:64] FLAG: --healthz-port="10248"
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452081    2573 flags.go:64] FLAG: --help="false"
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452084    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-129-93.ec2.internal"
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452087    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452090    2573 flags.go:64] FLAG: --http-check-frequency="20s"
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452093    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452097    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452101    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452104    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452107    2573 flags.go:64] FLAG: --image-service-endpoint=""
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452110    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452113    2573 flags.go:64] FLAG: --kube-api-burst="100"
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452116    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452119    2573 flags.go:64] FLAG: --kube-api-qps="50"
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452122    2573 flags.go:64] FLAG: --kube-reserved=""
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452126    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452129    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452132    2573 flags.go:64] FLAG: --kubelet-cgroups=""
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452134    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452137    2573 flags.go:64] FLAG: --lock-file=""
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452140    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452143    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
May 21 18:20:23.455689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452146    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452152    2573 flags.go:64] FLAG: --log-json-split-stream="false"
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452155    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452157    2573 flags.go:64] FLAG: --log-text-split-stream="false"
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452161    2573 flags.go:64] FLAG: --logging-format="text"
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452164    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452167    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452170    2573 flags.go:64] FLAG: --manifest-url=""
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452173    2573 flags.go:64] FLAG: --manifest-url-header=""
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452177    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452180    2573 flags.go:64] FLAG: --max-open-files="1000000"
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452185    2573 flags.go:64] FLAG: --max-pods="110"
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452187    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452191    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452193    2573 flags.go:64] FLAG: --memory-manager-policy="None"
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452196    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452199    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452203    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452206    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452217    2573 flags.go:64] FLAG: --node-status-max-images="50"
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452220    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452223    2573 flags.go:64] FLAG: --oom-score-adj="-999"
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452226    2573 flags.go:64] FLAG: --pod-cidr=""
May 21 18:20:23.456281 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452230    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452236    2573 flags.go:64] FLAG: --pod-manifest-path=""
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452238    2573 flags.go:64] FLAG: --pod-max-pids="-1"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452242    2573 flags.go:64] FLAG: --pods-per-core="0"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452245    2573 flags.go:64] FLAG: --port="10250"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452248    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452251    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04b55051c8c6ea04f"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452255    2573 flags.go:64] FLAG: --qos-reserved=""
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452258    2573 flags.go:64] FLAG: --read-only-port="10255"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452261    2573 flags.go:64] FLAG: --register-node="true"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452264    2573 flags.go:64] FLAG: --register-schedulable="true"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452267    2573 flags.go:64] FLAG: --register-with-taints=""
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452270    2573 flags.go:64] FLAG: --registry-burst="10"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452274    2573 flags.go:64] FLAG: --registry-qps="5"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452277    2573 flags.go:64] FLAG: --reserved-cpus=""
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452280    2573 flags.go:64] FLAG: --reserved-memory=""
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452284    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452287    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452290    2573 flags.go:64] FLAG: --rotate-certificates="false"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452293    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452296    2573 flags.go:64] FLAG: --runonce="false"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452298    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452313    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452317    2573 flags.go:64] FLAG: --seccomp-default="false"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452320    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452323    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 21 18:20:23.456892 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452326    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452330    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452333    2573 flags.go:64] FLAG: --storage-driver-password="root"
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452336    2573 flags.go:64] FLAG: --storage-driver-secure="false"
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452339    2573 flags.go:64] FLAG: --storage-driver-table="stats"
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452342    2573 flags.go:64] FLAG: --storage-driver-user="root"
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452346    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452349    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452352    2573 flags.go:64] FLAG: --system-cgroups=""
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452355    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452361    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452364    2573 flags.go:64] FLAG: --tls-cert-file=""
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452366    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452371    2573 flags.go:64] FLAG: --tls-min-version=""
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452374    2573 flags.go:64] FLAG: --tls-private-key-file=""
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452377    2573 flags.go:64] FLAG: --topology-manager-policy="none"
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452380    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452382    2573 flags.go:64] FLAG: --topology-manager-scope="container"
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452385    2573 flags.go:64] FLAG: --v="2"
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452390    2573 flags.go:64] FLAG: --version="false"
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452394    2573 flags.go:64] FLAG: --vmodule=""
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452403    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.452406    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452500    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 18:20:23.457591 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452505    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 18:20:23.458244 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452508    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 18:20:23.458244 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452512    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 18:20:23.458244 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452515    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 18:20:23.458244 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452517    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 18:20:23.458244 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452520    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 18:20:23.458244 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452523    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 18:20:23.458244 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452526    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 18:20:23.458244 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452529    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 18:20:23.458244 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452531    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 18:20:23.458244 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452534    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 18:20:23.458244 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452538    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 18:20:23.458244 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452542    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 18:20:23.458244 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452545    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 18:20:23.458244 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452549    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 18:20:23.458244 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452551    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 18:20:23.458244 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452554    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 18:20:23.458244 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452557    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 18:20:23.458244 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452559    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 18:20:23.458244 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452562    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 18:20:23.458244 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452564    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 18:20:23.458770 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452567    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 18:20:23.458770 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452569    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 18:20:23.458770 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452572    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 18:20:23.458770 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452575    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 18:20:23.458770 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452577    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 18:20:23.458770 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452579    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 18:20:23.458770 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452582    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 18:20:23.458770 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452585    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 18:20:23.458770 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452587    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 18:20:23.458770 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452590    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 18:20:23.458770 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452593    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 18:20:23.458770 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452596    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 18:20:23.458770 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452598    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 18:20:23.458770 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452601    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 18:20:23.458770 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452605    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 18:20:23.458770 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452608    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 18:20:23.458770 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452612    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 18:20:23.458770 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452614    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 18:20:23.458770 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452617    2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 18:20:23.459237 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452620    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 18:20:23.459237 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452623    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 18:20:23.459237 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452626    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 18:20:23.459237 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452629    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 18:20:23.459237 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452632    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 18:20:23.459237 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452635    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 18:20:23.459237 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452637    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 18:20:23.459237 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452640    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 18:20:23.459237 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452642    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 18:20:23.459237 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452646    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 18:20:23.459237 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452649    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 18:20:23.459237 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452651    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 18:20:23.459237 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452654    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 18:20:23.459237 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452657    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 18:20:23.459237 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452659    2573 feature_gate.go:328] unrecognized feature gate: Example2
May 21 18:20:23.459237 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452662    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 18:20:23.459237 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452665    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 18:20:23.459237 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452668    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 18:20:23.459237 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452670    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 18:20:23.459237 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452673    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 18:20:23.459747 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452676    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 18:20:23.459747 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452678    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 18:20:23.459747 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452681    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 18:20:23.459747 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452683    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 18:20:23.459747 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452686    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 18:20:23.459747 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452689    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 18:20:23.459747 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452691    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 18:20:23.459747 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452694    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 18:20:23.459747 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452696    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 18:20:23.459747 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452699    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 18:20:23.459747 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452701    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 18:20:23.459747 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452704    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 18:20:23.459747 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452706    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 18:20:23.459747 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452709    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 18:20:23.459747 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452711    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 18:20:23.459747 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452714    2573 feature_gate.go:328] unrecognized feature gate: Example
May 21 18:20:23.459747 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452717    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 18:20:23.459747 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452720    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 18:20:23.459747 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452722    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 18:20:23.459747 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452725    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 18:20:23.460320 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452727    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 18:20:23.460320 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452732    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 18:20:23.460320 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452735    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 18:20:23.460320 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452737    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 18:20:23.460320 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.452740    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 18:20:23.460320 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.453689    2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 18:20:23.463473 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.463453    2573 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 21 18:20:23.463518 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.463474    2573 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 21 18:20:23.463550 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463538    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 18:20:23.463550 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463543    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 18:20:23.463550 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463547    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 18:20:23.463550 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463551    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 18:20:23.463656 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463555    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 18:20:23.463656 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463558    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 18:20:23.463656 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463561    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 18:20:23.463656 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463564    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 18:20:23.463656 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463567    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 18:20:23.463656 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463570    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 18:20:23.463656 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463572    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 18:20:23.463656 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463575    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 18:20:23.463656 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463578    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 18:20:23.463656 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463581    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 18:20:23.463656 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463583    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 18:20:23.463656 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463586    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 18:20:23.463656 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463589    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 18:20:23.463656 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463592    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 18:20:23.463656 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463594    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 18:20:23.463656 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463597    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 18:20:23.463656 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463600    2573 feature_gate.go:328] unrecognized feature gate: Example2
May 21 18:20:23.463656 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463602    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 18:20:23.463656 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463605    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 18:20:23.463656 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463608    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 18:20:23.464147 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463612    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 18:20:23.464147 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463616    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 18:20:23.464147 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463619    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 18:20:23.464147 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463623    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 18:20:23.464147 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463626    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 18:20:23.464147 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463630    2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 18:20:23.464147 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463633    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 18:20:23.464147 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463636    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 18:20:23.464147 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463638    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 18:20:23.464147 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463641    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 18:20:23.464147 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463644    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 18:20:23.464147 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463646    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 18:20:23.464147 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463649    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 18:20:23.464147 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463652    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 18:20:23.464147 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463655    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 18:20:23.464147 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463658    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 18:20:23.464147 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463661    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 18:20:23.464147 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463665    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 18:20:23.464147 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463668    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 18:20:23.464147 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463670    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 18:20:23.464664 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463673    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 18:20:23.464664 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463676    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 18:20:23.464664 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463679    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 18:20:23.464664 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463681    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 18:20:23.464664 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463684    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 18:20:23.464664 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463686    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 18:20:23.464664 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463689    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 18:20:23.464664 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463691    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 18:20:23.464664 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463694    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 18:20:23.464664 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463697    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 18:20:23.464664 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463700    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 18:20:23.464664 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463702    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 18:20:23.464664 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463705    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 18:20:23.464664 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463709    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 18:20:23.464664 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463711    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 18:20:23.464664 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463714    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 18:20:23.464664 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463716    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 18:20:23.464664 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463719    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 18:20:23.464664 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463722    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 18:20:23.465154 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463725    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 18:20:23.465154 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463727    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 18:20:23.465154 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463730    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 18:20:23.465154 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463732    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 18:20:23.465154 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463735    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 18:20:23.465154 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463738    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 18:20:23.465154 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463741    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 18:20:23.465154 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463744    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 18:20:23.465154 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463747    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 18:20:23.465154 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463750    2573 feature_gate.go:328] unrecognized feature gate: Example
May 21 18:20:23.465154 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463752    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 18:20:23.465154 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463755    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 18:20:23.465154 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463758    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 18:20:23.465154 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463762    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 18:20:23.465154 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463766    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 18:20:23.465154 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463768    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 18:20:23.465154 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463771    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 18:20:23.465154 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463774    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 18:20:23.465154 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463777    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 18:20:23.465643 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463780    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 18:20:23.465643 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463782    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 18:20:23.465643 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463785    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 18:20:23.465643 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463787    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 18:20:23.465643 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.463793    2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 18:20:23.465643 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463890    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 18:20:23.465643 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463895    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 18:20:23.465643 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463898    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 18:20:23.465643 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463901    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 18:20:23.465643 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463904    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 18:20:23.465643 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463906    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 18:20:23.465643 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463909    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 18:20:23.465643 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463913    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 18:20:23.465643 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463917    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 18:20:23.465643 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463920    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 18:20:23.466014 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463922    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 18:20:23.466014 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463925    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 18:20:23.466014 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463928    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 18:20:23.466014 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463931    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 18:20:23.466014 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463934    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 18:20:23.466014 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463937    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 18:20:23.466014 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463940    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 18:20:23.466014 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463942    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 18:20:23.466014 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463945    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 18:20:23.466014 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463948    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 18:20:23.466014 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463951    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 18:20:23.466014 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463953    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 18:20:23.466014 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463956    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 18:20:23.466014 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463959    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 18:20:23.466014 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463962    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 18:20:23.466014 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463964    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 18:20:23.466014 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463967    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 18:20:23.466014 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463970    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 18:20:23.466014 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463987    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 18:20:23.466014 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463991    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 18:20:23.466518 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463995    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 18:20:23.466518 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.463998    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 18:20:23.466518 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464001    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 18:20:23.466518 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464005    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 18:20:23.466518 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464008    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 18:20:23.466518 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464011    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 18:20:23.466518 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464014    2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 18:20:23.466518 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464016    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 18:20:23.466518 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464019    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 18:20:23.466518 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464022    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 18:20:23.466518 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464025    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 18:20:23.466518 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464027    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 18:20:23.466518 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464030    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 18:20:23.466518 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464033    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 18:20:23.466518 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464035    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 18:20:23.466518 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464038    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 18:20:23.466518 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464041    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 18:20:23.466518 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464044    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 18:20:23.466518 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464046    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 18:20:23.466518 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464049    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 18:20:23.467045 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464051    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 18:20:23.467045 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464054    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 18:20:23.467045 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464056    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 18:20:23.467045 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464059    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 18:20:23.467045 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464062    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 18:20:23.467045 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464065    2573 feature_gate.go:328] unrecognized feature gate: Example
May 21 18:20:23.467045 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464068    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 18:20:23.467045 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464070    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 18:20:23.467045 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464073    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 18:20:23.467045 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464076    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 18:20:23.467045 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464078    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 18:20:23.467045 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464081    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 18:20:23.467045 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464083    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 18:20:23.467045 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464086    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 18:20:23.467045 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464088    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 18:20:23.467045 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464092    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 18:20:23.467045 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464094    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 18:20:23.467045 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464097    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 18:20:23.467045 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464099    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 18:20:23.467524 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464102    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 18:20:23.467524 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464105    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 18:20:23.467524 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464107    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 18:20:23.467524 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464110    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 18:20:23.467524 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464113    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 18:20:23.467524 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464115    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 18:20:23.467524 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464118    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 18:20:23.467524 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464121    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 18:20:23.467524 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464124    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 18:20:23.467524 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464126    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 18:20:23.467524 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464129    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 18:20:23.467524 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464133    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 18:20:23.467524 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464136    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 18:20:23.467524 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464139    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 18:20:23.467524 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464142    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 18:20:23.467524 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464145    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 18:20:23.467524 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:23.464148    2573 feature_gate.go:328] unrecognized feature gate: Example2
May 21 18:20:23.467936 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.464153    2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 18:20:23.467936 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.465058    2573 server.go:962] "Client rotation is on, will bootstrap in background"
May 21 18:20:23.469932 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.469917    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 21 18:20:23.471074 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.471063    2573 server.go:1019] "Starting client certificate rotation"
May 21 18:20:23.471176 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.471159    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 18:20:23.471211 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.471199    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 18:20:23.500756 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.500736    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 18:20:23.506015 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.505997    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 18:20:23.518607 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.518590    2573 log.go:25] "Validated CRI v1 runtime API"
May 21 18:20:23.524436 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.524420    2573 log.go:25] "Validated CRI v1 image API"
May 21 18:20:23.525818 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.525800    2573 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 21 18:20:23.530325 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.530286    2573 fs.go:135] Filesystem UUIDs: map[4c61ba0f-0cd8-449f-9924-8e7afeba92ca:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c984b4af-7564-4bab-a189-f3c258439c12:/dev/nvme0n1p4]
May 21 18:20:23.530397 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.530322    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 21 18:20:23.532200 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.532184    2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 18:20:23.534651 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.534539    2573 manager.go:217] Machine: {Timestamp:2026-05-21 18:20:23.53399778 +0000 UTC m=+0.459486299 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100971 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25414919d285a838cc3346d352bbcc SystemUUID:ec254149-19d2-85a8-38cc-3346d352bbcc BootID:8b2be6e9-f1e1-456a-b80f-051b79dd65e9 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:0d:d5:12:a7:f5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:0d:d5:12:a7:f5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:da:2c:8d:5a:4a:8a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 21 18:20:23.535524 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.535514    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 21 18:20:23.535614 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.535601    2573 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 21 18:20:23.536829 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.536797    2573 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 21 18:20:23.536973 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.536831    2573 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-93.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 21 18:20:23.537019 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.536983    2573 topology_manager.go:138] "Creating topology manager with none policy"
May 21 18:20:23.537019 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.536992    2573 container_manager_linux.go:306] "Creating device plugin manager"
May 21 18:20:23.537019 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.537000    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 18:20:23.537926 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.537916    2573 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 18:20:23.540408 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.540398    2573 state_mem.go:36] "Initialized new in-memory state store"
May 21 18:20:23.540524 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.540515    2573 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 21 18:20:23.543354 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.543344    2573 kubelet.go:491] "Attempting to sync node with API server"
May 21 18:20:23.543395 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.543362    2573 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 21 18:20:23.543395 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.543374    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 21 18:20:23.543395 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.543382    2573 kubelet.go:397] "Adding apiserver pod source"
May 21 18:20:23.543395 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.543394    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 21 18:20:23.544689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.544677    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 18:20:23.544731 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.544695    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 18:20:23.548201 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.548178    2573 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 21 18:20:23.549931 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.549912    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gkxkg"
May 21 18:20:23.550577 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.550561    2573 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 21 18:20:23.551505 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.551491    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 21 18:20:23.551582 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.551532    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 21 18:20:23.551582 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.551544    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 21 18:20:23.551582 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.551554    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 21 18:20:23.551582 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.551567    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 21 18:20:23.551582 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.551577    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 21 18:20:23.551741 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.551586    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 21 18:20:23.551741 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.551595    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 21 18:20:23.551741 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.551605    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 21 18:20:23.551741 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.551615    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 21 18:20:23.551741 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.551635    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 21 18:20:23.552057 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.552047    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 21 18:20:23.553076 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.553064    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 21 18:20:23.553130 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.553080    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 21 18:20:23.554645 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:23.554620    2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 21 18:20:23.554645 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:23.554628    2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-93.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 21 18:20:23.556363 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.556348    2573 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 21 18:20:23.556438 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.556407    2573 server.go:1295] "Started kubelet"
May 21 18:20:23.556494 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.556441    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 21 18:20:23.556576 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.556528    2573 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 21 18:20:23.556615 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.556596    2573 server_v1.go:47] "podresources" method="list" useActivePods=true
May 21 18:20:23.557290 ip-10-0-129-93 systemd[1]: Started Kubernetes Kubelet.
May 21 18:20:23.558044 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.558029    2573 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 21 18:20:23.558044 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.558039    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gkxkg"
May 21 18:20:23.559997 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.559981    2573 server.go:317] "Adding debug handlers to kubelet server"
May 21 18:20:23.569324 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:23.569292    2573 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 21 18:20:23.570263 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.570247    2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-129-93.ec2.internal" not found
May 21 18:20:23.571518 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.571503    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 21 18:20:23.572128 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.572111    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 21 18:20:23.572252 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.572221    2573 volume_manager.go:295] "The desired_state_of_world populator starts"
May 21 18:20:23.572252 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.572237    2573 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 21 18:20:23.572393 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.572358    2573 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 21 18:20:23.572458 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.572406    2573 reconstruct.go:97] "Volume reconstruction finished"
May 21 18:20:23.572458 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.572414    2573 reconciler.go:26] "Reconciler: start to sync state"
May 21 18:20:23.572789 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.572773    2573 factory.go:55] Registering systemd factory
May 21 18:20:23.572864 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.572792    2573 factory.go:223] Registration of the systemd container factory successfully
May 21 18:20:23.573051 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.573033    2573 factory.go:153] Registering CRI-O factory
May 21 18:20:23.573051 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:23.573045    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-93.ec2.internal\" not found"
May 21 18:20:23.573166 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.573052    2573 factory.go:223] Registration of the crio container factory successfully
May 21 18:20:23.573166 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.573105    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 21 18:20:23.573166 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.573126    2573 factory.go:103] Registering Raw factory
May 21 18:20:23.573166 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.573138    2573 manager.go:1196] Started watching for new ooms in manager
May 21 18:20:23.573525 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.573504    2573 manager.go:319] Starting recovery of all containers
May 21 18:20:23.575118 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.575094    2573 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:20:23.578051 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:23.577880    2573 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-93.ec2.internal\" not found" node="ip-10-0-129-93.ec2.internal"
May 21 18:20:23.582782 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.582766    2573 manager.go:324] Recovery completed
May 21 18:20:23.585830 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.585808    2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-129-93.ec2.internal" not found
May 21 18:20:23.587184 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.587173    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:20:23.589450 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.589436    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:20:23.589503 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.589460    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:20:23.589503 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.589471    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientPID"
May 21 18:20:23.589928 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.589913    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 21 18:20:23.589973 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.589929    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 21 18:20:23.589973 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.589946    2573 state_mem.go:36] "Initialized new in-memory state store"
May 21 18:20:23.593987 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.593968    2573 policy_none.go:49] "None policy: Start"
May 21 18:20:23.593987 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.593989    2573 memory_manager.go:186] "Starting memorymanager" policy="None"
May 21 18:20:23.594130 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.594002    2573 state_mem.go:35] "Initializing new in-memory state store"
May 21 18:20:23.654974 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.640645    2573 manager.go:341] "Starting Device Plugin manager"
May 21 18:20:23.654974 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:23.640675    2573 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 21 18:20:23.654974 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.640688    2573 server.go:85] "Starting device plugin registration server"
May 21 18:20:23.654974 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.640973    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
May 21 18:20:23.654974 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.640986    2573 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 21 18:20:23.654974 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.641077    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 21 18:20:23.654974 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.641163    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 21 18:20:23.654974 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.641173    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 21 18:20:23.654974 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:23.641661    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 21 18:20:23.654974 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:23.641700    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-93.ec2.internal\" not found"
May 21 18:20:23.654974 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.643462    2573 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-129-93.ec2.internal" not found
May 21 18:20:23.684386 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.684347    2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 21 18:20:23.685504 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.685490    2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 21 18:20:23.685602 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.685519    2573 status_manager.go:230] "Starting to sync pod status with apiserver"
May 21 18:20:23.685602 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.685541    2573 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 21 18:20:23.685602 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.685550    2573 kubelet.go:2451] "Starting kubelet main sync loop"
May 21 18:20:23.685602 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:23.685593    2573 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 21 18:20:23.691293 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.691243    2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:20:23.741542 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.741526    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:20:23.742576 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.742562    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:20:23.742638 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.742588    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:20:23.742638 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.742599    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientPID"
May 21 18:20:23.742638 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.742623    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-93.ec2.internal"
May 21 18:20:23.749288 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.749274    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-93.ec2.internal"
May 21 18:20:23.749341 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:23.749295    2573 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-93.ec2.internal\": node \"ip-10-0-129-93.ec2.internal\" not found"
May 21 18:20:23.765219 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:23.765200    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-93.ec2.internal\" not found"
May 21 18:20:23.785844 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.785825    2573 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal"]
May 21 18:20:23.785890 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.785883    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:20:23.787550 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.787535    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:20:23.787616 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.787566    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:20:23.787616 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.787578    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientPID"
May 21 18:20:23.790098 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.790086    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:20:23.790256 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.790243    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal"
May 21 18:20:23.790299 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.790290    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:20:23.790750 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.790736    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:20:23.790750 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.790745    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:20:23.790854 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.790763    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:20:23.790854 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.790763    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:20:23.790854 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.790776    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientPID"
May 21 18:20:23.790854 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.790785    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientPID"
May 21 18:20:23.792577 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.792561    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal"
May 21 18:20:23.792657 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.792585    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 18:20:23.793221 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.793207    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientMemory"
May 21 18:20:23.793373 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.793237    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasNoDiskPressure"
May 21 18:20:23.793373 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.793251    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeHasSufficientPID"
May 21 18:20:23.814873 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:23.814853    2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-93.ec2.internal\" not found" node="ip-10-0-129-93.ec2.internal"
May 21 18:20:23.818648 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:23.818631    2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-93.ec2.internal\" not found" node="ip-10-0-129-93.ec2.internal"
May 21 18:20:23.866101 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:23.866077    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-93.ec2.internal\" not found"
May 21 18:20:23.873596 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.873575    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a36d1bf3dd39f696cd9d4745837fcdf6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal\" (UID: \"a36d1bf3dd39f696cd9d4745837fcdf6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal"
May 21 18:20:23.873661 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.873600    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a36d1bf3dd39f696cd9d4745837fcdf6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal\" (UID: \"a36d1bf3dd39f696cd9d4745837fcdf6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal"
May 21 18:20:23.873661 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.873618    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8c9b756d2e1c708a8c4a862520c8414-config\") pod \"kube-apiserver-proxy-ip-10-0-129-93.ec2.internal\" (UID: \"a8c9b756d2e1c708a8c4a862520c8414\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal"
May 21 18:20:23.966502 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:23.966408    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-93.ec2.internal\" not found"
May 21 18:20:23.974759 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.974735    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a36d1bf3dd39f696cd9d4745837fcdf6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal\" (UID: \"a36d1bf3dd39f696cd9d4745837fcdf6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal"
May 21 18:20:23.974855 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.974771    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a36d1bf3dd39f696cd9d4745837fcdf6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal\" (UID: \"a36d1bf3dd39f696cd9d4745837fcdf6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal"
May 21 18:20:23.974855 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.974799    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8c9b756d2e1c708a8c4a862520c8414-config\") pod \"kube-apiserver-proxy-ip-10-0-129-93.ec2.internal\" (UID: \"a8c9b756d2e1c708a8c4a862520c8414\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal"
May 21 18:20:23.974855 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.974832    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a36d1bf3dd39f696cd9d4745837fcdf6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal\" (UID: \"a36d1bf3dd39f696cd9d4745837fcdf6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal"
May 21 18:20:23.974855 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.974842    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a8c9b756d2e1c708a8c4a862520c8414-config\") pod \"kube-apiserver-proxy-ip-10-0-129-93.ec2.internal\" (UID: \"a8c9b756d2e1c708a8c4a862520c8414\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal"
May 21 18:20:23.974855 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:23.974846    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a36d1bf3dd39f696cd9d4745837fcdf6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal\" (UID: \"a36d1bf3dd39f696cd9d4745837fcdf6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal"
May 21 18:20:24.067172 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:24.067147    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-93.ec2.internal\" not found"
May 21 18:20:24.117554 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:24.117536    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal"
May 21 18:20:24.121208 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:24.121189    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal"
May 21 18:20:24.167835 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:24.167801    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-93.ec2.internal\" not found"
May 21 18:20:24.268292 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:24.268257    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-93.ec2.internal\" not found"
May 21 18:20:24.368766 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:24.368731    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-93.ec2.internal\" not found"
May 21 18:20:24.469193 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:24.469163    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-93.ec2.internal\" not found"
May 21 18:20:24.470273 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:24.470254    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 21 18:20:24.470435 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:24.470414    2573 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 18:20:24.470491 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:24.470444    2573 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 18:20:24.560146 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:24.560108    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 18:15:23 +0000 UTC" deadline="2027-12-29 11:16:42.003484493 +0000 UTC"
May 21 18:20:24.560146 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:24.560142    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14080h56m17.443344963s"
May 21 18:20:24.570273 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:24.570249    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-93.ec2.internal\" not found"
May 21 18:20:24.572383 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:24.572365    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 21 18:20:24.591336 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:24.591299    2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 18:20:24.613047 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:24.613025    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-428wm"
May 21 18:20:24.621403 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:24.621386    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-428wm"
May 21 18:20:24.640218 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:24.640179    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda36d1bf3dd39f696cd9d4745837fcdf6.slice/crio-9e8c045ee7b4c086deef60a38b5fdbd70352b560f2d8a7ccd127c32ce4d02c41 WatchSource:0}: Error finding container 9e8c045ee7b4c086deef60a38b5fdbd70352b560f2d8a7ccd127c32ce4d02c41: Status 404 returned error can't find the container with id 9e8c045ee7b4c086deef60a38b5fdbd70352b560f2d8a7ccd127c32ce4d02c41
May 21 18:20:24.640478 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:24.640455    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8c9b756d2e1c708a8c4a862520c8414.slice/crio-86c5a6eebce02c94c679203fe5654634e899b2b81ccbb911ff58c9024ae304cf WatchSource:0}: Error finding container 86c5a6eebce02c94c679203fe5654634e899b2b81ccbb911ff58c9024ae304cf: Status 404 returned error can't find the container with id 86c5a6eebce02c94c679203fe5654634e899b2b81ccbb911ff58c9024ae304cf
May 21 18:20:24.644233 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:24.644219    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 18:20:24.671170 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:24.671145    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-93.ec2.internal\" not found"
May 21 18:20:24.688385 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:24.688343    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal" event={"ID":"a8c9b756d2e1c708a8c4a862520c8414","Type":"ContainerStarted","Data":"86c5a6eebce02c94c679203fe5654634e899b2b81ccbb911ff58c9024ae304cf"}
May 21 18:20:24.689340 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:24.689319    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal" event={"ID":"a36d1bf3dd39f696cd9d4745837fcdf6","Type":"ContainerStarted","Data":"9e8c045ee7b4c086deef60a38b5fdbd70352b560f2d8a7ccd127c32ce4d02c41"}
May 21 18:20:24.715473 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:24.715454    2573 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:20:24.772449 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:24.772433    2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal"
May 21 18:20:24.785949 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:24.785900    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 18:20:24.787515 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:24.787503    2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal"
May 21 18:20:24.795985 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:24.795967    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 18:20:24.996648 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:24.996573    2573 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:20:25.544551 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.544522    2573 apiserver.go:52] "Watching apiserver"
May 21 18:20:25.554784 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.554750    2573 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 21 18:20:25.556449 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.556414    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-bqjkb","openshift-network-diagnostics/network-check-target-r5cbv","kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm","openshift-multus/multus-additional-cni-plugins-wgwk8","openshift-network-operator/iptables-alerter-cl4cx","openshift-ovn-kubernetes/ovnkube-node-9qv8k","kube-system/konnectivity-agent-drjkn","openshift-cluster-node-tuning-operator/tuned-kvhnk","openshift-dns/node-resolver-jtz2j","openshift-image-registry/node-ca-7fgmq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal","openshift-multus/multus-mjrm9"]
May 21 18:20:25.559098 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.559074    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.560672 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.560651    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:25.560779 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:25.560743    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r5cbv" podUID="b0fe80cd-1e55-4221-b6ab-c1bc26507d4f"
May 21 18:20:25.561949 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.561926    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 21 18:20:25.562287 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.562266    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.562383 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.562369    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-9wzpb\""
May 21 18:20:25.563613 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.563455    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 21 18:20:25.563613 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.563509    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 21 18:20:25.563613 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.563540    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 21 18:20:25.563613 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.563516    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 21 18:20:25.563907 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.563515    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 21 18:20:25.564601 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.564585    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.565353 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.565325    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 21 18:20:25.566284 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.566179    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-pbl6l\""
May 21 18:20:25.566284 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.566233    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 21 18:20:25.566502 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.566334    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 21 18:20:25.566941 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.566921    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 21 18:20:25.567113 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.567070    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 21 18:20:25.567278 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.567262    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b7d54\""
May 21 18:20:25.567407 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.567389    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 21 18:20:25.567543 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.567467    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 21 18:20:25.567613 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.567587    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 21 18:20:25.569091 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.569072    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cl4cx"
May 21 18:20:25.569181 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.569165    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:25.569244 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:25.569223    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqjkb" podUID="f22b878b-cf41-4a22-bbda-ac4a10922613"
May 21 18:20:25.571543 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.571524    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-8v9cq\""
May 21 18:20:25.571656 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.571627    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 21 18:20:25.571803 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.571778    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 21 18:20:25.571905 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.571888    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 21 18:20:25.572073 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.572054    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-drjkn"
May 21 18:20:25.574692 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.574596    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 21 18:20:25.574692 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.574628    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 21 18:20:25.574844 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.574785    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sx62s\""
May 21 18:20:25.576638 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.576610    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.576742 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.576687    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jtz2j"
May 21 18:20:25.578814 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.578607    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7fgmq"
May 21 18:20:25.579126 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.579099    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-n8qtt\""
May 21 18:20:25.579232 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.579151    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 21 18:20:25.579232 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.579191    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 21 18:20:25.579444 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.579421    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 21 18:20:25.579565 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.579543    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 21 18:20:25.579642 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.579605    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j58fw\""
May 21 18:20:25.580099 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.580081    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.581059 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.581039    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 21 18:20:25.581168 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.581110    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 21 18:20:25.581168 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.581127    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-cmsx9\""
May 21 18:20:25.581325 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.581292    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 21 18:20:25.582940 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.582915    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-modprobe-d\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.583019 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.582961    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-sysctl-d\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.583019 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.582995    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-run-systemd\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.583128 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.583026    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qstd\" (UniqueName: \"kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd\") pod \"network-check-target-r5cbv\" (UID: \"b0fe80cd-1e55-4221-b6ab-c1bc26507d4f\") " pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:25.583128 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.583085    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-run-openvswitch\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.583352 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.583111    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.583430 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.583378    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9e2ab0cd-745a-4109-ab04-75eaaf550474-env-overrides\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.583430 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.583419    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/43b5ce2c-e682-449f-81d3-780df92bcd5a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.583528 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.583450    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs\") pod \"network-metrics-daemon-bqjkb\" (UID: \"f22b878b-cf41-4a22-bbda-ac4a10922613\") " pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:25.583528 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.583481    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ca4b82ca-d15d-4d1a-91be-c3b4fe425179-konnectivity-ca\") pod \"konnectivity-agent-drjkn\" (UID: \"ca4b82ca-d15d-4d1a-91be-c3b4fe425179\") " pod="kube-system/konnectivity-agent-drjkn"
May 21 18:20:25.583615 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.583510    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-sysconfig\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.583615 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.583569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn9xz\" (UniqueName: \"kubernetes.io/projected/f2de33e8-989e-42a0-84ec-d4375e51fab6-kube-api-access-zn9xz\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.583707 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.583617    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-kubelet\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.583707 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.583647    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-run-netns\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.583794 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.583767    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.583841 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.583797    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-socket-dir\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.583841 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.583827    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcnb2\" (UniqueName: \"kubernetes.io/projected/4fbe8f73-9a79-4400-9952-1f203e2f400e-kube-api-access-rcnb2\") pod \"iptables-alerter-cl4cx\" (UID: \"4fbe8f73-9a79-4400-9952-1f203e2f400e\") " pod="openshift-network-operator/iptables-alerter-cl4cx"
May 21 18:20:25.583929 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.583884    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fwtwg\" (UniqueName: \"kubernetes.io/projected/f22b878b-cf41-4a22-bbda-ac4a10922613-kube-api-access-fwtwg\") pod \"network-metrics-daemon-bqjkb\" (UID: \"f22b878b-cf41-4a22-bbda-ac4a10922613\") " pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:25.583975 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.583943    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-host\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.584020 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.583972    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-sys\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.584067 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.584016    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-var-lib-kubelet\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.584119 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.584088    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-slash\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.584161 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.584150    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43b5ce2c-e682-449f-81d3-780df92bcd5a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.584206 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.584173    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43b5ce2c-e682-449f-81d3-780df92bcd5a-system-cni-dir\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.584254 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.584232    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-kubernetes\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.584333 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.584259    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-sysctl-conf\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.584333 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.584316    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.584437 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.584346    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/43b5ce2c-e682-449f-81d3-780df92bcd5a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.584437 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.584368    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ca4b82ca-d15d-4d1a-91be-c3b4fe425179-agent-certs\") pod \"konnectivity-agent-drjkn\" (UID: \"ca4b82ca-d15d-4d1a-91be-c3b4fe425179\") " pod="kube-system/konnectivity-agent-drjkn"
May 21 18:20:25.584526 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.584451    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-node-log\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.584526 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.584477    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-cni-netd\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.586156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.584536    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43b5ce2c-e682-449f-81d3-780df92bcd5a-cnibin\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.586156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.584734    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-etc-openvswitch\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.586156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.584769    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2de33e8-989e-42a0-84ec-d4375e51fab6-tmp\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.586156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.584782    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-s4nk7\""
May 21 18:20:25.586156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.584885    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9e2ab0cd-745a-4109-ab04-75eaaf550474-ovnkube-script-lib\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.586156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.585065    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 21 18:20:25.586156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.585118    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnmtg\" (UniqueName: \"kubernetes.io/projected/9e2ab0cd-745a-4109-ab04-75eaaf550474-kube-api-access-mnmtg\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.586156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.585150    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-systemd\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.586156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.585214    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-systemd-units\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.586156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.585248    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-run-ovn\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.586156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.585327    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9e2ab0cd-745a-4109-ab04-75eaaf550474-ovnkube-config\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.586156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.585372    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-run\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.586156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.585604    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-log-socket\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.586156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.585685    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-cni-bin\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.586156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.585740    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-sys-fs\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.586156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.585777    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4fbe8f73-9a79-4400-9952-1f203e2f400e-iptables-alerter-script\") pod \"iptables-alerter-cl4cx\" (UID: \"4fbe8f73-9a79-4400-9952-1f203e2f400e\") " pod="openshift-network-operator/iptables-alerter-cl4cx"
May 21 18:20:25.586156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.585812    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fbe8f73-9a79-4400-9952-1f203e2f400e-host-slash\") pod \"iptables-alerter-cl4cx\" (UID: \"4fbe8f73-9a79-4400-9952-1f203e2f400e\") " pod="openshift-network-operator/iptables-alerter-cl4cx"
May 21 18:20:25.586156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.585841    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-lib-modules\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.587009 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.585871    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e2ab0cd-745a-4109-ab04-75eaaf550474-ovn-node-metrics-cert\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.587009 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.585921    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqtcn\" (UniqueName: \"kubernetes.io/projected/43b5ce2c-e682-449f-81d3-780df92bcd5a-kube-api-access-tqtcn\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.587009 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.585983    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-tuned\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.587009 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.586067    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-var-lib-openvswitch\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.587009 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.586122    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-registration-dir\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.587009 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.586234    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-etc-selinux\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.587009 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.586294    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/43b5ce2c-e682-449f-81d3-780df92bcd5a-os-release\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.587009 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.586384    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-device-dir\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.587009 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.586434    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs6z9\" (UniqueName: \"kubernetes.io/projected/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-kube-api-access-qs6z9\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.587009 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.586811    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43b5ce2c-e682-449f-81d3-780df92bcd5a-cni-binary-copy\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.622062 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.622029    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 18:15:24 +0000 UTC" deadline="2028-02-04 18:44:35.670970518 +0000 UTC"
May 21 18:20:25.622158 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.622062    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14976h24m10.048912842s"
May 21 18:20:25.630512 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.630495    2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:20:25.670296 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.670265    2573 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 18:20:25.673534 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.673509    2573 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 21 18:20:25.687028 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687003    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-hostroot\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.687160 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687038    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-multus-conf-dir\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.687160 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687080    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-run\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.687160 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687108    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-log-socket\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.687160 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687134    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-cni-bin\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.687160 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687160    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-sys-fs\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.687428 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687160    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-run\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.687428 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687186    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4fbe8f73-9a79-4400-9952-1f203e2f400e-iptables-alerter-script\") pod \"iptables-alerter-cl4cx\" (UID: \"4fbe8f73-9a79-4400-9952-1f203e2f400e\") " pod="openshift-network-operator/iptables-alerter-cl4cx"
May 21 18:20:25.687428 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687212    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fbe8f73-9a79-4400-9952-1f203e2f400e-host-slash\") pod \"iptables-alerter-cl4cx\" (UID: \"4fbe8f73-9a79-4400-9952-1f203e2f400e\") " pod="openshift-network-operator/iptables-alerter-cl4cx"
May 21 18:20:25.687428 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687217    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-cni-bin\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.687428 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687221    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-log-socket\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.687428 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687239    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-host-var-lib-kubelet\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.687428 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687263    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-lib-modules\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.687428 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687263    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-sys-fs\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.687428 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687282    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4fbe8f73-9a79-4400-9952-1f203e2f400e-host-slash\") pod \"iptables-alerter-cl4cx\" (UID: \"4fbe8f73-9a79-4400-9952-1f203e2f400e\") " pod="openshift-network-operator/iptables-alerter-cl4cx"
May 21 18:20:25.687428 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687287    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3f4defa-2429-43c6-aee6-c8ac57ad956b-host\") pod \"node-ca-7fgmq\" (UID: \"e3f4defa-2429-43c6-aee6-c8ac57ad956b\") " pod="openshift-image-registry/node-ca-7fgmq"
May 21 18:20:25.687428 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687346    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3f4defa-2429-43c6-aee6-c8ac57ad956b-serviceca\") pod \"node-ca-7fgmq\" (UID: \"e3f4defa-2429-43c6-aee6-c8ac57ad956b\") " pod="openshift-image-registry/node-ca-7fgmq"
May 21 18:20:25.687428 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687376    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-multus-cni-dir\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.687428 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687406    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e2ab0cd-745a-4109-ab04-75eaaf550474-ovn-node-metrics-cert\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.688006 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687469    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tqtcn\" (UniqueName: \"kubernetes.io/projected/43b5ce2c-e682-449f-81d3-780df92bcd5a-kube-api-access-tqtcn\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.688006 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687502    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3632a020-9a04-421c-8049-cb069bbd909a-hosts-file\") pod \"node-resolver-jtz2j\" (UID: \"3632a020-9a04-421c-8049-cb069bbd909a\") " pod="openshift-dns/node-resolver-jtz2j"
May 21 18:20:25.688006 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687532    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-host-var-lib-cni-multus\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.688006 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687531    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-lib-modules\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.688006 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687558    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crbff\" (UniqueName: \"kubernetes.io/projected/dfaf793c-3d9d-49d8-bc01-6956c6da2076-kube-api-access-crbff\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.688006 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687624    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-tuned\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.688006 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687655    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-var-lib-openvswitch\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.688006 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687708    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-registration-dir\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.688006 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687733    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-etc-selinux\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.688006 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687739    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-var-lib-openvswitch\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.688006 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687760    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/43b5ce2c-e682-449f-81d3-780df92bcd5a-os-release\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.688006 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687780    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 21 18:20:25.688006 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687802    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-registration-dir\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.688006 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687811    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-host-run-netns\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.688006 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687845    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4fbe8f73-9a79-4400-9952-1f203e2f400e-iptables-alerter-script\") pod \"iptables-alerter-cl4cx\" (UID: \"4fbe8f73-9a79-4400-9952-1f203e2f400e\") " pod="openshift-network-operator/iptables-alerter-cl4cx"
May 21 18:20:25.688006 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687859    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-device-dir\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.688006 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687867    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-etc-selinux\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.688795 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687890    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qs6z9\" (UniqueName: \"kubernetes.io/projected/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-kube-api-access-qs6z9\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.688795 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687895    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/43b5ce2c-e682-449f-81d3-780df92bcd5a-os-release\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.688795 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687920    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-device-dir\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.688795 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687920    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43b5ce2c-e682-449f-81d3-780df92bcd5a-cni-binary-copy\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.688795 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687956    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-modprobe-d\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.688795 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.687984    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-sysctl-d\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.688795 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.688013    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-run-systemd\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.688795 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.688043    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qstd\" (UniqueName: \"kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd\") pod \"network-check-target-r5cbv\" (UID: \"b0fe80cd-1e55-4221-b6ab-c1bc26507d4f\") " pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:25.688795 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.688096    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-os-release\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.688795 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.688124    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-run-openvswitch\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.688795 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.688140    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-modprobe-d\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.688795 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.688152    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.688795 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.688182    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9e2ab0cd-745a-4109-ab04-75eaaf550474-env-overrides\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.688795 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.688205    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-run-systemd\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.688795 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.688229    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/43b5ce2c-e682-449f-81d3-780df92bcd5a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.688795 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.688259    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-sysctl-d\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.688795 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.688255    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.689586 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.688283    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs\") pod \"network-metrics-daemon-bqjkb\" (UID: \"f22b878b-cf41-4a22-bbda-ac4a10922613\") " pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:25.689586 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.688354    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-run-openvswitch\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.689586 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:25.688562    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:25.689586 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:25.688664    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs podName:f22b878b-cf41-4a22-bbda-ac4a10922613 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:26.188601766 +0000 UTC m=+3.114090275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs") pod "network-metrics-daemon-bqjkb" (UID: "f22b878b-cf41-4a22-bbda-ac4a10922613") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:25.689586 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.688656    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43b5ce2c-e682-449f-81d3-780df92bcd5a-cni-binary-copy\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.689586 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.688833    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ca4b82ca-d15d-4d1a-91be-c3b4fe425179-konnectivity-ca\") pod \"konnectivity-agent-drjkn\" (UID: \"ca4b82ca-d15d-4d1a-91be-c3b4fe425179\") " pod="kube-system/konnectivity-agent-drjkn"
May 21 18:20:25.689586 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.688883    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-system-cni-dir\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.689586 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.688931    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-host-var-lib-cni-bin\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.689586 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.688962    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9e2ab0cd-745a-4109-ab04-75eaaf550474-env-overrides\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.689586 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.688959    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-sysconfig\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.689586 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689025    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zn9xz\" (UniqueName: \"kubernetes.io/projected/f2de33e8-989e-42a0-84ec-d4375e51fab6-kube-api-access-zn9xz\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.689586 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689059    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-kubelet\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.689586 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689085    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-run-netns\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.689586 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689144    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.689586 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689143    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/43b5ce2c-e682-449f-81d3-780df92bcd5a-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.689586 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689144    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-kubelet\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.689586 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689188    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-socket-dir\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.690366 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689219    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-run-netns\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.690366 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689239    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rcnb2\" (UniqueName: \"kubernetes.io/projected/4fbe8f73-9a79-4400-9952-1f203e2f400e-kube-api-access-rcnb2\") pod \"iptables-alerter-cl4cx\" (UID: \"4fbe8f73-9a79-4400-9952-1f203e2f400e\") " pod="openshift-network-operator/iptables-alerter-cl4cx"
May 21 18:20:25.690366 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689265    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fwtwg\" (UniqueName: \"kubernetes.io/projected/f22b878b-cf41-4a22-bbda-ac4a10922613-kube-api-access-fwtwg\") pod \"network-metrics-daemon-bqjkb\" (UID: \"f22b878b-cf41-4a22-bbda-ac4a10922613\") " pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:25.690366 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689261    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-sysconfig\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.690366 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689297    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-host\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.690366 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689339    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-sys\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.690366 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689374    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.690366 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689365    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-var-lib-kubelet\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.690366 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689433    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-slash\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.690366 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689462    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-var-lib-kubelet\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.690366 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689463    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43b5ce2c-e682-449f-81d3-780df92bcd5a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.690366 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689493    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-slash\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.690366 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689509    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ca4b82ca-d15d-4d1a-91be-c3b4fe425179-konnectivity-ca\") pod \"konnectivity-agent-drjkn\" (UID: \"ca4b82ca-d15d-4d1a-91be-c3b4fe425179\") " pod="kube-system/konnectivity-agent-drjkn"
May 21 18:20:25.690366 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689499    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-etc-kubernetes\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.690366 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689554    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43b5ce2c-e682-449f-81d3-780df92bcd5a-system-cni-dir\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.690366 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689564    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-sys\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.690366 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689580    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43b5ce2c-e682-449f-81d3-780df92bcd5a-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.691111 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689585    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3632a020-9a04-421c-8049-cb069bbd909a-tmp-dir\") pod \"node-resolver-jtz2j\" (UID: \"3632a020-9a04-421c-8049-cb069bbd909a\") " pod="openshift-dns/node-resolver-jtz2j"
May 21 18:20:25.691111 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689609    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-host\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.691111 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689612    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-kubernetes\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.691111 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689644    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-sysctl-conf\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.691111 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689635    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43b5ce2c-e682-449f-81d3-780df92bcd5a-system-cni-dir\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.691111 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689655    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-kubernetes\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.691111 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689682    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-socket-dir\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.691111 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689675    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.691111 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689721    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/43b5ce2c-e682-449f-81d3-780df92bcd5a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.691111 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689741    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ca4b82ca-d15d-4d1a-91be-c3b4fe425179-agent-certs\") pod \"konnectivity-agent-drjkn\" (UID: \"ca4b82ca-d15d-4d1a-91be-c3b4fe425179\") " pod="kube-system/konnectivity-agent-drjkn"
May 21 18:20:25.691111 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689752    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-run-ovn-kubernetes\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.691111 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689765    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-sysctl-conf\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.691111 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689771    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82zjt\" (UniqueName: \"kubernetes.io/projected/e3f4defa-2429-43c6-aee6-c8ac57ad956b-kube-api-access-82zjt\") pod \"node-ca-7fgmq\" (UID: \"e3f4defa-2429-43c6-aee6-c8ac57ad956b\") " pod="openshift-image-registry/node-ca-7fgmq"
May 21 18:20:25.691111 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689795    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-cnibin\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.691111 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689833    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-node-log\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.691111 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689880    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-cni-netd\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.691111 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689906    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43b5ce2c-e682-449f-81d3-780df92bcd5a-cnibin\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.691857 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689930    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-node-log\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.691857 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689932    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfaf793c-3d9d-49d8-bc01-6956c6da2076-cni-binary-copy\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.691857 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689977    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-host-run-multus-certs\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.691857 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.689971    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43b5ce2c-e682-449f-81d3-780df92bcd5a-cnibin\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.691857 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.690037    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-etc-openvswitch\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.691857 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.690086    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-multus-socket-dir-parent\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.691857 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.690113    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2de33e8-989e-42a0-84ec-d4375e51fab6-tmp\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.691857 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.690037    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-host-cni-netd\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.691857 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.690136    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9e2ab0cd-745a-4109-ab04-75eaaf550474-ovnkube-script-lib\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.691857 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.690161    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-etc-openvswitch\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.691857 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.690184    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mnmtg\" (UniqueName: \"kubernetes.io/projected/9e2ab0cd-745a-4109-ab04-75eaaf550474-kube-api-access-mnmtg\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.691857 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.690229    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/43b5ce2c-e682-449f-81d3-780df92bcd5a-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.691857 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.690856    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9e2ab0cd-745a-4109-ab04-75eaaf550474-ovnkube-script-lib\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.691857 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.691019    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-host-run-k8s-cni-cncf-io\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.691857 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.691054    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dfaf793c-3d9d-49d8-bc01-6956c6da2076-multus-daemon-config\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.691857 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.691117    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-systemd\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.691857 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.691341    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-systemd\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.692664 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.692062    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9e2ab0cd-745a-4109-ab04-75eaaf550474-ovn-node-metrics-cert\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.692664 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.692284    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-systemd-units\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.692664 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.692339    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-run-ovn\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.692664 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.692367    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9e2ab0cd-745a-4109-ab04-75eaaf550474-ovnkube-config\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.692664 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.692373    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-systemd-units\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.692664 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.692406    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqhxh\" (UniqueName: \"kubernetes.io/projected/3632a020-9a04-421c-8049-cb069bbd909a-kube-api-access-mqhxh\") pod \"node-resolver-jtz2j\" (UID: \"3632a020-9a04-421c-8049-cb069bbd909a\") " pod="openshift-dns/node-resolver-jtz2j"
May 21 18:20:25.692664 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.692446    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ca4b82ca-d15d-4d1a-91be-c3b4fe425179-agent-certs\") pod \"konnectivity-agent-drjkn\" (UID: \"ca4b82ca-d15d-4d1a-91be-c3b4fe425179\") " pod="kube-system/konnectivity-agent-drjkn"
May 21 18:20:25.692664 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.692445    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9e2ab0cd-745a-4109-ab04-75eaaf550474-run-ovn\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.693110 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.692683    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f2de33e8-989e-42a0-84ec-d4375e51fab6-etc-tuned\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.693110 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.692871    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9e2ab0cd-745a-4109-ab04-75eaaf550474-ovnkube-config\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.697137 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.693775    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f2de33e8-989e-42a0-84ec-d4375e51fab6-tmp\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.697137 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.696263    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqtcn\" (UniqueName: \"kubernetes.io/projected/43b5ce2c-e682-449f-81d3-780df92bcd5a-kube-api-access-tqtcn\") pod \"multus-additional-cni-plugins-wgwk8\" (UID: \"43b5ce2c-e682-449f-81d3-780df92bcd5a\") " pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.698442 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:25.698420    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:20:25.698529 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:25.698447    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:20:25.698529 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:25.698461    2573 projected.go:194] Error preparing data for projected volume kube-api-access-7qstd for pod openshift-network-diagnostics/network-check-target-r5cbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:25.698529 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:25.698522    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd podName:b0fe80cd-1e55-4221-b6ab-c1bc26507d4f nodeName:}" failed. No retries permitted until 2026-05-21 18:20:26.198505346 +0000 UTC m=+3.123993870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7qstd" (UniqueName: "kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd") pod "network-check-target-r5cbv" (UID: "b0fe80cd-1e55-4221-b6ab-c1bc26507d4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:25.699280 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.699265    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs6z9\" (UniqueName: \"kubernetes.io/projected/60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a-kube-api-access-qs6z9\") pod \"aws-ebs-csi-driver-node-rqhmm\" (UID: \"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.700196 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.700179    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn9xz\" (UniqueName: \"kubernetes.io/projected/f2de33e8-989e-42a0-84ec-d4375e51fab6-kube-api-access-zn9xz\") pod \"tuned-kvhnk\" (UID: \"f2de33e8-989e-42a0-84ec-d4375e51fab6\") " pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.703380 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.703354    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fwtwg\" (UniqueName: \"kubernetes.io/projected/f22b878b-cf41-4a22-bbda-ac4a10922613-kube-api-access-fwtwg\") pod \"network-metrics-daemon-bqjkb\" (UID: \"f22b878b-cf41-4a22-bbda-ac4a10922613\") " pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:25.703380 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.703372    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcnb2\" (UniqueName: \"kubernetes.io/projected/4fbe8f73-9a79-4400-9952-1f203e2f400e-kube-api-access-rcnb2\") pod \"iptables-alerter-cl4cx\" (UID: \"4fbe8f73-9a79-4400-9952-1f203e2f400e\") " pod="openshift-network-operator/iptables-alerter-cl4cx"
May 21 18:20:25.703872 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.703851    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnmtg\" (UniqueName: \"kubernetes.io/projected/9e2ab0cd-745a-4109-ab04-75eaaf550474-kube-api-access-mnmtg\") pod \"ovnkube-node-9qv8k\" (UID: \"9e2ab0cd-745a-4109-ab04-75eaaf550474\") " pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.793438 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793403    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-host-run-multus-certs\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.793597 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793446    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-multus-socket-dir-parent\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.793597 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793468    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-host-run-k8s-cni-cncf-io\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.793597 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793551    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-multus-socket-dir-parent\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.793738 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793633    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-host-run-multus-certs\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.793738 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793685    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dfaf793c-3d9d-49d8-bc01-6956c6da2076-multus-daemon-config\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.793738 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793711    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-host-run-k8s-cni-cncf-io\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.793738 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793716    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mqhxh\" (UniqueName: \"kubernetes.io/projected/3632a020-9a04-421c-8049-cb069bbd909a-kube-api-access-mqhxh\") pod \"node-resolver-jtz2j\" (UID: \"3632a020-9a04-421c-8049-cb069bbd909a\") " pod="openshift-dns/node-resolver-jtz2j"
May 21 18:20:25.793924 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793761    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-hostroot\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.793924 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793788    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-multus-conf-dir\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.793924 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793820    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-host-var-lib-kubelet\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.793924 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793837    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-hostroot\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.793924 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793843    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3f4defa-2429-43c6-aee6-c8ac57ad956b-host\") pod \"node-ca-7fgmq\" (UID: \"e3f4defa-2429-43c6-aee6-c8ac57ad956b\") " pod="openshift-image-registry/node-ca-7fgmq"
May 21 18:20:25.793924 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793893    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-multus-conf-dir\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.793924 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793899    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3f4defa-2429-43c6-aee6-c8ac57ad956b-serviceca\") pod \"node-ca-7fgmq\" (UID: \"e3f4defa-2429-43c6-aee6-c8ac57ad956b\") " pod="openshift-image-registry/node-ca-7fgmq"
May 21 18:20:25.793924 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793867    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3f4defa-2429-43c6-aee6-c8ac57ad956b-host\") pod \"node-ca-7fgmq\" (UID: \"e3f4defa-2429-43c6-aee6-c8ac57ad956b\") " pod="openshift-image-registry/node-ca-7fgmq"
May 21 18:20:25.793924 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793914    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-host-var-lib-kubelet\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.794332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793927    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-multus-cni-dir\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.794332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793960    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3632a020-9a04-421c-8049-cb069bbd909a-hosts-file\") pod \"node-resolver-jtz2j\" (UID: \"3632a020-9a04-421c-8049-cb069bbd909a\") " pod="openshift-dns/node-resolver-jtz2j"
May 21 18:20:25.794332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793984    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-host-var-lib-cni-multus\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.794332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.793986    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-multus-cni-dir\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.794332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794024    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-host-var-lib-cni-multus\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.794332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794054    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-crbff\" (UniqueName: \"kubernetes.io/projected/dfaf793c-3d9d-49d8-bc01-6956c6da2076-kube-api-access-crbff\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.794332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794087    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-host-run-netns\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.794332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794088    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/3632a020-9a04-421c-8049-cb069bbd909a-hosts-file\") pod \"node-resolver-jtz2j\" (UID: \"3632a020-9a04-421c-8049-cb069bbd909a\") " pod="openshift-dns/node-resolver-jtz2j"
May 21 18:20:25.794332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794134    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-os-release\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.794332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794187    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-host-run-netns\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.794332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794197    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-os-release\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.794332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794228    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-system-cni-dir\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.794332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794254    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-host-var-lib-cni-bin\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.794332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794277    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-system-cni-dir\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.794332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794289    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-etc-kubernetes\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.794332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794336    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-host-var-lib-cni-bin\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.794332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794335    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3632a020-9a04-421c-8049-cb069bbd909a-tmp-dir\") pod \"node-resolver-jtz2j\" (UID: \"3632a020-9a04-421c-8049-cb069bbd909a\") " pod="openshift-dns/node-resolver-jtz2j"
May 21 18:20:25.795105 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794344    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dfaf793c-3d9d-49d8-bc01-6956c6da2076-multus-daemon-config\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.795105 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794354    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3f4defa-2429-43c6-aee6-c8ac57ad956b-serviceca\") pod \"node-ca-7fgmq\" (UID: \"e3f4defa-2429-43c6-aee6-c8ac57ad956b\") " pod="openshift-image-registry/node-ca-7fgmq"
May 21 18:20:25.795105 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794376    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-etc-kubernetes\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.795105 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794373    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-82zjt\" (UniqueName: \"kubernetes.io/projected/e3f4defa-2429-43c6-aee6-c8ac57ad956b-kube-api-access-82zjt\") pod \"node-ca-7fgmq\" (UID: \"e3f4defa-2429-43c6-aee6-c8ac57ad956b\") " pod="openshift-image-registry/node-ca-7fgmq"
May 21 18:20:25.795105 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794420    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-cnibin\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.795105 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794443    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfaf793c-3d9d-49d8-bc01-6956c6da2076-cni-binary-copy\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.795105 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794510    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dfaf793c-3d9d-49d8-bc01-6956c6da2076-cnibin\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.795105 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794570    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3632a020-9a04-421c-8049-cb069bbd909a-tmp-dir\") pod \"node-resolver-jtz2j\" (UID: \"3632a020-9a04-421c-8049-cb069bbd909a\") " pod="openshift-dns/node-resolver-jtz2j"
May 21 18:20:25.795105 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.794909    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dfaf793c-3d9d-49d8-bc01-6956c6da2076-cni-binary-copy\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.803525 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.803463    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqhxh\" (UniqueName: \"kubernetes.io/projected/3632a020-9a04-421c-8049-cb069bbd909a-kube-api-access-mqhxh\") pod \"node-resolver-jtz2j\" (UID: \"3632a020-9a04-421c-8049-cb069bbd909a\") " pod="openshift-dns/node-resolver-jtz2j"
May 21 18:20:25.803643 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.803621    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-crbff\" (UniqueName: \"kubernetes.io/projected/dfaf793c-3d9d-49d8-bc01-6956c6da2076-kube-api-access-crbff\") pod \"multus-mjrm9\" (UID: \"dfaf793c-3d9d-49d8-bc01-6956c6da2076\") " pod="openshift-multus/multus-mjrm9"
May 21 18:20:25.803702 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.803624    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82zjt\" (UniqueName: \"kubernetes.io/projected/e3f4defa-2429-43c6-aee6-c8ac57ad956b-kube-api-access-82zjt\") pod \"node-ca-7fgmq\" (UID: \"e3f4defa-2429-43c6-aee6-c8ac57ad956b\") " pod="openshift-image-registry/node-ca-7fgmq"
May 21 18:20:25.871564 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.871534    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:25.878426 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.878404    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm"
May 21 18:20:25.890042 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.890023    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wgwk8"
May 21 18:20:25.896021 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.896001    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cl4cx"
May 21 18:20:25.902625 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.902605    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-drjkn"
May 21 18:20:25.910144 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.910124    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kvhnk"
May 21 18:20:25.916141 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.916123    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jtz2j"
May 21 18:20:25.922701 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.922678    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-7fgmq"
May 21 18:20:25.927250 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:25.927233    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mjrm9"
May 21 18:20:26.198068 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:26.197995    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs\") pod \"network-metrics-daemon-bqjkb\" (UID: \"f22b878b-cf41-4a22-bbda-ac4a10922613\") " pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:26.198187 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:26.198130    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:26.198225 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:26.198192    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs podName:f22b878b-cf41-4a22-bbda-ac4a10922613 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:27.198173914 +0000 UTC m=+4.123662423 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs") pod "network-metrics-daemon-bqjkb" (UID: "f22b878b-cf41-4a22-bbda-ac4a10922613") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:26.214103 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:26.214062    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca4b82ca_d15d_4d1a_91be_c3b4fe425179.slice/crio-7b1c4c7765917193a041dd825e59aa55deb132e257cd279bc0f53f19df3360bf WatchSource:0}: Error finding container 7b1c4c7765917193a041dd825e59aa55deb132e257cd279bc0f53f19df3360bf: Status 404 returned error can't find the container with id 7b1c4c7765917193a041dd825e59aa55deb132e257cd279bc0f53f19df3360bf
May 21 18:20:26.215487 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:26.215275    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2de33e8_989e_42a0_84ec_d4375e51fab6.slice/crio-c12f90f802b5a4c574a05b57df1444297a8dd6dea67671552b0c44fbdb2ba1ef WatchSource:0}: Error finding container c12f90f802b5a4c574a05b57df1444297a8dd6dea67671552b0c44fbdb2ba1ef: Status 404 returned error can't find the container with id c12f90f802b5a4c574a05b57df1444297a8dd6dea67671552b0c44fbdb2ba1ef
May 21 18:20:26.215978 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:26.215952    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3f4defa_2429_43c6_aee6_c8ac57ad956b.slice/crio-d69ceb289712777c393ed4f4ede61e885a762225e04f0376be186716dff79910 WatchSource:0}: Error finding container d69ceb289712777c393ed4f4ede61e885a762225e04f0376be186716dff79910: Status 404 returned error can't find the container with id d69ceb289712777c393ed4f4ede61e885a762225e04f0376be186716dff79910
May 21 18:20:26.217374 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:26.217178    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43b5ce2c_e682_449f_81d3_780df92bcd5a.slice/crio-2f8ebf46e22297d782f108de64b0e1efe1740b0e28b33b8db793ca8d5cbdbdaf WatchSource:0}: Error finding container 2f8ebf46e22297d782f108de64b0e1efe1740b0e28b33b8db793ca8d5cbdbdaf: Status 404 returned error can't find the container with id 2f8ebf46e22297d782f108de64b0e1efe1740b0e28b33b8db793ca8d5cbdbdaf
May 21 18:20:26.220029 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:26.220004    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfaf793c_3d9d_49d8_bc01_6956c6da2076.slice/crio-d57c4cfca2ddb9c3961809a61c62c0573766158b0560b43395532e3707fa9ea8 WatchSource:0}: Error finding container d57c4cfca2ddb9c3961809a61c62c0573766158b0560b43395532e3707fa9ea8: Status 404 returned error can't find the container with id d57c4cfca2ddb9c3961809a61c62c0573766158b0560b43395532e3707fa9ea8
May 21 18:20:26.220909 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:26.220882    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fbe8f73_9a79_4400_9952_1f203e2f400e.slice/crio-06c746ac157eccc10b0995080774cf8f7e0232bcbc411b19ab6374ad5265b489 WatchSource:0}: Error finding container 06c746ac157eccc10b0995080774cf8f7e0232bcbc411b19ab6374ad5265b489: Status 404 returned error can't find the container with id 06c746ac157eccc10b0995080774cf8f7e0232bcbc411b19ab6374ad5265b489
May 21 18:20:26.221633 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:26.221607    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60cd1bb5_3e26_4ca7_8c4d_a76a77f18d3a.slice/crio-d08ddad45ae9185bcb1f632d62c3274e256f316400270d5fe3c3cba593ad0dc4 WatchSource:0}: Error finding container d08ddad45ae9185bcb1f632d62c3274e256f316400270d5fe3c3cba593ad0dc4: Status 404 returned error can't find the container with id d08ddad45ae9185bcb1f632d62c3274e256f316400270d5fe3c3cba593ad0dc4
May 21 18:20:26.224367 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:26.223668    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e2ab0cd_745a_4109_ab04_75eaaf550474.slice/crio-6b5c60a6e21658c784cc7550e3d67b9e82259de193fe656ac337dd68ad733bcb WatchSource:0}: Error finding container 6b5c60a6e21658c784cc7550e3d67b9e82259de193fe656ac337dd68ad733bcb: Status 404 returned error can't find the container with id 6b5c60a6e21658c784cc7550e3d67b9e82259de193fe656ac337dd68ad733bcb
May 21 18:20:26.224750 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:20:26.224723    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3632a020_9a04_421c_8049_cb069bbd909a.slice/crio-7031ebe9b5b6a07924c3c31dcdc17b0ba74ad86d69959554c8660adaba1a20e0 WatchSource:0}: Error finding container 7031ebe9b5b6a07924c3c31dcdc17b0ba74ad86d69959554c8660adaba1a20e0: Status 404 returned error can't find the container with id 7031ebe9b5b6a07924c3c31dcdc17b0ba74ad86d69959554c8660adaba1a20e0
May 21 18:20:26.298785 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:26.298760    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qstd\" (UniqueName: \"kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd\") pod \"network-check-target-r5cbv\" (UID: \"b0fe80cd-1e55-4221-b6ab-c1bc26507d4f\") " pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:26.298909 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:26.298892    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:20:26.298960 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:26.298914    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:20:26.298960 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:26.298923    2573 projected.go:194] Error preparing data for projected volume kube-api-access-7qstd for pod openshift-network-diagnostics/network-check-target-r5cbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:26.299025 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:26.298968    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd podName:b0fe80cd-1e55-4221-b6ab-c1bc26507d4f nodeName:}" failed. No retries permitted until 2026-05-21 18:20:27.298955952 +0000 UTC m=+4.224444457 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qstd" (UniqueName: "kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd") pod "network-check-target-r5cbv" (UID: "b0fe80cd-1e55-4221-b6ab-c1bc26507d4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:26.625284 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:26.625217    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 18:15:24 +0000 UTC" deadline="2027-12-22 09:00:18.299906296 +0000 UTC"
May 21 18:20:26.625284 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:26.625250    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13910h39m51.674659583s"
May 21 18:20:26.707627 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:26.707337    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jtz2j" event={"ID":"3632a020-9a04-421c-8049-cb069bbd909a","Type":"ContainerStarted","Data":"7031ebe9b5b6a07924c3c31dcdc17b0ba74ad86d69959554c8660adaba1a20e0"}
May 21 18:20:26.712897 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:26.712860    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k" event={"ID":"9e2ab0cd-745a-4109-ab04-75eaaf550474","Type":"ContainerStarted","Data":"6b5c60a6e21658c784cc7550e3d67b9e82259de193fe656ac337dd68ad733bcb"}
May 21 18:20:26.723312 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:26.723269    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm" event={"ID":"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a","Type":"ContainerStarted","Data":"d08ddad45ae9185bcb1f632d62c3274e256f316400270d5fe3c3cba593ad0dc4"}
May 21 18:20:26.749936 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:26.749899    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7fgmq" event={"ID":"e3f4defa-2429-43c6-aee6-c8ac57ad956b","Type":"ContainerStarted","Data":"d69ceb289712777c393ed4f4ede61e885a762225e04f0376be186716dff79910"}
May 21 18:20:26.763415 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:26.763379    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kvhnk" event={"ID":"f2de33e8-989e-42a0-84ec-d4375e51fab6","Type":"ContainerStarted","Data":"c12f90f802b5a4c574a05b57df1444297a8dd6dea67671552b0c44fbdb2ba1ef"}
May 21 18:20:26.779971 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:26.779939    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal" event={"ID":"a8c9b756d2e1c708a8c4a862520c8414","Type":"ContainerStarted","Data":"2e5199752a13e1f6902d9a60b1f5e235fa19d7a3bf22e1f68991773588470815"}
May 21 18:20:26.794136 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:26.794108    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mjrm9" event={"ID":"dfaf793c-3d9d-49d8-bc01-6956c6da2076","Type":"ContainerStarted","Data":"d57c4cfca2ddb9c3961809a61c62c0573766158b0560b43395532e3707fa9ea8"}
May 21 18:20:26.807284 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:26.806494    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wgwk8" event={"ID":"43b5ce2c-e682-449f-81d3-780df92bcd5a","Type":"ContainerStarted","Data":"2f8ebf46e22297d782f108de64b0e1efe1740b0e28b33b8db793ca8d5cbdbdaf"}
May 21 18:20:26.823771 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:26.823744    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-drjkn" event={"ID":"ca4b82ca-d15d-4d1a-91be-c3b4fe425179","Type":"ContainerStarted","Data":"7b1c4c7765917193a041dd825e59aa55deb132e257cd279bc0f53f19df3360bf"}
May 21 18:20:26.841596 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:26.841559    2573 generic.go:358] "Generic (PLEG): container finished" podID="a36d1bf3dd39f696cd9d4745837fcdf6" containerID="dd39fd9df9a578285351be0bf754a6b244a936aa55de80a06bf094315ed36c90" exitCode=0
May 21 18:20:26.841711 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:26.841645    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal" event={"ID":"a36d1bf3dd39f696cd9d4745837fcdf6","Type":"ContainerDied","Data":"dd39fd9df9a578285351be0bf754a6b244a936aa55de80a06bf094315ed36c90"}
May 21 18:20:26.848154 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:26.848121    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cl4cx" event={"ID":"4fbe8f73-9a79-4400-9952-1f203e2f400e","Type":"ContainerStarted","Data":"06c746ac157eccc10b0995080774cf8f7e0232bcbc411b19ab6374ad5265b489"}
May 21 18:20:26.856734 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:26.856676    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-93.ec2.internal" podStartSLOduration=2.8566602469999998 podStartE2EDuration="2.856660247s" podCreationTimestamp="2026-05-21 18:20:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:20:26.796936827 +0000 UTC m=+3.722425355" watchObservedRunningTime="2026-05-21 18:20:26.856660247 +0000 UTC m=+3.782148779"
May 21 18:20:27.208971 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:27.208934    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs\") pod \"network-metrics-daemon-bqjkb\" (UID: \"f22b878b-cf41-4a22-bbda-ac4a10922613\") " pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:27.209150 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:27.209128    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:27.209213 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:27.209200    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs podName:f22b878b-cf41-4a22-bbda-ac4a10922613 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:29.20918142 +0000 UTC m=+6.134669939 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs") pod "network-metrics-daemon-bqjkb" (UID: "f22b878b-cf41-4a22-bbda-ac4a10922613") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:27.310093 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:27.309997    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qstd\" (UniqueName: \"kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd\") pod \"network-check-target-r5cbv\" (UID: \"b0fe80cd-1e55-4221-b6ab-c1bc26507d4f\") " pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:27.310275 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:27.310172    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:20:27.310275 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:27.310191    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:20:27.310275 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:27.310202    2573 projected.go:194] Error preparing data for projected volume kube-api-access-7qstd for pod openshift-network-diagnostics/network-check-target-r5cbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:27.310275 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:27.310257    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd podName:b0fe80cd-1e55-4221-b6ab-c1bc26507d4f nodeName:}" failed. No retries permitted until 2026-05-21 18:20:29.310241456 +0000 UTC m=+6.235729961 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qstd" (UniqueName: "kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd") pod "network-check-target-r5cbv" (UID: "b0fe80cd-1e55-4221-b6ab-c1bc26507d4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:27.689152 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:27.689076    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:27.689615 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:27.689203    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqjkb" podUID="f22b878b-cf41-4a22-bbda-ac4a10922613"
May 21 18:20:27.689615 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:27.689221    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:27.689615 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:27.689341    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r5cbv" podUID="b0fe80cd-1e55-4221-b6ab-c1bc26507d4f"
May 21 18:20:27.863084 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:27.863012    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal" event={"ID":"a36d1bf3dd39f696cd9d4745837fcdf6","Type":"ContainerStarted","Data":"c09b4ff034fe54b16fe44917871e2ea8b8ef00d24fefa4c52900119d28f30966"}
May 21 18:20:29.227577 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:29.226983    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs\") pod \"network-metrics-daemon-bqjkb\" (UID: \"f22b878b-cf41-4a22-bbda-ac4a10922613\") " pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:29.227577 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:29.227143    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:29.227577 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:29.227210    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs podName:f22b878b-cf41-4a22-bbda-ac4a10922613 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:33.227191585 +0000 UTC m=+10.152680097 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs") pod "network-metrics-daemon-bqjkb" (UID: "f22b878b-cf41-4a22-bbda-ac4a10922613") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:29.328517 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:29.327871    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qstd\" (UniqueName: \"kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd\") pod \"network-check-target-r5cbv\" (UID: \"b0fe80cd-1e55-4221-b6ab-c1bc26507d4f\") " pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:29.328517 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:29.328062    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:20:29.328517 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:29.328080    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:20:29.328517 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:29.328092    2573 projected.go:194] Error preparing data for projected volume kube-api-access-7qstd for pod openshift-network-diagnostics/network-check-target-r5cbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:29.328517 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:29.328154    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd podName:b0fe80cd-1e55-4221-b6ab-c1bc26507d4f nodeName:}" failed. No retries permitted until 2026-05-21 18:20:33.328133099 +0000 UTC m=+10.253621613 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qstd" (UniqueName: "kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd") pod "network-check-target-r5cbv" (UID: "b0fe80cd-1e55-4221-b6ab-c1bc26507d4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:29.685885 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:29.685853    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:29.685885 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:29.685875    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:29.686114 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:29.685988    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqjkb" podUID="f22b878b-cf41-4a22-bbda-ac4a10922613"
May 21 18:20:29.686466 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:29.686407    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r5cbv" podUID="b0fe80cd-1e55-4221-b6ab-c1bc26507d4f"
May 21 18:20:31.686613 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:31.686576    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:31.687080 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:31.686754    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqjkb" podUID="f22b878b-cf41-4a22-bbda-ac4a10922613"
May 21 18:20:31.687402 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:31.687242    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:31.687402 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:31.687362    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r5cbv" podUID="b0fe80cd-1e55-4221-b6ab-c1bc26507d4f"
May 21 18:20:33.262403 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:33.262366    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs\") pod \"network-metrics-daemon-bqjkb\" (UID: \"f22b878b-cf41-4a22-bbda-ac4a10922613\") " pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:33.262865 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:33.262535    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:33.262865 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:33.262611    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs podName:f22b878b-cf41-4a22-bbda-ac4a10922613 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:41.262589988 +0000 UTC m=+18.188078533 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs") pod "network-metrics-daemon-bqjkb" (UID: "f22b878b-cf41-4a22-bbda-ac4a10922613") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:33.362950 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:33.362850    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qstd\" (UniqueName: \"kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd\") pod \"network-check-target-r5cbv\" (UID: \"b0fe80cd-1e55-4221-b6ab-c1bc26507d4f\") " pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:33.363139 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:33.363061    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:20:33.363139 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:33.363081    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:20:33.363139 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:33.363093    2573 projected.go:194] Error preparing data for projected volume kube-api-access-7qstd for pod openshift-network-diagnostics/network-check-target-r5cbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:33.363296 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:33.363154    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd podName:b0fe80cd-1e55-4221-b6ab-c1bc26507d4f nodeName:}" failed. No retries permitted until 2026-05-21 18:20:41.363136103 +0000 UTC m=+18.288624612 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qstd" (UniqueName: "kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd") pod "network-check-target-r5cbv" (UID: "b0fe80cd-1e55-4221-b6ab-c1bc26507d4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:33.687964 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:33.687332    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:33.687964 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:33.687446    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r5cbv" podUID="b0fe80cd-1e55-4221-b6ab-c1bc26507d4f"
May 21 18:20:33.687964 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:33.687507    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:33.687964 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:33.687583    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqjkb" podUID="f22b878b-cf41-4a22-bbda-ac4a10922613"
May 21 18:20:35.686685 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:35.686489    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:35.686685 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:35.686489    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:35.686685 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:35.686645    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqjkb" podUID="f22b878b-cf41-4a22-bbda-ac4a10922613"
May 21 18:20:35.687247 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:35.686773    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r5cbv" podUID="b0fe80cd-1e55-4221-b6ab-c1bc26507d4f"
May 21 18:20:37.686813 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:37.686772    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:37.687244 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:37.686825    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:37.687322 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:37.687229    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r5cbv" podUID="b0fe80cd-1e55-4221-b6ab-c1bc26507d4f"
May 21 18:20:37.687437 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:37.687413    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqjkb" podUID="f22b878b-cf41-4a22-bbda-ac4a10922613"
May 21 18:20:39.686425 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:39.686388    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:39.686896 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:39.686390    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:39.686896 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:39.686510    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r5cbv" podUID="b0fe80cd-1e55-4221-b6ab-c1bc26507d4f"
May 21 18:20:39.686896 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:39.686569    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqjkb" podUID="f22b878b-cf41-4a22-bbda-ac4a10922613"
May 21 18:20:41.320016 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:41.319981    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs\") pod \"network-metrics-daemon-bqjkb\" (UID: \"f22b878b-cf41-4a22-bbda-ac4a10922613\") " pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:41.320489 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:41.320163    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:41.320489 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:41.320243    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs podName:f22b878b-cf41-4a22-bbda-ac4a10922613 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:57.320222191 +0000 UTC m=+34.245710697 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs") pod "network-metrics-daemon-bqjkb" (UID: "f22b878b-cf41-4a22-bbda-ac4a10922613") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:41.421041 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:41.421003    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qstd\" (UniqueName: \"kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd\") pod \"network-check-target-r5cbv\" (UID: \"b0fe80cd-1e55-4221-b6ab-c1bc26507d4f\") " pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:41.421214 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:41.421149    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:20:41.421214 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:41.421173    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:20:41.421214 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:41.421185    2573 projected.go:194] Error preparing data for projected volume kube-api-access-7qstd for pod openshift-network-diagnostics/network-check-target-r5cbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:41.421397 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:41.421252    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd podName:b0fe80cd-1e55-4221-b6ab-c1bc26507d4f nodeName:}" failed. No retries permitted until 2026-05-21 18:20:57.42123143 +0000 UTC m=+34.346719935 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qstd" (UniqueName: "kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd") pod "network-check-target-r5cbv" (UID: "b0fe80cd-1e55-4221-b6ab-c1bc26507d4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:41.686764 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:41.686684    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:41.686921 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:41.686684    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:41.686921 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:41.686803    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r5cbv" podUID="b0fe80cd-1e55-4221-b6ab-c1bc26507d4f"
May 21 18:20:41.686921 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:41.686909    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqjkb" podUID="f22b878b-cf41-4a22-bbda-ac4a10922613"
May 21 18:20:43.687016 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:43.686987    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:43.687493 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:43.687024    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:43.687493 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:43.687084    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r5cbv" podUID="b0fe80cd-1e55-4221-b6ab-c1bc26507d4f"
May 21 18:20:43.687493 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:43.687138    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqjkb" podUID="f22b878b-cf41-4a22-bbda-ac4a10922613"
May 21 18:20:44.893898 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:44.893665    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jtz2j" event={"ID":"3632a020-9a04-421c-8049-cb069bbd909a","Type":"ContainerStarted","Data":"a9b2c0957cfd396dad372ecd63c90ede3aab97f5776a2f36214b45057f0818f2"}
May 21 18:20:44.896204 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:44.896157    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm" event={"ID":"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a","Type":"ContainerStarted","Data":"b5e33ad959f81f67a7c550c0bb31578a7f825e3a65435ffa7348d0d7c8099119"}
May 21 18:20:44.897593 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:44.897571    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-7fgmq" event={"ID":"e3f4defa-2429-43c6-aee6-c8ac57ad956b","Type":"ContainerStarted","Data":"ad7f55854124684d9121b845a11be079518d769132bf560c7a74487e953a80ba"}
May 21 18:20:44.901619 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:44.901564    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kvhnk" event={"ID":"f2de33e8-989e-42a0-84ec-d4375e51fab6","Type":"ContainerStarted","Data":"d7342b1fad1c2783ef60a5665310a8cafc11f0dae8ca9700ba6fb510e05e6ca9"}
May 21 18:20:44.903077 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:44.903049    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mjrm9" event={"ID":"dfaf793c-3d9d-49d8-bc01-6956c6da2076","Type":"ContainerStarted","Data":"1b2bc6d018d9b67139e0dcb8f25fe5307c76a298e9c5c7f3b0c1d614d88e045a"}
May 21 18:20:44.904327 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:44.904286    2573 generic.go:358] "Generic (PLEG): container finished" podID="43b5ce2c-e682-449f-81d3-780df92bcd5a" containerID="e3749305bbb5e7962af58879c18e73ff2650ea8823088feb3806979048727aeb" exitCode=0
May 21 18:20:44.904411 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:44.904331    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wgwk8" event={"ID":"43b5ce2c-e682-449f-81d3-780df92bcd5a","Type":"ContainerDied","Data":"e3749305bbb5e7962af58879c18e73ff2650ea8823088feb3806979048727aeb"}
May 21 18:20:44.905714 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:44.905634    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-drjkn" event={"ID":"ca4b82ca-d15d-4d1a-91be-c3b4fe425179","Type":"ContainerStarted","Data":"0a1e25bad4c12495ec460d6b8f1099cce9db34703ed7dbd5f6ec40d12f3ce147"}
May 21 18:20:44.913820 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:44.913787    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-jtz2j" podStartSLOduration=3.678473428 podStartE2EDuration="21.913776254s" podCreationTimestamp="2026-05-21 18:20:23 +0000 UTC" firstStartedPulling="2026-05-21 18:20:26.226510201 +0000 UTC m=+3.151998706" lastFinishedPulling="2026-05-21 18:20:44.461813026 +0000 UTC m=+21.387301532" observedRunningTime="2026-05-21 18:20:44.91362768 +0000 UTC m=+21.839116207" watchObservedRunningTime="2026-05-21 18:20:44.913776254 +0000 UTC m=+21.839264780"
May 21 18:20:44.913889 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:44.913872    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-93.ec2.internal" podStartSLOduration=20.913868284 podStartE2EDuration="20.913868284s" podCreationTimestamp="2026-05-21 18:20:24 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:20:27.878758221 +0000 UTC m=+4.804246749" watchObservedRunningTime="2026-05-21 18:20:44.913868284 +0000 UTC m=+21.839356810"
May 21 18:20:44.949898 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:44.949860    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-drjkn" podStartSLOduration=3.653139659 podStartE2EDuration="21.949846498s" podCreationTimestamp="2026-05-21 18:20:23 +0000 UTC" firstStartedPulling="2026-05-21 18:20:26.216252419 +0000 UTC m=+3.141740942" lastFinishedPulling="2026-05-21 18:20:44.51295926 +0000 UTC m=+21.438447781" observedRunningTime="2026-05-21 18:20:44.933323729 +0000 UTC m=+21.858812248" watchObservedRunningTime="2026-05-21 18:20:44.949846498 +0000 UTC m=+21.875335028"
May 21 18:20:44.950008 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:44.949930    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kvhnk" podStartSLOduration=3.653008728 podStartE2EDuration="21.949926854s" podCreationTimestamp="2026-05-21 18:20:23 +0000 UTC" firstStartedPulling="2026-05-21 18:20:26.217601593 +0000 UTC m=+3.143090111" lastFinishedPulling="2026-05-21 18:20:44.514519732 +0000 UTC m=+21.440008237" observedRunningTime="2026-05-21 18:20:44.949791537 +0000 UTC m=+21.875280065" watchObservedRunningTime="2026-05-21 18:20:44.949926854 +0000 UTC m=+21.875415375"
May 21 18:20:44.988165 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:44.988108    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-7fgmq" podStartSLOduration=11.979913705 podStartE2EDuration="21.988091763s" podCreationTimestamp="2026-05-21 18:20:23 +0000 UTC" firstStartedPulling="2026-05-21 18:20:26.218496651 +0000 UTC m=+3.143985173" lastFinishedPulling="2026-05-21 18:20:36.226674723 +0000 UTC m=+13.152163231" observedRunningTime="2026-05-21 18:20:44.988041845 +0000 UTC m=+21.913530373" watchObservedRunningTime="2026-05-21 18:20:44.988091763 +0000 UTC m=+21.913580291"
May 21 18:20:45.004867 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:45.004815    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-mjrm9" podStartSLOduration=3.7062008889999998 podStartE2EDuration="22.004800655s" podCreationTimestamp="2026-05-21 18:20:23 +0000 UTC" firstStartedPulling="2026-05-21 18:20:26.221773312 +0000 UTC m=+3.147261816" lastFinishedPulling="2026-05-21 18:20:44.520373076 +0000 UTC m=+21.445861582" observedRunningTime="2026-05-21 18:20:45.004355759 +0000 UTC m=+21.929844283" watchObservedRunningTime="2026-05-21 18:20:45.004800655 +0000 UTC m=+21.930289182"
May 21 18:20:45.686197 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:45.685961    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:45.686406 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:45.686032    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:45.686406 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:45.686322    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r5cbv" podUID="b0fe80cd-1e55-4221-b6ab-c1bc26507d4f"
May 21 18:20:45.686514 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:45.686412    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqjkb" podUID="f22b878b-cf41-4a22-bbda-ac4a10922613"
May 21 18:20:45.911428 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:45.911398    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qv8k_9e2ab0cd-745a-4109-ab04-75eaaf550474/ovn-acl-logging/0.log"
May 21 18:20:45.911901 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:45.911738    2573 generic.go:358] "Generic (PLEG): container finished" podID="9e2ab0cd-745a-4109-ab04-75eaaf550474" containerID="0b8115707d2a445a6e4459c118072b620935e83171af39ef9e886b66b38b6c95" exitCode=1
May 21 18:20:45.911901 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:45.911832    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k" event={"ID":"9e2ab0cd-745a-4109-ab04-75eaaf550474","Type":"ContainerStarted","Data":"80705ffd374b1922f55957d47be7c9c4076e8100ce18d3e4b44ce76fb37b6f37"}
May 21 18:20:45.911999 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:45.911904    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k" event={"ID":"9e2ab0cd-745a-4109-ab04-75eaaf550474","Type":"ContainerStarted","Data":"f653b5252dade408c3489d368b2f4a2723f7bf4ae6c9cecdc178110a0d34c81b"}
May 21 18:20:45.911999 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:45.911922    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k" event={"ID":"9e2ab0cd-745a-4109-ab04-75eaaf550474","Type":"ContainerStarted","Data":"e703f8025ae657fe3801b1111f4acf7cbeea062bc17493599c9ad293e52bb03b"}
May 21 18:20:45.911999 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:45.911934    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k" event={"ID":"9e2ab0cd-745a-4109-ab04-75eaaf550474","Type":"ContainerStarted","Data":"7ceb17e48d017e2ba06f85938d768cbc84412df020c0beb510b7c402d36a1837"}
May 21 18:20:45.911999 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:45.911959    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k" event={"ID":"9e2ab0cd-745a-4109-ab04-75eaaf550474","Type":"ContainerDied","Data":"0b8115707d2a445a6e4459c118072b620935e83171af39ef9e886b66b38b6c95"}
May 21 18:20:45.911999 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:45.911977    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k" event={"ID":"9e2ab0cd-745a-4109-ab04-75eaaf550474","Type":"ContainerStarted","Data":"a78b4389f8e4179eb7d1a187801b39a267668a32e78ea5bcba758e65f7e54d43"}
May 21 18:20:46.077697 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:46.077671    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 21 18:20:46.652296 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:46.652173    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T18:20:46.077692165Z","UUID":"20510b30-52fb-4f53-9bd7-784e7ac53f3f","Handler":null,"Name":"","Endpoint":""}
May 21 18:20:46.654045 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:46.654023    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 21 18:20:46.654167 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:46.654064    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 21 18:20:46.915064 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:46.914990    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cl4cx" event={"ID":"4fbe8f73-9a79-4400-9952-1f203e2f400e","Type":"ContainerStarted","Data":"259f10ba6323bd30fcdb980f1c687f18c87a157e1cfb400db76841e165160504"}
May 21 18:20:46.916884 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:46.916849    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm" event={"ID":"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a","Type":"ContainerStarted","Data":"3a2c8561912b5238df9a04389a476c22b443b35814a6c478bb06a54b132d4b90"}
May 21 18:20:46.934100 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:46.934049    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cl4cx" podStartSLOduration=5.642513561 podStartE2EDuration="23.934032982s" podCreationTimestamp="2026-05-21 18:20:23 +0000 UTC" firstStartedPulling="2026-05-21 18:20:26.222926568 +0000 UTC m=+3.148415086" lastFinishedPulling="2026-05-21 18:20:44.514445997 +0000 UTC m=+21.439934507" observedRunningTime="2026-05-21 18:20:46.933814817 +0000 UTC m=+23.859303344" watchObservedRunningTime="2026-05-21 18:20:46.934032982 +0000 UTC m=+23.859521510"
May 21 18:20:47.687012 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:47.686761    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:47.687178 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:47.686791    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:47.687178 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:47.687121    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r5cbv" podUID="b0fe80cd-1e55-4221-b6ab-c1bc26507d4f"
May 21 18:20:47.687296 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:47.687208    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqjkb" podUID="f22b878b-cf41-4a22-bbda-ac4a10922613"
May 21 18:20:47.921354 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:47.921299    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm" event={"ID":"60cd1bb5-3e26-4ca7-8c4d-a76a77f18d3a","Type":"ContainerStarted","Data":"0005f85f57e2e4a9fd80269a3c95213318a73f8bcedfa775d80d2a0b393c5706"}
May 21 18:20:47.939152 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:47.939069    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rqhmm" podStartSLOduration=4.172884502 podStartE2EDuration="24.939053535s" podCreationTimestamp="2026-05-21 18:20:23 +0000 UTC" firstStartedPulling="2026-05-21 18:20:26.223948182 +0000 UTC m=+3.149436695" lastFinishedPulling="2026-05-21 18:20:46.990117219 +0000 UTC m=+23.915605728" observedRunningTime="2026-05-21 18:20:47.939000628 +0000 UTC m=+24.864489152" watchObservedRunningTime="2026-05-21 18:20:47.939053535 +0000 UTC m=+24.864542061"
May 21 18:20:48.935900 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:48.935875    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-drjkn"
May 21 18:20:48.936575 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:48.936409    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-drjkn"
May 21 18:20:49.685997 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:49.685963    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:49.686213 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:49.685968    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:49.686213 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:49.686065    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r5cbv" podUID="b0fe80cd-1e55-4221-b6ab-c1bc26507d4f"
May 21 18:20:49.686213 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:49.686148    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqjkb" podUID="f22b878b-cf41-4a22-bbda-ac4a10922613"
May 21 18:20:49.927201 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:49.927177    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qv8k_9e2ab0cd-745a-4109-ab04-75eaaf550474/ovn-acl-logging/0.log"
May 21 18:20:49.927527 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:49.927499    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k" event={"ID":"9e2ab0cd-745a-4109-ab04-75eaaf550474","Type":"ContainerStarted","Data":"e2817dea2ed7fb473ba66d39e9e40ffd7f74d7e38beb8120c551a66413f2b47b"}
May 21 18:20:49.928897 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:49.928851    2573 generic.go:358] "Generic (PLEG): container finished" podID="43b5ce2c-e682-449f-81d3-780df92bcd5a" containerID="5c83a11651c1fd122be2e7df82e2b41f306111bfde85fe6bd207d1cb9f839a46" exitCode=0
May 21 18:20:49.929007 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:49.928933    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wgwk8" event={"ID":"43b5ce2c-e682-449f-81d3-780df92bcd5a","Type":"ContainerDied","Data":"5c83a11651c1fd122be2e7df82e2b41f306111bfde85fe6bd207d1cb9f839a46"}
May 21 18:20:49.929290 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:49.929264    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-drjkn"
May 21 18:20:49.929826 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:49.929805    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-drjkn"
May 21 18:20:50.932043 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:50.932014    2573 generic.go:358] "Generic (PLEG): container finished" podID="43b5ce2c-e682-449f-81d3-780df92bcd5a" containerID="beae975d4a63ac13ba0a640e05f12c64047dbbb2d4b842e06db7421d778b50d4" exitCode=0
May 21 18:20:50.932526 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:50.932102    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wgwk8" event={"ID":"43b5ce2c-e682-449f-81d3-780df92bcd5a","Type":"ContainerDied","Data":"beae975d4a63ac13ba0a640e05f12c64047dbbb2d4b842e06db7421d778b50d4"}
May 21 18:20:51.685866 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:51.685709    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:51.685964 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:51.685750    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:51.685964 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:51.685939    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r5cbv" podUID="b0fe80cd-1e55-4221-b6ab-c1bc26507d4f"
May 21 18:20:51.686079 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:51.686045    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqjkb" podUID="f22b878b-cf41-4a22-bbda-ac4a10922613"
May 21 18:20:51.936633 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:51.936565    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qv8k_9e2ab0cd-745a-4109-ab04-75eaaf550474/ovn-acl-logging/0.log"
May 21 18:20:51.937022 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:51.936938    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k" event={"ID":"9e2ab0cd-745a-4109-ab04-75eaaf550474","Type":"ContainerStarted","Data":"230af9b99fe282d1b307584f9bf3171576ccb68e73ee7ada83ffd9dc170ed192"}
May 21 18:20:51.937279 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:51.937258    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:51.937432 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:51.937409    2573 scope.go:117] "RemoveContainer" containerID="0b8115707d2a445a6e4459c118072b620935e83171af39ef9e886b66b38b6c95"
May 21 18:20:51.939168 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:51.939146    2573 generic.go:358] "Generic (PLEG): container finished" podID="43b5ce2c-e682-449f-81d3-780df92bcd5a" containerID="15624b25121fb57c817198b2cce3c2aab41f35b89a4dd44f2e199229a54285ce" exitCode=0
May 21 18:20:51.939280 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:51.939180    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wgwk8" event={"ID":"43b5ce2c-e682-449f-81d3-780df92bcd5a","Type":"ContainerDied","Data":"15624b25121fb57c817198b2cce3c2aab41f35b89a4dd44f2e199229a54285ce"}
May 21 18:20:51.953141 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:51.953118    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:52.950962 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:52.950932    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bqjkb"]
May 21 18:20:52.951400 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:52.951069    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:52.951400 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:52.951192    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqjkb" podUID="f22b878b-cf41-4a22-bbda-ac4a10922613"
May 21 18:20:52.951795 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:52.951769    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r5cbv"]
May 21 18:20:52.951891 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:52.951872    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:52.951992 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:52.951960    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r5cbv" podUID="b0fe80cd-1e55-4221-b6ab-c1bc26507d4f"
May 21 18:20:52.954918 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:52.954833    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qv8k_9e2ab0cd-745a-4109-ab04-75eaaf550474/ovn-acl-logging/0.log"
May 21 18:20:52.955251 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:52.955221    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k" event={"ID":"9e2ab0cd-745a-4109-ab04-75eaaf550474","Type":"ContainerStarted","Data":"9aa44b43d0e9e3a4b853b8fbd98260a9862132fe7e0f905247a06087583ff0db"}
May 21 18:20:52.955978 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:52.955903    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:52.955978 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:52.955927    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:52.976158 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:52.976104    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:20:52.989163 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:52.989109    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k" podStartSLOduration=11.333756232 podStartE2EDuration="29.989093925s" podCreationTimestamp="2026-05-21 18:20:23 +0000 UTC" firstStartedPulling="2026-05-21 18:20:26.225758338 +0000 UTC m=+3.151246850" lastFinishedPulling="2026-05-21 18:20:44.881096029 +0000 UTC m=+21.806584543" observedRunningTime="2026-05-21 18:20:52.988945044 +0000 UTC m=+29.914433573" watchObservedRunningTime="2026-05-21 18:20:52.989093925 +0000 UTC m=+29.914582453"
May 21 18:20:54.685997 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:54.685780    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:54.686519 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:54.685777    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:54.686519 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:54.686106    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqjkb" podUID="f22b878b-cf41-4a22-bbda-ac4a10922613"
May 21 18:20:54.686519 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:54.686240    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r5cbv" podUID="b0fe80cd-1e55-4221-b6ab-c1bc26507d4f"
May 21 18:20:56.686618 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:56.686582    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:56.687173 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:56.686588    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:56.687173 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:56.686698    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r5cbv" podUID="b0fe80cd-1e55-4221-b6ab-c1bc26507d4f"
May 21 18:20:56.687173 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:56.686808    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bqjkb" podUID="f22b878b-cf41-4a22-bbda-ac4a10922613"
May 21 18:20:57.341359 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.341320    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs\") pod \"network-metrics-daemon-bqjkb\" (UID: \"f22b878b-cf41-4a22-bbda-ac4a10922613\") " pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:57.341543 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:57.341474    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:57.341602 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:57.341553    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs podName:f22b878b-cf41-4a22-bbda-ac4a10922613 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:29.341532116 +0000 UTC m=+66.267020624 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs") pod "network-metrics-daemon-bqjkb" (UID: "f22b878b-cf41-4a22-bbda-ac4a10922613") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 18:20:57.417851 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.417764    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-93.ec2.internal" event="NodeReady"
May 21 18:20:57.418000 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.417916    2573 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 21 18:20:57.442556 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.442525    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qstd\" (UniqueName: \"kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd\") pod \"network-check-target-r5cbv\" (UID: \"b0fe80cd-1e55-4221-b6ab-c1bc26507d4f\") " pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:57.442738 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:57.442709    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 18:20:57.442807 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:57.442742    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 18:20:57.442807 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:57.442752    2573 projected.go:194] Error preparing data for projected volume kube-api-access-7qstd for pod openshift-network-diagnostics/network-check-target-r5cbv: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:57.442906 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:57.442807    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd podName:b0fe80cd-1e55-4221-b6ab-c1bc26507d4f nodeName:}" failed. No retries permitted until 2026-05-21 18:21:29.442788771 +0000 UTC m=+66.368277279 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7qstd" (UniqueName: "kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd") pod "network-check-target-r5cbv" (UID: "b0fe80cd-1e55-4221-b6ab-c1bc26507d4f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 18:20:57.474228 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.474196    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sm8gn"]
May 21 18:20:57.513694 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.513649    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2slhb"]
May 21 18:20:57.513861 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.513836    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sm8gn"
May 21 18:20:57.516721 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.516694    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 21 18:20:57.516854 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.516694    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 21 18:20:57.516854 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.516738    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hpqft\""
May 21 18:20:57.529532 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.529512    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2slhb"]
May 21 18:20:57.529532 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.529533    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sm8gn"]
May 21 18:20:57.529658 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.529629    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2slhb"
May 21 18:20:57.532449 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.532429    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fn9qn\""
May 21 18:20:57.532572 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.532433    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 21 18:20:57.532572 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.532503    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 21 18:20:57.532780 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.532760    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 21 18:20:57.644280 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.644242    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46jtt\" (UniqueName: \"kubernetes.io/projected/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-kube-api-access-46jtt\") pod \"dns-default-sm8gn\" (UID: \"e43073c9-1e5c-411b-9f5c-8e35b66ffe54\") " pod="openshift-dns/dns-default-sm8gn"
May 21 18:20:57.644280 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.644281    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls\") pod \"dns-default-sm8gn\" (UID: \"e43073c9-1e5c-411b-9f5c-8e35b66ffe54\") " pod="openshift-dns/dns-default-sm8gn"
May 21 18:20:57.644518 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.644328    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-tmp-dir\") pod \"dns-default-sm8gn\" (UID: \"e43073c9-1e5c-411b-9f5c-8e35b66ffe54\") " pod="openshift-dns/dns-default-sm8gn"
May 21 18:20:57.644518 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.644434    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl8mp\" (UniqueName: \"kubernetes.io/projected/89f0442b-784c-49da-910d-122d18137dd7-kube-api-access-nl8mp\") pod \"ingress-canary-2slhb\" (UID: \"89f0442b-784c-49da-910d-122d18137dd7\") " pod="openshift-ingress-canary/ingress-canary-2slhb"
May 21 18:20:57.644518 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.644472    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert\") pod \"ingress-canary-2slhb\" (UID: \"89f0442b-784c-49da-910d-122d18137dd7\") " pod="openshift-ingress-canary/ingress-canary-2slhb"
May 21 18:20:57.644518 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.644512    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-config-volume\") pod \"dns-default-sm8gn\" (UID: \"e43073c9-1e5c-411b-9f5c-8e35b66ffe54\") " pod="openshift-dns/dns-default-sm8gn"
May 21 18:20:57.745730 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.745701    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-46jtt\" (UniqueName: \"kubernetes.io/projected/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-kube-api-access-46jtt\") pod \"dns-default-sm8gn\" (UID: \"e43073c9-1e5c-411b-9f5c-8e35b66ffe54\") " pod="openshift-dns/dns-default-sm8gn"
May 21 18:20:57.746239 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.745739    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls\") pod \"dns-default-sm8gn\" (UID: \"e43073c9-1e5c-411b-9f5c-8e35b66ffe54\") " pod="openshift-dns/dns-default-sm8gn"
May 21 18:20:57.746239 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.745778    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-tmp-dir\") pod \"dns-default-sm8gn\" (UID: \"e43073c9-1e5c-411b-9f5c-8e35b66ffe54\") " pod="openshift-dns/dns-default-sm8gn"
May 21 18:20:57.746239 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.745832    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nl8mp\" (UniqueName: \"kubernetes.io/projected/89f0442b-784c-49da-910d-122d18137dd7-kube-api-access-nl8mp\") pod \"ingress-canary-2slhb\" (UID: \"89f0442b-784c-49da-910d-122d18137dd7\") " pod="openshift-ingress-canary/ingress-canary-2slhb"
May 21 18:20:57.746239 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.745858    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert\") pod \"ingress-canary-2slhb\" (UID: \"89f0442b-784c-49da-910d-122d18137dd7\") " pod="openshift-ingress-canary/ingress-canary-2slhb"
May 21 18:20:57.746239 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:57.745866    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:20:57.746239 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.745884    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-config-volume\") pod \"dns-default-sm8gn\" (UID: \"e43073c9-1e5c-411b-9f5c-8e35b66ffe54\") " pod="openshift-dns/dns-default-sm8gn"
May 21 18:20:57.746239 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:57.745953    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls podName:e43073c9-1e5c-411b-9f5c-8e35b66ffe54 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:58.245930273 +0000 UTC m=+35.171418779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls") pod "dns-default-sm8gn" (UID: "e43073c9-1e5c-411b-9f5c-8e35b66ffe54") : secret "dns-default-metrics-tls" not found
May 21 18:20:57.746239 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:57.745985    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:20:57.746239 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:57.746048    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert podName:89f0442b-784c-49da-910d-122d18137dd7 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:58.246029566 +0000 UTC m=+35.171518074 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert") pod "ingress-canary-2slhb" (UID: "89f0442b-784c-49da-910d-122d18137dd7") : secret "canary-serving-cert" not found
May 21 18:20:57.746239 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.746169    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-tmp-dir\") pod \"dns-default-sm8gn\" (UID: \"e43073c9-1e5c-411b-9f5c-8e35b66ffe54\") " pod="openshift-dns/dns-default-sm8gn"
May 21 18:20:57.746568 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.746395    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-config-volume\") pod \"dns-default-sm8gn\" (UID: \"e43073c9-1e5c-411b-9f5c-8e35b66ffe54\") " pod="openshift-dns/dns-default-sm8gn"
May 21 18:20:57.755888 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.755855    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-46jtt\" (UniqueName: \"kubernetes.io/projected/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-kube-api-access-46jtt\") pod \"dns-default-sm8gn\" (UID: \"e43073c9-1e5c-411b-9f5c-8e35b66ffe54\") " pod="openshift-dns/dns-default-sm8gn"
May 21 18:20:57.756001 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:57.755919    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl8mp\" (UniqueName: \"kubernetes.io/projected/89f0442b-784c-49da-910d-122d18137dd7-kube-api-access-nl8mp\") pod \"ingress-canary-2slhb\" (UID: \"89f0442b-784c-49da-910d-122d18137dd7\") " pod="openshift-ingress-canary/ingress-canary-2slhb"
May 21 18:20:58.248726 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:58.248693    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls\") pod \"dns-default-sm8gn\" (UID: \"e43073c9-1e5c-411b-9f5c-8e35b66ffe54\") " pod="openshift-dns/dns-default-sm8gn"
May 21 18:20:58.248909 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:58.248766    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert\") pod \"ingress-canary-2slhb\" (UID: \"89f0442b-784c-49da-910d-122d18137dd7\") " pod="openshift-ingress-canary/ingress-canary-2slhb"
May 21 18:20:58.248909 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:58.248858    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:20:58.248980 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:58.248944    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls podName:e43073c9-1e5c-411b-9f5c-8e35b66ffe54 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:59.248928179 +0000 UTC m=+36.174416684 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls") pod "dns-default-sm8gn" (UID: "e43073c9-1e5c-411b-9f5c-8e35b66ffe54") : secret "dns-default-metrics-tls" not found
May 21 18:20:58.248980 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:58.248861    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:20:58.249052 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:58.249012    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert podName:89f0442b-784c-49da-910d-122d18137dd7 nodeName:}" failed. No retries permitted until 2026-05-21 18:20:59.249000614 +0000 UTC m=+36.174489118 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert") pod "ingress-canary-2slhb" (UID: "89f0442b-784c-49da-910d-122d18137dd7") : secret "canary-serving-cert" not found
May 21 18:20:58.686812 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:58.686729    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:20:58.686957 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:58.686729    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:20:58.690937 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:58.690917    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 18:20:58.691053 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:58.690993    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 18:20:58.691053 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:58.690999    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 18:20:58.691053 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:58.690997    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7dqz4\""
May 21 18:20:58.691181 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:58.691132    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pfxnj\""
May 21 18:20:58.967474 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:58.967390    2573 generic.go:358] "Generic (PLEG): container finished" podID="43b5ce2c-e682-449f-81d3-780df92bcd5a" containerID="60a66af39fbc6e7601089148d9ffa0d8316ac6c717813f95e6b209229ce90122" exitCode=0
May 21 18:20:58.967474 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:58.967451    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wgwk8" event={"ID":"43b5ce2c-e682-449f-81d3-780df92bcd5a","Type":"ContainerDied","Data":"60a66af39fbc6e7601089148d9ffa0d8316ac6c717813f95e6b209229ce90122"}
May 21 18:20:59.257341 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:59.257316    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert\") pod \"ingress-canary-2slhb\" (UID: \"89f0442b-784c-49da-910d-122d18137dd7\") " pod="openshift-ingress-canary/ingress-canary-2slhb"
May 21 18:20:59.257481 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:59.257362    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls\") pod \"dns-default-sm8gn\" (UID: \"e43073c9-1e5c-411b-9f5c-8e35b66ffe54\") " pod="openshift-dns/dns-default-sm8gn"
May 21 18:20:59.257481 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:59.257439    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:20:59.257481 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:59.257440    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:20:59.257576 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:59.257488    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls podName:e43073c9-1e5c-411b-9f5c-8e35b66ffe54 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:01.257474604 +0000 UTC m=+38.182963109 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls") pod "dns-default-sm8gn" (UID: "e43073c9-1e5c-411b-9f5c-8e35b66ffe54") : secret "dns-default-metrics-tls" not found
May 21 18:20:59.257576 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:20:59.257500    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert podName:89f0442b-784c-49da-910d-122d18137dd7 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:01.257495014 +0000 UTC m=+38.182983519 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert") pod "ingress-canary-2slhb" (UID: "89f0442b-784c-49da-910d-122d18137dd7") : secret "canary-serving-cert" not found
May 21 18:20:59.972157 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:59.972127    2573 generic.go:358] "Generic (PLEG): container finished" podID="43b5ce2c-e682-449f-81d3-780df92bcd5a" containerID="38629b20fe42055bec8e0eee3f3fd3b8cc9987cb7eed115f00ae5a4262cbb45e" exitCode=0
May 21 18:20:59.972513 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:20:59.972167    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wgwk8" event={"ID":"43b5ce2c-e682-449f-81d3-780df92bcd5a","Type":"ContainerDied","Data":"38629b20fe42055bec8e0eee3f3fd3b8cc9987cb7eed115f00ae5a4262cbb45e"}
May 21 18:21:00.976488 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:00.976284    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wgwk8" event={"ID":"43b5ce2c-e682-449f-81d3-780df92bcd5a","Type":"ContainerStarted","Data":"2438a7789c5537892c68a0130c7240ec043f715c91f6b7cf05955df674b9a69d"}
May 21 18:21:00.998988 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:00.998943    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wgwk8" podStartSLOduration=6.189330844 podStartE2EDuration="37.998929915s" podCreationTimestamp="2026-05-21 18:20:23 +0000 UTC" firstStartedPulling="2026-05-21 18:20:26.219784156 +0000 UTC m=+3.145272667" lastFinishedPulling="2026-05-21 18:20:58.02938323 +0000 UTC m=+34.954871738" observedRunningTime="2026-05-21 18:21:00.997638969 +0000 UTC m=+37.923127570" watchObservedRunningTime="2026-05-21 18:21:00.998929915 +0000 UTC m=+37.924418441"
May 21 18:21:01.269460 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:01.269429    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert\") pod \"ingress-canary-2slhb\" (UID: \"89f0442b-784c-49da-910d-122d18137dd7\") " pod="openshift-ingress-canary/ingress-canary-2slhb"
May 21 18:21:01.269601 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:01.269485    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls\") pod \"dns-default-sm8gn\" (UID: \"e43073c9-1e5c-411b-9f5c-8e35b66ffe54\") " pod="openshift-dns/dns-default-sm8gn"
May 21 18:21:01.269601 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:21:01.269573    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:21:01.269677 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:21:01.269625    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert podName:89f0442b-784c-49da-910d-122d18137dd7 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:05.269611664 +0000 UTC m=+42.195100172 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert") pod "ingress-canary-2slhb" (UID: "89f0442b-784c-49da-910d-122d18137dd7") : secret "canary-serving-cert" not found
May 21 18:21:01.269677 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:21:01.269622    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:21:01.269677 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:21:01.269671    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls podName:e43073c9-1e5c-411b-9f5c-8e35b66ffe54 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:05.269657756 +0000 UTC m=+42.195146261 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls") pod "dns-default-sm8gn" (UID: "e43073c9-1e5c-411b-9f5c-8e35b66ffe54") : secret "dns-default-metrics-tls" not found
May 21 18:21:05.295421 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:05.295380    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert\") pod \"ingress-canary-2slhb\" (UID: \"89f0442b-784c-49da-910d-122d18137dd7\") " pod="openshift-ingress-canary/ingress-canary-2slhb"
May 21 18:21:05.295774 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:05.295432    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls\") pod \"dns-default-sm8gn\" (UID: \"e43073c9-1e5c-411b-9f5c-8e35b66ffe54\") " pod="openshift-dns/dns-default-sm8gn"
May 21 18:21:05.295774 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:21:05.295526    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:21:05.295774 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:21:05.295543    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:21:05.295774 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:21:05.295577    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls podName:e43073c9-1e5c-411b-9f5c-8e35b66ffe54 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:13.295562683 +0000 UTC m=+50.221051187 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls") pod "dns-default-sm8gn" (UID: "e43073c9-1e5c-411b-9f5c-8e35b66ffe54") : secret "dns-default-metrics-tls" not found
May 21 18:21:05.295774 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:21:05.295601    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert podName:89f0442b-784c-49da-910d-122d18137dd7 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:13.295586007 +0000 UTC m=+50.221074511 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert") pod "ingress-canary-2slhb" (UID: "89f0442b-784c-49da-910d-122d18137dd7") : secret "canary-serving-cert" not found
May 21 18:21:13.345408 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:13.345363    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls\") pod \"dns-default-sm8gn\" (UID: \"e43073c9-1e5c-411b-9f5c-8e35b66ffe54\") " pod="openshift-dns/dns-default-sm8gn"
May 21 18:21:13.345838 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:13.345456    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert\") pod \"ingress-canary-2slhb\" (UID: \"89f0442b-784c-49da-910d-122d18137dd7\") " pod="openshift-ingress-canary/ingress-canary-2slhb"
May 21 18:21:13.345838 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:21:13.345494    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:21:13.345838 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:21:13.345565    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls podName:e43073c9-1e5c-411b-9f5c-8e35b66ffe54 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:29.345548867 +0000 UTC m=+66.271037372 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls") pod "dns-default-sm8gn" (UID: "e43073c9-1e5c-411b-9f5c-8e35b66ffe54") : secret "dns-default-metrics-tls" not found
May 21 18:21:13.345838 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:21:13.345573    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:21:13.345838 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:21:13.345633    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert podName:89f0442b-784c-49da-910d-122d18137dd7 nodeName:}" failed. No retries permitted until 2026-05-21 18:21:29.345616909 +0000 UTC m=+66.271105429 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert") pod "ingress-canary-2slhb" (UID: "89f0442b-784c-49da-910d-122d18137dd7") : secret "canary-serving-cert" not found
May 21 18:21:24.969191 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:24.969165    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-9qv8k"
May 21 18:21:29.344813 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:29.344784    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs\") pod \"network-metrics-daemon-bqjkb\" (UID: \"f22b878b-cf41-4a22-bbda-ac4a10922613\") " pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:21:29.347913 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:29.347894    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 18:21:29.355280 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:21:29.355264    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 18:21:29.355344 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:21:29.355339    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs podName:f22b878b-cf41-4a22-bbda-ac4a10922613 nodeName:}" failed. No retries permitted until 2026-05-21 18:22:33.355322791 +0000 UTC m=+130.280811296 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs") pod "network-metrics-daemon-bqjkb" (UID: "f22b878b-cf41-4a22-bbda-ac4a10922613") : secret "metrics-daemon-secret" not found
May 21 18:21:29.445384 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:29.445363    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert\") pod \"ingress-canary-2slhb\" (UID: \"89f0442b-784c-49da-910d-122d18137dd7\") " pod="openshift-ingress-canary/ingress-canary-2slhb"
May 21 18:21:29.445462 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:29.445397    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls\") pod \"dns-default-sm8gn\" (UID: \"e43073c9-1e5c-411b-9f5c-8e35b66ffe54\") " pod="openshift-dns/dns-default-sm8gn"
May 21 18:21:29.445462 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:29.445418    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7qstd\" (UniqueName: \"kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd\") pod \"network-check-target-r5cbv\" (UID: \"b0fe80cd-1e55-4221-b6ab-c1bc26507d4f\") " pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:21:29.445530 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:21:29.445502    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:21:29.445570 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:21:29.445560    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert podName:89f0442b-784c-49da-910d-122d18137dd7 nodeName:}" failed. No retries permitted until 2026-05-21 18:22:01.445546625 +0000 UTC m=+98.371035130 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert") pod "ingress-canary-2slhb" (UID: "89f0442b-784c-49da-910d-122d18137dd7") : secret "canary-serving-cert" not found
May 21 18:21:29.445609 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:21:29.445506    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:21:29.445609 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:21:29.445591    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls podName:e43073c9-1e5c-411b-9f5c-8e35b66ffe54 nodeName:}" failed. No retries permitted until 2026-05-21 18:22:01.445584651 +0000 UTC m=+98.371073156 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls") pod "dns-default-sm8gn" (UID: "e43073c9-1e5c-411b-9f5c-8e35b66ffe54") : secret "dns-default-metrics-tls" not found
May 21 18:21:29.448183 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:29.448168    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 18:21:29.459373 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:29.459346    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 18:21:29.469603 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:29.469585    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qstd\" (UniqueName: \"kubernetes.io/projected/b0fe80cd-1e55-4221-b6ab-c1bc26507d4f-kube-api-access-7qstd\") pod \"network-check-target-r5cbv\" (UID: \"b0fe80cd-1e55-4221-b6ab-c1bc26507d4f\") " pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:21:29.603782 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:29.603713    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-pfxnj\""
May 21 18:21:29.612046 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:29.612028    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:21:29.739218 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:29.739187    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r5cbv"]
May 21 18:21:29.742570 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:21:29.742542    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0fe80cd_1e55_4221_b6ab_c1bc26507d4f.slice/crio-1ff22a7c04ef9152d8a941afe518fce94a26c6d92bba339ac46bd9338a379e9a WatchSource:0}: Error finding container 1ff22a7c04ef9152d8a941afe518fce94a26c6d92bba339ac46bd9338a379e9a: Status 404 returned error can't find the container with id 1ff22a7c04ef9152d8a941afe518fce94a26c6d92bba339ac46bd9338a379e9a
May 21 18:21:30.029710 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:30.029670    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r5cbv" event={"ID":"b0fe80cd-1e55-4221-b6ab-c1bc26507d4f","Type":"ContainerStarted","Data":"1ff22a7c04ef9152d8a941afe518fce94a26c6d92bba339ac46bd9338a379e9a"}
May 21 18:21:33.037250 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:33.037216    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r5cbv" event={"ID":"b0fe80cd-1e55-4221-b6ab-c1bc26507d4f","Type":"ContainerStarted","Data":"77e29550a589cba160412adbed074587732440c51cac6abd324a4771e5db3a51"}
May 21 18:21:33.037621 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:33.037337    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:21:33.053561 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:21:33.053521    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r5cbv" podStartSLOduration=67.085737547 podStartE2EDuration="1m10.05350953s" podCreationTimestamp="2026-05-21 18:20:23 +0000 UTC" firstStartedPulling="2026-05-21 18:21:29.744343799 +0000 UTC m=+66.669832305" lastFinishedPulling="2026-05-21 18:21:32.712115769 +0000 UTC m=+69.637604288" observedRunningTime="2026-05-21 18:21:33.052327971 +0000 UTC m=+69.977816492" watchObservedRunningTime="2026-05-21 18:21:33.05350953 +0000 UTC m=+69.978998054"
May 21 18:22:01.460562 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:01.460411    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls\") pod \"dns-default-sm8gn\" (UID: \"e43073c9-1e5c-411b-9f5c-8e35b66ffe54\") " pod="openshift-dns/dns-default-sm8gn"
May 21 18:22:01.460562 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:01.460473    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert\") pod \"ingress-canary-2slhb\" (UID: \"89f0442b-784c-49da-910d-122d18137dd7\") " pod="openshift-ingress-canary/ingress-canary-2slhb"
May 21 18:22:01.461173 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:01.460574    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 18:22:01.461173 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:01.460581    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 18:22:01.461173 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:01.460633    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert podName:89f0442b-784c-49da-910d-122d18137dd7 nodeName:}" failed. No retries permitted until 2026-05-21 18:23:05.460616064 +0000 UTC m=+162.386104569 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert") pod "ingress-canary-2slhb" (UID: "89f0442b-784c-49da-910d-122d18137dd7") : secret "canary-serving-cert" not found
May 21 18:22:01.461173 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:01.460646    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls podName:e43073c9-1e5c-411b-9f5c-8e35b66ffe54 nodeName:}" failed. No retries permitted until 2026-05-21 18:23:05.460640522 +0000 UTC m=+162.386129026 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls") pod "dns-default-sm8gn" (UID: "e43073c9-1e5c-411b-9f5c-8e35b66ffe54") : secret "dns-default-metrics-tls" not found
May 21 18:22:04.042536 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:04.042508    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r5cbv"
May 21 18:22:33.381734 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:33.381698    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs\") pod \"network-metrics-daemon-bqjkb\" (UID: \"f22b878b-cf41-4a22-bbda-ac4a10922613\") " pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:22:33.382211 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:33.381813    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 18:22:33.382211 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:33.381872    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs podName:f22b878b-cf41-4a22-bbda-ac4a10922613 nodeName:}" failed. No retries permitted until 2026-05-21 18:24:35.381856849 +0000 UTC m=+252.307345358 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs") pod "network-metrics-daemon-bqjkb" (UID: "f22b878b-cf41-4a22-bbda-ac4a10922613") : secret "metrics-daemon-secret" not found
May 21 18:22:35.481607 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.481571    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fpzmg"]
May 21 18:22:35.483477 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.483458    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-d9jkq"]
May 21 18:22:35.483612 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.483593    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fpzmg"
May 21 18:22:35.484825 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.484809    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-d9jkq"
May 21 18:22:35.486138 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.486119    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
May 21 18:22:35.486259 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.486196    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
May 21 18:22:35.486342 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.486325    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-b9z9h\""
May 21 18:22:35.487864 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.487839    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 21 18:22:35.488004 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.487987    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 21 18:22:35.488171 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.488155    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 21 18:22:35.488321 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.488283    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-x6s7x\""
May 21 18:22:35.488423 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.488362    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 21 18:22:35.493114 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.493090    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fpzmg"]
May 21 18:22:35.493992 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.493974    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 21 18:22:35.496672 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.496654    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-d9jkq"]
May 21 18:22:35.577684 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.577652    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5"]
May 21 18:22:35.579419 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.579404    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5"
May 21 18:22:35.580682 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.580662    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-94ffb845b-vw5dm"]
May 21 18:22:35.582282 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.582257    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:35.582398 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.582375    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 21 18:22:35.582593 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.582575    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 21 18:22:35.582909 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.582888    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 21 18:22:35.584049 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.584033    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-mjzlg\""
May 21 18:22:35.584152 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.584072    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 21 18:22:35.584554 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.584530    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 21 18:22:35.584650 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.584607    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 21 18:22:35.584788 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.584773    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 21 18:22:35.585226 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.585208    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-qb7j8\""
May 21 18:22:35.585330 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.585233    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 21 18:22:35.585330 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.585211    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 21 18:22:35.585546 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.585531    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 21 18:22:35.592144 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.592120    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5"]
May 21 18:22:35.595055 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.595032    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrj7n\" (UniqueName: \"kubernetes.io/projected/e46e9a9f-aa27-4ae0-b821-0d9ac59edb41-kube-api-access-xrj7n\") pod \"volume-data-source-validator-5cf8c89d64-fpzmg\" (UID: \"e46e9a9f-aa27-4ae0-b821-0d9ac59edb41\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fpzmg"
May 21 18:22:35.595259 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.595232    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4dkm\" (UniqueName: \"kubernetes.io/projected/4e0c7492-8cf6-4b1b-8326-e298f267e011-kube-api-access-v4dkm\") pod \"insights-operator-78bdfb888c-d9jkq\" (UID: \"4e0c7492-8cf6-4b1b-8326-e298f267e011\") " pod="openshift-insights/insights-operator-78bdfb888c-d9jkq"
May 21 18:22:35.595733 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.595712    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e0c7492-8cf6-4b1b-8326-e298f267e011-service-ca-bundle\") pod \"insights-operator-78bdfb888c-d9jkq\" (UID: \"4e0c7492-8cf6-4b1b-8326-e298f267e011\") " pod="openshift-insights/insights-operator-78bdfb888c-d9jkq"
May 21 18:22:35.595826 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.595738    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e0c7492-8cf6-4b1b-8326-e298f267e011-serving-cert\") pod \"insights-operator-78bdfb888c-d9jkq\" (UID: \"4e0c7492-8cf6-4b1b-8326-e298f267e011\") " pod="openshift-insights/insights-operator-78bdfb888c-d9jkq"
May 21 18:22:35.595826 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.595808    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e0c7492-8cf6-4b1b-8326-e298f267e011-tmp\") pod \"insights-operator-78bdfb888c-d9jkq\" (UID: \"4e0c7492-8cf6-4b1b-8326-e298f267e011\") " pod="openshift-insights/insights-operator-78bdfb888c-d9jkq"
May 21 18:22:35.595931 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.595836    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4e0c7492-8cf6-4b1b-8326-e298f267e011-snapshots\") pod \"insights-operator-78bdfb888c-d9jkq\" (UID: \"4e0c7492-8cf6-4b1b-8326-e298f267e011\") " pod="openshift-insights/insights-operator-78bdfb888c-d9jkq"
May 21 18:22:35.595931 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.595854    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e0c7492-8cf6-4b1b-8326-e298f267e011-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-d9jkq\" (UID: \"4e0c7492-8cf6-4b1b-8326-e298f267e011\") " pod="openshift-insights/insights-operator-78bdfb888c-d9jkq"
May 21 18:22:35.600108 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.600086    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-94ffb845b-vw5dm"]
May 21 18:22:35.696211 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.696180    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v4dkm\" (UniqueName: \"kubernetes.io/projected/4e0c7492-8cf6-4b1b-8326-e298f267e011-kube-api-access-v4dkm\") pod \"insights-operator-78bdfb888c-d9jkq\" (UID: \"4e0c7492-8cf6-4b1b-8326-e298f267e011\") " pod="openshift-insights/insights-operator-78bdfb888c-d9jkq"
May 21 18:22:35.696211 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.696215    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:35.696409 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.696238    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1431aa6e-556f-4298-9b0f-ec77a990ad86-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-h9bn5\" (UID: \"1431aa6e-556f-4298-9b0f-ec77a990ad86\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5"
May 21 18:22:35.696409 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.696315    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-default-certificate\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:35.696409 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.696365    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6lcb\" (UniqueName: \"kubernetes.io/projected/1431aa6e-556f-4298-9b0f-ec77a990ad86-kube-api-access-c6lcb\") pod \"cluster-monitoring-operator-6c75959455-h9bn5\" (UID: \"1431aa6e-556f-4298-9b0f-ec77a990ad86\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5"
May 21 18:22:35.696409 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.696385    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxfxl\" (UniqueName: \"kubernetes.io/projected/c4063312-2538-4bdd-853e-cdc90d0db2be-kube-api-access-rxfxl\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:35.696409 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.696403    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:35.696582 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.696430    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e0c7492-8cf6-4b1b-8326-e298f267e011-service-ca-bundle\") pod \"insights-operator-78bdfb888c-d9jkq\" (UID: \"4e0c7492-8cf6-4b1b-8326-e298f267e011\") " pod="openshift-insights/insights-operator-78bdfb888c-d9jkq"
May 21 18:22:35.696582 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.696456    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e0c7492-8cf6-4b1b-8326-e298f267e011-serving-cert\") pod \"insights-operator-78bdfb888c-d9jkq\" (UID: \"4e0c7492-8cf6-4b1b-8326-e298f267e011\") " pod="openshift-insights/insights-operator-78bdfb888c-d9jkq"
May 21 18:22:35.696582 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.696488    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e0c7492-8cf6-4b1b-8326-e298f267e011-tmp\") pod \"insights-operator-78bdfb888c-d9jkq\" (UID: \"4e0c7492-8cf6-4b1b-8326-e298f267e011\") " pod="openshift-insights/insights-operator-78bdfb888c-d9jkq"
May 21 18:22:35.696582 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.696507    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4e0c7492-8cf6-4b1b-8326-e298f267e011-snapshots\") pod \"insights-operator-78bdfb888c-d9jkq\" (UID: \"4e0c7492-8cf6-4b1b-8326-e298f267e011\") " pod="openshift-insights/insights-operator-78bdfb888c-d9jkq"
May 21 18:22:35.696582 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.696530    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e0c7492-8cf6-4b1b-8326-e298f267e011-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-d9jkq\" (UID: \"4e0c7492-8cf6-4b1b-8326-e298f267e011\") " pod="openshift-insights/insights-operator-78bdfb888c-d9jkq"
May 21 18:22:35.696582 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.696561    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h9bn5\" (UID: \"1431aa6e-556f-4298-9b0f-ec77a990ad86\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5"
May 21 18:22:35.696809 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.696588    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-stats-auth\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:35.696809 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.696618    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xrj7n\" (UniqueName: \"kubernetes.io/projected/e46e9a9f-aa27-4ae0-b821-0d9ac59edb41-kube-api-access-xrj7n\") pod \"volume-data-source-validator-5cf8c89d64-fpzmg\" (UID: \"e46e9a9f-aa27-4ae0-b821-0d9ac59edb41\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fpzmg"
May 21 18:22:35.697054 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.697034    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e0c7492-8cf6-4b1b-8326-e298f267e011-service-ca-bundle\") pod \"insights-operator-78bdfb888c-d9jkq\" (UID: \"4e0c7492-8cf6-4b1b-8326-e298f267e011\") " pod="openshift-insights/insights-operator-78bdfb888c-d9jkq"
May 21 18:22:35.697120 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.697108    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4e0c7492-8cf6-4b1b-8326-e298f267e011-tmp\") pod \"insights-operator-78bdfb888c-d9jkq\" (UID: \"4e0c7492-8cf6-4b1b-8326-e298f267e011\") " pod="openshift-insights/insights-operator-78bdfb888c-d9jkq"
May 21 18:22:35.697192 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.697174    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4e0c7492-8cf6-4b1b-8326-e298f267e011-snapshots\") pod \"insights-operator-78bdfb888c-d9jkq\" (UID: \"4e0c7492-8cf6-4b1b-8326-e298f267e011\") " pod="openshift-insights/insights-operator-78bdfb888c-d9jkq"
May 21 18:22:35.697243 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.697227    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4e0c7492-8cf6-4b1b-8326-e298f267e011-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-d9jkq\" (UID: \"4e0c7492-8cf6-4b1b-8326-e298f267e011\") " pod="openshift-insights/insights-operator-78bdfb888c-d9jkq"
May 21 18:22:35.698924 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.698898    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4e0c7492-8cf6-4b1b-8326-e298f267e011-serving-cert\") pod \"insights-operator-78bdfb888c-d9jkq\" (UID: \"4e0c7492-8cf6-4b1b-8326-e298f267e011\") " pod="openshift-insights/insights-operator-78bdfb888c-d9jkq"
May 21 18:22:35.711074 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.711044    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4dkm\" (UniqueName: \"kubernetes.io/projected/4e0c7492-8cf6-4b1b-8326-e298f267e011-kube-api-access-v4dkm\") pod \"insights-operator-78bdfb888c-d9jkq\" (UID: \"4e0c7492-8cf6-4b1b-8326-e298f267e011\") " pod="openshift-insights/insights-operator-78bdfb888c-d9jkq"
May 21 18:22:35.711291 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.711269    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrj7n\" (UniqueName: \"kubernetes.io/projected/e46e9a9f-aa27-4ae0-b821-0d9ac59edb41-kube-api-access-xrj7n\") pod \"volume-data-source-validator-5cf8c89d64-fpzmg\" (UID: \"e46e9a9f-aa27-4ae0-b821-0d9ac59edb41\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fpzmg"
May 21 18:22:35.794173 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.794146    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fpzmg"
May 21 18:22:35.796939 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.796915    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h9bn5\" (UID: \"1431aa6e-556f-4298-9b0f-ec77a990ad86\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5"
May 21 18:22:35.797006 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.796949    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-stats-auth\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:35.797006 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.796970    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:35.797103 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:35.797049    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 18:22:35.797103 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:35.797065    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 18:22:35.797204 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:35.797116    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs podName:c4063312-2538-4bdd-853e-cdc90d0db2be nodeName:}" failed. No retries permitted until 2026-05-21 18:22:36.29709706 +0000 UTC m=+133.222585567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs") pod "router-default-94ffb845b-vw5dm" (UID: "c4063312-2538-4bdd-853e-cdc90d0db2be") : secret "router-metrics-certs-default" not found
May 21 18:22:35.797204 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.797109    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1431aa6e-556f-4298-9b0f-ec77a990ad86-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-h9bn5\" (UID: \"1431aa6e-556f-4298-9b0f-ec77a990ad86\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5"
May 21 18:22:35.797204 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:35.797140    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls podName:1431aa6e-556f-4298-9b0f-ec77a990ad86 nodeName:}" failed. No retries permitted until 2026-05-21 18:22:36.29712251 +0000 UTC m=+133.222611019 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-h9bn5" (UID: "1431aa6e-556f-4298-9b0f-ec77a990ad86") : secret "cluster-monitoring-operator-tls" not found
May 21 18:22:35.797204 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.797196    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-default-certificate\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:35.797484 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.797255    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c6lcb\" (UniqueName: \"kubernetes.io/projected/1431aa6e-556f-4298-9b0f-ec77a990ad86-kube-api-access-c6lcb\") pod \"cluster-monitoring-operator-6c75959455-h9bn5\" (UID: \"1431aa6e-556f-4298-9b0f-ec77a990ad86\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5"
May 21 18:22:35.797484 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.797287    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rxfxl\" (UniqueName: \"kubernetes.io/projected/c4063312-2538-4bdd-853e-cdc90d0db2be-kube-api-access-rxfxl\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:35.797484 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.797337    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:35.797484 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:35.797463    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle podName:c4063312-2538-4bdd-853e-cdc90d0db2be nodeName:}" failed. No retries permitted until 2026-05-21 18:22:36.297449449 +0000 UTC m=+133.222937973 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle") pod "router-default-94ffb845b-vw5dm" (UID: "c4063312-2538-4bdd-853e-cdc90d0db2be") : configmap references non-existent config key: service-ca.crt
May 21 18:22:35.797846 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.797821    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1431aa6e-556f-4298-9b0f-ec77a990ad86-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-h9bn5\" (UID: \"1431aa6e-556f-4298-9b0f-ec77a990ad86\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5"
May 21 18:22:35.800262 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.800231    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-default-certificate\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:35.800375 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.800359    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-d9jkq"
May 21 18:22:35.801089 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.801068    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-stats-auth\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:35.812487 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.812465    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxfxl\" (UniqueName: \"kubernetes.io/projected/c4063312-2538-4bdd-853e-cdc90d0db2be-kube-api-access-rxfxl\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:35.813125 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.813101    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6lcb\" (UniqueName: \"kubernetes.io/projected/1431aa6e-556f-4298-9b0f-ec77a990ad86-kube-api-access-c6lcb\") pod \"cluster-monitoring-operator-6c75959455-h9bn5\" (UID: \"1431aa6e-556f-4298-9b0f-ec77a990ad86\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5"
May 21 18:22:35.919852 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.919819    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fpzmg"]
May 21 18:22:35.923183 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:22:35.923156    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode46e9a9f_aa27_4ae0_b821_0d9ac59edb41.slice/crio-991898fbb6afed92a35c3cfa88f2796cecbe74eee09991550b2dd169d4b9eea3 WatchSource:0}: Error finding container 991898fbb6afed92a35c3cfa88f2796cecbe74eee09991550b2dd169d4b9eea3: Status 404 returned error can't find the container with id 991898fbb6afed92a35c3cfa88f2796cecbe74eee09991550b2dd169d4b9eea3
May 21 18:22:35.937330 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:35.937288    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-d9jkq"]
May 21 18:22:35.956689 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:22:35.956668    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e0c7492_8cf6_4b1b_8326_e298f267e011.slice/crio-41581f64c215d9357dc0c61b086f0164950bbd78797eed4adf00d1efff42f4ee WatchSource:0}: Error finding container 41581f64c215d9357dc0c61b086f0164950bbd78797eed4adf00d1efff42f4ee: Status 404 returned error can't find the container with id 41581f64c215d9357dc0c61b086f0164950bbd78797eed4adf00d1efff42f4ee
May 21 18:22:36.152626 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:36.152543    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-d9jkq" event={"ID":"4e0c7492-8cf6-4b1b-8326-e298f267e011","Type":"ContainerStarted","Data":"41581f64c215d9357dc0c61b086f0164950bbd78797eed4adf00d1efff42f4ee"}
May 21 18:22:36.153453 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:36.153433    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fpzmg" event={"ID":"e46e9a9f-aa27-4ae0-b821-0d9ac59edb41","Type":"ContainerStarted","Data":"991898fbb6afed92a35c3cfa88f2796cecbe74eee09991550b2dd169d4b9eea3"}
May 21 18:22:36.301195 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:36.301153    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h9bn5\" (UID: \"1431aa6e-556f-4298-9b0f-ec77a990ad86\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5"
May 21 18:22:36.301389 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:36.301207    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:36.301389 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:36.301278    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:36.301389 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:36.301326    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 18:22:36.301389 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:36.301376    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 18:22:36.301561 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:36.301394    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls podName:1431aa6e-556f-4298-9b0f-ec77a990ad86 nodeName:}" failed. No retries permitted until 2026-05-21 18:22:37.301375073 +0000 UTC m=+134.226863581 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-h9bn5" (UID: "1431aa6e-556f-4298-9b0f-ec77a990ad86") : secret "cluster-monitoring-operator-tls" not found
May 21 18:22:36.301561 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:36.301421    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs podName:c4063312-2538-4bdd-853e-cdc90d0db2be nodeName:}" failed. No retries permitted until 2026-05-21 18:22:37.301407936 +0000 UTC m=+134.226896441 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs") pod "router-default-94ffb845b-vw5dm" (UID: "c4063312-2538-4bdd-853e-cdc90d0db2be") : secret "router-metrics-certs-default" not found
May 21 18:22:36.301561 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:36.301436    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle podName:c4063312-2538-4bdd-853e-cdc90d0db2be nodeName:}" failed. No retries permitted until 2026-05-21 18:22:37.301429855 +0000 UTC m=+134.226918361 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle") pod "router-default-94ffb845b-vw5dm" (UID: "c4063312-2538-4bdd-853e-cdc90d0db2be") : configmap references non-existent config key: service-ca.crt
May 21 18:22:37.309187 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.309123    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:37.309642 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.309223    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:37.309642 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.309278    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h9bn5\" (UID: \"1431aa6e-556f-4298-9b0f-ec77a990ad86\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5"
May 21 18:22:37.309642 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:37.309324    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 18:22:37.309642 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:37.309400    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs podName:c4063312-2538-4bdd-853e-cdc90d0db2be nodeName:}" failed. No retries permitted until 2026-05-21 18:22:39.309380533 +0000 UTC m=+136.234869047 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs") pod "router-default-94ffb845b-vw5dm" (UID: "c4063312-2538-4bdd-853e-cdc90d0db2be") : secret "router-metrics-certs-default" not found
May 21 18:22:37.309642 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:37.309407    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 18:22:37.309642 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:37.309420    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle podName:c4063312-2538-4bdd-853e-cdc90d0db2be nodeName:}" failed. No retries permitted until 2026-05-21 18:22:39.309410308 +0000 UTC m=+136.234898819 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle") pod "router-default-94ffb845b-vw5dm" (UID: "c4063312-2538-4bdd-853e-cdc90d0db2be") : configmap references non-existent config key: service-ca.crt
May 21 18:22:37.309642 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:37.309456    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls podName:1431aa6e-556f-4298-9b0f-ec77a990ad86 nodeName:}" failed. No retries permitted until 2026-05-21 18:22:39.30943978 +0000 UTC m=+136.234928291 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-h9bn5" (UID: "1431aa6e-556f-4298-9b0f-ec77a990ad86") : secret "cluster-monitoring-operator-tls" not found
May 21 18:22:37.503449 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.503422    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-jrmpx"]
May 21 18:22:37.505487 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.505470    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-jrmpx"
May 21 18:22:37.508065 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.508044    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 21 18:22:37.508160 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.508071    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 21 18:22:37.509206 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.509190    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-nfpnp\""
May 21 18:22:37.509337 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.509291    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 21 18:22:37.509435 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.509342    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 21 18:22:37.516398 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.516368    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-jrmpx"]
May 21 18:22:37.610912 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.610838    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mfcp\" (UniqueName: \"kubernetes.io/projected/c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55-kube-api-access-8mfcp\") pod \"service-ca-operator-57b5b68b8-jrmpx\" (UID: \"c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-jrmpx"
May 21 18:22:37.610912 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.610887    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55-serving-cert\") pod \"service-ca-operator-57b5b68b8-jrmpx\" (UID: \"c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-jrmpx"
May 21 18:22:37.611074 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.610948    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55-config\") pod \"service-ca-operator-57b5b68b8-jrmpx\" (UID: \"c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-jrmpx"
May 21 18:22:37.711711 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.711678    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8mfcp\" (UniqueName: \"kubernetes.io/projected/c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55-kube-api-access-8mfcp\") pod \"service-ca-operator-57b5b68b8-jrmpx\" (UID: \"c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-jrmpx"
May 21 18:22:37.711864 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.711730    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55-serving-cert\") pod \"service-ca-operator-57b5b68b8-jrmpx\" (UID: \"c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-jrmpx"
May 21 18:22:37.711864 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.711759    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55-config\") pod \"service-ca-operator-57b5b68b8-jrmpx\" (UID: \"c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-jrmpx"
May 21 18:22:37.712322 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.712281    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55-config\") pod \"service-ca-operator-57b5b68b8-jrmpx\" (UID: \"c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-jrmpx"
May 21 18:22:37.714096 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.714071    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55-serving-cert\") pod \"service-ca-operator-57b5b68b8-jrmpx\" (UID: \"c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-jrmpx"
May 21 18:22:37.720515 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.720492    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mfcp\" (UniqueName: \"kubernetes.io/projected/c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55-kube-api-access-8mfcp\") pod \"service-ca-operator-57b5b68b8-jrmpx\" (UID: \"c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-jrmpx"
May 21 18:22:37.819734 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:37.819700    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-jrmpx"
May 21 18:22:38.160018 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:38.159987    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fpzmg" event={"ID":"e46e9a9f-aa27-4ae0-b821-0d9ac59edb41","Type":"ContainerStarted","Data":"94b5b238f1b5770f4e80020a0487aabf212c28804b069fa5eee96202ab027fb6"}
May 21 18:22:38.184642 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:38.184597    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5cf8c89d64-fpzmg" podStartSLOduration=1.6252649030000001 podStartE2EDuration="3.184580146s" podCreationTimestamp="2026-05-21 18:22:35 +0000 UTC" firstStartedPulling="2026-05-21 18:22:35.924862339 +0000 UTC m=+132.850350844" lastFinishedPulling="2026-05-21 18:22:37.484177579 +0000 UTC m=+134.409666087" observedRunningTime="2026-05-21 18:22:38.184146797 +0000 UTC m=+135.109635323" watchObservedRunningTime="2026-05-21 18:22:38.184580146 +0000 UTC m=+135.110068670"
May 21 18:22:38.271032 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:38.271008    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-jrmpx"]
May 21 18:22:38.274549 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:22:38.274525    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8f30455_1de9_47a7_9fd3_5b6f7f2dbb55.slice/crio-07ebccbd45b48d9db1f96a7a2d64d2be0bd5bb6ce9954ba1ee3b1b28c5084feb WatchSource:0}: Error finding container 07ebccbd45b48d9db1f96a7a2d64d2be0bd5bb6ce9954ba1ee3b1b28c5084feb: Status 404 returned error can't find the container with id 07ebccbd45b48d9db1f96a7a2d64d2be0bd5bb6ce9954ba1ee3b1b28c5084feb
May 21 18:22:39.164092 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:39.164035    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-d9jkq" event={"ID":"4e0c7492-8cf6-4b1b-8326-e298f267e011","Type":"ContainerStarted","Data":"b31cc0573c0993c22aa3aaa2f6eb5b654b2d005ead151df7e0718a689f633f9e"}
May 21 18:22:39.165173 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:39.165124    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-jrmpx" event={"ID":"c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55","Type":"ContainerStarted","Data":"07ebccbd45b48d9db1f96a7a2d64d2be0bd5bb6ce9954ba1ee3b1b28c5084feb"}
May 21 18:22:39.180336 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:39.180273    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-d9jkq" podStartSLOduration=1.945907952 podStartE2EDuration="4.180256753s" podCreationTimestamp="2026-05-21 18:22:35 +0000 UTC" firstStartedPulling="2026-05-21 18:22:35.958180654 +0000 UTC m=+132.883669163" lastFinishedPulling="2026-05-21 18:22:38.192529454 +0000 UTC m=+135.118017964" observedRunningTime="2026-05-21 18:22:39.180213171 +0000 UTC m=+136.105701698" watchObservedRunningTime="2026-05-21 18:22:39.180256753 +0000 UTC m=+136.105745280"
May 21 18:22:39.323550 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:39.323501    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:39.323706 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:39.323631    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h9bn5\" (UID: \"1431aa6e-556f-4298-9b0f-ec77a990ad86\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5"
May 21 18:22:39.323706 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:39.323694    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle podName:c4063312-2538-4bdd-853e-cdc90d0db2be nodeName:}" failed. No retries permitted until 2026-05-21 18:22:43.323671199 +0000 UTC m=+140.249159715 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle") pod "router-default-94ffb845b-vw5dm" (UID: "c4063312-2538-4bdd-853e-cdc90d0db2be") : configmap references non-existent config key: service-ca.crt
May 21 18:22:39.323859 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:39.323753    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:39.324044 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:39.324028    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 18:22:39.324114 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:39.324040    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 18:22:39.324114 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:39.324070    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs podName:c4063312-2538-4bdd-853e-cdc90d0db2be nodeName:}" failed. No retries permitted until 2026-05-21 18:22:43.324058391 +0000 UTC m=+140.249546899 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs") pod "router-default-94ffb845b-vw5dm" (UID: "c4063312-2538-4bdd-853e-cdc90d0db2be") : secret "router-metrics-certs-default" not found
May 21 18:22:39.324114 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:39.324101    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls podName:1431aa6e-556f-4298-9b0f-ec77a990ad86 nodeName:}" failed. No retries permitted until 2026-05-21 18:22:43.32408416 +0000 UTC m=+140.249572665 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-h9bn5" (UID: "1431aa6e-556f-4298-9b0f-ec77a990ad86") : secret "cluster-monitoring-operator-tls" not found
May 21 18:22:39.920090 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:39.920055    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-qbbbn"]
May 21 18:22:39.922084 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:39.922068    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qbbbn"
May 21 18:22:39.925045 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:39.925025    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 21 18:22:39.926208 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:39.926183    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 21 18:22:39.926321 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:39.926279    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-m5mwt\""
May 21 18:22:39.930674 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:39.930651    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-qbbbn"]
May 21 18:22:40.029840 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:40.029804    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ln6cn\" (UniqueName: \"kubernetes.io/projected/1bc6a605-0aba-4c17-a709-da041e322719-kube-api-access-ln6cn\") pod \"migrator-b985f5d89-qbbbn\" (UID: \"1bc6a605-0aba-4c17-a709-da041e322719\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qbbbn"
May 21 18:22:40.130331 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:40.130280    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ln6cn\" (UniqueName: \"kubernetes.io/projected/1bc6a605-0aba-4c17-a709-da041e322719-kube-api-access-ln6cn\") pod \"migrator-b985f5d89-qbbbn\" (UID: \"1bc6a605-0aba-4c17-a709-da041e322719\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qbbbn"
May 21 18:22:40.138601 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:40.138581    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ln6cn\" (UniqueName: \"kubernetes.io/projected/1bc6a605-0aba-4c17-a709-da041e322719-kube-api-access-ln6cn\") pod \"migrator-b985f5d89-qbbbn\" (UID: \"1bc6a605-0aba-4c17-a709-da041e322719\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qbbbn"
May 21 18:22:40.231316 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:40.231243    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qbbbn"
May 21 18:22:40.364399 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:40.364365    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-qbbbn"]
May 21 18:22:40.810941 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:22:40.810908    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bc6a605_0aba_4c17_a709_da041e322719.slice/crio-a698e5dc4f14776f52299c09d19e410a78b25490a856258003bd74b825523c06 WatchSource:0}: Error finding container a698e5dc4f14776f52299c09d19e410a78b25490a856258003bd74b825523c06: Status 404 returned error can't find the container with id a698e5dc4f14776f52299c09d19e410a78b25490a856258003bd74b825523c06
May 21 18:22:41.170247 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:41.170160    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qbbbn" event={"ID":"1bc6a605-0aba-4c17-a709-da041e322719","Type":"ContainerStarted","Data":"a698e5dc4f14776f52299c09d19e410a78b25490a856258003bd74b825523c06"}
May 21 18:22:41.171392 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:41.171363    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-jrmpx" event={"ID":"c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55","Type":"ContainerStarted","Data":"7fb908cb23c08f36f20c13ea823ed8a08d22447d7d3954bf7bf56e6672b40ca0"}
May 21 18:22:41.188405 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:41.188362    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-jrmpx" podStartSLOduration=1.628499679 podStartE2EDuration="4.188349941s" podCreationTimestamp="2026-05-21 18:22:37 +0000 UTC" firstStartedPulling="2026-05-21 18:22:38.276373557 +0000 UTC m=+135.201862062" lastFinishedPulling="2026-05-21 18:22:40.836223815 +0000 UTC m=+137.761712324" observedRunningTime="2026-05-21 18:22:41.187357904 +0000 UTC m=+138.112846431" watchObservedRunningTime="2026-05-21 18:22:41.188349941 +0000 UTC m=+138.113838468"
May 21 18:22:41.463702 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:41.463636    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jtz2j_3632a020-9a04-421c-8049-cb069bbd909a/dns-node-resolver/0.log"
May 21 18:22:42.465096 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:42.465019    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7fgmq_e3f4defa-2429-43c6-aee6-c8ac57ad956b/node-ca/0.log"
May 21 18:22:43.178278 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:43.178235    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qbbbn" event={"ID":"1bc6a605-0aba-4c17-a709-da041e322719","Type":"ContainerStarted","Data":"39cb8c1e0e4d6d4cd4e7922248c32d1e85031a165d8ef7c99368ae39e3ff2847"}
May 21 18:22:43.178278 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:43.178278    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qbbbn" event={"ID":"1bc6a605-0aba-4c17-a709-da041e322719","Type":"ContainerStarted","Data":"8e96a7508868be3c9d940de4aec1e76b7d3c10376659c838dd948f443198550a"}
May 21 18:22:43.194946 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:43.194900    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qbbbn" podStartSLOduration=2.803382248 podStartE2EDuration="4.194886741s" podCreationTimestamp="2026-05-21 18:22:39 +0000 UTC" firstStartedPulling="2026-05-21 18:22:40.812724922 +0000 UTC m=+137.738213428" lastFinishedPulling="2026-05-21 18:22:42.204229417 +0000 UTC m=+139.129717921" observedRunningTime="2026-05-21 18:22:43.193448627 +0000 UTC m=+140.118937154" watchObservedRunningTime="2026-05-21 18:22:43.194886741 +0000 UTC m=+140.120375267"
May 21 18:22:43.359447 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:43.359408    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:43.359613 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:43.359477    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h9bn5\" (UID: \"1431aa6e-556f-4298-9b0f-ec77a990ad86\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5"
May 21 18:22:43.359613 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:43.359502    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:43.359613 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:43.359573    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle podName:c4063312-2538-4bdd-853e-cdc90d0db2be nodeName:}" failed. No retries permitted until 2026-05-21 18:22:51.359555884 +0000 UTC m=+148.285044389 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle") pod "router-default-94ffb845b-vw5dm" (UID: "c4063312-2538-4bdd-853e-cdc90d0db2be") : configmap references non-existent config key: service-ca.crt
May 21 18:22:43.359613 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:43.359610    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 18:22:43.359775 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:43.359620    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 18:22:43.359775 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:43.359658    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs podName:c4063312-2538-4bdd-853e-cdc90d0db2be nodeName:}" failed. No retries permitted until 2026-05-21 18:22:51.359639957 +0000 UTC m=+148.285128465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs") pod "router-default-94ffb845b-vw5dm" (UID: "c4063312-2538-4bdd-853e-cdc90d0db2be") : secret "router-metrics-certs-default" not found
May 21 18:22:43.359775 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:43.359673    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls podName:1431aa6e-556f-4298-9b0f-ec77a990ad86 nodeName:}" failed. No retries permitted until 2026-05-21 18:22:51.359666637 +0000 UTC m=+148.285155141 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-h9bn5" (UID: "1431aa6e-556f-4298-9b0f-ec77a990ad86") : secret "cluster-monitoring-operator-tls" not found
May 21 18:22:51.423194 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:51.423148    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h9bn5\" (UID: \"1431aa6e-556f-4298-9b0f-ec77a990ad86\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5"
May 21 18:22:51.423194 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:51.423201    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:51.423620 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:22:51.423248    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:22:51.423620 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:51.423317    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 18:22:51.423620 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:51.423353    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 18:22:51.423620 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:51.423390    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls podName:1431aa6e-556f-4298-9b0f-ec77a990ad86 nodeName:}" failed. No retries permitted until 2026-05-21 18:23:07.423368833 +0000 UTC m=+164.348857345 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-h9bn5" (UID: "1431aa6e-556f-4298-9b0f-ec77a990ad86") : secret "cluster-monitoring-operator-tls" not found
May 21 18:22:51.423620 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:51.423406    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle podName:c4063312-2538-4bdd-853e-cdc90d0db2be nodeName:}" failed. No retries permitted until 2026-05-21 18:23:07.423399551 +0000 UTC m=+164.348888055 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle") pod "router-default-94ffb845b-vw5dm" (UID: "c4063312-2538-4bdd-853e-cdc90d0db2be") : configmap references non-existent config key: service-ca.crt
May 21 18:22:51.423620 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:22:51.423418    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs podName:c4063312-2538-4bdd-853e-cdc90d0db2be nodeName:}" failed. No retries permitted until 2026-05-21 18:23:07.42341181 +0000 UTC m=+164.348900315 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs") pod "router-default-94ffb845b-vw5dm" (UID: "c4063312-2538-4bdd-853e-cdc90d0db2be") : secret "router-metrics-certs-default" not found
May 21 18:23:00.524826 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:23:00.524784    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-sm8gn" podUID="e43073c9-1e5c-411b-9f5c-8e35b66ffe54"
May 21 18:23:00.539902 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:23:00.539885    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-2slhb" podUID="89f0442b-784c-49da-910d-122d18137dd7"
May 21 18:23:01.220568 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:01.220539    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sm8gn"
May 21 18:23:01.695857 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:23:01.695813    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bqjkb" podUID="f22b878b-cf41-4a22-bbda-ac4a10922613"
May 21 18:23:05.526989 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:05.526939    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls\") pod \"dns-default-sm8gn\" (UID: \"e43073c9-1e5c-411b-9f5c-8e35b66ffe54\") " pod="openshift-dns/dns-default-sm8gn"
May 21 18:23:05.527406 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:05.527025    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert\") pod \"ingress-canary-2slhb\" (UID: \"89f0442b-784c-49da-910d-122d18137dd7\") " pod="openshift-ingress-canary/ingress-canary-2slhb"
May 21 18:23:05.529266 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:05.529241    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/e43073c9-1e5c-411b-9f5c-8e35b66ffe54-metrics-tls\") pod \"dns-default-sm8gn\" (UID: \"e43073c9-1e5c-411b-9f5c-8e35b66ffe54\") " pod="openshift-dns/dns-default-sm8gn"
May 21 18:23:05.529509 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:05.529489    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/89f0442b-784c-49da-910d-122d18137dd7-cert\") pod \"ingress-canary-2slhb\" (UID: \"89f0442b-784c-49da-910d-122d18137dd7\") " pod="openshift-ingress-canary/ingress-canary-2slhb"
May 21 18:23:05.724370 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:05.724336    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hpqft\""
May 21 18:23:05.731790 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:05.731768    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sm8gn"
May 21 18:23:05.847727 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:05.847694    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sm8gn"]
May 21 18:23:05.850459 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:23:05.850430    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode43073c9_1e5c_411b_9f5c_8e35b66ffe54.slice/crio-821d85022da68d381b251b3798602834b0e47fafbc1e45bc1cb2a839d470a010 WatchSource:0}: Error finding container 821d85022da68d381b251b3798602834b0e47fafbc1e45bc1cb2a839d470a010: Status 404 returned error can't find the container with id 821d85022da68d381b251b3798602834b0e47fafbc1e45bc1cb2a839d470a010
May 21 18:23:06.233834 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:06.233794    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sm8gn" event={"ID":"e43073c9-1e5c-411b-9f5c-8e35b66ffe54","Type":"ContainerStarted","Data":"821d85022da68d381b251b3798602834b0e47fafbc1e45bc1cb2a839d470a010"}
May 21 18:23:07.237559 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:07.237522    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sm8gn" event={"ID":"e43073c9-1e5c-411b-9f5c-8e35b66ffe54","Type":"ContainerStarted","Data":"2d6e4937cd4bfda32e3d621f3467917c5e6c8ecc9d39d825d3cb6be95ef6a513"}
May 21 18:23:07.237559 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:07.237557    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sm8gn" event={"ID":"e43073c9-1e5c-411b-9f5c-8e35b66ffe54","Type":"ContainerStarted","Data":"31ffa9a96047de32cdb8f06f6b1ba0f46ec997278a21770a46ca1a9050a26cbc"}
May 21 18:23:07.237926 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:07.237649    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sm8gn"
May 21 18:23:07.257012 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:07.256937    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-sm8gn" podStartSLOduration=129.116562236 podStartE2EDuration="2m10.256926806s" podCreationTimestamp="2026-05-21 18:20:57 +0000 UTC" firstStartedPulling="2026-05-21 18:23:05.852265631 +0000 UTC m=+162.777754137" lastFinishedPulling="2026-05-21 18:23:06.992630187 +0000 UTC m=+163.918118707" observedRunningTime="2026-05-21 18:23:07.255178445 +0000 UTC m=+164.180666971" watchObservedRunningTime="2026-05-21 18:23:07.256926806 +0000 UTC m=+164.182415359"
May 21 18:23:07.440681 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:07.440639    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h9bn5\" (UID: \"1431aa6e-556f-4298-9b0f-ec77a990ad86\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5"
May 21 18:23:07.440681 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:07.440691    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:23:07.440893 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:07.440741    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:23:07.441459 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:07.441429    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c4063312-2538-4bdd-853e-cdc90d0db2be-service-ca-bundle\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:23:07.443059 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:07.443035    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1431aa6e-556f-4298-9b0f-ec77a990ad86-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-h9bn5\" (UID: \"1431aa6e-556f-4298-9b0f-ec77a990ad86\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5"
May 21 18:23:07.443059 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:07.443048    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c4063312-2538-4bdd-853e-cdc90d0db2be-metrics-certs\") pod \"router-default-94ffb845b-vw5dm\" (UID: \"c4063312-2538-4bdd-853e-cdc90d0db2be\") " pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:23:07.690135 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:07.690048    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5"
May 21 18:23:07.697743 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:07.697700    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:23:07.816585 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:07.816553    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5"]
May 21 18:23:07.819275 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:23:07.819244    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1431aa6e_556f_4298_9b0f_ec77a990ad86.slice/crio-c75766c6c7c9b47bff566e77122b47593c2f62d8cbbfda5747ce9dd19d0acd7a WatchSource:0}: Error finding container c75766c6c7c9b47bff566e77122b47593c2f62d8cbbfda5747ce9dd19d0acd7a: Status 404 returned error can't find the container with id c75766c6c7c9b47bff566e77122b47593c2f62d8cbbfda5747ce9dd19d0acd7a
May 21 18:23:07.835127 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:07.835030    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-94ffb845b-vw5dm"]
May 21 18:23:07.837280 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:23:07.837259    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4063312_2538_4bdd_853e_cdc90d0db2be.slice/crio-b5d15b8a2febb8f8b0f76806b56ecb4e02a6df53ea0da84d1a0038e91effba8e WatchSource:0}: Error finding container b5d15b8a2febb8f8b0f76806b56ecb4e02a6df53ea0da84d1a0038e91effba8e: Status 404 returned error can't find the container with id b5d15b8a2febb8f8b0f76806b56ecb4e02a6df53ea0da84d1a0038e91effba8e
May 21 18:23:08.241718 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.241679    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-94ffb845b-vw5dm" event={"ID":"c4063312-2538-4bdd-853e-cdc90d0db2be","Type":"ContainerStarted","Data":"4e66f51b44f1898656674a781002979172aef15527fd09fbb010ed48fe86f753"}
May 21 18:23:08.242156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.241723    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-94ffb845b-vw5dm" event={"ID":"c4063312-2538-4bdd-853e-cdc90d0db2be","Type":"ContainerStarted","Data":"b5d15b8a2febb8f8b0f76806b56ecb4e02a6df53ea0da84d1a0038e91effba8e"}
May 21 18:23:08.242786 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.242764    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5" event={"ID":"1431aa6e-556f-4298-9b0f-ec77a990ad86","Type":"ContainerStarted","Data":"c75766c6c7c9b47bff566e77122b47593c2f62d8cbbfda5747ce9dd19d0acd7a"}
May 21 18:23:08.268125 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.268060    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-94ffb845b-vw5dm" podStartSLOduration=33.268046985 podStartE2EDuration="33.268046985s" podCreationTimestamp="2026-05-21 18:22:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:23:08.266859749 +0000 UTC m=+165.192348275" watchObservedRunningTime="2026-05-21 18:23:08.268046985 +0000 UTC m=+165.193535512"
May 21 18:23:08.379742 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.379710    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k4j68"]
May 21 18:23:08.381782 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.381762    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k4j68"
May 21 18:23:08.384673 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.384651    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 21 18:23:08.384771 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.384699    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-khvvx\""
May 21 18:23:08.385004 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.384986    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 21 18:23:08.394666 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.394647    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k4j68"]
May 21 18:23:08.448040 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.448019    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1586a237-3bc6-41ca-825d-cf2e89d4d709-crio-socket\") pod \"insights-runtime-extractor-k4j68\" (UID: \"1586a237-3bc6-41ca-825d-cf2e89d4d709\") " pod="openshift-insights/insights-runtime-extractor-k4j68"
May 21 18:23:08.448163 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.448063    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1586a237-3bc6-41ca-825d-cf2e89d4d709-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4j68\" (UID: \"1586a237-3bc6-41ca-825d-cf2e89d4d709\") " pod="openshift-insights/insights-runtime-extractor-k4j68"
May 21 18:23:08.448163 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.448103    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1586a237-3bc6-41ca-825d-cf2e89d4d709-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k4j68\" (UID: \"1586a237-3bc6-41ca-825d-cf2e89d4d709\") " pod="openshift-insights/insights-runtime-extractor-k4j68"
May 21 18:23:08.448264 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.448166    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjhll\" (UniqueName: \"kubernetes.io/projected/1586a237-3bc6-41ca-825d-cf2e89d4d709-kube-api-access-sjhll\") pod \"insights-runtime-extractor-k4j68\" (UID: \"1586a237-3bc6-41ca-825d-cf2e89d4d709\") " pod="openshift-insights/insights-runtime-extractor-k4j68"
May 21 18:23:08.448264 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.448197    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1586a237-3bc6-41ca-825d-cf2e89d4d709-data-volume\") pod \"insights-runtime-extractor-k4j68\" (UID: \"1586a237-3bc6-41ca-825d-cf2e89d4d709\") " pod="openshift-insights/insights-runtime-extractor-k4j68"
May 21 18:23:08.548880 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.548808    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1586a237-3bc6-41ca-825d-cf2e89d4d709-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k4j68\" (UID: \"1586a237-3bc6-41ca-825d-cf2e89d4d709\") " pod="openshift-insights/insights-runtime-extractor-k4j68"
May 21 18:23:08.548880 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.548842    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjhll\" (UniqueName: \"kubernetes.io/projected/1586a237-3bc6-41ca-825d-cf2e89d4d709-kube-api-access-sjhll\") pod \"insights-runtime-extractor-k4j68\" (UID: \"1586a237-3bc6-41ca-825d-cf2e89d4d709\") " pod="openshift-insights/insights-runtime-extractor-k4j68"
May 21 18:23:08.548880 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.548868    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1586a237-3bc6-41ca-825d-cf2e89d4d709-data-volume\") pod \"insights-runtime-extractor-k4j68\" (UID: \"1586a237-3bc6-41ca-825d-cf2e89d4d709\") " pod="openshift-insights/insights-runtime-extractor-k4j68"
May 21 18:23:08.549125 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.548900    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1586a237-3bc6-41ca-825d-cf2e89d4d709-crio-socket\") pod \"insights-runtime-extractor-k4j68\" (UID: \"1586a237-3bc6-41ca-825d-cf2e89d4d709\") " pod="openshift-insights/insights-runtime-extractor-k4j68"
May 21 18:23:08.549125 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.548961    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1586a237-3bc6-41ca-825d-cf2e89d4d709-crio-socket\") pod \"insights-runtime-extractor-k4j68\" (UID: \"1586a237-3bc6-41ca-825d-cf2e89d4d709\") " pod="openshift-insights/insights-runtime-extractor-k4j68"
May 21 18:23:08.549125 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.549031    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1586a237-3bc6-41ca-825d-cf2e89d4d709-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4j68\" (UID: \"1586a237-3bc6-41ca-825d-cf2e89d4d709\") " pod="openshift-insights/insights-runtime-extractor-k4j68"
May 21 18:23:08.549361 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.549298    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1586a237-3bc6-41ca-825d-cf2e89d4d709-data-volume\") pod \"insights-runtime-extractor-k4j68\" (UID: \"1586a237-3bc6-41ca-825d-cf2e89d4d709\") " pod="openshift-insights/insights-runtime-extractor-k4j68"
May 21 18:23:08.549425 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.549404    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1586a237-3bc6-41ca-825d-cf2e89d4d709-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k4j68\" (UID: \"1586a237-3bc6-41ca-825d-cf2e89d4d709\") " pod="openshift-insights/insights-runtime-extractor-k4j68"
May 21 18:23:08.551179 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.551154    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1586a237-3bc6-41ca-825d-cf2e89d4d709-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4j68\" (UID: \"1586a237-3bc6-41ca-825d-cf2e89d4d709\") " pod="openshift-insights/insights-runtime-extractor-k4j68"
May 21 18:23:08.560288 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.560264    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjhll\" (UniqueName: \"kubernetes.io/projected/1586a237-3bc6-41ca-825d-cf2e89d4d709-kube-api-access-sjhll\") pod \"insights-runtime-extractor-k4j68\" (UID: \"1586a237-3bc6-41ca-825d-cf2e89d4d709\") " pod="openshift-insights/insights-runtime-extractor-k4j68"
May 21 18:23:08.690666 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.690643    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k4j68"
May 21 18:23:08.698436 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.698414    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:23:08.701428 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.701407    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:23:08.817204 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:08.817132    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k4j68"]
May 21 18:23:08.821173 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:23:08.821146    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1586a237_3bc6_41ca_825d_cf2e89d4d709.slice/crio-23bf62feaa8767b312df64d541ff53b1a073231337afa33060c8d9d75730304c WatchSource:0}: Error finding container 23bf62feaa8767b312df64d541ff53b1a073231337afa33060c8d9d75730304c: Status 404 returned error can't find the container with id 23bf62feaa8767b312df64d541ff53b1a073231337afa33060c8d9d75730304c
May 21 18:23:09.247321 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:09.247280    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k4j68" event={"ID":"1586a237-3bc6-41ca-825d-cf2e89d4d709","Type":"ContainerStarted","Data":"0be84b1dde59705ae8948919fdd4795159f16479880f8a5687599e39df80fac8"}
May 21 18:23:09.247712 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:09.247331    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k4j68" event={"ID":"1586a237-3bc6-41ca-825d-cf2e89d4d709","Type":"ContainerStarted","Data":"23bf62feaa8767b312df64d541ff53b1a073231337afa33060c8d9d75730304c"}
May 21 18:23:09.247712 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:09.247547    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:23:09.248644 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:09.248623    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-94ffb845b-vw5dm"
May 21 18:23:10.251680 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:10.251641    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k4j68" event={"ID":"1586a237-3bc6-41ca-825d-cf2e89d4d709","Type":"ContainerStarted","Data":"af7f26beda8c8db0358bffea2b99f204ffb90ab0e1a5e680d719fbdc26419e29"}
May 21 18:23:10.253019 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:10.252992    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5" event={"ID":"1431aa6e-556f-4298-9b0f-ec77a990ad86","Type":"ContainerStarted","Data":"f18a75d3041ea9f11003780786aa3ac86cfc715e5a7d56ea5cfe0b345a21a0b3"}
May 21 18:23:10.269730 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:10.269691    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-h9bn5" podStartSLOduration=33.174450763 podStartE2EDuration="35.269679164s" podCreationTimestamp="2026-05-21 18:22:35 +0000 UTC" firstStartedPulling="2026-05-21 18:23:07.821133724 +0000 UTC m=+164.746622233" lastFinishedPulling="2026-05-21 18:23:09.916362129 +0000 UTC m=+166.841850634" observedRunningTime="2026-05-21 18:23:10.269095858 +0000 UTC m=+167.194584385" watchObservedRunningTime="2026-05-21 18:23:10.269679164 +0000 UTC m=+167.195167690"
May 21 18:23:10.428208 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:10.428177    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fsds2"]
May 21 18:23:10.431253 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:10.431225    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fsds2"
May 21 18:23:10.433888 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:10.433863    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 21 18:23:10.434090 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:10.434071    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-mbm8f\""
May 21 18:23:10.438768 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:10.438731    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fsds2"]
May 21 18:23:10.466042 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:10.466016    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/278ba78d-f521-450a-8526-6841273b5290-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-fsds2\" (UID: \"278ba78d-f521-450a-8526-6841273b5290\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fsds2"
May 21 18:23:10.566776 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:10.566685    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/278ba78d-f521-450a-8526-6841273b5290-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-fsds2\" (UID: \"278ba78d-f521-450a-8526-6841273b5290\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fsds2"
May 21 18:23:10.566931 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:23:10.566826    2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
May 21 18:23:10.566931 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:23:10.566897    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/278ba78d-f521-450a-8526-6841273b5290-tls-certificates podName:278ba78d-f521-450a-8526-6841273b5290 nodeName:}" failed. No retries permitted until 2026-05-21 18:23:11.066876296 +0000 UTC m=+167.992364803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/278ba78d-f521-450a-8526-6841273b5290-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-fsds2" (UID: "278ba78d-f521-450a-8526-6841273b5290") : secret "prometheus-operator-admission-webhook-tls" not found
May 21 18:23:11.070605 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:11.070560    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/278ba78d-f521-450a-8526-6841273b5290-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-fsds2\" (UID: \"278ba78d-f521-450a-8526-6841273b5290\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fsds2"
May 21 18:23:11.070771 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:23:11.070738    2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
May 21 18:23:11.070842 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:23:11.070827    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/278ba78d-f521-450a-8526-6841273b5290-tls-certificates podName:278ba78d-f521-450a-8526-6841273b5290 nodeName:}" failed. No retries permitted until 2026-05-21 18:23:12.070803224 +0000 UTC m=+168.996291733 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/278ba78d-f521-450a-8526-6841273b5290-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-fsds2" (UID: "278ba78d-f521-450a-8526-6841273b5290") : secret "prometheus-operator-admission-webhook-tls" not found
May 21 18:23:12.076838 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:12.076801    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/278ba78d-f521-450a-8526-6841273b5290-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-fsds2\" (UID: \"278ba78d-f521-450a-8526-6841273b5290\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fsds2"
May 21 18:23:12.077222 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:23:12.076920    2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
May 21 18:23:12.077222 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:23:12.076972    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/278ba78d-f521-450a-8526-6841273b5290-tls-certificates podName:278ba78d-f521-450a-8526-6841273b5290 nodeName:}" failed. No retries permitted until 2026-05-21 18:23:14.076958589 +0000 UTC m=+171.002447094 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/278ba78d-f521-450a-8526-6841273b5290-tls-certificates") pod "prometheus-operator-admission-webhook-6c4bbc67b7-fsds2" (UID: "278ba78d-f521-450a-8526-6841273b5290") : secret "prometheus-operator-admission-webhook-tls" not found
May 21 18:23:12.259750 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:12.259710    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k4j68" event={"ID":"1586a237-3bc6-41ca-825d-cf2e89d4d709","Type":"ContainerStarted","Data":"7e88bb0854a2ea5760dcd35c91a24be0c285e729672d366c8bf0606da0ea19c7"}
May 21 18:23:12.279765 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:12.279717    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k4j68" podStartSLOduration=1.867997189 podStartE2EDuration="4.279704636s" podCreationTimestamp="2026-05-21 18:23:08 +0000 UTC" firstStartedPulling="2026-05-21 18:23:08.875037083 +0000 UTC m=+165.800525588" lastFinishedPulling="2026-05-21 18:23:11.286744526 +0000 UTC m=+168.212233035" observedRunningTime="2026-05-21 18:23:12.278220762 +0000 UTC m=+169.203709293" watchObservedRunningTime="2026-05-21 18:23:12.279704636 +0000 UTC m=+169.205193163"
May 21 18:23:13.687077 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:13.687004    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:23:14.091833 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:14.091797    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/278ba78d-f521-450a-8526-6841273b5290-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-fsds2\" (UID: \"278ba78d-f521-450a-8526-6841273b5290\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fsds2"
May 21 18:23:14.094241 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:14.094211    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/278ba78d-f521-450a-8526-6841273b5290-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-fsds2\" (UID: \"278ba78d-f521-450a-8526-6841273b5290\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fsds2"
May 21 18:23:14.342386 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:14.342298    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fsds2"
May 21 18:23:14.478013 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:14.477981    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fsds2"]
May 21 18:23:14.480620 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:23:14.480597    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod278ba78d_f521_450a_8526_6841273b5290.slice/crio-b99a0003294615cdb710e0a6c3eb5c38f4c55ba34ca8d38f832dde99bc0699b9 WatchSource:0}: Error finding container b99a0003294615cdb710e0a6c3eb5c38f4c55ba34ca8d38f832dde99bc0699b9: Status 404 returned error can't find the container with id b99a0003294615cdb710e0a6c3eb5c38f4c55ba34ca8d38f832dde99bc0699b9
May 21 18:23:14.685905 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:14.685814    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2slhb"
May 21 18:23:14.688855 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:14.688836    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-fn9qn\""
May 21 18:23:14.697016 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:14.697002    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2slhb"
May 21 18:23:14.815280 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:14.815244    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2slhb"]
May 21 18:23:14.817800 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:23:14.817774    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f0442b_784c_49da_910d_122d18137dd7.slice/crio-821e16b2fb2bfda7d86caf32d3facbcd1114673315a737d723e671b91db399a9 WatchSource:0}: Error finding container 821e16b2fb2bfda7d86caf32d3facbcd1114673315a737d723e671b91db399a9: Status 404 returned error can't find the container with id 821e16b2fb2bfda7d86caf32d3facbcd1114673315a737d723e671b91db399a9
May 21 18:23:15.268202 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:15.268161    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fsds2" event={"ID":"278ba78d-f521-450a-8526-6841273b5290","Type":"ContainerStarted","Data":"b99a0003294615cdb710e0a6c3eb5c38f4c55ba34ca8d38f832dde99bc0699b9"}
May 21 18:23:15.269320 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:15.269278    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2slhb" event={"ID":"89f0442b-784c-49da-910d-122d18137dd7","Type":"ContainerStarted","Data":"821e16b2fb2bfda7d86caf32d3facbcd1114673315a737d723e671b91db399a9"}
May 21 18:23:17.245251 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:17.245220    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sm8gn"
May 21 18:23:17.275271 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:17.275236    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fsds2" event={"ID":"278ba78d-f521-450a-8526-6841273b5290","Type":"ContainerStarted","Data":"786b9177d63bf2bb883d20166eb5df730472c991f58da37e44b71f2dffe5b312"}
May 21 18:23:17.275437 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:17.275405    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fsds2"
May 21 18:23:17.276746 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:17.276719    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2slhb" event={"ID":"89f0442b-784c-49da-910d-122d18137dd7","Type":"ContainerStarted","Data":"de9215a27d0f7f4a934e9381ad2ea3ae373cb43e10c9f9f06393a303078e805e"}
May 21 18:23:17.280043 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:17.280023    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fsds2"
May 21 18:23:17.295823 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:17.295776    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-fsds2" podStartSLOduration=5.161069862 podStartE2EDuration="7.295759687s" podCreationTimestamp="2026-05-21 18:23:10 +0000 UTC" firstStartedPulling="2026-05-21 18:23:14.482535021 +0000 UTC m=+171.408023526" lastFinishedPulling="2026-05-21 18:23:16.617224842 +0000 UTC m=+173.542713351" observedRunningTime="2026-05-21 18:23:17.294299171 +0000 UTC m=+174.219787700" watchObservedRunningTime="2026-05-21 18:23:17.295759687 +0000 UTC m=+174.221248218"
May 21 18:23:17.331435 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:17.331394    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2slhb" podStartSLOduration=138.529294192 podStartE2EDuration="2m20.331381168s" podCreationTimestamp="2026-05-21 18:20:57 +0000 UTC" firstStartedPulling="2026-05-21 18:23:14.819644179 +0000 UTC m=+171.745132688" lastFinishedPulling="2026-05-21 18:23:16.621731154 +0000 UTC m=+173.547219664" observedRunningTime="2026-05-21 18:23:17.330544186 +0000 UTC m=+174.256032714" watchObservedRunningTime="2026-05-21 18:23:17.331381168 +0000 UTC m=+174.256869694"
May 21 18:23:22.024217 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.024182    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h"]
May 21 18:23:22.027518 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.027501    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h"
May 21 18:23:22.030017 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.029992    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kxfsc\""
May 21 18:23:22.030017 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.030010    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 21 18:23:22.030184 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.030070    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 21 18:23:22.031203 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.031185    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 21 18:23:22.038744 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.038724    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h"]
May 21 18:23:22.046067 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.046023    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ns5z7"]
May 21 18:23:22.049203 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.049185    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.051677 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.051656    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 21 18:23:22.051958 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.051939    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 21 18:23:22.052070 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.052052    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8h69f\""
May 21 18:23:22.052198 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.052182    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 21 18:23:22.150479 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.150451    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf441887-7b70-46d3-bf40-4b03aa9a3453-root\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.150479 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.150481    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf441887-7b70-46d3-bf40-4b03aa9a3453-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.150643 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.150504    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmtv6\" (UniqueName: \"kubernetes.io/projected/66085c95-e03f-4b72-95c7-ed6a58e88542-kube-api-access-qmtv6\") pod \"openshift-state-metrics-9c959559f-n8p7h\" (UID: \"66085c95-e03f-4b72-95c7-ed6a58e88542\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h"
May 21 18:23:22.150643 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.150529    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/66085c95-e03f-4b72-95c7-ed6a58e88542-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-n8p7h\" (UID: \"66085c95-e03f-4b72-95c7-ed6a58e88542\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h"
May 21 18:23:22.150643 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.150552    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf441887-7b70-46d3-bf40-4b03aa9a3453-metrics-client-ca\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.150643 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.150571    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf441887-7b70-46d3-bf40-4b03aa9a3453-node-exporter-accelerators-collector-config\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.150643 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.150612    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66085c95-e03f-4b72-95c7-ed6a58e88542-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-n8p7h\" (UID: \"66085c95-e03f-4b72-95c7-ed6a58e88542\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h"
May 21 18:23:22.150794 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.150652    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66085c95-e03f-4b72-95c7-ed6a58e88542-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-n8p7h\" (UID: \"66085c95-e03f-4b72-95c7-ed6a58e88542\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h"
May 21 18:23:22.150794 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.150710    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf441887-7b70-46d3-bf40-4b03aa9a3453-node-exporter-wtmp\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.150794 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.150738    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf441887-7b70-46d3-bf40-4b03aa9a3453-node-exporter-textfile\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.150794 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.150756    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf441887-7b70-46d3-bf40-4b03aa9a3453-node-exporter-tls\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.150794 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.150786    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf441887-7b70-46d3-bf40-4b03aa9a3453-sys\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.150940 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.150854    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dct6g\" (UniqueName: \"kubernetes.io/projected/cf441887-7b70-46d3-bf40-4b03aa9a3453-kube-api-access-dct6g\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.251396 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.251358    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf441887-7b70-46d3-bf40-4b03aa9a3453-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.251396 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.251396    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qmtv6\" (UniqueName: \"kubernetes.io/projected/66085c95-e03f-4b72-95c7-ed6a58e88542-kube-api-access-qmtv6\") pod \"openshift-state-metrics-9c959559f-n8p7h\" (UID: \"66085c95-e03f-4b72-95c7-ed6a58e88542\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h"
May 21 18:23:22.251613 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.251435    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/66085c95-e03f-4b72-95c7-ed6a58e88542-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-n8p7h\" (UID: \"66085c95-e03f-4b72-95c7-ed6a58e88542\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h"
May 21 18:23:22.251613 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.251459    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf441887-7b70-46d3-bf40-4b03aa9a3453-metrics-client-ca\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.251613 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.251486    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf441887-7b70-46d3-bf40-4b03aa9a3453-node-exporter-accelerators-collector-config\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.251613 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.251518    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66085c95-e03f-4b72-95c7-ed6a58e88542-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-n8p7h\" (UID: \"66085c95-e03f-4b72-95c7-ed6a58e88542\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h"
May 21 18:23:22.251613 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.251566    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66085c95-e03f-4b72-95c7-ed6a58e88542-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-n8p7h\" (UID: \"66085c95-e03f-4b72-95c7-ed6a58e88542\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h"
May 21 18:23:22.251613 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:23:22.251590    2573 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
May 21 18:23:22.251900 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:23:22.251666    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66085c95-e03f-4b72-95c7-ed6a58e88542-openshift-state-metrics-tls podName:66085c95-e03f-4b72-95c7-ed6a58e88542 nodeName:}" failed. No retries permitted until 2026-05-21 18:23:22.751643967 +0000 UTC m=+179.677132494 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/66085c95-e03f-4b72-95c7-ed6a58e88542-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-n8p7h" (UID: "66085c95-e03f-4b72-95c7-ed6a58e88542") : secret "openshift-state-metrics-tls" not found
May 21 18:23:22.251900 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.251600    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf441887-7b70-46d3-bf40-4b03aa9a3453-node-exporter-wtmp\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.251900 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.251717    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cf441887-7b70-46d3-bf40-4b03aa9a3453-node-exporter-wtmp\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.251900 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.251725    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf441887-7b70-46d3-bf40-4b03aa9a3453-node-exporter-textfile\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.251900 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.251761    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf441887-7b70-46d3-bf40-4b03aa9a3453-node-exporter-tls\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.251900 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.251794    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf441887-7b70-46d3-bf40-4b03aa9a3453-sys\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.251900 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.251845    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dct6g\" (UniqueName: \"kubernetes.io/projected/cf441887-7b70-46d3-bf40-4b03aa9a3453-kube-api-access-dct6g\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.251900 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.251873    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf441887-7b70-46d3-bf40-4b03aa9a3453-root\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.252273 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.251959    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cf441887-7b70-46d3-bf40-4b03aa9a3453-root\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.252273 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.252027    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cf441887-7b70-46d3-bf40-4b03aa9a3453-sys\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.252273 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.252032    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cf441887-7b70-46d3-bf40-4b03aa9a3453-node-exporter-textfile\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.252273 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:23:22.252125    2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
May 21 18:23:22.252273 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:23:22.252173    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf441887-7b70-46d3-bf40-4b03aa9a3453-node-exporter-tls podName:cf441887-7b70-46d3-bf40-4b03aa9a3453 nodeName:}" failed. No retries permitted until 2026-05-21 18:23:22.752156227 +0000 UTC m=+179.677644734 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/cf441887-7b70-46d3-bf40-4b03aa9a3453-node-exporter-tls") pod "node-exporter-ns5z7" (UID: "cf441887-7b70-46d3-bf40-4b03aa9a3453") : secret "node-exporter-tls" not found
May 21 18:23:22.252273 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.252217    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cf441887-7b70-46d3-bf40-4b03aa9a3453-node-exporter-accelerators-collector-config\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.252478 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.252392    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/66085c95-e03f-4b72-95c7-ed6a58e88542-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-n8p7h\" (UID: \"66085c95-e03f-4b72-95c7-ed6a58e88542\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h"
May 21 18:23:22.252478 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.252448    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf441887-7b70-46d3-bf40-4b03aa9a3453-metrics-client-ca\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.253867 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.253841    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf441887-7b70-46d3-bf40-4b03aa9a3453-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.254012 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.253994    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/66085c95-e03f-4b72-95c7-ed6a58e88542-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-n8p7h\" (UID: \"66085c95-e03f-4b72-95c7-ed6a58e88542\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h"
May 21 18:23:22.264656 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.264631    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dct6g\" (UniqueName: \"kubernetes.io/projected/cf441887-7b70-46d3-bf40-4b03aa9a3453-kube-api-access-dct6g\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.264797 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.264777    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmtv6\" (UniqueName: \"kubernetes.io/projected/66085c95-e03f-4b72-95c7-ed6a58e88542-kube-api-access-qmtv6\") pod \"openshift-state-metrics-9c959559f-n8p7h\" (UID: \"66085c95-e03f-4b72-95c7-ed6a58e88542\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h"
May 21 18:23:22.757055 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.757015    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf441887-7b70-46d3-bf40-4b03aa9a3453-node-exporter-tls\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.757239 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.757089    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/66085c95-e03f-4b72-95c7-ed6a58e88542-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-n8p7h\" (UID: \"66085c95-e03f-4b72-95c7-ed6a58e88542\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h"
May 21 18:23:22.757239 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:23:22.757210    2573 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
May 21 18:23:22.757388 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:23:22.757277    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/66085c95-e03f-4b72-95c7-ed6a58e88542-openshift-state-metrics-tls podName:66085c95-e03f-4b72-95c7-ed6a58e88542 nodeName:}" failed. No retries permitted until 2026-05-21 18:23:23.757259412 +0000 UTC m=+180.682747935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/66085c95-e03f-4b72-95c7-ed6a58e88542-openshift-state-metrics-tls") pod "openshift-state-metrics-9c959559f-n8p7h" (UID: "66085c95-e03f-4b72-95c7-ed6a58e88542") : secret "openshift-state-metrics-tls" not found
May 21 18:23:22.759233 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.759209    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cf441887-7b70-46d3-bf40-4b03aa9a3453-node-exporter-tls\") pod \"node-exporter-ns5z7\" (UID: \"cf441887-7b70-46d3-bf40-4b03aa9a3453\") " pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.958554 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:22.958514    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ns5z7"
May 21 18:23:22.969153 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:23:22.969111    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf441887_7b70_46d3_bf40_4b03aa9a3453.slice/crio-0860e264b08f530e367ca57664f652915106fa018cad45befeb1c406f98e8c7b WatchSource:0}: Error finding container 0860e264b08f530e367ca57664f652915106fa018cad45befeb1c406f98e8c7b: Status 404 returned error can't find the container with id 0860e264b08f530e367ca57664f652915106fa018cad45befeb1c406f98e8c7b
May 21 18:23:23.066872 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.066803    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 18:23:23.071759 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.071742    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.074722 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.074701    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 21 18:23:23.075279 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.075261    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 21 18:23:23.075384 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.075370    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 21 18:23:23.076763 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.076745    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 21 18:23:23.077126 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.077105    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 21 18:23:23.077126 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.077128    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 21 18:23:23.077288 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.077108    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 21 18:23:23.077288 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.077202    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 21 18:23:23.077494 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.077455    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zmpfc\""
May 21 18:23:23.083821 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.083802    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 21 18:23:23.097577 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.097555    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 18:23:23.160749 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.160726    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-web-config\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.160850 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.160772    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.160850 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.160794    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e766552d-6920-4bda-800d-6dc705b44a6c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.160927 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.160869    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e766552d-6920-4bda-800d-6dc705b44a6c-config-out\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.160927 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.160915    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.160992 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.160941    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hm4pj\" (UniqueName: \"kubernetes.io/projected/e766552d-6920-4bda-800d-6dc705b44a6c-kube-api-access-hm4pj\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.161037 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.161020    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.161071 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.161056    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e766552d-6920-4bda-800d-6dc705b44a6c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.161107 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.161086    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-config-volume\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.161139 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.161108    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e766552d-6920-4bda-800d-6dc705b44a6c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.161171 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.161159    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.161203 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.161179    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e766552d-6920-4bda-800d-6dc705b44a6c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.161203 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.161200    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.261714 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.261681    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-config-volume\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.261854 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.261724    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e766552d-6920-4bda-800d-6dc705b44a6c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.261854 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.261767    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.261971 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.261867    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e766552d-6920-4bda-800d-6dc705b44a6c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.261971 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.261918    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.262073 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.261982    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-web-config\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.262182 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.262160    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.262236 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.262212    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e766552d-6920-4bda-800d-6dc705b44a6c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.262285 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.262263    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e766552d-6920-4bda-800d-6dc705b44a6c-config-out\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.262358 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.262291    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.262358 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.262293    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e766552d-6920-4bda-800d-6dc705b44a6c-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.262358 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.262337    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hm4pj\" (UniqueName: \"kubernetes.io/projected/e766552d-6920-4bda-800d-6dc705b44a6c-kube-api-access-hm4pj\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.262504 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.262377    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.262504 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.262410    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e766552d-6920-4bda-800d-6dc705b44a6c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.262639 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.262616    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e766552d-6920-4bda-800d-6dc705b44a6c-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.263609 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.263258    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e766552d-6920-4bda-800d-6dc705b44a6c-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.265472 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.265128    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.265472 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.265151    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e766552d-6920-4bda-800d-6dc705b44a6c-config-out\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.265472 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.265237    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-web-config\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.265897 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.265875    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e766552d-6920-4bda-800d-6dc705b44a6c-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.265983 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.265892    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.266122 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.266096    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-config-volume\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.266535 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.266516    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.267248 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.267225    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.267354 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.267342    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.271129 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.271107    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hm4pj\" (UniqueName: \"kubernetes.io/projected/e766552d-6920-4bda-800d-6dc705b44a6c-kube-api-access-hm4pj\") pod \"alertmanager-main-0\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.290943 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.290912    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ns5z7" event={"ID":"cf441887-7b70-46d3-bf40-4b03aa9a3453","Type":"ContainerStarted","Data":"0860e264b08f530e367ca57664f652915106fa018cad45befeb1c406f98e8c7b"}
May 21 18:23:23.381580 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.381498    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 18:23:23.517798 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.517764    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 18:23:23.522032 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:23:23.522001    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode766552d_6920_4bda_800d_6dc705b44a6c.slice/crio-588fdfb5a0c5a586b3b6683d77c221d8c644af53df018ff6f6fbe8400b3d9e69 WatchSource:0}: Error finding container 588fdfb5a0c5a586b3b6683d77c221d8c644af53df018ff6f6fbe8400b3d9e69: Status 404 returned error can't find the container with id 588fdfb5a0c5a586b3b6683d77c221d8c644af53df018ff6f6fbe8400b3d9e69
May 21 18:23:23.766598 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.766561    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/66085c95-e03f-4b72-95c7-ed6a58e88542-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-n8p7h\" (UID: \"66085c95-e03f-4b72-95c7-ed6a58e88542\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h"
May 21 18:23:23.769038 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.769014    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/66085c95-e03f-4b72-95c7-ed6a58e88542-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-n8p7h\" (UID: \"66085c95-e03f-4b72-95c7-ed6a58e88542\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h"
May 21 18:23:23.840320 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.840283    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-kxfsc\""
May 21 18:23:23.847883 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.847858    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h"
May 21 18:23:23.997218 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:23.997180    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"]
May 21 18:23:24.002752 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.002724    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.005855 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.005642    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 21 18:23:24.005855 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.005693    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 21 18:23:24.005855 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.005704    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 21 18:23:24.005855 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.005734    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 21 18:23:24.006173 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.006005    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-1uk43ddpocbvk\""
May 21 18:23:24.006173 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.006092    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 21 18:23:24.006367 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.006285    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-nkdl8\""
May 21 18:23:24.017480 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.017424    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"]
May 21 18:23:24.068880 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.068835    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1da1d840-fb85-4064-b193-14753a2ac0fe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.069273 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.068882    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1da1d840-fb85-4064-b193-14753a2ac0fe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.069273 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.068927    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1da1d840-fb85-4064-b193-14753a2ac0fe-secret-grpc-tls\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.069273 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.068996    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1da1d840-fb85-4064-b193-14753a2ac0fe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.069273 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.069030    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1da1d840-fb85-4064-b193-14753a2ac0fe-metrics-client-ca\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.069273 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.069066    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1da1d840-fb85-4064-b193-14753a2ac0fe-secret-thanos-querier-tls\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.069273 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.069091    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1da1d840-fb85-4064-b193-14753a2ac0fe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.069273 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.069142    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vphk\" (UniqueName: \"kubernetes.io/projected/1da1d840-fb85-4064-b193-14753a2ac0fe-kube-api-access-9vphk\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.170250 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.170191    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1da1d840-fb85-4064-b193-14753a2ac0fe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.170250 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.170238    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1da1d840-fb85-4064-b193-14753a2ac0fe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.170465 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.170276    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1da1d840-fb85-4064-b193-14753a2ac0fe-secret-grpc-tls\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.170465 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.170345    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1da1d840-fb85-4064-b193-14753a2ac0fe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.170465 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.170378    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1da1d840-fb85-4064-b193-14753a2ac0fe-metrics-client-ca\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.170465 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.170413    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1da1d840-fb85-4064-b193-14753a2ac0fe-secret-thanos-querier-tls\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.170465 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.170439    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1da1d840-fb85-4064-b193-14753a2ac0fe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.170687 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.170511    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9vphk\" (UniqueName: \"kubernetes.io/projected/1da1d840-fb85-4064-b193-14753a2ac0fe-kube-api-access-9vphk\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.171443 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.171294    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1da1d840-fb85-4064-b193-14753a2ac0fe-metrics-client-ca\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.174129 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.173731    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1da1d840-fb85-4064-b193-14753a2ac0fe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.174129 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.173888    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/1da1d840-fb85-4064-b193-14753a2ac0fe-secret-thanos-querier-tls\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.174129 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.173893    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/1da1d840-fb85-4064-b193-14753a2ac0fe-secret-grpc-tls\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.174129 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.174087    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/1da1d840-fb85-4064-b193-14753a2ac0fe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.174494 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.174236    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/1da1d840-fb85-4064-b193-14753a2ac0fe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.175805 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.175783    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1da1d840-fb85-4064-b193-14753a2ac0fe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.179388 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.179367    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vphk\" (UniqueName: \"kubernetes.io/projected/1da1d840-fb85-4064-b193-14753a2ac0fe-kube-api-access-9vphk\") pod \"thanos-querier-5979cc64d4-2v9vn\" (UID: \"1da1d840-fb85-4064-b193-14753a2ac0fe\") " pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.181732 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.181709    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h"]
May 21 18:23:24.184171 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:23:24.184146    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66085c95_e03f_4b72_95c7_ed6a58e88542.slice/crio-0d8308dba3a45fad0af608f17cf284cfc97086ea360ce35ffd0d73017243a262 WatchSource:0}: Error finding container 0d8308dba3a45fad0af608f17cf284cfc97086ea360ce35ffd0d73017243a262: Status 404 returned error can't find the container with id 0d8308dba3a45fad0af608f17cf284cfc97086ea360ce35ffd0d73017243a262
May 21 18:23:24.296161 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.296124    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ns5z7" event={"ID":"cf441887-7b70-46d3-bf40-4b03aa9a3453","Type":"ContainerStarted","Data":"f48f71df65f1c47b956bba514ee5508427c5f736428e6bf226356e7d6237fe6e"}
May 21 18:23:24.297215 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.297186    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h" event={"ID":"66085c95-e03f-4b72-95c7-ed6a58e88542","Type":"ContainerStarted","Data":"0d8308dba3a45fad0af608f17cf284cfc97086ea360ce35ffd0d73017243a262"}
May 21 18:23:24.298357 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.298331    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e766552d-6920-4bda-800d-6dc705b44a6c","Type":"ContainerStarted","Data":"588fdfb5a0c5a586b3b6683d77c221d8c644af53df018ff6f6fbe8400b3d9e69"}
May 21 18:23:24.315820 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.315799    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:24.578202 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:24.578142    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"]
May 21 18:23:24.580613 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:23:24.580587    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1da1d840_fb85_4064_b193_14753a2ac0fe.slice/crio-b0ec964259ff505896e1f1caa47e4573e55e40a06177963d44475262f40c2688 WatchSource:0}: Error finding container b0ec964259ff505896e1f1caa47e4573e55e40a06177963d44475262f40c2688: Status 404 returned error can't find the container with id b0ec964259ff505896e1f1caa47e4573e55e40a06177963d44475262f40c2688
May 21 18:23:25.302481 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:25.302435    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn" event={"ID":"1da1d840-fb85-4064-b193-14753a2ac0fe","Type":"ContainerStarted","Data":"b0ec964259ff505896e1f1caa47e4573e55e40a06177963d44475262f40c2688"}
May 21 18:23:25.304503 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:25.304378    2573 generic.go:358] "Generic (PLEG): container finished" podID="cf441887-7b70-46d3-bf40-4b03aa9a3453" containerID="f48f71df65f1c47b956bba514ee5508427c5f736428e6bf226356e7d6237fe6e" exitCode=0
May 21 18:23:25.304503 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:25.304425    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ns5z7" event={"ID":"cf441887-7b70-46d3-bf40-4b03aa9a3453","Type":"ContainerDied","Data":"f48f71df65f1c47b956bba514ee5508427c5f736428e6bf226356e7d6237fe6e"}
May 21 18:23:25.306768 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:25.306714    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h" event={"ID":"66085c95-e03f-4b72-95c7-ed6a58e88542","Type":"ContainerStarted","Data":"1f004933688338e5c47f01a8c78ff34153a677cef7f326f51fd4ab054efb3a41"}
May 21 18:23:25.306768 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:25.306748    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h" event={"ID":"66085c95-e03f-4b72-95c7-ed6a58e88542","Type":"ContainerStarted","Data":"d8bcca306e4a1d637e6076690ad48758b0497a7a62763c8c89adb0f70c51b2a4"}
May 21 18:23:25.308294 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:25.308263    2573 generic.go:358] "Generic (PLEG): container finished" podID="e766552d-6920-4bda-800d-6dc705b44a6c" containerID="8f76fa4dcd7820d547355c760cf8bb6d46cf418569f8272a9e7ba88290137b89" exitCode=0
May 21 18:23:25.308412 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:25.308325    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e766552d-6920-4bda-800d-6dc705b44a6c","Type":"ContainerDied","Data":"8f76fa4dcd7820d547355c760cf8bb6d46cf418569f8272a9e7ba88290137b89"}
May 21 18:23:26.315426 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.315384    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h" event={"ID":"66085c95-e03f-4b72-95c7-ed6a58e88542","Type":"ContainerStarted","Data":"e0cc1f389695cff194c306efe04a1d8167aacb376ded45cd9d695e55d40b8acf"}
May 21 18:23:26.318426 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.318175    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-7954df9985-6zwkf"]
May 21 18:23:26.321858 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.321831    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ns5z7" event={"ID":"cf441887-7b70-46d3-bf40-4b03aa9a3453","Type":"ContainerStarted","Data":"5a566d49deab523e015a0fa80b969ce6f98f34228281c18794d6715324d6e3e0"}
May 21 18:23:26.321960 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.321860    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ns5z7" event={"ID":"cf441887-7b70-46d3-bf40-4b03aa9a3453","Type":"ContainerStarted","Data":"2d957b71b4ec8f41d3c69ba1e95d7df6c1f981f0568525e4701dc2ae352683e1"}
May 21 18:23:26.322007 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.321959    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.324592 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.324570    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 21 18:23:26.324693 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.324643    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-db6p919gjtcbk\""
May 21 18:23:26.326050 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.325791    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-jlx4j\""
May 21 18:23:26.326050 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.325795    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 21 18:23:26.326050 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.325794    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 21 18:23:26.326050 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.325842    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 21 18:23:26.329721 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.329686    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7954df9985-6zwkf"]
May 21 18:23:26.334706 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.334663    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-n8p7h" podStartSLOduration=3.102617461 podStartE2EDuration="4.334648167s" podCreationTimestamp="2026-05-21 18:23:22 +0000 UTC" firstStartedPulling="2026-05-21 18:23:24.573242902 +0000 UTC m=+181.498731421" lastFinishedPulling="2026-05-21 18:23:25.805273607 +0000 UTC m=+182.730762127" observedRunningTime="2026-05-21 18:23:26.333988164 +0000 UTC m=+183.259476697" watchObservedRunningTime="2026-05-21 18:23:26.334648167 +0000 UTC m=+183.260136696"
May 21 18:23:26.373066 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.373019    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ns5z7" podStartSLOduration=3.255414431 podStartE2EDuration="4.373002152s" podCreationTimestamp="2026-05-21 18:23:22 +0000 UTC" firstStartedPulling="2026-05-21 18:23:22.970821714 +0000 UTC m=+179.896310224" lastFinishedPulling="2026-05-21 18:23:24.08840942 +0000 UTC m=+181.013897945" observedRunningTime="2026-05-21 18:23:26.372207597 +0000 UTC m=+183.297696150" watchObservedRunningTime="2026-05-21 18:23:26.373002152 +0000 UTC m=+183.298490680"
May 21 18:23:26.393027 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.392991    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c82c7ff3-a886-4056-baf0-15bcbe675d1c-secret-metrics-server-client-certs\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.393454 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.393427    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c82c7ff3-a886-4056-baf0-15bcbe675d1c-audit-log\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.393554 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.393507    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpf7h\" (UniqueName: \"kubernetes.io/projected/c82c7ff3-a886-4056-baf0-15bcbe675d1c-kube-api-access-rpf7h\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.393658 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.393624    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c82c7ff3-a886-4056-baf0-15bcbe675d1c-metrics-server-audit-profiles\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.393777 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.393694    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c82c7ff3-a886-4056-baf0-15bcbe675d1c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.393777 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.393732    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c82c7ff3-a886-4056-baf0-15bcbe675d1c-secret-metrics-server-tls\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.393889 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.393820    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c82c7ff3-a886-4056-baf0-15bcbe675d1c-client-ca-bundle\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.494544 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.494506    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c82c7ff3-a886-4056-baf0-15bcbe675d1c-secret-metrics-server-tls\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.494697 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.494558    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c82c7ff3-a886-4056-baf0-15bcbe675d1c-client-ca-bundle\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.494697 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.494624    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c82c7ff3-a886-4056-baf0-15bcbe675d1c-secret-metrics-server-client-certs\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.494697 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.494679    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c82c7ff3-a886-4056-baf0-15bcbe675d1c-audit-log\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.494862 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.494710    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rpf7h\" (UniqueName: \"kubernetes.io/projected/c82c7ff3-a886-4056-baf0-15bcbe675d1c-kube-api-access-rpf7h\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.494862 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.494758    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c82c7ff3-a886-4056-baf0-15bcbe675d1c-metrics-server-audit-profiles\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.494862 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.494796    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c82c7ff3-a886-4056-baf0-15bcbe675d1c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.495556 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.495526    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c82c7ff3-a886-4056-baf0-15bcbe675d1c-audit-log\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.495675 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.495617    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c82c7ff3-a886-4056-baf0-15bcbe675d1c-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.496139 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.496112    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c82c7ff3-a886-4056-baf0-15bcbe675d1c-metrics-server-audit-profiles\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.497663 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.497629    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c82c7ff3-a886-4056-baf0-15bcbe675d1c-secret-metrics-server-tls\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.497759 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.497710    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c82c7ff3-a886-4056-baf0-15bcbe675d1c-secret-metrics-server-client-certs\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.497759 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.497744    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c82c7ff3-a886-4056-baf0-15bcbe675d1c-client-ca-bundle\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.503296 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.503271    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpf7h\" (UniqueName: \"kubernetes.io/projected/c82c7ff3-a886-4056-baf0-15bcbe675d1c-kube-api-access-rpf7h\") pod \"metrics-server-7954df9985-6zwkf\" (UID: \"c82c7ff3-a886-4056-baf0-15bcbe675d1c\") " pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.635177 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.635106    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:26.641011 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.640985    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-nbb8g"]
May 21 18:23:26.644178 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.644156    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-nbb8g"
May 21 18:23:26.646716 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.646693    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-22862\""
May 21 18:23:26.646788 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.646736    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 21 18:23:26.653350 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.653331    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-nbb8g"]
May 21 18:23:26.696885 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.696845    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42e80e40-d309-487f-a1dd-24b1a8b5f8e8-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-nbb8g\" (UID: \"42e80e40-d309-487f-a1dd-24b1a8b5f8e8\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-nbb8g"
May 21 18:23:26.797949 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.797907    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42e80e40-d309-487f-a1dd-24b1a8b5f8e8-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-nbb8g\" (UID: \"42e80e40-d309-487f-a1dd-24b1a8b5f8e8\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-nbb8g"
May 21 18:23:26.801070 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.801037    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/42e80e40-d309-487f-a1dd-24b1a8b5f8e8-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-nbb8g\" (UID: \"42e80e40-d309-487f-a1dd-24b1a8b5f8e8\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-nbb8g"
May 21 18:23:26.955711 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:26.955636    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-nbb8g"
May 21 18:23:27.169143 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.169090    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-7954df9985-6zwkf"]
May 21 18:23:27.170860 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:23:27.170833    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc82c7ff3_a886_4056_baf0_15bcbe675d1c.slice/crio-3c175d2fede900332f0288e432485953c06d4e6a0474e8d887d66b92217fe9b8 WatchSource:0}: Error finding container 3c175d2fede900332f0288e432485953c06d4e6a0474e8d887d66b92217fe9b8: Status 404 returned error can't find the container with id 3c175d2fede900332f0288e432485953c06d4e6a0474e8d887d66b92217fe9b8
May 21 18:23:27.185442 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.185419    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-nbb8g"]
May 21 18:23:27.188381 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:23:27.188348    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42e80e40_d309_487f_a1dd_24b1a8b5f8e8.slice/crio-423764d737da7674d92163f313029f4eb16172fe91aba304208388ce30b20f89 WatchSource:0}: Error finding container 423764d737da7674d92163f313029f4eb16172fe91aba304208388ce30b20f89: Status 404 returned error can't find the container with id 423764d737da7674d92163f313029f4eb16172fe91aba304208388ce30b20f89
May 21 18:23:27.213682 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.213652    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-67ddd58468-qn6m6"]
May 21 18:23:27.219184 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.219167    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.222296 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.222276    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 21 18:23:27.222416 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.222276    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 21 18:23:27.222416 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.222393    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 21 18:23:27.222529 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.222484    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 21 18:23:27.222580 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.222524    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-p6vm8\""
May 21 18:23:27.222651 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.222583    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 21 18:23:27.229251 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.229181    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 21 18:23:27.229939 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.229913    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67ddd58468-qn6m6"]
May 21 18:23:27.302260 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.302239    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.302398 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.302277    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkzxm\" (UniqueName: \"kubernetes.io/projected/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-kube-api-access-nkzxm\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.302398 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.302339    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-serving-certs-ca-bundle\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.302398 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.302368    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-federate-client-tls\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.302518 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.302401    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-metrics-client-ca\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.302548 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.302516    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-secret-telemeter-client\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.302619 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.302600    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.302681 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.302664    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-telemeter-client-tls\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.324582 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.324389    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn" event={"ID":"1da1d840-fb85-4064-b193-14753a2ac0fe","Type":"ContainerStarted","Data":"e4dec80db55e5ae8bd369fcd8f860f1ce1c9396cc5b89b3761d786ac648a4120"}
May 21 18:23:27.324582 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.324430    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn" event={"ID":"1da1d840-fb85-4064-b193-14753a2ac0fe","Type":"ContainerStarted","Data":"a7089ebd4110b8c3bc7f12e5c4266487145e3e2b2550ee9f408b8e82c2e8ba01"}
May 21 18:23:27.324582 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.324445    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn" event={"ID":"1da1d840-fb85-4064-b193-14753a2ac0fe","Type":"ContainerStarted","Data":"4e7f9ec2592f4e8f92db392cedf9bc56a7ef5fe06b0b3ffbbb67a5fe5d0230de"}
May 21 18:23:27.325558 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.325536    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-nbb8g" event={"ID":"42e80e40-d309-487f-a1dd-24b1a8b5f8e8","Type":"ContainerStarted","Data":"423764d737da7674d92163f313029f4eb16172fe91aba304208388ce30b20f89"}
May 21 18:23:27.326466 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.326449    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7954df9985-6zwkf" event={"ID":"c82c7ff3-a886-4056-baf0-15bcbe675d1c","Type":"ContainerStarted","Data":"3c175d2fede900332f0288e432485953c06d4e6a0474e8d887d66b92217fe9b8"}
May 21 18:23:27.328760 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.328739    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e766552d-6920-4bda-800d-6dc705b44a6c","Type":"ContainerStarted","Data":"3eb7aee6bedb8c4b49b265677eb354c35d33155109368fde7f7f708b784de599"}
May 21 18:23:27.328800 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.328772    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e766552d-6920-4bda-800d-6dc705b44a6c","Type":"ContainerStarted","Data":"ae11b17e91198f21cbf93a488cc0729d01b70048a659ca0d34b064a35ae77b17"}
May 21 18:23:27.328800 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.328784    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e766552d-6920-4bda-800d-6dc705b44a6c","Type":"ContainerStarted","Data":"7e0d37c80ac242b6979a93149c16a3f6ed3ab6029d612332213e12b4d64780c6"}
May 21 18:23:27.328800 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.328793    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e766552d-6920-4bda-800d-6dc705b44a6c","Type":"ContainerStarted","Data":"3aeb478b3fa4892a5338535c87d1b4aebf5d619c7376149d798ea84ee80cb18d"}
May 21 18:23:27.403460 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.403431    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nkzxm\" (UniqueName: \"kubernetes.io/projected/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-kube-api-access-nkzxm\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.403580 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.403483    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-serving-certs-ca-bundle\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.403580 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.403503    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-federate-client-tls\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.403580 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.403532    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-metrics-client-ca\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.403738 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.403595    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-secret-telemeter-client\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.403738 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.403670    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.403738 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.403728    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-telemeter-client-tls\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.403878 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.403842    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.404340 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.404278    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-serving-certs-ca-bundle\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.404498 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.404345    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-metrics-client-ca\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.404837 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.404812    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.406279 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.406254    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-telemeter-client-tls\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.406455 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.406435    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-secret-telemeter-client\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.406523 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.406501    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.406607 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.406594    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-federate-client-tls\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.419750 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.419733    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkzxm\" (UniqueName: \"kubernetes.io/projected/50b7f0f6-e9f1-49be-a887-2dbadabe4d95-kube-api-access-nkzxm\") pod \"telemeter-client-67ddd58468-qn6m6\" (UID: \"50b7f0f6-e9f1-49be-a887-2dbadabe4d95\") " pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.530149 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.530123    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6"
May 21 18:23:27.655315 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:27.655259    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67ddd58468-qn6m6"]
May 21 18:23:27.660187 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:23:27.660158    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50b7f0f6_e9f1_49be_a887_2dbadabe4d95.slice/crio-064b3a8caad88d67c815a19b3c59fc112355bcae17bf9b7b512355ab2a56366d WatchSource:0}: Error finding container 064b3a8caad88d67c815a19b3c59fc112355bcae17bf9b7b512355ab2a56366d: Status 404 returned error can't find the container with id 064b3a8caad88d67c815a19b3c59fc112355bcae17bf9b7b512355ab2a56366d
May 21 18:23:28.144910 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.144875    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 18:23:28.149116 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.149089    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.155103 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.155080    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 21 18:23:28.155362 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.155342    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 21 18:23:28.155720 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.155698    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 21 18:23:28.156051 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.156028    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 21 18:23:28.156391 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.156370    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 21 18:23:28.156776 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.156760    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 21 18:23:28.156938 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.156912    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 21 18:23:28.157031 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.156920    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 21 18:23:28.157031 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.156958    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mlq7z\""
May 21 18:23:28.157031 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.156784    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 21 18:23:28.157424 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.157319    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 21 18:23:28.157424 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.157417    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-acec8fvdp1h1e\""
May 21 18:23:28.158950 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.158736    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 21 18:23:28.169657 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.169077    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 21 18:23:28.171686 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.171664    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 18:23:28.211885 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.211856    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-config\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.211992 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.211924    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.211992 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.211952    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c981abd9-e1a9-4e97-8b93-901e297d38a8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.211992 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.211975    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n87xj\" (UniqueName: \"kubernetes.io/projected/c981abd9-e1a9-4e97-8b93-901e297d38a8-kube-api-access-n87xj\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.212154 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.211993    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-web-config\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.212154 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.212013    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.212154 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.212027    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.212154 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.212058    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.212154 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.212078    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.212154 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.212115    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.212154 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.212134    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.212458 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.212156    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.212458 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.212229    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.212458 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.212370    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.212458 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.212442    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c981abd9-e1a9-4e97-8b93-901e297d38a8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.212621 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.212472    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.212621 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.212500    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c981abd9-e1a9-4e97-8b93-901e297d38a8-config-out\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.212621 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.212538    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.313524 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.313494    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.313686 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.313533    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.313686 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.313566    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.313686 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.313595    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.313686 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.313630    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.313913 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.313876    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c981abd9-e1a9-4e97-8b93-901e297d38a8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.313994 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.313931    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.313994 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.313964    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c981abd9-e1a9-4e97-8b93-901e297d38a8-config-out\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.314098 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.313998    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.314098 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.314048    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-config\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.314187 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.314100    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.314187 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.314126    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c981abd9-e1a9-4e97-8b93-901e297d38a8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.314187 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.314149    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n87xj\" (UniqueName: \"kubernetes.io/projected/c981abd9-e1a9-4e97-8b93-901e297d38a8-kube-api-access-n87xj\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.314187 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.314178    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-web-config\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.314413 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.314207    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.314413 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.314232    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.314413 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.314288    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.314413 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.314295    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.314413 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.314338    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.315289 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.314633    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c981abd9-e1a9-4e97-8b93-901e297d38a8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.315289 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.315185    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.317851 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.317827    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.318486 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.318467    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.318707 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.318685    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.319446 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.319107    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.319446 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.319404    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.319593 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.319513    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-web-config\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.319656 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.319608    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-config\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.319813 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.319795    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c981abd9-e1a9-4e97-8b93-901e297d38a8-config-out\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.320423 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.320327    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c981abd9-e1a9-4e97-8b93-901e297d38a8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.320594 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.320533    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.320884 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.320861    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.320971 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.320904    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.321027 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.320980    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.322151 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.322129    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.323975 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.323934    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n87xj\" (UniqueName: \"kubernetes.io/projected/c981abd9-e1a9-4e97-8b93-901e297d38a8-kube-api-access-n87xj\") pod \"prometheus-k8s-0\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:28.336479 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.336452    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e766552d-6920-4bda-800d-6dc705b44a6c","Type":"ContainerStarted","Data":"fd89861ea5ed4a6d456bccd8964a5c087e850143713fda23cebf58e96245df91"}
May 21 18:23:28.336816 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.336491    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e766552d-6920-4bda-800d-6dc705b44a6c","Type":"ContainerStarted","Data":"d9f1bd0b08b31e6f41e769e261d27333e6ddd5aef51a18f8a712054abe9592cd"}
May 21 18:23:28.340260 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.340239    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn" event={"ID":"1da1d840-fb85-4064-b193-14753a2ac0fe","Type":"ContainerStarted","Data":"140d85114037dbe1ba0305ac66055e2677d4fed9995190aa3135a317ff187da9"}
May 21 18:23:28.341487 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.341448    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6" event={"ID":"50b7f0f6-e9f1-49be-a887-2dbadabe4d95","Type":"ContainerStarted","Data":"064b3a8caad88d67c815a19b3c59fc112355bcae17bf9b7b512355ab2a56366d"}
May 21 18:23:28.368069 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.368022    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=0.687317911 podStartE2EDuration="5.368007924s" podCreationTimestamp="2026-05-21 18:23:23 +0000 UTC" firstStartedPulling="2026-05-21 18:23:23.52421701 +0000 UTC m=+180.449705515" lastFinishedPulling="2026-05-21 18:23:28.204907011 +0000 UTC m=+185.130395528" observedRunningTime="2026-05-21 18:23:28.36649483 +0000 UTC m=+185.291983361" watchObservedRunningTime="2026-05-21 18:23:28.368007924 +0000 UTC m=+185.293496453"
May 21 18:23:28.465920 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:28.465844    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:29.292554 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:29.292521    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 18:23:29.297104 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:23:29.297073    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc981abd9_e1a9_4e97_8b93_901e297d38a8.slice/crio-d58fae350dfaa998410cc90a90d4ab7c8ef6af6b4d452aaa1de1e7bb2e2b040d WatchSource:0}: Error finding container d58fae350dfaa998410cc90a90d4ab7c8ef6af6b4d452aaa1de1e7bb2e2b040d: Status 404 returned error can't find the container with id d58fae350dfaa998410cc90a90d4ab7c8ef6af6b4d452aaa1de1e7bb2e2b040d
May 21 18:23:29.348880 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:29.348295    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn" event={"ID":"1da1d840-fb85-4064-b193-14753a2ac0fe","Type":"ContainerStarted","Data":"49163a225d0a8012a13f6ec0d1dc690137eba4aa2ecf7291fe3fd6db6a2616f4"}
May 21 18:23:29.348880 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:29.348364    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn" event={"ID":"1da1d840-fb85-4064-b193-14753a2ac0fe","Type":"ContainerStarted","Data":"5c160ffe2410d3670b680c7cd469130e6105cd20cf5f73aaf44261f29d225feb"}
May 21 18:23:29.349335 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:29.349239    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:29.350737 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:29.350709    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c981abd9-e1a9-4e97-8b93-901e297d38a8","Type":"ContainerStarted","Data":"d58fae350dfaa998410cc90a90d4ab7c8ef6af6b4d452aaa1de1e7bb2e2b040d"}
May 21 18:23:29.352995 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:29.352970    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-7954df9985-6zwkf" event={"ID":"c82c7ff3-a886-4056-baf0-15bcbe675d1c","Type":"ContainerStarted","Data":"72de9aca6ea07f4f6dafeb812427c1561883f1da706eb3959552c2343679bfa1"}
May 21 18:23:29.354907 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:29.354868    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-nbb8g" event={"ID":"42e80e40-d309-487f-a1dd-24b1a8b5f8e8","Type":"ContainerStarted","Data":"0fca4ddc6f9612293b955404262bd72c42721e925ca17a44fd58fa907ce791a9"}
May 21 18:23:29.355693 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:29.355348    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-nbb8g"
May 21 18:23:29.362422 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:29.362403    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-nbb8g"
May 21 18:23:29.379397 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:29.379347    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn" podStartSLOduration=2.7554618939999997 podStartE2EDuration="6.3793331s" podCreationTimestamp="2026-05-21 18:23:23 +0000 UTC" firstStartedPulling="2026-05-21 18:23:24.582728886 +0000 UTC m=+181.508217391" lastFinishedPulling="2026-05-21 18:23:28.206600091 +0000 UTC m=+185.132088597" observedRunningTime="2026-05-21 18:23:29.376827278 +0000 UTC m=+186.302315831" watchObservedRunningTime="2026-05-21 18:23:29.3793331 +0000 UTC m=+186.304821626"
May 21 18:23:29.396431 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:29.396376    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-nbb8g" podStartSLOduration=1.4594555169999999 podStartE2EDuration="3.396360238s" podCreationTimestamp="2026-05-21 18:23:26 +0000 UTC" firstStartedPulling="2026-05-21 18:23:27.190734719 +0000 UTC m=+184.116223224" lastFinishedPulling="2026-05-21 18:23:29.127639436 +0000 UTC m=+186.053127945" observedRunningTime="2026-05-21 18:23:29.394142669 +0000 UTC m=+186.319631197" watchObservedRunningTime="2026-05-21 18:23:29.396360238 +0000 UTC m=+186.321848767"
May 21 18:23:29.415872 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:29.414231    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-7954df9985-6zwkf" podStartSLOduration=1.459655017 podStartE2EDuration="3.414212895s" podCreationTimestamp="2026-05-21 18:23:26 +0000 UTC" firstStartedPulling="2026-05-21 18:23:27.173082913 +0000 UTC m=+184.098571417" lastFinishedPulling="2026-05-21 18:23:29.12764079 +0000 UTC m=+186.053129295" observedRunningTime="2026-05-21 18:23:29.413651719 +0000 UTC m=+186.339140499" watchObservedRunningTime="2026-05-21 18:23:29.414212895 +0000 UTC m=+186.339701423"
May 21 18:23:30.359611 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:30.359576    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6" event={"ID":"50b7f0f6-e9f1-49be-a887-2dbadabe4d95","Type":"ContainerStarted","Data":"2e03d66df90c992bd41f06acdbcaa2a0ea17c57cdd0f0b3074a4ea836251c499"}
May 21 18:23:30.359611 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:30.359614    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6" event={"ID":"50b7f0f6-e9f1-49be-a887-2dbadabe4d95","Type":"ContainerStarted","Data":"0ac35035571239a76f25126450d348f6c1ea67401bfd4cab36fc96ff811483cd"}
May 21 18:23:30.360088 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:30.359624    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6" event={"ID":"50b7f0f6-e9f1-49be-a887-2dbadabe4d95","Type":"ContainerStarted","Data":"e0dc1574ebc2422aa441d3a368821f971765dc86090b36ed380e98e9b0e3ac1f"}
May 21 18:23:30.360986 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:30.360963    2573 generic.go:358] "Generic (PLEG): container finished" podID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerID="a882fce495db01f872b25d70e7e3e34ba60a0b91ad76861815607772b91af94d" exitCode=0
May 21 18:23:30.361095 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:30.361068    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c981abd9-e1a9-4e97-8b93-901e297d38a8","Type":"ContainerDied","Data":"a882fce495db01f872b25d70e7e3e34ba60a0b91ad76861815607772b91af94d"}
May 21 18:23:30.390177 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:30.390133    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-67ddd58468-qn6m6" podStartSLOduration=1.104882195 podStartE2EDuration="3.390120278s" podCreationTimestamp="2026-05-21 18:23:27 +0000 UTC" firstStartedPulling="2026-05-21 18:23:27.66190935 +0000 UTC m=+184.587397855" lastFinishedPulling="2026-05-21 18:23:29.947147428 +0000 UTC m=+186.872635938" observedRunningTime="2026-05-21 18:23:30.387927483 +0000 UTC m=+187.313416023" watchObservedRunningTime="2026-05-21 18:23:30.390120278 +0000 UTC m=+187.315608804"
May 21 18:23:34.381865 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:34.381832    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c981abd9-e1a9-4e97-8b93-901e297d38a8","Type":"ContainerStarted","Data":"25c48892f54defa4ff01b8fc995df63b1e41b6b11cad647ba789ea375c531836"}
May 21 18:23:34.381865 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:34.381867    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c981abd9-e1a9-4e97-8b93-901e297d38a8","Type":"ContainerStarted","Data":"1cae6a8d8ae1267c0acb528a33a1b3a560d9d51ead4d7e851932ffd8e70bc843"}
May 21 18:23:34.382290 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:34.381877    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c981abd9-e1a9-4e97-8b93-901e297d38a8","Type":"ContainerStarted","Data":"40a1aba8deb055f4b2512d85bda99153e7cde94f77a246636fba2a82e99fc896"}
May 21 18:23:34.382290 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:34.381885    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c981abd9-e1a9-4e97-8b93-901e297d38a8","Type":"ContainerStarted","Data":"869c0b839b977fa10c0b1621c6f0d80464af2eb77769c1e50463831c90c421fa"}
May 21 18:23:34.382290 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:34.381895    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c981abd9-e1a9-4e97-8b93-901e297d38a8","Type":"ContainerStarted","Data":"0904b8433c4a2724f4a86854679184ad37d523a89c2377afe246a82c1e20a1eb"}
May 21 18:23:34.382290 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:34.381909    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c981abd9-e1a9-4e97-8b93-901e297d38a8","Type":"ContainerStarted","Data":"c57d52fbdefa4f05ab545f7725b92bed1c03a7548ff0cf5607c0a7a5a4fcf939"}
May 21 18:23:34.426671 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:34.426620    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.400685042 podStartE2EDuration="6.426605289s" podCreationTimestamp="2026-05-21 18:23:28 +0000 UTC" firstStartedPulling="2026-05-21 18:23:30.362208372 +0000 UTC m=+187.287696877" lastFinishedPulling="2026-05-21 18:23:33.388128604 +0000 UTC m=+190.313617124" observedRunningTime="2026-05-21 18:23:34.420650036 +0000 UTC m=+191.346138562" watchObservedRunningTime="2026-05-21 18:23:34.426605289 +0000 UTC m=+191.352093816"
May 21 18:23:36.376756 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:36.376725    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5979cc64d4-2v9vn"
May 21 18:23:38.466982 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:38.466946    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:23:46.635298 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:46.635260    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:23:46.635298 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:23:46.635300    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:24:06.640732 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:06.640697    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:24:06.644427 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:06.644409    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-7954df9985-6zwkf"
May 21 18:24:14.502760 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:14.502728    2573 generic.go:358] "Generic (PLEG): container finished" podID="4e0c7492-8cf6-4b1b-8326-e298f267e011" containerID="b31cc0573c0993c22aa3aaa2f6eb5b654b2d005ead151df7e0718a689f633f9e" exitCode=0
May 21 18:24:14.503166 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:14.502808    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-d9jkq" event={"ID":"4e0c7492-8cf6-4b1b-8326-e298f267e011","Type":"ContainerDied","Data":"b31cc0573c0993c22aa3aaa2f6eb5b654b2d005ead151df7e0718a689f633f9e"}
May 21 18:24:14.503166 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:14.503163    2573 scope.go:117] "RemoveContainer" containerID="b31cc0573c0993c22aa3aaa2f6eb5b654b2d005ead151df7e0718a689f633f9e"
May 21 18:24:15.507382 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:15.507345    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-d9jkq" event={"ID":"4e0c7492-8cf6-4b1b-8326-e298f267e011","Type":"ContainerStarted","Data":"d7a201a7fd06842ebe1bbe7004c9a32400ce3c6218f83fc4e6e8c3517624943e"}
May 21 18:24:17.514377 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:17.514341    2573 generic.go:358] "Generic (PLEG): container finished" podID="c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55" containerID="7fb908cb23c08f36f20c13ea823ed8a08d22447d7d3954bf7bf56e6672b40ca0" exitCode=0
May 21 18:24:17.514841 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:17.514410    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-jrmpx" event={"ID":"c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55","Type":"ContainerDied","Data":"7fb908cb23c08f36f20c13ea823ed8a08d22447d7d3954bf7bf56e6672b40ca0"}
May 21 18:24:17.514841 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:17.514834    2573 scope.go:117] "RemoveContainer" containerID="7fb908cb23c08f36f20c13ea823ed8a08d22447d7d3954bf7bf56e6672b40ca0"
May 21 18:24:18.519079 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:18.519043    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-jrmpx" event={"ID":"c8f30455-1de9-47a7-9fd3-5b6f7f2dbb55","Type":"ContainerStarted","Data":"732b4f623e3916e7a70bade967bffb19dad83021327a2f282bd7c1dc6a312163"}
May 21 18:24:28.466849 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:28.466813    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:28.482524 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:28.482496    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:28.569644 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:28.569605    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:35.424457 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:35.424405    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs\") pod \"network-metrics-daemon-bqjkb\" (UID: \"f22b878b-cf41-4a22-bbda-ac4a10922613\") " pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:24:35.426829 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:35.426794    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f22b878b-cf41-4a22-bbda-ac4a10922613-metrics-certs\") pod \"network-metrics-daemon-bqjkb\" (UID: \"f22b878b-cf41-4a22-bbda-ac4a10922613\") " pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:24:35.590800 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:35.590770    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-7dqz4\""
May 21 18:24:35.598345 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:35.598327    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bqjkb"
May 21 18:24:35.746034 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:35.746011    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bqjkb"]
May 21 18:24:35.747779 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:24:35.747750    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf22b878b_cf41_4a22_bbda_ac4a10922613.slice/crio-15c2386b76e01d338f8e0fd1e13a800398c1295952f341d748b7793e00537040 WatchSource:0}: Error finding container 15c2386b76e01d338f8e0fd1e13a800398c1295952f341d748b7793e00537040: Status 404 returned error can't find the container with id 15c2386b76e01d338f8e0fd1e13a800398c1295952f341d748b7793e00537040
May 21 18:24:36.575681 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:36.575635    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bqjkb" event={"ID":"f22b878b-cf41-4a22-bbda-ac4a10922613","Type":"ContainerStarted","Data":"15c2386b76e01d338f8e0fd1e13a800398c1295952f341d748b7793e00537040"}
May 21 18:24:37.581227 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:37.581191    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bqjkb" event={"ID":"f22b878b-cf41-4a22-bbda-ac4a10922613","Type":"ContainerStarted","Data":"e6ca0a8fc654c82608301f120ae7a7e478de9ff2e631d78b4cf564c226b33c09"}
May 21 18:24:37.581227 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:37.581228    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bqjkb" event={"ID":"f22b878b-cf41-4a22-bbda-ac4a10922613","Type":"ContainerStarted","Data":"a11adb8b401dbee17b74d0446334f3d98c09d9602bed9b9f8ff64bb561e7994e"}
May 21 18:24:37.601692 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:37.601645    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bqjkb" podStartSLOduration=253.644933475 podStartE2EDuration="4m14.601630606s" podCreationTimestamp="2026-05-21 18:20:23 +0000 UTC" firstStartedPulling="2026-05-21 18:24:35.749766962 +0000 UTC m=+252.675255471" lastFinishedPulling="2026-05-21 18:24:36.706464094 +0000 UTC m=+253.631952602" observedRunningTime="2026-05-21 18:24:37.599785961 +0000 UTC m=+254.525274488" watchObservedRunningTime="2026-05-21 18:24:37.601630606 +0000 UTC m=+254.527119133"
May 21 18:24:42.462745 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:42.462715    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 18:24:42.463195 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:42.463166    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="alertmanager" containerID="cri-o://3aeb478b3fa4892a5338535c87d1b4aebf5d619c7376149d798ea84ee80cb18d" gracePeriod=120
May 21 18:24:42.463323 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:42.463259    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="kube-rbac-proxy-web" containerID="cri-o://ae11b17e91198f21cbf93a488cc0729d01b70048a659ca0d34b064a35ae77b17" gracePeriod=120
May 21 18:24:42.463323 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:42.463261    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="prom-label-proxy" containerID="cri-o://fd89861ea5ed4a6d456bccd8964a5c087e850143713fda23cebf58e96245df91" gracePeriod=120
May 21 18:24:42.463460 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:42.463297    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="kube-rbac-proxy" containerID="cri-o://3eb7aee6bedb8c4b49b265677eb354c35d33155109368fde7f7f708b784de599" gracePeriod=120
May 21 18:24:42.463460 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:42.463234    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="kube-rbac-proxy-metric" containerID="cri-o://d9f1bd0b08b31e6f41e769e261d27333e6ddd5aef51a18f8a712054abe9592cd" gracePeriod=120
May 21 18:24:42.463460 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:42.463348    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="config-reloader" containerID="cri-o://7e0d37c80ac242b6979a93149c16a3f6ed3ab6029d612332213e12b4d64780c6" gracePeriod=120
May 21 18:24:42.600614 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:42.600585    2573 generic.go:358] "Generic (PLEG): container finished" podID="e766552d-6920-4bda-800d-6dc705b44a6c" containerID="fd89861ea5ed4a6d456bccd8964a5c087e850143713fda23cebf58e96245df91" exitCode=0
May 21 18:24:42.600614 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:42.600609    2573 generic.go:358] "Generic (PLEG): container finished" podID="e766552d-6920-4bda-800d-6dc705b44a6c" containerID="3eb7aee6bedb8c4b49b265677eb354c35d33155109368fde7f7f708b784de599" exitCode=0
May 21 18:24:42.600614 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:42.600617    2573 generic.go:358] "Generic (PLEG): container finished" podID="e766552d-6920-4bda-800d-6dc705b44a6c" containerID="7e0d37c80ac242b6979a93149c16a3f6ed3ab6029d612332213e12b4d64780c6" exitCode=0
May 21 18:24:42.600792 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:42.600623    2573 generic.go:358] "Generic (PLEG): container finished" podID="e766552d-6920-4bda-800d-6dc705b44a6c" containerID="3aeb478b3fa4892a5338535c87d1b4aebf5d619c7376149d798ea84ee80cb18d" exitCode=0
May 21 18:24:42.600792 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:42.600653    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e766552d-6920-4bda-800d-6dc705b44a6c","Type":"ContainerDied","Data":"fd89861ea5ed4a6d456bccd8964a5c087e850143713fda23cebf58e96245df91"}
May 21 18:24:42.600792 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:42.600685    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e766552d-6920-4bda-800d-6dc705b44a6c","Type":"ContainerDied","Data":"3eb7aee6bedb8c4b49b265677eb354c35d33155109368fde7f7f708b784de599"}
May 21 18:24:42.600792 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:42.600705    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e766552d-6920-4bda-800d-6dc705b44a6c","Type":"ContainerDied","Data":"7e0d37c80ac242b6979a93149c16a3f6ed3ab6029d612332213e12b4d64780c6"}
May 21 18:24:42.600792 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:42.600715    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e766552d-6920-4bda-800d-6dc705b44a6c","Type":"ContainerDied","Data":"3aeb478b3fa4892a5338535c87d1b4aebf5d619c7376149d798ea84ee80cb18d"}
May 21 18:24:43.606683 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.606650    2573 generic.go:358] "Generic (PLEG): container finished" podID="e766552d-6920-4bda-800d-6dc705b44a6c" containerID="d9f1bd0b08b31e6f41e769e261d27333e6ddd5aef51a18f8a712054abe9592cd" exitCode=0
May 21 18:24:43.606683 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.606682    2573 generic.go:358] "Generic (PLEG): container finished" podID="e766552d-6920-4bda-800d-6dc705b44a6c" containerID="ae11b17e91198f21cbf93a488cc0729d01b70048a659ca0d34b064a35ae77b17" exitCode=0
May 21 18:24:43.607063 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.606722    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e766552d-6920-4bda-800d-6dc705b44a6c","Type":"ContainerDied","Data":"d9f1bd0b08b31e6f41e769e261d27333e6ddd5aef51a18f8a712054abe9592cd"}
May 21 18:24:43.607063 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.606766    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e766552d-6920-4bda-800d-6dc705b44a6c","Type":"ContainerDied","Data":"ae11b17e91198f21cbf93a488cc0729d01b70048a659ca0d34b064a35ae77b17"}
May 21 18:24:43.718858 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.718836    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:43.789628 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.789530    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e766552d-6920-4bda-800d-6dc705b44a6c-metrics-client-ca\") pod \"e766552d-6920-4bda-800d-6dc705b44a6c\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") "
May 21 18:24:43.789778 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.789646    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e766552d-6920-4bda-800d-6dc705b44a6c\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") "
May 21 18:24:43.789778 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.789704    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e766552d-6920-4bda-800d-6dc705b44a6c-alertmanager-main-db\") pod \"e766552d-6920-4bda-800d-6dc705b44a6c\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") "
May 21 18:24:43.789778 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.789737    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-kube-rbac-proxy\") pod \"e766552d-6920-4bda-800d-6dc705b44a6c\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") "
May 21 18:24:43.789943 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.789783    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hm4pj\" (UniqueName: \"kubernetes.io/projected/e766552d-6920-4bda-800d-6dc705b44a6c-kube-api-access-hm4pj\") pod \"e766552d-6920-4bda-800d-6dc705b44a6c\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") "
May 21 18:24:43.789943 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.789826    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e766552d-6920-4bda-800d-6dc705b44a6c-config-out\") pod \"e766552d-6920-4bda-800d-6dc705b44a6c\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") "
May 21 18:24:43.789943 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.789864    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-web-config\") pod \"e766552d-6920-4bda-800d-6dc705b44a6c\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") "
May 21 18:24:43.789943 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.789888    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-main-tls\") pod \"e766552d-6920-4bda-800d-6dc705b44a6c\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") "
May 21 18:24:43.789943 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.789916    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-kube-rbac-proxy-web\") pod \"e766552d-6920-4bda-800d-6dc705b44a6c\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") "
May 21 18:24:43.789943 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.789940    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e766552d-6920-4bda-800d-6dc705b44a6c-tls-assets\") pod \"e766552d-6920-4bda-800d-6dc705b44a6c\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") "
May 21 18:24:43.790231 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.789975    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-cluster-tls-config\") pod \"e766552d-6920-4bda-800d-6dc705b44a6c\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") "
May 21 18:24:43.790231 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.789986    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e766552d-6920-4bda-800d-6dc705b44a6c-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e766552d-6920-4bda-800d-6dc705b44a6c" (UID: "e766552d-6920-4bda-800d-6dc705b44a6c"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:24:43.790231 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.790008    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e766552d-6920-4bda-800d-6dc705b44a6c-alertmanager-trusted-ca-bundle\") pod \"e766552d-6920-4bda-800d-6dc705b44a6c\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") "
May 21 18:24:43.790231 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.790023    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e766552d-6920-4bda-800d-6dc705b44a6c-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e766552d-6920-4bda-800d-6dc705b44a6c" (UID: "e766552d-6920-4bda-800d-6dc705b44a6c"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:24:43.790231 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.790061    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-config-volume\") pod \"e766552d-6920-4bda-800d-6dc705b44a6c\" (UID: \"e766552d-6920-4bda-800d-6dc705b44a6c\") "
May 21 18:24:43.790499 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.790296    2573 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e766552d-6920-4bda-800d-6dc705b44a6c-metrics-client-ca\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:43.790499 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.790336    2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e766552d-6920-4bda-800d-6dc705b44a6c-alertmanager-main-db\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:43.791615 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.791321    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e766552d-6920-4bda-800d-6dc705b44a6c-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e766552d-6920-4bda-800d-6dc705b44a6c" (UID: "e766552d-6920-4bda-800d-6dc705b44a6c"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:24:43.792899 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.792534    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e766552d-6920-4bda-800d-6dc705b44a6c" (UID: "e766552d-6920-4bda-800d-6dc705b44a6c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:24:43.792899 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.792770    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e766552d-6920-4bda-800d-6dc705b44a6c-kube-api-access-hm4pj" (OuterVolumeSpecName: "kube-api-access-hm4pj") pod "e766552d-6920-4bda-800d-6dc705b44a6c" (UID: "e766552d-6920-4bda-800d-6dc705b44a6c"). InnerVolumeSpecName "kube-api-access-hm4pj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:24:43.793880 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.793814    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-config-volume" (OuterVolumeSpecName: "config-volume") pod "e766552d-6920-4bda-800d-6dc705b44a6c" (UID: "e766552d-6920-4bda-800d-6dc705b44a6c"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:24:43.794172 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.794138    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e766552d-6920-4bda-800d-6dc705b44a6c-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e766552d-6920-4bda-800d-6dc705b44a6c" (UID: "e766552d-6920-4bda-800d-6dc705b44a6c"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:24:43.794876 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.794827    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e766552d-6920-4bda-800d-6dc705b44a6c-config-out" (OuterVolumeSpecName: "config-out") pod "e766552d-6920-4bda-800d-6dc705b44a6c" (UID: "e766552d-6920-4bda-800d-6dc705b44a6c"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:24:43.794952 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.794925    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e766552d-6920-4bda-800d-6dc705b44a6c" (UID: "e766552d-6920-4bda-800d-6dc705b44a6c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:24:43.796528 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.796507    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e766552d-6920-4bda-800d-6dc705b44a6c" (UID: "e766552d-6920-4bda-800d-6dc705b44a6c"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:24:43.796659 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.796636    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e766552d-6920-4bda-800d-6dc705b44a6c" (UID: "e766552d-6920-4bda-800d-6dc705b44a6c"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:24:43.799103 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.799077    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e766552d-6920-4bda-800d-6dc705b44a6c" (UID: "e766552d-6920-4bda-800d-6dc705b44a6c"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:24:43.806027 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.806004    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-web-config" (OuterVolumeSpecName: "web-config") pod "e766552d-6920-4bda-800d-6dc705b44a6c" (UID: "e766552d-6920-4bda-800d-6dc705b44a6c"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:24:43.891600 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.891573    2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e766552d-6920-4bda-800d-6dc705b44a6c-config-out\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:43.891600 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.891596    2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-web-config\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:43.891600 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.891606    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-main-tls\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:43.891780 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.891618    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:43.891780 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.891628    2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e766552d-6920-4bda-800d-6dc705b44a6c-tls-assets\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:43.891780 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.891636    2573 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-cluster-tls-config\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:43.891780 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.891645    2573 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e766552d-6920-4bda-800d-6dc705b44a6c-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:43.891780 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.891654    2573 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-config-volume\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:43.891780 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.891664    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:43.891780 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.891674    2573 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e766552d-6920-4bda-800d-6dc705b44a6c-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:43.891780 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:43.891682    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hm4pj\" (UniqueName: \"kubernetes.io/projected/e766552d-6920-4bda-800d-6dc705b44a6c-kube-api-access-hm4pj\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:44.615505 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.615471    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e766552d-6920-4bda-800d-6dc705b44a6c","Type":"ContainerDied","Data":"588fdfb5a0c5a586b3b6683d77c221d8c644af53df018ff6f6fbe8400b3d9e69"}
May 21 18:24:44.615857 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.615520    2573 scope.go:117] "RemoveContainer" containerID="fd89861ea5ed4a6d456bccd8964a5c087e850143713fda23cebf58e96245df91"
May 21 18:24:44.615857 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.615592    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.624635 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.624617    2573 scope.go:117] "RemoveContainer" containerID="d9f1bd0b08b31e6f41e769e261d27333e6ddd5aef51a18f8a712054abe9592cd"
May 21 18:24:44.632471 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.632445    2573 scope.go:117] "RemoveContainer" containerID="3eb7aee6bedb8c4b49b265677eb354c35d33155109368fde7f7f708b784de599"
May 21 18:24:44.639297 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.639242    2573 scope.go:117] "RemoveContainer" containerID="ae11b17e91198f21cbf93a488cc0729d01b70048a659ca0d34b064a35ae77b17"
May 21 18:24:44.642154 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.642115    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 18:24:44.647048 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.647024    2573 scope.go:117] "RemoveContainer" containerID="7e0d37c80ac242b6979a93149c16a3f6ed3ab6029d612332213e12b4d64780c6"
May 21 18:24:44.650144 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.650124    2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 18:24:44.654765 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.654750    2573 scope.go:117] "RemoveContainer" containerID="3aeb478b3fa4892a5338535c87d1b4aebf5d619c7376149d798ea84ee80cb18d"
May 21 18:24:44.661035 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.661019    2573 scope.go:117] "RemoveContainer" containerID="8f76fa4dcd7820d547355c760cf8bb6d46cf418569f8272a9e7ba88290137b89"
May 21 18:24:44.695836 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.695806    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 18:24:44.696140 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.696128    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="config-reloader"
May 21 18:24:44.696179 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.696142    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="config-reloader"
May 21 18:24:44.696179 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.696155    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="kube-rbac-proxy-metric"
May 21 18:24:44.696179 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.696161    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="kube-rbac-proxy-metric"
May 21 18:24:44.696179 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.696170    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="init-config-reloader"
May 21 18:24:44.696179 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.696176    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="init-config-reloader"
May 21 18:24:44.696332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.696184    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="alertmanager"
May 21 18:24:44.696332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.696189    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="alertmanager"
May 21 18:24:44.696332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.696195    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="prom-label-proxy"
May 21 18:24:44.696332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.696199    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="prom-label-proxy"
May 21 18:24:44.696332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.696207    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="kube-rbac-proxy-web"
May 21 18:24:44.696332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.696212    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="kube-rbac-proxy-web"
May 21 18:24:44.696332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.696225    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="kube-rbac-proxy"
May 21 18:24:44.696332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.696230    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="kube-rbac-proxy"
May 21 18:24:44.696332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.696278    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="alertmanager"
May 21 18:24:44.696332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.696286    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="kube-rbac-proxy-web"
May 21 18:24:44.696332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.696293    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="config-reloader"
May 21 18:24:44.696332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.696313    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="kube-rbac-proxy"
May 21 18:24:44.696332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.696328    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="prom-label-proxy"
May 21 18:24:44.696332 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.696335    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" containerName="kube-rbac-proxy-metric"
May 21 18:24:44.699849 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.699829    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.708723 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.708690    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 21 18:24:44.708816 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.708787    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 21 18:24:44.708960 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.708946    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zmpfc\""
May 21 18:24:44.709012 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.708995    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 21 18:24:44.709053 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.708994    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 21 18:24:44.709277 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.709259    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 21 18:24:44.709277 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.709276    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 21 18:24:44.709484 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.709277    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 21 18:24:44.709566 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.709551    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 21 18:24:44.714176 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.714159    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 21 18:24:44.726947 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.726927    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 18:24:44.798794 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.798721    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.798794 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.798773    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.798942 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.798825    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.798942 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.798850    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-web-config\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.798942 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.798910    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8d2c\" (UniqueName: \"kubernetes.io/projected/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-kube-api-access-x8d2c\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.799039 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.798945    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-config-out\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.799039 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.798962    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.799039 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.798979    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.799039 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.799000    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.799039 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.799034    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.799177 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.799085    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.799177 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.799108    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.799177 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.799141    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.899874 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.899839    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.899874 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.899874    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.900070 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.899898    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.900070 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.899916    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-web-config\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.900070 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.899941    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x8d2c\" (UniqueName: \"kubernetes.io/projected/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-kube-api-access-x8d2c\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.900070 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.899963    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-config-out\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.900070 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.899979    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.900070 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.899997    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.900482 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.900454    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.900570 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.900495    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.900570 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.900551    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.900668 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.900588    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.900668 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.900641    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.900940 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.900913    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.901865 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.901341    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.901865 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.901581    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.903148 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.902879    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-config-out\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.903148 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.902970    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.903148 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.903038    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.903148 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.903084    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.903500 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.903474    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.903603 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.903533    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-web-config\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.903809 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.903791    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.904121 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.904100    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.904994 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.904973    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:44.910356 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:44.910337    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8d2c\" (UniqueName: \"kubernetes.io/projected/d2e980d4-0f12-476b-8e54-62ec0f79a1b1-kube-api-access-x8d2c\") pod \"alertmanager-main-0\" (UID: \"d2e980d4-0f12-476b-8e54-62ec0f79a1b1\") " pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:45.009151 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:45.009121    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 21 18:24:45.148059 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:45.148036    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 21 18:24:45.150028 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:24:45.150000    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2e980d4_0f12_476b_8e54_62ec0f79a1b1.slice/crio-cfc43dcabbbf5f6013528ba6e31e9cb4b4738a4bf24ee2e15c3091e88cf7ef4e WatchSource:0}: Error finding container cfc43dcabbbf5f6013528ba6e31e9cb4b4738a4bf24ee2e15c3091e88cf7ef4e: Status 404 returned error can't find the container with id cfc43dcabbbf5f6013528ba6e31e9cb4b4738a4bf24ee2e15c3091e88cf7ef4e
May 21 18:24:45.625189 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:45.625154    2573 generic.go:358] "Generic (PLEG): container finished" podID="d2e980d4-0f12-476b-8e54-62ec0f79a1b1" containerID="f8219811a32ff02f5ab815ac986c7b131e579368694f01448b1c7941d81226a5" exitCode=0
May 21 18:24:45.625578 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:45.625240    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2e980d4-0f12-476b-8e54-62ec0f79a1b1","Type":"ContainerDied","Data":"f8219811a32ff02f5ab815ac986c7b131e579368694f01448b1c7941d81226a5"}
May 21 18:24:45.625578 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:45.625276    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2e980d4-0f12-476b-8e54-62ec0f79a1b1","Type":"ContainerStarted","Data":"cfc43dcabbbf5f6013528ba6e31e9cb4b4738a4bf24ee2e15c3091e88cf7ef4e"}
May 21 18:24:45.690955 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:45.690931    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e766552d-6920-4bda-800d-6dc705b44a6c" path="/var/lib/kubelet/pods/e766552d-6920-4bda-800d-6dc705b44a6c/volumes"
May 21 18:24:46.632407 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:46.632370    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2e980d4-0f12-476b-8e54-62ec0f79a1b1","Type":"ContainerStarted","Data":"648ff3ebd0c802e6d215a82b2269ec12c6100f1c5fb5d9e14d50e78baf5b3d53"}
May 21 18:24:46.632407 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:46.632408    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2e980d4-0f12-476b-8e54-62ec0f79a1b1","Type":"ContainerStarted","Data":"411a17c04d32a6952f748f628cec347007f0123d8a67a7ec7549496c519bbeb1"}
May 21 18:24:46.632822 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:46.632421    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2e980d4-0f12-476b-8e54-62ec0f79a1b1","Type":"ContainerStarted","Data":"d6cb7aa263d0fc9e84101a8547f402296950b33f9b304327f2a394408856c3da"}
May 21 18:24:46.632822 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:46.632432    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2e980d4-0f12-476b-8e54-62ec0f79a1b1","Type":"ContainerStarted","Data":"d0c0574b383ecdaec7a7432870fb4b6b52e0223fff92453e5293268b885a31a4"}
May 21 18:24:46.632822 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:46.632443    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2e980d4-0f12-476b-8e54-62ec0f79a1b1","Type":"ContainerStarted","Data":"6c9fd0f2e7b9601b4b2b2a24ae4ef9075c939a609b1bec76630d9322b3574dfa"}
May 21 18:24:46.632822 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:46.632453    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d2e980d4-0f12-476b-8e54-62ec0f79a1b1","Type":"ContainerStarted","Data":"2ebb3b6803d341e1a3e5354763f4183fff1c1d9260ec0e1f19916ec4a3c7cd29"}
May 21 18:24:46.675878 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:46.675820    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.6758020240000002 podStartE2EDuration="2.675802024s" podCreationTimestamp="2026-05-21 18:24:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:24:46.673413798 +0000 UTC m=+263.598902327" watchObservedRunningTime="2026-05-21 18:24:46.675802024 +0000 UTC m=+263.601290551"
May 21 18:24:46.755831 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:46.755796    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 18:24:46.756527 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:46.756393    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="kube-rbac-proxy" containerID="cri-o://1cae6a8d8ae1267c0acb528a33a1b3a560d9d51ead4d7e851932ffd8e70bc843" gracePeriod=600
May 21 18:24:46.756527 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:46.756389    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="prometheus" containerID="cri-o://c57d52fbdefa4f05ab545f7725b92bed1c03a7548ff0cf5607c0a7a5a4fcf939" gracePeriod=600
May 21 18:24:46.756527 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:46.756434    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="config-reloader" containerID="cri-o://0904b8433c4a2724f4a86854679184ad37d523a89c2377afe246a82c1e20a1eb" gracePeriod=600
May 21 18:24:46.756527 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:46.756424    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="kube-rbac-proxy-thanos" containerID="cri-o://25c48892f54defa4ff01b8fc995df63b1e41b6b11cad647ba789ea375c531836" gracePeriod=600
May 21 18:24:46.756527 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:46.756451    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="kube-rbac-proxy-web" containerID="cri-o://40a1aba8deb055f4b2512d85bda99153e7cde94f77a246636fba2a82e99fc896" gracePeriod=600
May 21 18:24:46.756527 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:46.756429    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="thanos-sidecar" containerID="cri-o://869c0b839b977fa10c0b1621c6f0d80464af2eb77769c1e50463831c90c421fa" gracePeriod=600
May 21 18:24:47.638112 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:47.638084    2573 generic.go:358] "Generic (PLEG): container finished" podID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerID="25c48892f54defa4ff01b8fc995df63b1e41b6b11cad647ba789ea375c531836" exitCode=0
May 21 18:24:47.638112 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:47.638109    2573 generic.go:358] "Generic (PLEG): container finished" podID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerID="1cae6a8d8ae1267c0acb528a33a1b3a560d9d51ead4d7e851932ffd8e70bc843" exitCode=0
May 21 18:24:47.638112 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:47.638115    2573 generic.go:358] "Generic (PLEG): container finished" podID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerID="869c0b839b977fa10c0b1621c6f0d80464af2eb77769c1e50463831c90c421fa" exitCode=0
May 21 18:24:47.638112 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:47.638120    2573 generic.go:358] "Generic (PLEG): container finished" podID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerID="0904b8433c4a2724f4a86854679184ad37d523a89c2377afe246a82c1e20a1eb" exitCode=0
May 21 18:24:47.638543 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:47.638126    2573 generic.go:358] "Generic (PLEG): container finished" podID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerID="c57d52fbdefa4f05ab545f7725b92bed1c03a7548ff0cf5607c0a7a5a4fcf939" exitCode=0
May 21 18:24:47.638543 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:47.638152    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c981abd9-e1a9-4e97-8b93-901e297d38a8","Type":"ContainerDied","Data":"25c48892f54defa4ff01b8fc995df63b1e41b6b11cad647ba789ea375c531836"}
May 21 18:24:47.638543 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:47.638190    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c981abd9-e1a9-4e97-8b93-901e297d38a8","Type":"ContainerDied","Data":"1cae6a8d8ae1267c0acb528a33a1b3a560d9d51ead4d7e851932ffd8e70bc843"}
May 21 18:24:47.638543 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:47.638201    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c981abd9-e1a9-4e97-8b93-901e297d38a8","Type":"ContainerDied","Data":"869c0b839b977fa10c0b1621c6f0d80464af2eb77769c1e50463831c90c421fa"}
May 21 18:24:47.638543 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:47.638210    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c981abd9-e1a9-4e97-8b93-901e297d38a8","Type":"ContainerDied","Data":"0904b8433c4a2724f4a86854679184ad37d523a89c2377afe246a82c1e20a1eb"}
May 21 18:24:47.638543 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:47.638218    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c981abd9-e1a9-4e97-8b93-901e297d38a8","Type":"ContainerDied","Data":"c57d52fbdefa4f05ab545f7725b92bed1c03a7548ff0cf5607c0a7a5a4fcf939"}
May 21 18:24:48.020711 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.020681    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.126335 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.126245    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-web-config\") pod \"c981abd9-e1a9-4e97-8b93-901e297d38a8\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") "
May 21 18:24:48.126335 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.126292    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-metrics-client-certs\") pod \"c981abd9-e1a9-4e97-8b93-901e297d38a8\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") "
May 21 18:24:48.126335 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.126332    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n87xj\" (UniqueName: \"kubernetes.io/projected/c981abd9-e1a9-4e97-8b93-901e297d38a8-kube-api-access-n87xj\") pod \"c981abd9-e1a9-4e97-8b93-901e297d38a8\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") "
May 21 18:24:48.126581 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.126363    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-prometheus-trusted-ca-bundle\") pod \"c981abd9-e1a9-4e97-8b93-901e297d38a8\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") "
May 21 18:24:48.126581 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.126389    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-grpc-tls\") pod \"c981abd9-e1a9-4e97-8b93-901e297d38a8\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") "
May 21 18:24:48.126581 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.126420    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-config\") pod \"c981abd9-e1a9-4e97-8b93-901e297d38a8\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") "
May 21 18:24:48.126581 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.126440    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-thanos-prometheus-http-client-file\") pod \"c981abd9-e1a9-4e97-8b93-901e297d38a8\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") "
May 21 18:24:48.126774 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.126696    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-prometheus-k8s-tls\") pod \"c981abd9-e1a9-4e97-8b93-901e297d38a8\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") "
May 21 18:24:48.126774 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.126734    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c981abd9-e1a9-4e97-8b93-901e297d38a8-tls-assets\") pod \"c981abd9-e1a9-4e97-8b93-901e297d38a8\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") "
May 21 18:24:48.126870 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.126773    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-prometheus-k8s-rulefiles-0\") pod \"c981abd9-e1a9-4e97-8b93-901e297d38a8\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") "
May 21 18:24:48.126870 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.126807    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-kube-rbac-proxy\") pod \"c981abd9-e1a9-4e97-8b93-901e297d38a8\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") "
May 21 18:24:48.126870 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.126856    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-configmap-serving-certs-ca-bundle\") pod \"c981abd9-e1a9-4e97-8b93-901e297d38a8\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") "
May 21 18:24:48.127018 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.126905    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c981abd9-e1a9-4e97-8b93-901e297d38a8-prometheus-k8s-db\") pod \"c981abd9-e1a9-4e97-8b93-901e297d38a8\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") "
May 21 18:24:48.127018 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.126930    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-configmap-kubelet-serving-ca-bundle\") pod \"c981abd9-e1a9-4e97-8b93-901e297d38a8\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") "
May 21 18:24:48.127018 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.126963    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c981abd9-e1a9-4e97-8b93-901e297d38a8\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") "
May 21 18:24:48.127018 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.126991    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c981abd9-e1a9-4e97-8b93-901e297d38a8-config-out\") pod \"c981abd9-e1a9-4e97-8b93-901e297d38a8\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") "
May 21 18:24:48.127196 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.127028    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-configmap-metrics-client-ca\") pod \"c981abd9-e1a9-4e97-8b93-901e297d38a8\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") "
May 21 18:24:48.127196 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.127070    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c981abd9-e1a9-4e97-8b93-901e297d38a8\" (UID: \"c981abd9-e1a9-4e97-8b93-901e297d38a8\") "
May 21 18:24:48.127613 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.127415    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c981abd9-e1a9-4e97-8b93-901e297d38a8" (UID: "c981abd9-e1a9-4e97-8b93-901e297d38a8"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:24:48.129241 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.128059    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c981abd9-e1a9-4e97-8b93-901e297d38a8" (UID: "c981abd9-e1a9-4e97-8b93-901e297d38a8"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:24:48.129241 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.128176    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c981abd9-e1a9-4e97-8b93-901e297d38a8" (UID: "c981abd9-e1a9-4e97-8b93-901e297d38a8"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:24:48.129241 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.128601    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c981abd9-e1a9-4e97-8b93-901e297d38a8" (UID: "c981abd9-e1a9-4e97-8b93-901e297d38a8"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:24:48.129663 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.129604    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c981abd9-e1a9-4e97-8b93-901e297d38a8-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c981abd9-e1a9-4e97-8b93-901e297d38a8" (UID: "c981abd9-e1a9-4e97-8b93-901e297d38a8"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:24:48.129663 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.129627    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c981abd9-e1a9-4e97-8b93-901e297d38a8" (UID: "c981abd9-e1a9-4e97-8b93-901e297d38a8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 18:24:48.130200 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.130160    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c981abd9-e1a9-4e97-8b93-901e297d38a8" (UID: "c981abd9-e1a9-4e97-8b93-901e297d38a8"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:24:48.130200 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.130177    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c981abd9-e1a9-4e97-8b93-901e297d38a8-kube-api-access-n87xj" (OuterVolumeSpecName: "kube-api-access-n87xj") pod "c981abd9-e1a9-4e97-8b93-901e297d38a8" (UID: "c981abd9-e1a9-4e97-8b93-901e297d38a8"). InnerVolumeSpecName "kube-api-access-n87xj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:24:48.130716 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.130679    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c981abd9-e1a9-4e97-8b93-901e297d38a8" (UID: "c981abd9-e1a9-4e97-8b93-901e297d38a8"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:24:48.131012 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.130985    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c981abd9-e1a9-4e97-8b93-901e297d38a8" (UID: "c981abd9-e1a9-4e97-8b93-901e297d38a8"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:24:48.131157 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.131133    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c981abd9-e1a9-4e97-8b93-901e297d38a8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c981abd9-e1a9-4e97-8b93-901e297d38a8" (UID: "c981abd9-e1a9-4e97-8b93-901e297d38a8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 18:24:48.131277 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.131238    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c981abd9-e1a9-4e97-8b93-901e297d38a8" (UID: "c981abd9-e1a9-4e97-8b93-901e297d38a8"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:24:48.131547 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.131509    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c981abd9-e1a9-4e97-8b93-901e297d38a8" (UID: "c981abd9-e1a9-4e97-8b93-901e297d38a8"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:24:48.131721 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.131691    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c981abd9-e1a9-4e97-8b93-901e297d38a8" (UID: "c981abd9-e1a9-4e97-8b93-901e297d38a8"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:24:48.131893 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.131872    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c981abd9-e1a9-4e97-8b93-901e297d38a8" (UID: "c981abd9-e1a9-4e97-8b93-901e297d38a8"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:24:48.132234 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.132214    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-config" (OuterVolumeSpecName: "config") pod "c981abd9-e1a9-4e97-8b93-901e297d38a8" (UID: "c981abd9-e1a9-4e97-8b93-901e297d38a8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:24:48.132746 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.132725    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c981abd9-e1a9-4e97-8b93-901e297d38a8-config-out" (OuterVolumeSpecName: "config-out") pod "c981abd9-e1a9-4e97-8b93-901e297d38a8" (UID: "c981abd9-e1a9-4e97-8b93-901e297d38a8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 18:24:48.142475 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.142453    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-web-config" (OuterVolumeSpecName: "web-config") pod "c981abd9-e1a9-4e97-8b93-901e297d38a8" (UID: "c981abd9-e1a9-4e97-8b93-901e297d38a8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 18:24:48.228580 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.228544    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:48.228580 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.228578    2573 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-grpc-tls\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:48.228580 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.228588    2573 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-config\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:48.228747 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.228596    2573 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:48.228747 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.228607    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:48.228747 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.228615    2573 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c981abd9-e1a9-4e97-8b93-901e297d38a8-tls-assets\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:48.228747 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.228624    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:48.228747 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.228633    2573 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-kube-rbac-proxy\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:48.228747 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.228642    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:48.228747 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.228652    2573 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c981abd9-e1a9-4e97-8b93-901e297d38a8-prometheus-k8s-db\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:48.228747 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.228660    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:48.228747 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.228670    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:48.228747 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.228678    2573 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c981abd9-e1a9-4e97-8b93-901e297d38a8-config-out\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:48.228747 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.228687    2573 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c981abd9-e1a9-4e97-8b93-901e297d38a8-configmap-metrics-client-ca\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:48.228747 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.228703    2573 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:48.228747 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.228712    2573 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-web-config\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:48.228747 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.228720    2573 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c981abd9-e1a9-4e97-8b93-901e297d38a8-secret-metrics-client-certs\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:48.228747 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.228729    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n87xj\" (UniqueName: \"kubernetes.io/projected/c981abd9-e1a9-4e97-8b93-901e297d38a8-kube-api-access-n87xj\") on node \"ip-10-0-129-93.ec2.internal\" DevicePath \"\""
May 21 18:24:48.643932 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.643899    2573 generic.go:358] "Generic (PLEG): container finished" podID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerID="40a1aba8deb055f4b2512d85bda99153e7cde94f77a246636fba2a82e99fc896" exitCode=0
May 21 18:24:48.644316 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.643970    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c981abd9-e1a9-4e97-8b93-901e297d38a8","Type":"ContainerDied","Data":"40a1aba8deb055f4b2512d85bda99153e7cde94f77a246636fba2a82e99fc896"}
May 21 18:24:48.644316 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.643997    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c981abd9-e1a9-4e97-8b93-901e297d38a8","Type":"ContainerDied","Data":"d58fae350dfaa998410cc90a90d4ab7c8ef6af6b4d452aaa1de1e7bb2e2b040d"}
May 21 18:24:48.644316 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.643999    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.644316 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.644013    2573 scope.go:117] "RemoveContainer" containerID="25c48892f54defa4ff01b8fc995df63b1e41b6b11cad647ba789ea375c531836"
May 21 18:24:48.652172 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.652142    2573 scope.go:117] "RemoveContainer" containerID="1cae6a8d8ae1267c0acb528a33a1b3a560d9d51ead4d7e851932ffd8e70bc843"
May 21 18:24:48.658804 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.658788    2573 scope.go:117] "RemoveContainer" containerID="40a1aba8deb055f4b2512d85bda99153e7cde94f77a246636fba2a82e99fc896"
May 21 18:24:48.665081 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.665065    2573 scope.go:117] "RemoveContainer" containerID="869c0b839b977fa10c0b1621c6f0d80464af2eb77769c1e50463831c90c421fa"
May 21 18:24:48.671155 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.671142    2573 scope.go:117] "RemoveContainer" containerID="0904b8433c4a2724f4a86854679184ad37d523a89c2377afe246a82c1e20a1eb"
May 21 18:24:48.679684 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.679656    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 18:24:48.681171 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.681141    2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 18:24:48.684382 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.684360    2573 scope.go:117] "RemoveContainer" containerID="c57d52fbdefa4f05ab545f7725b92bed1c03a7548ff0cf5607c0a7a5a4fcf939"
May 21 18:24:48.691366 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.691347    2573 scope.go:117] "RemoveContainer" containerID="a882fce495db01f872b25d70e7e3e34ba60a0b91ad76861815607772b91af94d"
May 21 18:24:48.697738 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.697719    2573 scope.go:117] "RemoveContainer" containerID="25c48892f54defa4ff01b8fc995df63b1e41b6b11cad647ba789ea375c531836"
May 21 18:24:48.697990 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:24:48.697972    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"25c48892f54defa4ff01b8fc995df63b1e41b6b11cad647ba789ea375c531836\": container with ID starting with 25c48892f54defa4ff01b8fc995df63b1e41b6b11cad647ba789ea375c531836 not found: ID does not exist" containerID="25c48892f54defa4ff01b8fc995df63b1e41b6b11cad647ba789ea375c531836"
May 21 18:24:48.698041 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.698007    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"25c48892f54defa4ff01b8fc995df63b1e41b6b11cad647ba789ea375c531836"} err="failed to get container status \"25c48892f54defa4ff01b8fc995df63b1e41b6b11cad647ba789ea375c531836\": rpc error: code = NotFound desc = could not find container \"25c48892f54defa4ff01b8fc995df63b1e41b6b11cad647ba789ea375c531836\": container with ID starting with 25c48892f54defa4ff01b8fc995df63b1e41b6b11cad647ba789ea375c531836 not found: ID does not exist"
May 21 18:24:48.698080 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.698041    2573 scope.go:117] "RemoveContainer" containerID="1cae6a8d8ae1267c0acb528a33a1b3a560d9d51ead4d7e851932ffd8e70bc843"
May 21 18:24:48.698289 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:24:48.698270    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1cae6a8d8ae1267c0acb528a33a1b3a560d9d51ead4d7e851932ffd8e70bc843\": container with ID starting with 1cae6a8d8ae1267c0acb528a33a1b3a560d9d51ead4d7e851932ffd8e70bc843 not found: ID does not exist" containerID="1cae6a8d8ae1267c0acb528a33a1b3a560d9d51ead4d7e851932ffd8e70bc843"
May 21 18:24:48.698385 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.698292    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1cae6a8d8ae1267c0acb528a33a1b3a560d9d51ead4d7e851932ffd8e70bc843"} err="failed to get container status \"1cae6a8d8ae1267c0acb528a33a1b3a560d9d51ead4d7e851932ffd8e70bc843\": rpc error: code = NotFound desc = could not find container \"1cae6a8d8ae1267c0acb528a33a1b3a560d9d51ead4d7e851932ffd8e70bc843\": container with ID starting with 1cae6a8d8ae1267c0acb528a33a1b3a560d9d51ead4d7e851932ffd8e70bc843 not found: ID does not exist"
May 21 18:24:48.698385 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.698328    2573 scope.go:117] "RemoveContainer" containerID="40a1aba8deb055f4b2512d85bda99153e7cde94f77a246636fba2a82e99fc896"
May 21 18:24:48.698559 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:24:48.698535    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"40a1aba8deb055f4b2512d85bda99153e7cde94f77a246636fba2a82e99fc896\": container with ID starting with 40a1aba8deb055f4b2512d85bda99153e7cde94f77a246636fba2a82e99fc896 not found: ID does not exist" containerID="40a1aba8deb055f4b2512d85bda99153e7cde94f77a246636fba2a82e99fc896"
May 21 18:24:48.698623 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.698561    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"40a1aba8deb055f4b2512d85bda99153e7cde94f77a246636fba2a82e99fc896"} err="failed to get container status \"40a1aba8deb055f4b2512d85bda99153e7cde94f77a246636fba2a82e99fc896\": rpc error: code = NotFound desc = could not find container \"40a1aba8deb055f4b2512d85bda99153e7cde94f77a246636fba2a82e99fc896\": container with ID starting with 40a1aba8deb055f4b2512d85bda99153e7cde94f77a246636fba2a82e99fc896 not found: ID does not exist"
May 21 18:24:48.698623 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.698574    2573 scope.go:117] "RemoveContainer" containerID="869c0b839b977fa10c0b1621c6f0d80464af2eb77769c1e50463831c90c421fa"
May 21 18:24:48.698836 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:24:48.698816    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"869c0b839b977fa10c0b1621c6f0d80464af2eb77769c1e50463831c90c421fa\": container with ID starting with 869c0b839b977fa10c0b1621c6f0d80464af2eb77769c1e50463831c90c421fa not found: ID does not exist" containerID="869c0b839b977fa10c0b1621c6f0d80464af2eb77769c1e50463831c90c421fa"
May 21 18:24:48.698881 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.698842    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"869c0b839b977fa10c0b1621c6f0d80464af2eb77769c1e50463831c90c421fa"} err="failed to get container status \"869c0b839b977fa10c0b1621c6f0d80464af2eb77769c1e50463831c90c421fa\": rpc error: code = NotFound desc = could not find container \"869c0b839b977fa10c0b1621c6f0d80464af2eb77769c1e50463831c90c421fa\": container with ID starting with 869c0b839b977fa10c0b1621c6f0d80464af2eb77769c1e50463831c90c421fa not found: ID does not exist"
May 21 18:24:48.698881 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.698859    2573 scope.go:117] "RemoveContainer" containerID="0904b8433c4a2724f4a86854679184ad37d523a89c2377afe246a82c1e20a1eb"
May 21 18:24:48.699122 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:24:48.699107    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0904b8433c4a2724f4a86854679184ad37d523a89c2377afe246a82c1e20a1eb\": container with ID starting with 0904b8433c4a2724f4a86854679184ad37d523a89c2377afe246a82c1e20a1eb not found: ID does not exist" containerID="0904b8433c4a2724f4a86854679184ad37d523a89c2377afe246a82c1e20a1eb"
May 21 18:24:48.699175 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.699127    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0904b8433c4a2724f4a86854679184ad37d523a89c2377afe246a82c1e20a1eb"} err="failed to get container status \"0904b8433c4a2724f4a86854679184ad37d523a89c2377afe246a82c1e20a1eb\": rpc error: code = NotFound desc = could not find container \"0904b8433c4a2724f4a86854679184ad37d523a89c2377afe246a82c1e20a1eb\": container with ID starting with 0904b8433c4a2724f4a86854679184ad37d523a89c2377afe246a82c1e20a1eb not found: ID does not exist"
May 21 18:24:48.699175 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.699144    2573 scope.go:117] "RemoveContainer" containerID="c57d52fbdefa4f05ab545f7725b92bed1c03a7548ff0cf5607c0a7a5a4fcf939"
May 21 18:24:48.699427 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:24:48.699407    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c57d52fbdefa4f05ab545f7725b92bed1c03a7548ff0cf5607c0a7a5a4fcf939\": container with ID starting with c57d52fbdefa4f05ab545f7725b92bed1c03a7548ff0cf5607c0a7a5a4fcf939 not found: ID does not exist" containerID="c57d52fbdefa4f05ab545f7725b92bed1c03a7548ff0cf5607c0a7a5a4fcf939"
May 21 18:24:48.699489 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.699436    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c57d52fbdefa4f05ab545f7725b92bed1c03a7548ff0cf5607c0a7a5a4fcf939"} err="failed to get container status \"c57d52fbdefa4f05ab545f7725b92bed1c03a7548ff0cf5607c0a7a5a4fcf939\": rpc error: code = NotFound desc = could not find container \"c57d52fbdefa4f05ab545f7725b92bed1c03a7548ff0cf5607c0a7a5a4fcf939\": container with ID starting with c57d52fbdefa4f05ab545f7725b92bed1c03a7548ff0cf5607c0a7a5a4fcf939 not found: ID does not exist"
May 21 18:24:48.699489 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.699458    2573 scope.go:117] "RemoveContainer" containerID="a882fce495db01f872b25d70e7e3e34ba60a0b91ad76861815607772b91af94d"
May 21 18:24:48.699771 ip-10-0-129-93 kubenswrapper[2573]: E0521 18:24:48.699745    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a882fce495db01f872b25d70e7e3e34ba60a0b91ad76861815607772b91af94d\": container with ID starting with a882fce495db01f872b25d70e7e3e34ba60a0b91ad76861815607772b91af94d not found: ID does not exist" containerID="a882fce495db01f872b25d70e7e3e34ba60a0b91ad76861815607772b91af94d"
May 21 18:24:48.699771 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.699771    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a882fce495db01f872b25d70e7e3e34ba60a0b91ad76861815607772b91af94d"} err="failed to get container status \"a882fce495db01f872b25d70e7e3e34ba60a0b91ad76861815607772b91af94d\": rpc error: code = NotFound desc = could not find container \"a882fce495db01f872b25d70e7e3e34ba60a0b91ad76861815607772b91af94d\": container with ID starting with a882fce495db01f872b25d70e7e3e34ba60a0b91ad76861815607772b91af94d not found: ID does not exist"
May 21 18:24:48.712804 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.712782    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 18:24:48.713110 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.713098    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="prometheus"
May 21 18:24:48.713156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.713112    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="prometheus"
May 21 18:24:48.713156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.713124    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="kube-rbac-proxy-thanos"
May 21 18:24:48.713156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.713129    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="kube-rbac-proxy-thanos"
May 21 18:24:48.713156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.713140    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="init-config-reloader"
May 21 18:24:48.713156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.713145    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="init-config-reloader"
May 21 18:24:48.713321 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.713157    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="kube-rbac-proxy-web"
May 21 18:24:48.713321 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.713163    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="kube-rbac-proxy-web"
May 21 18:24:48.713321 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.713170    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="config-reloader"
May 21 18:24:48.713321 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.713175    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="config-reloader"
May 21 18:24:48.713321 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.713181    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="kube-rbac-proxy"
May 21 18:24:48.713321 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.713187    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="kube-rbac-proxy"
May 21 18:24:48.713321 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.713194    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="thanos-sidecar"
May 21 18:24:48.713321 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.713199    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="thanos-sidecar"
May 21 18:24:48.713321 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.713243    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="prometheus"
May 21 18:24:48.713321 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.713251    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="kube-rbac-proxy-thanos"
May 21 18:24:48.713321 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.713259    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="thanos-sidecar"
May 21 18:24:48.713321 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.713267    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="config-reloader"
May 21 18:24:48.713321 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.713272    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="kube-rbac-proxy-web"
May 21 18:24:48.713321 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.713278    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" containerName="kube-rbac-proxy"
May 21 18:24:48.717391 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.717371    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.720371 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.720353    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 21 18:24:48.720842 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.720824    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 21 18:24:48.720842 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.720837    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-acec8fvdp1h1e\""
May 21 18:24:48.721215 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.721197    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mlq7z\""
May 21 18:24:48.721697 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.721681    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 21 18:24:48.721784 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.721703    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 21 18:24:48.721924 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.721910    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 21 18:24:48.721996 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.721977    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 21 18:24:48.721996 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.721977    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 21 18:24:48.722182 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.722170    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 21 18:24:48.722881 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.722867    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 21 18:24:48.723969 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.723953    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 21 18:24:48.725820 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.725802    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 21 18:24:48.728532 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.728512    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 21 18:24:48.734210 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.734188    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 18:24:48.832736 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.832645    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e89fdc0b-edc0-4ca4-ba53-fe385238f385-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.832736 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.832677    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.832736 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.832707    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e89fdc0b-edc0-4ca4-ba53-fe385238f385-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.832736 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.832728    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e89fdc0b-edc0-4ca4-ba53-fe385238f385-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.833003 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.832791    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e89fdc0b-edc0-4ca4-ba53-fe385238f385-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.833003 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.832849    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e89fdc0b-edc0-4ca4-ba53-fe385238f385-config-out\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.833003 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.832877    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e89fdc0b-edc0-4ca4-ba53-fe385238f385-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.833003 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.832906    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-config\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.833003 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.832987    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.833146 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.833020    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.833146 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.833053    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e89fdc0b-edc0-4ca4-ba53-fe385238f385-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.833146 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.833087    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bs9r7\" (UniqueName: \"kubernetes.io/projected/e89fdc0b-edc0-4ca4-ba53-fe385238f385-kube-api-access-bs9r7\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.833146 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.833111    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.833146 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.833126    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.833371 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.833152    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.833371 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.833202    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.833371 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.833223    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e89fdc0b-edc0-4ca4-ba53-fe385238f385-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.833371 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.833277    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-web-config\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.934485 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.934460    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.934606 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.934489    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e89fdc0b-edc0-4ca4-ba53-fe385238f385-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.934606 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.934510    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bs9r7\" (UniqueName: \"kubernetes.io/projected/e89fdc0b-edc0-4ca4-ba53-fe385238f385-kube-api-access-bs9r7\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.934606 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.934534    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.934606 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.934558    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.934606 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.934591    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.934824 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.934622    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.934824 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.934645    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e89fdc0b-edc0-4ca4-ba53-fe385238f385-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.934824 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.934669    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-web-config\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.934824 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.934701    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e89fdc0b-edc0-4ca4-ba53-fe385238f385-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.934824 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.934728    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.934824 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.934759    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e89fdc0b-edc0-4ca4-ba53-fe385238f385-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.935504 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.935148    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e89fdc0b-edc0-4ca4-ba53-fe385238f385-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.935504 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.935400    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e89fdc0b-edc0-4ca4-ba53-fe385238f385-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.935674 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.935525    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e89fdc0b-edc0-4ca4-ba53-fe385238f385-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.937852 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.937675    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.937852 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.937732    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e89fdc0b-edc0-4ca4-ba53-fe385238f385-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.937852 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.937739    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.937852 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.937773    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e89fdc0b-edc0-4ca4-ba53-fe385238f385-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.937852 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.937805    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e89fdc0b-edc0-4ca4-ba53-fe385238f385-config-out\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.937852 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.937835    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e89fdc0b-edc0-4ca4-ba53-fe385238f385-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.938180 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.937867    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-config\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.938180 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.937871    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-web-config\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.938180 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.937922    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.938180 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.937961    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.938180 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.938064    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.938450 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.938400    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e89fdc0b-edc0-4ca4-ba53-fe385238f385-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.938450 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.938438    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.938751 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.938724    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e89fdc0b-edc0-4ca4-ba53-fe385238f385-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.938856 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.938764    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.939048 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.939025    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e89fdc0b-edc0-4ca4-ba53-fe385238f385-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.940219 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.940193    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e89fdc0b-edc0-4ca4-ba53-fe385238f385-config-out\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.940219 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.940212    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-config\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.941268 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.941247    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e89fdc0b-edc0-4ca4-ba53-fe385238f385-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.941669 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.941650    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e89fdc0b-edc0-4ca4-ba53-fe385238f385-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:48.944810 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:48.944794    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bs9r7\" (UniqueName: \"kubernetes.io/projected/e89fdc0b-edc0-4ca4-ba53-fe385238f385-kube-api-access-bs9r7\") pod \"prometheus-k8s-0\" (UID: \"e89fdc0b-edc0-4ca4-ba53-fe385238f385\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:49.026978 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:49.026949    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:24:49.169601 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:49.169485    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 18:24:49.171773 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:24:49.171745    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode89fdc0b_edc0_4ca4_ba53_fe385238f385.slice/crio-308d003be0ee994250569eb76ff88b8c50b1a715175984ee74fdcff3356177da WatchSource:0}: Error finding container 308d003be0ee994250569eb76ff88b8c50b1a715175984ee74fdcff3356177da: Status 404 returned error can't find the container with id 308d003be0ee994250569eb76ff88b8c50b1a715175984ee74fdcff3356177da
May 21 18:24:49.648403 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:49.648370    2573 generic.go:358] "Generic (PLEG): container finished" podID="e89fdc0b-edc0-4ca4-ba53-fe385238f385" containerID="72422f51e771b6e8f8e0605931c3af0084311ad959815a642c7a166da9ed2286" exitCode=0
May 21 18:24:49.648832 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:49.648457    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e89fdc0b-edc0-4ca4-ba53-fe385238f385","Type":"ContainerDied","Data":"72422f51e771b6e8f8e0605931c3af0084311ad959815a642c7a166da9ed2286"}
May 21 18:24:49.648832 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:49.648494    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e89fdc0b-edc0-4ca4-ba53-fe385238f385","Type":"ContainerStarted","Data":"308d003be0ee994250569eb76ff88b8c50b1a715175984ee74fdcff3356177da"}
May 21 18:24:49.691273 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:49.691245    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c981abd9-e1a9-4e97-8b93-901e297d38a8" path="/var/lib/kubelet/pods/c981abd9-e1a9-4e97-8b93-901e297d38a8/volumes"
May 21 18:24:50.655861 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:50.655825    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e89fdc0b-edc0-4ca4-ba53-fe385238f385","Type":"ContainerStarted","Data":"e6cb5a560f438c7477f9746aca77194340d282a1b0a37c2866f6b2bd087a092d"}
May 21 18:24:50.655861 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:50.655865    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e89fdc0b-edc0-4ca4-ba53-fe385238f385","Type":"ContainerStarted","Data":"88c9bac8df7eac56fcbe239920916a0a4e1ce8a1821078fc06bbe91c6955d39c"}
May 21 18:24:50.656247 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:50.655876    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e89fdc0b-edc0-4ca4-ba53-fe385238f385","Type":"ContainerStarted","Data":"e7b6bb520b19816051ad81ede8c299507af8b346558ef2e0d1a76a6be81609f6"}
May 21 18:24:50.656247 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:50.655884    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e89fdc0b-edc0-4ca4-ba53-fe385238f385","Type":"ContainerStarted","Data":"52ed27d36066420b7cc4afe9fca1d58c5a4d315668cfc6c4445a8e72862dc57c"}
May 21 18:24:50.656247 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:50.655892    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e89fdc0b-edc0-4ca4-ba53-fe385238f385","Type":"ContainerStarted","Data":"2f516a578b6de6e71c2f9d57197152db6803d0906e05694f95d938d1587a29df"}
May 21 18:24:50.656247 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:50.655901    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e89fdc0b-edc0-4ca4-ba53-fe385238f385","Type":"ContainerStarted","Data":"9db89f70c91f5140a6fd92a2dd10272121c29b81708ee05e3a475cb2ed66594f"}
May 21 18:24:50.739258 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:50.739210    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.739195643 podStartE2EDuration="2.739195643s" podCreationTimestamp="2026-05-21 18:24:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:24:50.738354452 +0000 UTC m=+267.663842978" watchObservedRunningTime="2026-05-21 18:24:50.739195643 +0000 UTC m=+267.664684170"
May 21 18:24:54.027088 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:24:54.027052    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:25:23.596518 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:23.596490    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qv8k_9e2ab0cd-745a-4109-ab04-75eaaf550474/ovn-acl-logging/0.log"
May 21 18:25:23.599838 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:23.599821    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qv8k_9e2ab0cd-745a-4109-ab04-75eaaf550474/ovn-acl-logging/0.log"
May 21 18:25:23.603220 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:23.603202    2573 kubelet.go:1628] "Image garbage collection succeeded"
May 21 18:25:38.945837 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:38.945805    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-9b7hr"]
May 21 18:25:38.949095 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:38.949079    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b7hr"
May 21 18:25:38.956284 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:38.956268    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 18:25:38.964044 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:38.964023    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9b7hr"]
May 21 18:25:39.058833 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:39.058792    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f6446cf-9c00-40be-abdf-cd5a694002c9-kubelet-config\") pod \"global-pull-secret-syncer-9b7hr\" (UID: \"3f6446cf-9c00-40be-abdf-cd5a694002c9\") " pod="kube-system/global-pull-secret-syncer-9b7hr"
May 21 18:25:39.059012 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:39.058894    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f6446cf-9c00-40be-abdf-cd5a694002c9-dbus\") pod \"global-pull-secret-syncer-9b7hr\" (UID: \"3f6446cf-9c00-40be-abdf-cd5a694002c9\") " pod="kube-system/global-pull-secret-syncer-9b7hr"
May 21 18:25:39.059012 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:39.058989    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f6446cf-9c00-40be-abdf-cd5a694002c9-original-pull-secret\") pod \"global-pull-secret-syncer-9b7hr\" (UID: \"3f6446cf-9c00-40be-abdf-cd5a694002c9\") " pod="kube-system/global-pull-secret-syncer-9b7hr"
May 21 18:25:39.159835 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:39.159799    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f6446cf-9c00-40be-abdf-cd5a694002c9-original-pull-secret\") pod \"global-pull-secret-syncer-9b7hr\" (UID: \"3f6446cf-9c00-40be-abdf-cd5a694002c9\") " pod="kube-system/global-pull-secret-syncer-9b7hr"
May 21 18:25:39.159986 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:39.159848    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f6446cf-9c00-40be-abdf-cd5a694002c9-kubelet-config\") pod \"global-pull-secret-syncer-9b7hr\" (UID: \"3f6446cf-9c00-40be-abdf-cd5a694002c9\") " pod="kube-system/global-pull-secret-syncer-9b7hr"
May 21 18:25:39.159986 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:39.159892    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f6446cf-9c00-40be-abdf-cd5a694002c9-dbus\") pod \"global-pull-secret-syncer-9b7hr\" (UID: \"3f6446cf-9c00-40be-abdf-cd5a694002c9\") " pod="kube-system/global-pull-secret-syncer-9b7hr"
May 21 18:25:39.160058 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:39.160000    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/3f6446cf-9c00-40be-abdf-cd5a694002c9-kubelet-config\") pod \"global-pull-secret-syncer-9b7hr\" (UID: \"3f6446cf-9c00-40be-abdf-cd5a694002c9\") " pod="kube-system/global-pull-secret-syncer-9b7hr"
May 21 18:25:39.160058 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:39.160052    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/3f6446cf-9c00-40be-abdf-cd5a694002c9-dbus\") pod \"global-pull-secret-syncer-9b7hr\" (UID: \"3f6446cf-9c00-40be-abdf-cd5a694002c9\") " pod="kube-system/global-pull-secret-syncer-9b7hr"
May 21 18:25:39.162064 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:39.162029    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/3f6446cf-9c00-40be-abdf-cd5a694002c9-original-pull-secret\") pod \"global-pull-secret-syncer-9b7hr\" (UID: \"3f6446cf-9c00-40be-abdf-cd5a694002c9\") " pod="kube-system/global-pull-secret-syncer-9b7hr"
May 21 18:25:39.258327 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:39.258287    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9b7hr"
May 21 18:25:39.383117 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:39.382962    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9b7hr"]
May 21 18:25:39.386189 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:25:39.386159    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f6446cf_9c00_40be_abdf_cd5a694002c9.slice/crio-cd92c97fd5945d3320c95b6e8459b476e0257a9679d07bad4f252375820c3f0d WatchSource:0}: Error finding container cd92c97fd5945d3320c95b6e8459b476e0257a9679d07bad4f252375820c3f0d: Status 404 returned error can't find the container with id cd92c97fd5945d3320c95b6e8459b476e0257a9679d07bad4f252375820c3f0d
May 21 18:25:39.387978 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:39.387958    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 18:25:39.803103 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:39.803059    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9b7hr" event={"ID":"3f6446cf-9c00-40be-abdf-cd5a694002c9","Type":"ContainerStarted","Data":"cd92c97fd5945d3320c95b6e8459b476e0257a9679d07bad4f252375820c3f0d"}
May 21 18:25:44.820032 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:44.819991    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9b7hr" event={"ID":"3f6446cf-9c00-40be-abdf-cd5a694002c9","Type":"ContainerStarted","Data":"effbee18012cf7925c1efeb6f1ff5e70ac683f65a7131dc21402ad299b8aa77c"}
May 21 18:25:44.852623 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:44.852575    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9b7hr" podStartSLOduration=2.275579032 podStartE2EDuration="6.852560462s" podCreationTimestamp="2026-05-21 18:25:38 +0000 UTC" firstStartedPulling="2026-05-21 18:25:39.38811154 +0000 UTC m=+316.313600045" lastFinishedPulling="2026-05-21 18:25:43.96509297 +0000 UTC m=+320.890581475" observedRunningTime="2026-05-21 18:25:44.852190337 +0000 UTC m=+321.777678864" watchObservedRunningTime="2026-05-21 18:25:44.852560462 +0000 UTC m=+321.778049050"
May 21 18:25:49.027386 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:49.027354    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:25:49.048138 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:49.043821    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:25:49.851682 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:25:49.851658    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 18:27:20.123139 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:20.123105    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67595b8579-5tvbn"]
May 21 18:27:20.126746 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:20.126727    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-5tvbn"
May 21 18:27:20.129437 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:20.129418    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 21 18:27:20.129532 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:20.129425    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 21 18:27:20.130085 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:20.130069    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 21 18:27:20.130359 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:20.130338    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gnvp9\""
May 21 18:27:20.130464 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:20.130428    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 21 18:27:20.143114 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:20.143086    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67595b8579-5tvbn"]
May 21 18:27:20.198665 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:20.198634    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/09ec2eb4-290d-456a-9f53-21428a9a2705-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67595b8579-5tvbn\" (UID: \"09ec2eb4-290d-456a-9f53-21428a9a2705\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-5tvbn"
May 21 18:27:20.198779 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:20.198683    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdpth\" (UniqueName: \"kubernetes.io/projected/09ec2eb4-290d-456a-9f53-21428a9a2705-kube-api-access-cdpth\") pod \"opendatahub-operator-controller-manager-67595b8579-5tvbn\" (UID: \"09ec2eb4-290d-456a-9f53-21428a9a2705\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-5tvbn"
May 21 18:27:20.198779 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:20.198754    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09ec2eb4-290d-456a-9f53-21428a9a2705-webhook-cert\") pod \"opendatahub-operator-controller-manager-67595b8579-5tvbn\" (UID: \"09ec2eb4-290d-456a-9f53-21428a9a2705\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-5tvbn"
May 21 18:27:20.299615 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:20.299575    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cdpth\" (UniqueName: \"kubernetes.io/projected/09ec2eb4-290d-456a-9f53-21428a9a2705-kube-api-access-cdpth\") pod \"opendatahub-operator-controller-manager-67595b8579-5tvbn\" (UID: \"09ec2eb4-290d-456a-9f53-21428a9a2705\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-5tvbn"
May 21 18:27:20.299739 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:20.299628    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09ec2eb4-290d-456a-9f53-21428a9a2705-webhook-cert\") pod \"opendatahub-operator-controller-manager-67595b8579-5tvbn\" (UID: \"09ec2eb4-290d-456a-9f53-21428a9a2705\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-5tvbn"
May 21 18:27:20.299739 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:20.299673    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/09ec2eb4-290d-456a-9f53-21428a9a2705-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67595b8579-5tvbn\" (UID: \"09ec2eb4-290d-456a-9f53-21428a9a2705\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-5tvbn"
May 21 18:27:20.302018 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:20.301992    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09ec2eb4-290d-456a-9f53-21428a9a2705-webhook-cert\") pod \"opendatahub-operator-controller-manager-67595b8579-5tvbn\" (UID: \"09ec2eb4-290d-456a-9f53-21428a9a2705\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-5tvbn"
May 21 18:27:20.302110 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:20.302027    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/09ec2eb4-290d-456a-9f53-21428a9a2705-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67595b8579-5tvbn\" (UID: \"09ec2eb4-290d-456a-9f53-21428a9a2705\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-5tvbn"
May 21 18:27:20.321574 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:20.321549    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdpth\" (UniqueName: \"kubernetes.io/projected/09ec2eb4-290d-456a-9f53-21428a9a2705-kube-api-access-cdpth\") pod \"opendatahub-operator-controller-manager-67595b8579-5tvbn\" (UID: \"09ec2eb4-290d-456a-9f53-21428a9a2705\") " pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-5tvbn"
May 21 18:27:20.437146 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:20.437080    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-5tvbn"
May 21 18:27:20.589430 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:20.589362    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67595b8579-5tvbn"]
May 21 18:27:20.591724 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:27:20.591698    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09ec2eb4_290d_456a_9f53_21428a9a2705.slice/crio-5931e469c4de0fdaa9f287577669d52c55975b6b9cd241b70283cefda36456ec WatchSource:0}: Error finding container 5931e469c4de0fdaa9f287577669d52c55975b6b9cd241b70283cefda36456ec: Status 404 returned error can't find the container with id 5931e469c4de0fdaa9f287577669d52c55975b6b9cd241b70283cefda36456ec
May 21 18:27:21.129861 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:21.129821    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-5tvbn" event={"ID":"09ec2eb4-290d-456a-9f53-21428a9a2705","Type":"ContainerStarted","Data":"5931e469c4de0fdaa9f287577669d52c55975b6b9cd241b70283cefda36456ec"}
May 21 18:27:24.140639 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:24.140600    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-5tvbn" event={"ID":"09ec2eb4-290d-456a-9f53-21428a9a2705","Type":"ContainerStarted","Data":"f6dde2be3e270c5e506cc5a68ced2fd087c545bb3c2368aee07f02fdaa8f4d90"}
May 21 18:27:24.141004 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:24.140720    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-5tvbn"
May 21 18:27:24.163156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:24.163110    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-5tvbn" podStartSLOduration=1.589462945 podStartE2EDuration="4.16309792s" podCreationTimestamp="2026-05-21 18:27:20 +0000 UTC" firstStartedPulling="2026-05-21 18:27:20.593297429 +0000 UTC m=+417.518785935" lastFinishedPulling="2026-05-21 18:27:23.166932392 +0000 UTC m=+420.092420910" observedRunningTime="2026-05-21 18:27:24.161730404 +0000 UTC m=+421.087218932" watchObservedRunningTime="2026-05-21 18:27:24.16309792 +0000 UTC m=+421.088586447"
May 21 18:27:26.968556 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:26.968522    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2"]
May 21 18:27:26.972035 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:26.972020    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2"
May 21 18:27:26.976557 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:26.976534    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 21 18:27:26.976690 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:26.976535    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 21 18:27:26.976895 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:26.976881    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 21 18:27:26.977137 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:26.977116    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 21 18:27:26.977243 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:26.977124    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 21 18:27:26.977243 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:26.977125    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mnvks\""
May 21 18:27:26.982288 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:26.982265    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2"]
May 21 18:27:27.058089 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:27.058060    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jljw9\" (UniqueName: \"kubernetes.io/projected/aebe5a81-f29c-4bbc-a1aa-021174efa20e-kube-api-access-jljw9\") pod \"lws-controller-manager-59996fdc5c-5bbc2\" (UID: \"aebe5a81-f29c-4bbc-a1aa-021174efa20e\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2"
May 21 18:27:27.058198 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:27.058100    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aebe5a81-f29c-4bbc-a1aa-021174efa20e-metrics-cert\") pod \"lws-controller-manager-59996fdc5c-5bbc2\" (UID: \"aebe5a81-f29c-4bbc-a1aa-021174efa20e\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2"
May 21 18:27:27.058249 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:27.058213    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aebe5a81-f29c-4bbc-a1aa-021174efa20e-manager-config\") pod \"lws-controller-manager-59996fdc5c-5bbc2\" (UID: \"aebe5a81-f29c-4bbc-a1aa-021174efa20e\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2"
May 21 18:27:27.058289 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:27.058278    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aebe5a81-f29c-4bbc-a1aa-021174efa20e-cert\") pod \"lws-controller-manager-59996fdc5c-5bbc2\" (UID: \"aebe5a81-f29c-4bbc-a1aa-021174efa20e\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2"
May 21 18:27:27.158901 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:27.158871    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aebe5a81-f29c-4bbc-a1aa-021174efa20e-cert\") pod \"lws-controller-manager-59996fdc5c-5bbc2\" (UID: \"aebe5a81-f29c-4bbc-a1aa-021174efa20e\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2"
May 21 18:27:27.159040 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:27.158906    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jljw9\" (UniqueName: \"kubernetes.io/projected/aebe5a81-f29c-4bbc-a1aa-021174efa20e-kube-api-access-jljw9\") pod \"lws-controller-manager-59996fdc5c-5bbc2\" (UID: \"aebe5a81-f29c-4bbc-a1aa-021174efa20e\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2"
May 21 18:27:27.159040 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:27.158926    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aebe5a81-f29c-4bbc-a1aa-021174efa20e-metrics-cert\") pod \"lws-controller-manager-59996fdc5c-5bbc2\" (UID: \"aebe5a81-f29c-4bbc-a1aa-021174efa20e\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2"
May 21 18:27:27.159040 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:27.158980    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aebe5a81-f29c-4bbc-a1aa-021174efa20e-manager-config\") pod \"lws-controller-manager-59996fdc5c-5bbc2\" (UID: \"aebe5a81-f29c-4bbc-a1aa-021174efa20e\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2"
May 21 18:27:27.159624 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:27.159602    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aebe5a81-f29c-4bbc-a1aa-021174efa20e-manager-config\") pod \"lws-controller-manager-59996fdc5c-5bbc2\" (UID: \"aebe5a81-f29c-4bbc-a1aa-021174efa20e\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2"
May 21 18:27:27.161394 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:27.161373    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aebe5a81-f29c-4bbc-a1aa-021174efa20e-cert\") pod \"lws-controller-manager-59996fdc5c-5bbc2\" (UID: \"aebe5a81-f29c-4bbc-a1aa-021174efa20e\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2"
May 21 18:27:27.161496 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:27.161443    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aebe5a81-f29c-4bbc-a1aa-021174efa20e-metrics-cert\") pod \"lws-controller-manager-59996fdc5c-5bbc2\" (UID: \"aebe5a81-f29c-4bbc-a1aa-021174efa20e\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2"
May 21 18:27:27.173224 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:27.173201    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jljw9\" (UniqueName: \"kubernetes.io/projected/aebe5a81-f29c-4bbc-a1aa-021174efa20e-kube-api-access-jljw9\") pod \"lws-controller-manager-59996fdc5c-5bbc2\" (UID: \"aebe5a81-f29c-4bbc-a1aa-021174efa20e\") " pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2"
May 21 18:27:27.281891 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:27.281864    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2"
May 21 18:27:27.413901 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:27.413807    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2"]
May 21 18:27:27.416551 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:27:27.416521    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaebe5a81_f29c_4bbc_a1aa_021174efa20e.slice/crio-939cd3f0ba91ae9692ee7434448dcae776399007c7e717e9839db5a846738492 WatchSource:0}: Error finding container 939cd3f0ba91ae9692ee7434448dcae776399007c7e717e9839db5a846738492: Status 404 returned error can't find the container with id 939cd3f0ba91ae9692ee7434448dcae776399007c7e717e9839db5a846738492
May 21 18:27:28.154059 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:28.154023    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2" event={"ID":"aebe5a81-f29c-4bbc-a1aa-021174efa20e","Type":"ContainerStarted","Data":"939cd3f0ba91ae9692ee7434448dcae776399007c7e717e9839db5a846738492"}
May 21 18:27:30.161870 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:30.161830    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2" event={"ID":"aebe5a81-f29c-4bbc-a1aa-021174efa20e","Type":"ContainerStarted","Data":"79f0fd8e813d72e091c746f63d268a60246074ec6727c3882e530c5514065597"}
May 21 18:27:30.162226 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:30.161985    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2"
May 21 18:27:30.181481 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:30.181434    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2" podStartSLOduration=1.591000733 podStartE2EDuration="4.181421944s" podCreationTimestamp="2026-05-21 18:27:26 +0000 UTC" firstStartedPulling="2026-05-21 18:27:27.418401664 +0000 UTC m=+424.343890168" lastFinishedPulling="2026-05-21 18:27:30.008822869 +0000 UTC m=+426.934311379" observedRunningTime="2026-05-21 18:27:30.180206103 +0000 UTC m=+427.105694631" watchObservedRunningTime="2026-05-21 18:27:30.181421944 +0000 UTC m=+427.106910470"
May 21 18:27:35.146298 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:35.146268    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67595b8579-5tvbn"
May 21 18:27:38.755546 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:38.755514    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-d887b4ccb-gvtff"]
May 21 18:27:38.759046 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:38.759029    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d887b4ccb-gvtff"
May 21 18:27:38.764368 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:38.764348    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 21 18:27:38.764495 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:38.764349    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 21 18:27:38.764495 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:38.764380    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dxjvn\""
May 21 18:27:38.773023 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:38.772999    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d887b4ccb-gvtff"]
May 21 18:27:38.864006 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:38.863977    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2243b965-600d-40db-b222-1b3bf07e4dce-tls-certs\") pod \"kube-auth-proxy-d887b4ccb-gvtff\" (UID: \"2243b965-600d-40db-b222-1b3bf07e4dce\") " pod="openshift-ingress/kube-auth-proxy-d887b4ccb-gvtff"
May 21 18:27:38.864159 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:38.864021    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2243b965-600d-40db-b222-1b3bf07e4dce-tmp\") pod \"kube-auth-proxy-d887b4ccb-gvtff\" (UID: \"2243b965-600d-40db-b222-1b3bf07e4dce\") " pod="openshift-ingress/kube-auth-proxy-d887b4ccb-gvtff"
May 21 18:27:38.864159 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:38.864106    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th5ns\" (UniqueName: \"kubernetes.io/projected/2243b965-600d-40db-b222-1b3bf07e4dce-kube-api-access-th5ns\") pod \"kube-auth-proxy-d887b4ccb-gvtff\" (UID: \"2243b965-600d-40db-b222-1b3bf07e4dce\") " pod="openshift-ingress/kube-auth-proxy-d887b4ccb-gvtff"
May 21 18:27:38.965079 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:38.965047    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2243b965-600d-40db-b222-1b3bf07e4dce-tmp\") pod \"kube-auth-proxy-d887b4ccb-gvtff\" (UID: \"2243b965-600d-40db-b222-1b3bf07e4dce\") " pod="openshift-ingress/kube-auth-proxy-d887b4ccb-gvtff"
May 21 18:27:38.965186 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:38.965108    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-th5ns\" (UniqueName: \"kubernetes.io/projected/2243b965-600d-40db-b222-1b3bf07e4dce-kube-api-access-th5ns\") pod \"kube-auth-proxy-d887b4ccb-gvtff\" (UID: \"2243b965-600d-40db-b222-1b3bf07e4dce\") " pod="openshift-ingress/kube-auth-proxy-d887b4ccb-gvtff"
May 21 18:27:38.965186 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:38.965144    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2243b965-600d-40db-b222-1b3bf07e4dce-tls-certs\") pod \"kube-auth-proxy-d887b4ccb-gvtff\" (UID: \"2243b965-600d-40db-b222-1b3bf07e4dce\") " pod="openshift-ingress/kube-auth-proxy-d887b4ccb-gvtff"
May 21 18:27:38.967374 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:38.967345    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2243b965-600d-40db-b222-1b3bf07e4dce-tmp\") pod \"kube-auth-proxy-d887b4ccb-gvtff\" (UID: \"2243b965-600d-40db-b222-1b3bf07e4dce\") " pod="openshift-ingress/kube-auth-proxy-d887b4ccb-gvtff"
May 21 18:27:38.967533 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:38.967518    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2243b965-600d-40db-b222-1b3bf07e4dce-tls-certs\") pod \"kube-auth-proxy-d887b4ccb-gvtff\" (UID: \"2243b965-600d-40db-b222-1b3bf07e4dce\") " pod="openshift-ingress/kube-auth-proxy-d887b4ccb-gvtff"
May 21 18:27:38.985848 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:38.985825    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th5ns\" (UniqueName: \"kubernetes.io/projected/2243b965-600d-40db-b222-1b3bf07e4dce-kube-api-access-th5ns\") pod \"kube-auth-proxy-d887b4ccb-gvtff\" (UID: \"2243b965-600d-40db-b222-1b3bf07e4dce\") " pod="openshift-ingress/kube-auth-proxy-d887b4ccb-gvtff"
May 21 18:27:39.069314 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:39.069221    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d887b4ccb-gvtff"
May 21 18:27:39.199788 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:39.199650    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d887b4ccb-gvtff"]
May 21 18:27:39.202689 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:27:39.202657    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2243b965_600d_40db_b222_1b3bf07e4dce.slice/crio-92c1a0e092cdb5eabf6ad15ba8854cb37d47d653736419149e1aa959f445c53a WatchSource:0}: Error finding container 92c1a0e092cdb5eabf6ad15ba8854cb37d47d653736419149e1aa959f445c53a: Status 404 returned error can't find the container with id 92c1a0e092cdb5eabf6ad15ba8854cb37d47d653736419149e1aa959f445c53a
May 21 18:27:40.197739 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:40.197685    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d887b4ccb-gvtff" event={"ID":"2243b965-600d-40db-b222-1b3bf07e4dce","Type":"ContainerStarted","Data":"92c1a0e092cdb5eabf6ad15ba8854cb37d47d653736419149e1aa959f445c53a"}
May 21 18:27:41.168151 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:41.168114    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-59996fdc5c-5bbc2"
May 21 18:27:43.211156 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:43.211066    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d887b4ccb-gvtff" event={"ID":"2243b965-600d-40db-b222-1b3bf07e4dce","Type":"ContainerStarted","Data":"98cc154d28c240bdb774eca38ce4a6b497ae4ea9db65f29419bf616a848795a1"}
May 21 18:27:43.230471 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:27:43.230416    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-d887b4ccb-gvtff" podStartSLOduration=2.135183505 podStartE2EDuration="5.230402444s" podCreationTimestamp="2026-05-21 18:27:38 +0000 UTC" firstStartedPulling="2026-05-21 18:27:39.204616207 +0000 UTC m=+436.130104720" lastFinishedPulling="2026-05-21 18:27:42.299835145 +0000 UTC m=+439.225323659" observedRunningTime="2026-05-21 18:27:43.228963081 +0000 UTC m=+440.154451609" watchObservedRunningTime="2026-05-21 18:27:43.230402444 +0000 UTC m=+440.155890971"
May 21 18:29:16.413612 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:16.413534    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-hk9vw"]
May 21 18:29:16.416980 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:16.416960    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hk9vw"
May 21 18:29:16.420164 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:16.420137    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 18:29:16.420282 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:16.420186    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 21 18:29:16.420282 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:16.420270    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 18:29:16.421524 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:16.421501    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-mk8cs\""
May 21 18:29:16.433977 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:16.433955    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-hk9vw"]
May 21 18:29:16.550048 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:16.550015    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd2l7\" (UniqueName: \"kubernetes.io/projected/adc9ead4-105d-4d3a-a040-be9705fa8989-kube-api-access-pd2l7\") pod \"dns-operator-controller-manager-648d5c98bc-hk9vw\" (UID: \"adc9ead4-105d-4d3a-a040-be9705fa8989\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hk9vw"
May 21 18:29:16.650790 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:16.650757    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pd2l7\" (UniqueName: \"kubernetes.io/projected/adc9ead4-105d-4d3a-a040-be9705fa8989-kube-api-access-pd2l7\") pod \"dns-operator-controller-manager-648d5c98bc-hk9vw\" (UID: \"adc9ead4-105d-4d3a-a040-be9705fa8989\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hk9vw"
May 21 18:29:16.678526 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:16.678458    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd2l7\" (UniqueName: \"kubernetes.io/projected/adc9ead4-105d-4d3a-a040-be9705fa8989-kube-api-access-pd2l7\") pod \"dns-operator-controller-manager-648d5c98bc-hk9vw\" (UID: \"adc9ead4-105d-4d3a-a040-be9705fa8989\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hk9vw"
May 21 18:29:16.727663 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:16.727624    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hk9vw"
May 21 18:29:16.862957 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:16.862925    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-hk9vw"]
May 21 18:29:16.869587 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:29:16.867391    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc9ead4_105d_4d3a_a040_be9705fa8989.slice/crio-3f62162dbd9a4b2bf15c638503810130a5482576944e54762d31eff016c76ce4 WatchSource:0}: Error finding container 3f62162dbd9a4b2bf15c638503810130a5482576944e54762d31eff016c76ce4: Status 404 returned error can't find the container with id 3f62162dbd9a4b2bf15c638503810130a5482576944e54762d31eff016c76ce4
May 21 18:29:17.532710 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:17.532665    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hk9vw" event={"ID":"adc9ead4-105d-4d3a-a040-be9705fa8989","Type":"ContainerStarted","Data":"3f62162dbd9a4b2bf15c638503810130a5482576944e54762d31eff016c76ce4"}
May 21 18:29:19.540991 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:19.540948    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hk9vw" event={"ID":"adc9ead4-105d-4d3a-a040-be9705fa8989","Type":"ContainerStarted","Data":"ea440283ebee0aca55c994bc8ea38444f82b921d99f8c62482be100013765126"}
May 21 18:29:19.541384 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:19.541071    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hk9vw"
May 21 18:29:19.574784 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:19.574735    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hk9vw" podStartSLOduration=1.312676054 podStartE2EDuration="3.57472042s" podCreationTimestamp="2026-05-21 18:29:16 +0000 UTC" firstStartedPulling="2026-05-21 18:29:16.870947125 +0000 UTC m=+533.796435643" lastFinishedPulling="2026-05-21 18:29:19.132991505 +0000 UTC m=+536.058480009" observedRunningTime="2026-05-21 18:29:19.573246316 +0000 UTC m=+536.498734855" watchObservedRunningTime="2026-05-21 18:29:19.57472042 +0000 UTC m=+536.500208946"
May 21 18:29:21.247089 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:21.247056    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-96x2p"]
May 21 18:29:21.250515 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:21.250498    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-96x2p"
May 21 18:29:21.253877 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:21.253856    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
May 21 18:29:21.253999 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:21.253899    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
May 21 18:29:21.253999 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:21.253946    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8pcmr\""
May 21 18:29:21.261475 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:21.261451    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-96x2p"]
May 21 18:29:21.397738 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:21.397703    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/09517476-9dac-4a6c-9e10-666bf2f0b12a-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-96x2p\" (UID: \"09517476-9dac-4a6c-9e10-666bf2f0b12a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-96x2p"
May 21 18:29:21.397886 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:21.397759    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrcgn\" (UniqueName: \"kubernetes.io/projected/09517476-9dac-4a6c-9e10-666bf2f0b12a-kube-api-access-lrcgn\") pod \"kuadrant-console-plugin-6cb54b5c86-96x2p\" (UID: \"09517476-9dac-4a6c-9e10-666bf2f0b12a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-96x2p"
May 21 18:29:21.397886 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:21.397815    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/09517476-9dac-4a6c-9e10-666bf2f0b12a-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-96x2p\" (UID: \"09517476-9dac-4a6c-9e10-666bf2f0b12a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-96x2p"
May 21 18:29:21.499193 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:21.499107    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/09517476-9dac-4a6c-9e10-666bf2f0b12a-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-96x2p\" (UID: \"09517476-9dac-4a6c-9e10-666bf2f0b12a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-96x2p"
May 21 18:29:21.499193 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:21.499158    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/09517476-9dac-4a6c-9e10-666bf2f0b12a-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-96x2p\" (UID: \"09517476-9dac-4a6c-9e10-666bf2f0b12a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-96x2p"
May 21 18:29:21.499420 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:21.499198    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lrcgn\" (UniqueName: \"kubernetes.io/projected/09517476-9dac-4a6c-9e10-666bf2f0b12a-kube-api-access-lrcgn\") pod \"kuadrant-console-plugin-6cb54b5c86-96x2p\" (UID: \"09517476-9dac-4a6c-9e10-666bf2f0b12a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-96x2p"
May 21 18:29:21.499876 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:21.499846    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/09517476-9dac-4a6c-9e10-666bf2f0b12a-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-96x2p\" (UID: \"09517476-9dac-4a6c-9e10-666bf2f0b12a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-96x2p"
May 21 18:29:21.501575 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:21.501552    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/09517476-9dac-4a6c-9e10-666bf2f0b12a-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-96x2p\" (UID: \"09517476-9dac-4a6c-9e10-666bf2f0b12a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-96x2p"
May 21 18:29:21.510430 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:21.510411    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrcgn\" (UniqueName: \"kubernetes.io/projected/09517476-9dac-4a6c-9e10-666bf2f0b12a-kube-api-access-lrcgn\") pod \"kuadrant-console-plugin-6cb54b5c86-96x2p\" (UID: \"09517476-9dac-4a6c-9e10-666bf2f0b12a\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-96x2p"
May 21 18:29:21.572084 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:21.572050    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-96x2p"
May 21 18:29:21.710131 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:21.710104    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-96x2p"]
May 21 18:29:21.712352 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:29:21.712321    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09517476_9dac_4a6c_9e10_666bf2f0b12a.slice/crio-916663886cb0c80710ee5535a6e6d74e88dd57e8a0cb095e511c0e28c3bb3ec4 WatchSource:0}: Error finding container 916663886cb0c80710ee5535a6e6d74e88dd57e8a0cb095e511c0e28c3bb3ec4: Status 404 returned error can't find the container with id 916663886cb0c80710ee5535a6e6d74e88dd57e8a0cb095e511c0e28c3bb3ec4
May 21 18:29:22.553178 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:22.553140    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-96x2p" event={"ID":"09517476-9dac-4a6c-9e10-666bf2f0b12a","Type":"ContainerStarted","Data":"916663886cb0c80710ee5535a6e6d74e88dd57e8a0cb095e511c0e28c3bb3ec4"}
May 21 18:29:30.546888 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:30.546853    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-hk9vw"
May 21 18:29:46.646604 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:46.646563    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-96x2p" event={"ID":"09517476-9dac-4a6c-9e10-666bf2f0b12a","Type":"ContainerStarted","Data":"3f994902c7ac526b323f7be4e38b86f546c84e0da0b47a98d044cd3c4a95d0f1"}
May 21 18:29:46.668434 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:29:46.668385    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-96x2p" podStartSLOduration=1.715149231 podStartE2EDuration="25.668370423s" podCreationTimestamp="2026-05-21 18:29:21 +0000 UTC" firstStartedPulling="2026-05-21 18:29:21.713662579 +0000 UTC m=+538.639151083" lastFinishedPulling="2026-05-21 18:29:45.666883756 +0000 UTC m=+562.592372275" observedRunningTime="2026-05-21 18:29:46.665633785 +0000 UTC m=+563.591122312" watchObservedRunningTime="2026-05-21 18:29:46.668370423 +0000 UTC m=+563.593858949"
May 21 18:30:08.484422 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:30:08.484362    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:30:08.544585 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:30:08.544543    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:30:08.544585 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:30:08.544577    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:30:08.544795 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:30:08.544708    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-9gtkr"
May 21 18:30:08.547468 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:30:08.547445    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 21 18:30:08.628123 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:30:08.628079    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6929157a-2964-4bd1-83b7-e87caf0b0a71-config-file\") pod \"limitador-limitador-78c99df468-9gtkr\" (UID: \"6929157a-2964-4bd1-83b7-e87caf0b0a71\") " pod="kuadrant-system/limitador-limitador-78c99df468-9gtkr"
May 21 18:30:08.628123 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:30:08.628123    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dfkrc\" (UniqueName: \"kubernetes.io/projected/6929157a-2964-4bd1-83b7-e87caf0b0a71-kube-api-access-dfkrc\") pod \"limitador-limitador-78c99df468-9gtkr\" (UID: \"6929157a-2964-4bd1-83b7-e87caf0b0a71\") " pod="kuadrant-system/limitador-limitador-78c99df468-9gtkr"
May 21 18:30:08.729210 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:30:08.729174    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6929157a-2964-4bd1-83b7-e87caf0b0a71-config-file\") pod \"limitador-limitador-78c99df468-9gtkr\" (UID: \"6929157a-2964-4bd1-83b7-e87caf0b0a71\") " pod="kuadrant-system/limitador-limitador-78c99df468-9gtkr"
May 21 18:30:08.729210 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:30:08.729211    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dfkrc\" (UniqueName: \"kubernetes.io/projected/6929157a-2964-4bd1-83b7-e87caf0b0a71-kube-api-access-dfkrc\") pod \"limitador-limitador-78c99df468-9gtkr\" (UID: \"6929157a-2964-4bd1-83b7-e87caf0b0a71\") " pod="kuadrant-system/limitador-limitador-78c99df468-9gtkr"
May 21 18:30:08.729803 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:30:08.729783    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/6929157a-2964-4bd1-83b7-e87caf0b0a71-config-file\") pod \"limitador-limitador-78c99df468-9gtkr\" (UID: \"6929157a-2964-4bd1-83b7-e87caf0b0a71\") " pod="kuadrant-system/limitador-limitador-78c99df468-9gtkr"
May 21 18:30:08.738326 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:30:08.738238    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dfkrc\" (UniqueName: \"kubernetes.io/projected/6929157a-2964-4bd1-83b7-e87caf0b0a71-kube-api-access-dfkrc\") pod \"limitador-limitador-78c99df468-9gtkr\" (UID: \"6929157a-2964-4bd1-83b7-e87caf0b0a71\") " pod="kuadrant-system/limitador-limitador-78c99df468-9gtkr"
May 21 18:30:08.855617 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:30:08.855578    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-9gtkr"
May 21 18:30:08.990225 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:30:08.990197    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:30:08.992939 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:30:08.992907    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6929157a_2964_4bd1_83b7_e87caf0b0a71.slice/crio-7e86e3fa5861f9aae905c02cf2aedc10a0c5a0a562561d65e1a81b39f17ac43c WatchSource:0}: Error finding container 7e86e3fa5861f9aae905c02cf2aedc10a0c5a0a562561d65e1a81b39f17ac43c: Status 404 returned error can't find the container with id 7e86e3fa5861f9aae905c02cf2aedc10a0c5a0a562561d65e1a81b39f17ac43c
May 21 18:30:09.735282 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:30:09.735176    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-9gtkr" event={"ID":"6929157a-2964-4bd1-83b7-e87caf0b0a71","Type":"ContainerStarted","Data":"7e86e3fa5861f9aae905c02cf2aedc10a0c5a0a562561d65e1a81b39f17ac43c"}
May 21 18:30:11.743257 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:30:11.743217    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-9gtkr" event={"ID":"6929157a-2964-4bd1-83b7-e87caf0b0a71","Type":"ContainerStarted","Data":"884a7b2887786051a1638b82fdc4f7f13016d5c054a94f8d9797927a7e8aab86"}
May 21 18:30:11.743655 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:30:11.743327    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-9gtkr"
May 21 18:30:11.764634 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:30:11.764585    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-9gtkr" podStartSLOduration=1.240014287 podStartE2EDuration="3.764570199s" podCreationTimestamp="2026-05-21 18:30:08 +0000 UTC" firstStartedPulling="2026-05-21 18:30:08.99474241 +0000 UTC m=+585.920230915" lastFinishedPulling="2026-05-21 18:30:11.51929832 +0000 UTC m=+588.444786827" observedRunningTime="2026-05-21 18:30:11.762797698 +0000 UTC m=+588.688286240" watchObservedRunningTime="2026-05-21 18:30:11.764570199 +0000 UTC m=+588.690058726"
May 21 18:30:22.747406 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:30:22.747373    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-9gtkr"
May 21 18:30:23.636851 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:30:23.636823    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qv8k_9e2ab0cd-745a-4109-ab04-75eaaf550474/ovn-acl-logging/0.log"
May 21 18:30:23.637046 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:30:23.636955    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qv8k_9e2ab0cd-745a-4109-ab04-75eaaf550474/ovn-acl-logging/0.log"
May 21 18:31:30.865233 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:31:30.865194    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:31:55.769176 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:31:55.769145    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:32:18.620560 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:32:18.620526    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:32:23.701411 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:32:23.701381    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:32:27.379594 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:32:27.379559    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:32:39.001378 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:32:39.001343    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:33:05.980257 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:33:05.980219    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:33:59.068637 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:33:59.068550    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:34:08.873802 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:34:08.873770    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:34:17.871962 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:34:17.871922    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:34:28.870424 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:34:28.870381    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:34:37.873771 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:34:37.873734    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:34:48.970698 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:34:48.970659    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:35:23.663791 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:35:23.663757    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qv8k_9e2ab0cd-745a-4109-ab04-75eaaf550474/ovn-acl-logging/0.log"
May 21 18:35:23.664643 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:35:23.664623    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qv8k_9e2ab0cd-745a-4109-ab04-75eaaf550474/ovn-acl-logging/0.log"
May 21 18:36:03.258134 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:36:03.258093    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:36:17.658961 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:36:17.658925    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:36:56.966510 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:36:56.966433    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:37:13.775758 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:37:13.775718    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:37:27.068713 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:37:27.068679    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:37:32.363196 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:37:32.363160    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:37:45.163052 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:37:45.163018    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:38:10.708328 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:38:10.708276    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:38:16.673609 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:38:16.673573    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:38:39.066171 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:38:39.066138    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:38:48.995770 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:38:48.995737    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:39:04.969427 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:39:04.969393    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:39:13.763071 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:39:13.763032    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:39:31.464644 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:39:31.464604    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:39:39.171091 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:39:39.171054    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:40:12.461482 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:40:12.461402    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:40:19.871994 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:40:19.871962    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:40:23.692399 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:40:23.692364    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qv8k_9e2ab0cd-745a-4109-ab04-75eaaf550474/ovn-acl-logging/0.log"
May 21 18:40:23.695051 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:40:23.695024    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qv8k_9e2ab0cd-745a-4109-ab04-75eaaf550474/ovn-acl-logging/0.log"
May 21 18:40:28.760455 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:40:28.760426    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:40:37.663928 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:40:37.663890    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:40:45.959371 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:40:45.959339    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:41:03.567314 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:41:03.567269    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:41:13.364225 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:41:13.364144    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:42:01.771700 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:42:01.771665    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:42:06.671285 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:42:06.671253    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:42:15.266058 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:42:15.266024    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:42:23.369385 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:42:23.369348    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:42:32.978736 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:42:32.978708    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:42:41.872754 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:42:41.872720    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:42:49.791786 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:42:49.791709    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:42:55.264706 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:42:55.264665    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:42:59.466729 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:42:59.466697    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:43:07.476502 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:43:07.476473    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:43:16.516983 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:43:16.516953    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:43:26.069855 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:43:26.069819    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:43:33.775544 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:43:33.775508    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:43:43.482622 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:43:43.482590    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:43:51.990321 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:43:51.990272    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:44:00.377594 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:44:00.377563    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:44:08.585965 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:44:08.585929    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:44:17.475897 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:44:17.475809    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:44:26.076607 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:44:26.076571    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:45:23.721460 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:45:23.721431    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qv8k_9e2ab0cd-745a-4109-ab04-75eaaf550474/ovn-acl-logging/0.log"
May 21 18:45:23.723914 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:45:23.723893    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qv8k_9e2ab0cd-745a-4109-ab04-75eaaf550474/ovn-acl-logging/0.log"
May 21 18:46:44.771125 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:46:44.771088    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:46:49.969998 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:46:49.969958    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:47:15.266262 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:47:15.266179    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:47:22.285148 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:47:22.285108    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:47:31.870007 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:47:31.869971    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:47:41.167663 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:47:41.167634    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:47:50.174458 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:47:50.174424    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:48:01.772059 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:48:01.772022    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:48:09.967134 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:48:09.967099    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:48:21.049324 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:48:21.049270    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:48:29.074888 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:48:29.074851    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:48:40.064638 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:48:40.064607    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:48:49.471579 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:48:49.471497    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:49:24.480210 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:49:24.480174    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:50:07.372074 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:50:07.372039    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:50:14.965547 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:50:14.965464    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:50:23.746831 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:50:23.746805    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qv8k_9e2ab0cd-745a-4109-ab04-75eaaf550474/ovn-acl-logging/0.log"
May 21 18:50:23.752769 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:50:23.752744    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qv8k_9e2ab0cd-745a-4109-ab04-75eaaf550474/ovn-acl-logging/0.log"
May 21 18:50:23.871135 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:50:23.871105    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:50:33.278046 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:50:33.278008    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:50:41.661716 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:50:41.661670    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:50:55.088984 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:50:55.088952    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:51:03.293700 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:51:03.293663    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:51:11.479094 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:51:11.479061    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:51:19.679407 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:51:19.679375    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:51:28.306040 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:51:28.306005    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:51:36.905022 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:51:36.904973    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:51:47.877183 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:51:47.877142    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:52:05.275456 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:52:05.275419    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:52:13.279234 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:52:13.279195    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:52:21.592739 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:52:21.592703    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:52:29.982016 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:52:29.981984    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:52:47.293269 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:52:47.293230    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:52:55.996009 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:52:55.995971    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:53:03.879400 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:53:03.879366    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:53:13.091454 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:53:13.091375    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:53:22.386251 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:53:22.386212    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:53:30.283873 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:53:30.283833    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:53:39.698879 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:53:39.698845    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:53:49.678394 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:53:49.678356    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:53:59.597524 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:53:59.597488    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:54:10.686469 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:54:10.686420    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:54:19.971741 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:54:19.971698    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:54:27.673788 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:54:27.673752    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:54:37.853067 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:54:37.853033    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:54:43.895907 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:54:43.895829    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:55:01.278181 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:55:01.278152    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:55:09.700014 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:55:09.699986    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:55:19.243551 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:55:19.243517    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:55:23.780710 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:55:23.780679    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qv8k_9e2ab0cd-745a-4109-ab04-75eaaf550474/ovn-acl-logging/0.log"
May 21 18:55:23.786033 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:55:23.786011    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-9qv8k_9e2ab0cd-745a-4109-ab04-75eaaf550474/ovn-acl-logging/0.log"
May 21 18:55:28.019540 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:55:28.019509    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:55:51.578027 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:55:51.577989    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:56:02.867673 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:02.867638    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-9gtkr"]
May 21 18:56:12.740487 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:12.740456    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67595b8579-5tvbn_09ec2eb4-290d-456a-9f53-21428a9a2705/manager/0.log"
May 21 18:56:14.540515 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:14.540488    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-hk9vw_adc9ead4-105d-4d3a-a040-be9705fa8989/manager/0.log"
May 21 18:56:14.660587 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:14.660561    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-96x2p_09517476-9dac-4a6c-9e10-666bf2f0b12a/kuadrant-console-plugin/0.log"
May 21 18:56:15.003793 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:15.003768    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-9gtkr_6929157a-2964-4bd1-83b7-e87caf0b0a71/limitador/0.log"
May 21 18:56:15.705136 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:15.705105    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d887b4ccb-gvtff_2243b965-600d-40db-b222-1b3bf07e4dce/kube-auth-proxy/0.log"
May 21 18:56:16.160987 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:16.160953    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-94ffb845b-vw5dm_c4063312-2538-4bdd-853e-cdc90d0db2be/router/0.log"
May 21 18:56:21.326294 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:21.326255    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kg6zt/must-gather-6tkn7"]
May 21 18:56:21.329854 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:21.329837    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kg6zt/must-gather-6tkn7"
May 21 18:56:21.336426 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:21.336078    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-kg6zt\"/\"default-dockercfg-qjd9n\""
May 21 18:56:21.337334 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:21.337299    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kg6zt\"/\"kube-root-ca.crt\""
May 21 18:56:21.337453 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:21.337345    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-kg6zt\"/\"openshift-service-ca.crt\""
May 21 18:56:21.441478 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:21.441450    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kg6zt/must-gather-6tkn7"]
May 21 18:56:21.454568 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:21.454547    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/52d543d2-d434-4547-a612-d32750f57c38-must-gather-output\") pod \"must-gather-6tkn7\" (UID: \"52d543d2-d434-4547-a612-d32750f57c38\") " pod="openshift-must-gather-kg6zt/must-gather-6tkn7"
May 21 18:56:21.454679 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:21.454658    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nl7lk\" (UniqueName: \"kubernetes.io/projected/52d543d2-d434-4547-a612-d32750f57c38-kube-api-access-nl7lk\") pod \"must-gather-6tkn7\" (UID: \"52d543d2-d434-4547-a612-d32750f57c38\") " pod="openshift-must-gather-kg6zt/must-gather-6tkn7"
May 21 18:56:21.555954 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:21.555931    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nl7lk\" (UniqueName: \"kubernetes.io/projected/52d543d2-d434-4547-a612-d32750f57c38-kube-api-access-nl7lk\") pod \"must-gather-6tkn7\" (UID: \"52d543d2-d434-4547-a612-d32750f57c38\") " pod="openshift-must-gather-kg6zt/must-gather-6tkn7"
May 21 18:56:21.556060 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:21.555976    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/52d543d2-d434-4547-a612-d32750f57c38-must-gather-output\") pod \"must-gather-6tkn7\" (UID: \"52d543d2-d434-4547-a612-d32750f57c38\") " pod="openshift-must-gather-kg6zt/must-gather-6tkn7"
May 21 18:56:21.556243 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:21.556230    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/52d543d2-d434-4547-a612-d32750f57c38-must-gather-output\") pod \"must-gather-6tkn7\" (UID: \"52d543d2-d434-4547-a612-d32750f57c38\") " pod="openshift-must-gather-kg6zt/must-gather-6tkn7"
May 21 18:56:21.575473 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:21.575447    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nl7lk\" (UniqueName: \"kubernetes.io/projected/52d543d2-d434-4547-a612-d32750f57c38-kube-api-access-nl7lk\") pod \"must-gather-6tkn7\" (UID: \"52d543d2-d434-4547-a612-d32750f57c38\") " pod="openshift-must-gather-kg6zt/must-gather-6tkn7"
May 21 18:56:21.638949 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:21.638890    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kg6zt/must-gather-6tkn7"
May 21 18:56:21.782891 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:21.782861    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kg6zt/must-gather-6tkn7"]
May 21 18:56:21.783973 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:56:21.783939    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52d543d2_d434_4547_a612_d32750f57c38.slice/crio-547d33736f4ea393b8c5157280c2a928e516e8af82e6ea4cf26fa48f0373247a WatchSource:0}: Error finding container 547d33736f4ea393b8c5157280c2a928e516e8af82e6ea4cf26fa48f0373247a: Status 404 returned error can't find the container with id 547d33736f4ea393b8c5157280c2a928e516e8af82e6ea4cf26fa48f0373247a
May 21 18:56:21.785887 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:21.785870    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 18:56:22.160367 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:22.160335    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kg6zt/must-gather-6tkn7" event={"ID":"52d543d2-d434-4547-a612-d32750f57c38","Type":"ContainerStarted","Data":"547d33736f4ea393b8c5157280c2a928e516e8af82e6ea4cf26fa48f0373247a"}
May 21 18:56:23.170934 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:23.170857    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kg6zt/must-gather-6tkn7" event={"ID":"52d543d2-d434-4547-a612-d32750f57c38","Type":"ContainerStarted","Data":"3818eac43acdc8586ff619e2ca448b4d22c8c9936f335bf0b359148886840133"}
May 21 18:56:23.170934 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:23.170899    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kg6zt/must-gather-6tkn7" event={"ID":"52d543d2-d434-4547-a612-d32750f57c38","Type":"ContainerStarted","Data":"f040933419176c152beb2be36cf9310fb8fa3ed729f474273dbe0216191ca5a4"}
May 21 18:56:24.715213 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:24.715173    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9b7hr_3f6446cf-9c00-40be-abdf-cd5a694002c9/global-pull-secret-syncer/0.log"
May 21 18:56:24.943865 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:24.943827    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-drjkn_ca4b82ca-d15d-4d1a-91be-c3b4fe425179/konnectivity-agent/0.log"
May 21 18:56:25.074623 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:25.074598    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-93.ec2.internal_a8c9b756d2e1c708a8c4a862520c8414/haproxy/0.log"
May 21 18:56:29.785767 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:29.785734    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-hk9vw_adc9ead4-105d-4d3a-a040-be9705fa8989/manager/0.log"
May 21 18:56:29.881352 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:29.881321    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-96x2p_09517476-9dac-4a6c-9e10-666bf2f0b12a/kuadrant-console-plugin/0.log"
May 21 18:56:30.112047 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:30.111962    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-9gtkr_6929157a-2964-4bd1-83b7-e87caf0b0a71/limitador/0.log"
May 21 18:56:31.402174 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:31.402108    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2e980d4-0f12-476b-8e54-62ec0f79a1b1/alertmanager/0.log"
May 21 18:56:31.433564 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:31.433533    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2e980d4-0f12-476b-8e54-62ec0f79a1b1/config-reloader/0.log"
May 21 18:56:31.482706 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:31.481632    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2e980d4-0f12-476b-8e54-62ec0f79a1b1/kube-rbac-proxy-web/0.log"
May 21 18:56:31.509992 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:31.509963    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2e980d4-0f12-476b-8e54-62ec0f79a1b1/kube-rbac-proxy/0.log"
May 21 18:56:31.555001 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:31.554976    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2e980d4-0f12-476b-8e54-62ec0f79a1b1/kube-rbac-proxy-metric/0.log"
May 21 18:56:31.581763 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:31.581734    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2e980d4-0f12-476b-8e54-62ec0f79a1b1/prom-label-proxy/0.log"
May 21 18:56:31.608949 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:31.608917    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_d2e980d4-0f12-476b-8e54-62ec0f79a1b1/init-config-reloader/0.log"
May 21 18:56:31.664115 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:31.664040    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-h9bn5_1431aa6e-556f-4298-9b0f-ec77a990ad86/cluster-monitoring-operator/0.log"
May 21 18:56:31.811954 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:31.811929    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-7954df9985-6zwkf_c82c7ff3-a886-4056-baf0-15bcbe675d1c/metrics-server/0.log"
May 21 18:56:31.869295 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:31.869268    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-nbb8g_42e80e40-d309-487f-a1dd-24b1a8b5f8e8/monitoring-plugin/0.log"
May 21 18:56:32.010524 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.010496    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ns5z7_cf441887-7b70-46d3-bf40-4b03aa9a3453/node-exporter/0.log"
May 21 18:56:32.041923 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.041895    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ns5z7_cf441887-7b70-46d3-bf40-4b03aa9a3453/kube-rbac-proxy/0.log"
May 21 18:56:32.065806 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.065780    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ns5z7_cf441887-7b70-46d3-bf40-4b03aa9a3453/init-textfile/0.log"
May 21 18:56:32.192478 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.192447    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-n8p7h_66085c95-e03f-4b72-95c7-ed6a58e88542/kube-rbac-proxy-main/0.log"
May 21 18:56:32.220877 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.220811    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-n8p7h_66085c95-e03f-4b72-95c7-ed6a58e88542/kube-rbac-proxy-self/0.log"
May 21 18:56:32.246705 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.246669    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-n8p7h_66085c95-e03f-4b72-95c7-ed6a58e88542/openshift-state-metrics/0.log"
May 21 18:56:32.282896 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.282820    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e89fdc0b-edc0-4ca4-ba53-fe385238f385/prometheus/0.log"
May 21 18:56:32.314452 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.314421    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e89fdc0b-edc0-4ca4-ba53-fe385238f385/config-reloader/0.log"
May 21 18:56:32.348955 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.348929    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e89fdc0b-edc0-4ca4-ba53-fe385238f385/thanos-sidecar/0.log"
May 21 18:56:32.374839 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.374812    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e89fdc0b-edc0-4ca4-ba53-fe385238f385/kube-rbac-proxy-web/0.log"
May 21 18:56:32.412336 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.412296    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e89fdc0b-edc0-4ca4-ba53-fe385238f385/kube-rbac-proxy/0.log"
May 21 18:56:32.441069 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.441048    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e89fdc0b-edc0-4ca4-ba53-fe385238f385/kube-rbac-proxy-thanos/0.log"
May 21 18:56:32.473404 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.473374    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e89fdc0b-edc0-4ca4-ba53-fe385238f385/init-config-reloader/0.log"
May 21 18:56:32.547084 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.546974    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-fsds2_278ba78d-f521-450a-8526-6841273b5290/prometheus-operator-admission-webhook/0.log"
May 21 18:56:32.574341 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.574315    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67ddd58468-qn6m6_50b7f0f6-e9f1-49be-a887-2dbadabe4d95/telemeter-client/0.log"
May 21 18:56:32.597660 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.597633    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67ddd58468-qn6m6_50b7f0f6-e9f1-49be-a887-2dbadabe4d95/reload/0.log"
May 21 18:56:32.621740 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.621703    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67ddd58468-qn6m6_50b7f0f6-e9f1-49be-a887-2dbadabe4d95/kube-rbac-proxy/0.log"
May 21 18:56:32.656919 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.656894    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5979cc64d4-2v9vn_1da1d840-fb85-4064-b193-14753a2ac0fe/thanos-query/0.log"
May 21 18:56:32.681047 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.681019    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5979cc64d4-2v9vn_1da1d840-fb85-4064-b193-14753a2ac0fe/kube-rbac-proxy-web/0.log"
May 21 18:56:32.705052 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.705020    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5979cc64d4-2v9vn_1da1d840-fb85-4064-b193-14753a2ac0fe/kube-rbac-proxy/0.log"
May 21 18:56:32.736499 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.736470    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5979cc64d4-2v9vn_1da1d840-fb85-4064-b193-14753a2ac0fe/prom-label-proxy/0.log"
May 21 18:56:32.763911 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.763884    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5979cc64d4-2v9vn_1da1d840-fb85-4064-b193-14753a2ac0fe/kube-rbac-proxy-rules/0.log"
May 21 18:56:32.799954 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.799886    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5979cc64d4-2v9vn_1da1d840-fb85-4064-b193-14753a2ac0fe/kube-rbac-proxy-metrics/0.log"
May 21 18:56:32.915689 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.915622    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-kg6zt/must-gather-6tkn7" podStartSLOduration=10.951095146 podStartE2EDuration="11.915599351s" podCreationTimestamp="2026-05-21 18:56:21 +0000 UTC" firstStartedPulling="2026-05-21 18:56:21.786042518 +0000 UTC m=+2158.711531023" lastFinishedPulling="2026-05-21 18:56:22.750546724 +0000 UTC m=+2159.676035228" observedRunningTime="2026-05-21 18:56:23.202656579 +0000 UTC m=+2160.128145105" watchObservedRunningTime="2026-05-21 18:56:32.915599351 +0000 UTC m=+2169.841087879"
May 21 18:56:32.917763 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.917729    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"]
May 21 18:56:32.924802 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.924772    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"
May 21 18:56:32.938343 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.938293    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"]
May 21 18:56:32.976412 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.976373    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5788f271-d941-417e-ba15-70537bc15020-lib-modules\") pod \"perf-node-gather-daemonset-qh6wx\" (UID: \"5788f271-d941-417e-ba15-70537bc15020\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"
May 21 18:56:32.976593 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.976427    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlgfc\" (UniqueName: \"kubernetes.io/projected/5788f271-d941-417e-ba15-70537bc15020-kube-api-access-wlgfc\") pod \"perf-node-gather-daemonset-qh6wx\" (UID: \"5788f271-d941-417e-ba15-70537bc15020\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"
May 21 18:56:32.976593 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.976483    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5788f271-d941-417e-ba15-70537bc15020-podres\") pod \"perf-node-gather-daemonset-qh6wx\" (UID: \"5788f271-d941-417e-ba15-70537bc15020\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"
May 21 18:56:32.976707 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.976620    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5788f271-d941-417e-ba15-70537bc15020-sys\") pod \"perf-node-gather-daemonset-qh6wx\" (UID: \"5788f271-d941-417e-ba15-70537bc15020\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"
May 21 18:56:32.976707 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:32.976679    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5788f271-d941-417e-ba15-70537bc15020-proc\") pod \"perf-node-gather-daemonset-qh6wx\" (UID: \"5788f271-d941-417e-ba15-70537bc15020\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"
May 21 18:56:33.077504 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:33.077421    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5788f271-d941-417e-ba15-70537bc15020-lib-modules\") pod \"perf-node-gather-daemonset-qh6wx\" (UID: \"5788f271-d941-417e-ba15-70537bc15020\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"
May 21 18:56:33.077504 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:33.077462    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wlgfc\" (UniqueName: \"kubernetes.io/projected/5788f271-d941-417e-ba15-70537bc15020-kube-api-access-wlgfc\") pod \"perf-node-gather-daemonset-qh6wx\" (UID: \"5788f271-d941-417e-ba15-70537bc15020\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"
May 21 18:56:33.077504 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:33.077489    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5788f271-d941-417e-ba15-70537bc15020-podres\") pod \"perf-node-gather-daemonset-qh6wx\" (UID: \"5788f271-d941-417e-ba15-70537bc15020\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"
May 21 18:56:33.077720 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:33.077539    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5788f271-d941-417e-ba15-70537bc15020-sys\") pod \"perf-node-gather-daemonset-qh6wx\" (UID: \"5788f271-d941-417e-ba15-70537bc15020\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"
May 21 18:56:33.077720 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:33.077561    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5788f271-d941-417e-ba15-70537bc15020-proc\") pod \"perf-node-gather-daemonset-qh6wx\" (UID: \"5788f271-d941-417e-ba15-70537bc15020\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"
May 21 18:56:33.077720 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:33.077627    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5788f271-d941-417e-ba15-70537bc15020-lib-modules\") pod \"perf-node-gather-daemonset-qh6wx\" (UID: \"5788f271-d941-417e-ba15-70537bc15020\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"
May 21 18:56:33.077720 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:33.077655    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5788f271-d941-417e-ba15-70537bc15020-proc\") pod \"perf-node-gather-daemonset-qh6wx\" (UID: \"5788f271-d941-417e-ba15-70537bc15020\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"
May 21 18:56:33.077720 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:33.077665    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5788f271-d941-417e-ba15-70537bc15020-sys\") pod \"perf-node-gather-daemonset-qh6wx\" (UID: \"5788f271-d941-417e-ba15-70537bc15020\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"
May 21 18:56:33.077720 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:33.077696    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5788f271-d941-417e-ba15-70537bc15020-podres\") pod \"perf-node-gather-daemonset-qh6wx\" (UID: \"5788f271-d941-417e-ba15-70537bc15020\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"
May 21 18:56:33.087350 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:33.087331    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlgfc\" (UniqueName: \"kubernetes.io/projected/5788f271-d941-417e-ba15-70537bc15020-kube-api-access-wlgfc\") pod \"perf-node-gather-daemonset-qh6wx\" (UID: \"5788f271-d941-417e-ba15-70537bc15020\") " pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"
May 21 18:56:33.238661 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:33.238626    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"
May 21 18:56:33.397929 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:33.397893    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"]
May 21 18:56:33.401050 ip-10-0-129-93 kubenswrapper[2573]: W0521 18:56:33.401013    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5788f271_d941_417e_ba15_70537bc15020.slice/crio-92466a128c4f1a33d5efd0f4a89e4b32da9a47445aa02b471cb34f32c0d9e3c6 WatchSource:0}: Error finding container 92466a128c4f1a33d5efd0f4a89e4b32da9a47445aa02b471cb34f32c0d9e3c6: Status 404 returned error can't find the container with id 92466a128c4f1a33d5efd0f4a89e4b32da9a47445aa02b471cb34f32c0d9e3c6
May 21 18:56:34.223860 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:34.223821    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx" event={"ID":"5788f271-d941-417e-ba15-70537bc15020","Type":"ContainerStarted","Data":"e333e4925d0d9f5cec4fab49d05299a3cbca33f85492fb4414ea4def0df0565d"}
May 21 18:56:34.223860 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:34.223865    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx" event={"ID":"5788f271-d941-417e-ba15-70537bc15020","Type":"ContainerStarted","Data":"92466a128c4f1a33d5efd0f4a89e4b32da9a47445aa02b471cb34f32c0d9e3c6"}
May 21 18:56:34.224251 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:34.223965    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"
May 21 18:56:34.255002 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:34.254945    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx" podStartSLOduration=2.254915612 podStartE2EDuration="2.254915612s" podCreationTimestamp="2026-05-21 18:56:32 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 18:56:34.251768457 +0000 UTC m=+2171.177256983" watchObservedRunningTime="2026-05-21 18:56:34.254915612 +0000 UTC m=+2171.180404141"
May 21 18:56:35.676257 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:35.676232    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5cf8c89d64-fpzmg_e46e9a9f-aa27-4ae0-b821-0d9ac59edb41/volume-data-source-validator/0.log"
May 21 18:56:36.742460 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:36.742419    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sm8gn_e43073c9-1e5c-411b-9f5c-8e35b66ffe54/dns/0.log"
May 21 18:56:36.781238 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:36.781180    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sm8gn_e43073c9-1e5c-411b-9f5c-8e35b66ffe54/kube-rbac-proxy/0.log"
May 21 18:56:36.819381 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:36.819355    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jtz2j_3632a020-9a04-421c-8049-cb069bbd909a/dns-node-resolver/0.log"
May 21 18:56:37.552545 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:37.552520    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-7fgmq_e3f4defa-2429-43c6-aee6-c8ac57ad956b/node-ca/0.log"
May 21 18:56:38.922423 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:38.922397    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d887b4ccb-gvtff_2243b965-600d-40db-b222-1b3bf07e4dce/kube-auth-proxy/0.log"
May 21 18:56:39.139499 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:39.139476    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-94ffb845b-vw5dm_c4063312-2538-4bdd-853e-cdc90d0db2be/router/0.log"
May 21 18:56:39.849995 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:39.849949    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2slhb_89f0442b-784c-49da-910d-122d18137dd7/serve-healthcheck-canary/0.log"
May 21 18:56:40.243106 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:40.243080    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-kg6zt/perf-node-gather-daemonset-qh6wx"
May 21 18:56:40.676382 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:40.676289    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-d9jkq_4e0c7492-8cf6-4b1b-8326-e298f267e011/insights-operator/0.log"
May 21 18:56:40.676517 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:40.676441    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-d9jkq_4e0c7492-8cf6-4b1b-8326-e298f267e011/insights-operator/1.log"
May 21 18:56:40.733753 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:40.733727    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k4j68_1586a237-3bc6-41ca-825d-cf2e89d4d709/kube-rbac-proxy/0.log"
May 21 18:56:40.788818 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:40.788796    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k4j68_1586a237-3bc6-41ca-825d-cf2e89d4d709/exporter/0.log"
May 21 18:56:40.865027 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:40.864998    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k4j68_1586a237-3bc6-41ca-825d-cf2e89d4d709/extractor/0.log"
May 21 18:56:44.148669 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:44.148639    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67595b8579-5tvbn_09ec2eb4-290d-456a-9f53-21428a9a2705/manager/0.log"
May 21 18:56:45.766039 ip-10-0-129-93 kubenswrapper[2573]: I0521 18:56:45.765990    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-59996fdc5c-5bbc2_aebe5a81-f29c-4bbc-a1aa-021174efa20e/manager/0.log"