May 28 16:05:07.215155 ip-10-0-132-51 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 28 16:05:07.215168 ip-10-0-132-51 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 28 16:05:07.215179 ip-10-0-132-51 systemd[1]: kubelet.service: Failed with result 'resources'.
May 28 16:05:07.215489 ip-10-0-132-51 systemd[1]: Failed to start Kubernetes Kubelet.
May 28 16:05:17.225628 ip-10-0-132-51 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 28 16:05:17.225652 ip-10-0-132-51 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 87c452c01e674bb58291cd4bb245b168 --
May 28 16:08:00.025761 ip-10-0-132-51 systemd[1]: Starting Kubernetes Kubelet...
May 28 16:08:00.471300 ip-10-0-132-51 kubenswrapper[2564]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 16:08:00.471300 ip-10-0-132-51 kubenswrapper[2564]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 16:08:00.471300 ip-10-0-132-51 kubenswrapper[2564]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 16:08:00.471300 ip-10-0-132-51 kubenswrapper[2564]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 16:08:00.471300 ip-10-0-132-51 kubenswrapper[2564]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 16:08:00.474083 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.473995    2564 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 16:08:00.477552 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477537    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 16:08:00.477552 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477552    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 16:08:00.477624 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477556    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 16:08:00.477624 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477560    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 16:08:00.477624 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477563    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 16:08:00.477624 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477565    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 16:08:00.477624 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477568    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 16:08:00.477624 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477571    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 16:08:00.477624 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477575    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 16:08:00.477624 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477578    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 16:08:00.477624 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477581    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 16:08:00.477624 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477584    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 16:08:00.477624 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477590    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 16:08:00.477624 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477594    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 16:08:00.477624 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477597    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 16:08:00.477624 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477600    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 16:08:00.477624 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477602    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 16:08:00.477624 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477604    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 16:08:00.477624 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477607    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 28 16:08:00.477624 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477610    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 16:08:00.477624 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477612    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 16:08:00.477624 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477615    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 16:08:00.478091 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477617    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 16:08:00.478091 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477620    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 16:08:00.478091 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477622    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 16:08:00.478091 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477625    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 16:08:00.478091 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477627    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 16:08:00.478091 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477631    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 16:08:00.478091 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477634    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 16:08:00.478091 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477636    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 16:08:00.478091 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477639    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 16:08:00.478091 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477642    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 16:08:00.478091 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477644    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 16:08:00.478091 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477646    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 16:08:00.478091 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477650    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 16:08:00.478091 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477652    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 16:08:00.478091 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477655    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 16:08:00.478091 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477657    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 16:08:00.478091 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477660    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 16:08:00.478091 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477662    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 16:08:00.478091 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477664    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 16:08:00.478091 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477667    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 16:08:00.478799 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477669    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 16:08:00.478799 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477671    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 16:08:00.478799 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477674    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 16:08:00.478799 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477676    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 16:08:00.478799 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477679    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 16:08:00.478799 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477681    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 16:08:00.478799 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477683    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 16:08:00.478799 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477687    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 16:08:00.478799 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477691    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 16:08:00.478799 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477694    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 16:08:00.478799 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477697    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 16:08:00.478799 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477699    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 16:08:00.478799 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477702    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 16:08:00.478799 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477706    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 16:08:00.478799 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477709    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 16:08:00.478799 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477712    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 16:08:00.478799 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477714    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 16:08:00.478799 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477717    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 16:08:00.478799 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477719    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 16:08:00.479341 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477722    2564 feature_gate.go:328] unrecognized feature gate: Example
May 28 16:08:00.479341 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477725    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 16:08:00.479341 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477727    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 16:08:00.479341 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477729    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 16:08:00.479341 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477732    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 16:08:00.479341 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477734    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 16:08:00.479341 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477737    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 16:08:00.479341 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477739    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 16:08:00.479341 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477744    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 16:08:00.479341 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477748    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 16:08:00.479341 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477750    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 16:08:00.479341 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477753    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 16:08:00.479341 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477755    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 16:08:00.479341 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477758    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 16:08:00.479341 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477760    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 16:08:00.479341 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477762    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 16:08:00.479341 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477765    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 16:08:00.479341 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477768    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 16:08:00.479341 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477770    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 16:08:00.479820 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477772    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 16:08:00.479820 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477775    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 16:08:00.479820 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477777    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 16:08:00.479820 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477779    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 16:08:00.479820 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477782    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 16:08:00.479820 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.477784    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 16:08:00.479820 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479665    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 16:08:00.479820 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479677    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 16:08:00.479820 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479681    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 16:08:00.479820 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479684    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 16:08:00.479820 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479687    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 16:08:00.479820 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479690    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 16:08:00.479820 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479693    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 16:08:00.479820 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479696    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 16:08:00.479820 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479698    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 16:08:00.479820 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479701    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 16:08:00.479820 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479704    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 16:08:00.479820 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479707    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 16:08:00.479820 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479709    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 16:08:00.479820 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479712    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 16:08:00.480301 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479714    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 16:08:00.480301 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479717    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 16:08:00.480301 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479719    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 16:08:00.480301 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479722    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 16:08:00.480301 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479724    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 16:08:00.480301 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479727    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 16:08:00.480301 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479729    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 28 16:08:00.480301 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479732    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 16:08:00.480301 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479734    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 16:08:00.480301 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479736    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 16:08:00.480301 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479739    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 16:08:00.480301 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479741    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 16:08:00.480301 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479744    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 16:08:00.480301 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479746    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 16:08:00.480301 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479749    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 16:08:00.480301 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479751    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 16:08:00.480301 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479754    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 16:08:00.480301 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479757    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 16:08:00.480301 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479760    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 16:08:00.480301 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479762    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 16:08:00.480816 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479765    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 16:08:00.480816 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479767    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 16:08:00.480816 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479770    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 16:08:00.480816 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479772    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 16:08:00.480816 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479775    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 16:08:00.480816 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479777    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 16:08:00.480816 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479779    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 16:08:00.480816 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479782    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 16:08:00.480816 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479784    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 16:08:00.480816 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479786    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 16:08:00.480816 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479789    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 16:08:00.480816 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479792    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 16:08:00.480816 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479794    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 16:08:00.480816 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479797    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 16:08:00.480816 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479799    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 16:08:00.480816 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479801    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 16:08:00.480816 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479805    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 16:08:00.480816 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479807    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 16:08:00.480816 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479810    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 16:08:00.481271 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479812    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 16:08:00.481271 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479815    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 16:08:00.481271 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479818    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 16:08:00.481271 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479820    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 16:08:00.481271 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479823    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 16:08:00.481271 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479826    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 16:08:00.481271 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479828    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 16:08:00.481271 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479831    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 16:08:00.481271 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479833    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 16:08:00.481271 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479836    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 16:08:00.481271 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479839    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 16:08:00.481271 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479842    2564 feature_gate.go:328] unrecognized feature gate: Example
May 28 16:08:00.481271 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479845    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 16:08:00.481271 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479848    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 16:08:00.481271 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479850    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 16:08:00.481271 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479853    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 16:08:00.481271 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479856    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 16:08:00.481271 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479858    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 16:08:00.481271 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479860    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 16:08:00.481778 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479863    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 16:08:00.481778 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479865    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 16:08:00.481778 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479868    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 16:08:00.481778 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479872    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 16:08:00.481778 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479877    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 16:08:00.481778 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479879    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 16:08:00.481778 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479883    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 16:08:00.481778 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479888    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 16:08:00.481778 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479891    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 16:08:00.481778 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479893    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 16:08:00.481778 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479895    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 16:08:00.481778 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479898    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 16:08:00.481778 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479900    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 16:08:00.481778 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.479902    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 16:08:00.481778 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.479982    2564 flags.go:64] FLAG: --address="0.0.0.0"
May 28 16:08:00.481778 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.479990    2564 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 16:08:00.481778 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480000    2564 flags.go:64] FLAG: --anonymous-auth="true"
May 28 16:08:00.481778 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480006    2564 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 16:08:00.481778 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480011    2564 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 16:08:00.481778 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480014    2564 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480018    2564 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480023    2564 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480026    2564 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480029    2564 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480033    2564 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480037    2564 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480040    2564 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480043    2564 flags.go:64] FLAG: --cgroup-root=""
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480046    2564 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480049    2564 flags.go:64] FLAG: --client-ca-file=""
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480052    2564 flags.go:64] FLAG: --cloud-config=""
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480055    2564 flags.go:64] FLAG: --cloud-provider="external"
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480058    2564 flags.go:64] FLAG: --cluster-dns="[]"
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480063    2564 flags.go:64] FLAG: --cluster-domain=""
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480065    2564 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480069    2564 flags.go:64] FLAG: --config-dir=""
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480071    2564 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480075    2564 flags.go:64] FLAG: --container-log-max-files="5"
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480078    2564 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480082    2564 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480086    2564 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480089    2564 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480092    2564 flags.go:64] FLAG: --contention-profiling="false"
May 28 16:08:00.482247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480095    2564 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480098    2564 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480101    2564 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480104    2564 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480108    2564 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480111    2564 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480114    2564 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480116    2564 flags.go:64] FLAG: --enable-load-reader="false"
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480119    2564 flags.go:64] FLAG: --enable-server="true"
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480122    2564 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480126    2564 flags.go:64] FLAG: --event-burst="100"
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480129    2564 flags.go:64] FLAG: --event-qps="50"
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480132    2564 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480136    2564 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480139    2564 flags.go:64] FLAG: --eviction-hard=""
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480144    2564 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480146    2564 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480149    2564 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480153    2564 flags.go:64] FLAG: --eviction-soft=""
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480155    2564 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480158    2564 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480161    2564 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480165    2564 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480168    2564 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480170    2564 flags.go:64] FLAG: --fail-swap-on="true"
May 28 16:08:00.482857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480173    2564 flags.go:64] FLAG: --feature-gates=""
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480177    2564 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480180    2564 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480183    2564 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480186    2564 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480189    2564 flags.go:64] FLAG: --healthz-port="10248"
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480192    2564 flags.go:64] FLAG: --help="false"
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480195    2564 flags.go:64] FLAG: --hostname-override="ip-10-0-132-51.ec2.internal"
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480198    2564 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480201    2564 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480204    2564 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480207    2564 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480211    2564 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480213    2564 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480216    2564 flags.go:64] FLAG: --image-service-endpoint=""
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480219    2564 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480222    2564 flags.go:64] FLAG: --kube-api-burst="100"
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480224    2564 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480227    2564 flags.go:64] FLAG: --kube-api-qps="50"
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480230    2564 flags.go:64] FLAG: --kube-reserved=""
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480233    2564 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480236    2564 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480239    2564 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480242    2564 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 16:08:00.483460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480244    2564 flags.go:64] FLAG: --lock-file=""
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480247    2564 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480250    2564 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480253    2564 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480259    2564 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480262    2564 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480264    2564 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480267    2564 flags.go:64] FLAG: --logging-format="text"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480270    2564 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480273    2564 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480276    2564 flags.go:64] FLAG: --manifest-url=""
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480278    2564 flags.go:64] FLAG: --manifest-url-header=""
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480283    2564 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480286    2564 flags.go:64] FLAG: --max-open-files="1000000"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480291    2564 flags.go:64] FLAG: --max-pods="110"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480294    2564 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480297    2564 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480300    2564 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480303    2564 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480306    2564 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480309    2564 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480312    2564 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480320    2564 flags.go:64] FLAG: --node-status-max-images="50"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480323    2564 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480326    2564 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 16:08:00.484084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480329    2564 flags.go:64] FLAG: --pod-cidr=""
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480332    2564 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480338    2564 flags.go:64] FLAG: --pod-manifest-path=""
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480341    2564 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480344    2564 flags.go:64] FLAG: --pods-per-core="0"
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480347    2564 flags.go:64] FLAG: --port="10250"
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480350    2564 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480353    2564 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08335f6ed52affa25"
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480374    2564 flags.go:64] FLAG: --qos-reserved=""
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480380    2564 flags.go:64] FLAG: --read-only-port="10255"
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480383    2564 flags.go:64] FLAG: --register-node="true"
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480386    2564 flags.go:64] FLAG: --register-schedulable="true"
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480389    2564 flags.go:64] FLAG: --register-with-taints=""
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480393    2564 flags.go:64] FLAG: --registry-burst="10"
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480395    2564 flags.go:64] FLAG: --registry-qps="5"
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480398    2564 flags.go:64] FLAG: --reserved-cpus=""
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480401    2564 flags.go:64] FLAG: --reserved-memory=""
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480405    2564 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480408    2564 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480411    2564 flags.go:64] FLAG: --rotate-certificates="false"
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480414    2564 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480418    2564 flags.go:64] FLAG: --runonce="false"
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480421    2564 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480424    2564 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480427    2564 flags.go:64] FLAG: --seccomp-default="false"
May 28 16:08:00.484700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480430    2564 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480432    2564 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480435    2564 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480438    2564 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480441    2564 flags.go:64] FLAG: --storage-driver-password="root"
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480444    2564 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480447    2564 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480449    2564 flags.go:64] FLAG: --storage-driver-user="root"
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480452    2564 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480455    2564 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480458    2564 flags.go:64] FLAG: --system-cgroups=""
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480462    2564 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480467    2564 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480470    2564 flags.go:64] FLAG: --tls-cert-file=""
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480473    2564 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480477    2564 flags.go:64] FLAG: --tls-min-version=""
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480480    2564 flags.go:64] FLAG: --tls-private-key-file=""
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480483    2564 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480485    2564 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480488    2564 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480491    2564 flags.go:64] FLAG: --v="2"
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480495    2564 flags.go:64] FLAG: --version="false"
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480499    2564 flags.go:64] FLAG: --vmodule=""
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480503    2564 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480509    2564 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 16:08:00.485292 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480600    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 16:08:00.485954 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480603    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 16:08:00.485954 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480607    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 16:08:00.485954 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480611    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 16:08:00.485954 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480614    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 16:08:00.485954 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480618    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 16:08:00.485954 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480621    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 16:08:00.485954 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480624    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 16:08:00.485954 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480627    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 16:08:00.485954 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480630    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 16:08:00.485954 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480633    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 16:08:00.485954 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480635    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 16:08:00.485954 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480638    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 16:08:00.485954 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480641    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 16:08:00.485954 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480643    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 16:08:00.485954 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480645    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 16:08:00.485954 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480648    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 16:08:00.485954 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480654    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 16:08:00.485954 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480656    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 16:08:00.485954 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480659    2564 feature_gate.go:328] unrecognized feature gate: Example
May 28 16:08:00.486527 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480661    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 16:08:00.486527 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480664    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 16:08:00.486527 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480668    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 16:08:00.486527 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480671    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 16:08:00.486527 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480675    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 16:08:00.486527 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480678    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 16:08:00.486527 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480680    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 16:08:00.486527 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480683    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 16:08:00.486527 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480686    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 16:08:00.486527 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480689    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 16:08:00.486527 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480691    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 16:08:00.486527 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480695    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 16:08:00.486527 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480698    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 16:08:00.486527 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480701    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 16:08:00.486527 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480704    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 16:08:00.486527 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480707    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 16:08:00.486527 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480709    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 16:08:00.486527 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480713    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 16:08:00.486527 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480716    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 16:08:00.487012 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480718    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 16:08:00.487012 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480721    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 16:08:00.487012 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480723    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 16:08:00.487012 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480726    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 16:08:00.487012 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480729    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 16:08:00.487012 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480732    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 16:08:00.487012 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480735    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 16:08:00.487012 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480737    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 16:08:00.487012 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480740    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 16:08:00.487012 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480742    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 16:08:00.487012 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480746    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 16:08:00.487012 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480749    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 16:08:00.487012 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480752    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 16:08:00.487012 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480754    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 16:08:00.487012 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480756    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 16:08:00.487012 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480759    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 16:08:00.487012 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480762    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 16:08:00.487012 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480764    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 28 16:08:00.487012 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480766    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 16:08:00.487012 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480769    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 16:08:00.487511 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480771    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 16:08:00.487511 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480774    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 16:08:00.487511 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480776    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 16:08:00.487511 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480779    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 16:08:00.487511 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480783    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 16:08:00.487511 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480786    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 16:08:00.487511 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480788    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 16:08:00.487511 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480791    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 16:08:00.487511 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480794    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 16:08:00.487511 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480796    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 16:08:00.487511 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480799    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 16:08:00.487511 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480802    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 16:08:00.487511 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480804    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 16:08:00.487511 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480807    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 16:08:00.487511 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480809    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 16:08:00.487511 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480811    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 16:08:00.487511 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480814    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 16:08:00.487511 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480816    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 16:08:00.487511 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480819    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 16:08:00.487511 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480822    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 16:08:00.488010 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480824    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 16:08:00.488010 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480826    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 16:08:00.488010 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480830    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 16:08:00.488010 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480833    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 16:08:00.488010 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480835    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 16:08:00.488010 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480837    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 16:08:00.488010 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.480840    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 16:08:00.488010 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.480845    2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 16:08:00.488010 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.487374    2564 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 16:08:00.488010 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.487392    2564 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 16:08:00.488010 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487441    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 16:08:00.488010 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487446    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 16:08:00.488010 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487450    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 16:08:00.488010 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487454    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 16:08:00.488010 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487457    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 16:08:00.488432 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487460    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 28 16:08:00.488432 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487462    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 16:08:00.488432 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487466    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 16:08:00.488432 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487468    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 16:08:00.488432 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487471    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 16:08:00.488432 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487474    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 16:08:00.488432 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487477    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 16:08:00.488432 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487479    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 16:08:00.488432 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487483    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 16:08:00.488432 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487486    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 16:08:00.488432 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487489    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 16:08:00.488432 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487492    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 16:08:00.488432 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487494    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 16:08:00.488432 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487497    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 16:08:00.488432 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487500    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 16:08:00.488432 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487503    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 16:08:00.488432 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487506    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 16:08:00.488432 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487509    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 16:08:00.488432 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487511    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 16:08:00.488432 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487514    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 16:08:00.488908 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487517    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 16:08:00.488908 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487520    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 16:08:00.488908 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487522    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 16:08:00.488908 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487525    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 16:08:00.488908 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487528    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 16:08:00.488908 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487530    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 16:08:00.488908 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487533    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 16:08:00.488908 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487536    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 16:08:00.488908 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487539    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 16:08:00.488908 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487541    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 16:08:00.488908 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487544    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 16:08:00.488908 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487546    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 16:08:00.488908 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487549    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 16:08:00.488908 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487551    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 16:08:00.488908 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487554    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 16:08:00.488908 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487556    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 16:08:00.488908 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487559    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 16:08:00.488908 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487561    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 16:08:00.488908 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487564    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 16:08:00.488908 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487567    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 16:08:00.489427 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487571    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 16:08:00.489427 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487576    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 16:08:00.489427 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487579    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 16:08:00.489427 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487582    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 16:08:00.489427 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487585    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 16:08:00.489427 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487587    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 16:08:00.489427 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487590    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 16:08:00.489427 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487593    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 16:08:00.489427 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487596    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 16:08:00.489427 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487599    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 16:08:00.489427 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487602    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 16:08:00.489427 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487604    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 16:08:00.489427 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487606    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 16:08:00.489427 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487609    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 16:08:00.489427 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487612    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 16:08:00.489427 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487614    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 16:08:00.489427 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487617    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 16:08:00.489427 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487619    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 16:08:00.489427 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487622    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 16:08:00.489897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487625    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 16:08:00.489897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487628    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 16:08:00.489897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487631    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 16:08:00.489897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487634    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 16:08:00.489897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487636    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 16:08:00.489897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487639    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 16:08:00.489897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487641    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 16:08:00.489897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487644    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 16:08:00.489897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487646    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 16:08:00.489897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487649    2564 feature_gate.go:328] unrecognized feature gate: Example
May 28 16:08:00.489897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487651    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 16:08:00.489897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487655    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 16:08:00.489897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487658    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 16:08:00.489897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487660    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 16:08:00.489897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487663    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 16:08:00.489897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487666    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 16:08:00.489897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487668    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 16:08:00.489897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487671    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 16:08:00.489897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487673    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 16:08:00.489897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487676    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 16:08:00.490395 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487678    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 16:08:00.490395 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487680    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 16:08:00.490395 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.487685    2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 16:08:00.490395 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487785    2564 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 16:08:00.490395 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487790    2564 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 16:08:00.490395 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487792    2564 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 16:08:00.490395 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487795    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 16:08:00.490395 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487798    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 16:08:00.490395 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487801    2564 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 16:08:00.490395 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487804    2564 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 16:08:00.490395 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487807    2564 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 16:08:00.490395 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487809    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 16:08:00.490395 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487813    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 16:08:00.490395 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487816    2564 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 16:08:00.490395 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487837    2564 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 16:08:00.490395 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487841    2564 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 16:08:00.490793 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487845    2564 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 16:08:00.490793 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487848    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 16:08:00.490793 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487851    2564 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 16:08:00.490793 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487853    2564 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 16:08:00.490793 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487856    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 16:08:00.490793 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487859    2564 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 16:08:00.490793 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487861    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 16:08:00.490793 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487864    2564 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 16:08:00.490793 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487867    2564 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 16:08:00.490793 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487869    2564 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 16:08:00.490793 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487872    2564 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 16:08:00.490793 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487874    2564 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 16:08:00.490793 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487878    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 16:08:00.490793 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487880    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 16:08:00.490793 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487883    2564 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 16:08:00.490793 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487885    2564 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 16:08:00.490793 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487888    2564 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 16:08:00.490793 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487890    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 16:08:00.490793 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487893    2564 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 16:08:00.491257 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487895    2564 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 16:08:00.491257 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487897    2564 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 16:08:00.491257 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487901    2564 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 16:08:00.491257 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487905    2564 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 16:08:00.491257 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487909    2564 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 16:08:00.491257 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487911    2564 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 16:08:00.491257 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487914    2564 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 16:08:00.491257 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487917    2564 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 16:08:00.491257 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487920    2564 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 16:08:00.491257 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487923    2564 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 16:08:00.491257 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487926    2564 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 16:08:00.491257 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487929    2564 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 16:08:00.491257 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487932    2564 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 16:08:00.491257 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487934    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 16:08:00.491257 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487937    2564 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 16:08:00.491257 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487940    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 16:08:00.491257 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487942    2564 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 16:08:00.491257 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487945    2564 feature_gate.go:328] unrecognized feature gate: Example
May 28 16:08:00.491257 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487947    2564 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 16:08:00.491734 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487958    2564 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 16:08:00.491734 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487962    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 16:08:00.491734 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487965    2564 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 16:08:00.491734 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487967    2564 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 16:08:00.491734 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487969    2564 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 16:08:00.491734 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487972    2564 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 16:08:00.491734 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487974    2564 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 16:08:00.491734 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487978    2564 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 16:08:00.491734 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487981    2564 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 16:08:00.491734 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487983    2564 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 16:08:00.491734 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487986    2564 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 16:08:00.491734 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487988    2564 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 16:08:00.491734 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487991    2564 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 16:08:00.491734 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487993    2564 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 16:08:00.491734 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487996    2564 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 16:08:00.491734 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.487998    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 16:08:00.491734 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.488000    2564 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 16:08:00.491734 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.488003    2564 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 16:08:00.491734 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.488005    2564 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 16:08:00.491734 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.488008    2564 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 16:08:00.492216 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.488011    2564 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 16:08:00.492216 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.488014    2564 feature_gate.go:328] unrecognized feature gate: Example2
May 28 16:08:00.492216 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.488017    2564 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 16:08:00.492216 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.488019    2564 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 16:08:00.492216 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.488022    2564 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 16:08:00.492216 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.488025    2564 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 16:08:00.492216 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.488027    2564 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 16:08:00.492216 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.488030    2564 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 16:08:00.492216 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.488032    2564 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 16:08:00.492216 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.488035    2564 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 16:08:00.492216 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.488038    2564 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 16:08:00.492216 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.488040    2564 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 16:08:00.492216 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.488043    2564 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 16:08:00.492216 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.488045    2564 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 16:08:00.492216 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:00.488047    2564 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 16:08:00.492216 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.488052    2564 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 16:08:00.492642 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.488874    2564 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 16:08:00.492642 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.490816    2564 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 16:08:00.492642 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.491704    2564 server.go:1019] "Starting client certificate rotation"
May 28 16:08:00.492642 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.491801    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 16:08:00.492642 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.491850    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 16:08:00.515245 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.515223    2564 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 16:08:00.517217 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.517196    2564 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 16:08:00.533408 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.533380    2564 log.go:25] "Validated CRI v1 runtime API"
May 28 16:08:00.538207 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.538190    2564 log.go:25] "Validated CRI v1 image API"
May 28 16:08:00.539440 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.539418    2564 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 16:08:00.545444 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.545420    2564 fs.go:135] Filesystem UUIDs: map[3597a219-5607-4ff4-9700-1d3e2c9c9bcb:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 88e15052-5ab8-4dfe-a6dd-69c225687c59:/dev/nvme0n1p4]
May 28 16:08:00.545522 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.545443    2564 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 16:08:00.549842 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.549723    2564 manager.go:217] Machine: {Timestamp:2026-05-28 16:08:00.549218105 +0000 UTC m=+0.398695568 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3095301 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28f901c25840c482fc32f55228f6ca SystemUUID:ec28f901-c258-40c4-82fc-32f55228f6ca BootID:87c452c0-1e67-4bb5-8291-cd4bb245b168 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:3f:f2:d9:0d:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:3f:f2:d9:0d:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:26:f8:ee:5c:82 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 16:08:00.550639 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.550628    2564 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 16:08:00.550761 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.550750    2564 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 16:08:00.551775 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.551756    2564 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 16:08:00.552668 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.552645    2564 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 16:08:00.552806 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.552671    2564 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-51.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 16:08:00.552853 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.552817    2564 topology_manager.go:138] "Creating topology manager with none policy"
May 28 16:08:00.552853 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.552826    2564 container_manager_linux.go:306] "Creating device plugin manager"
May 28 16:08:00.552853 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.552833    2564 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 16:08:00.553628 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.553616    2564 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 16:08:00.555455 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.555444    2564 state_mem.go:36] "Initialized new in-memory state store"
May 28 16:08:00.555564 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.555555    2564 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 16:08:00.557893 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.557883    2564 kubelet.go:491] "Attempting to sync node with API server"
May 28 16:08:00.557935 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.557899    2564 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 16:08:00.557935 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.557910    2564 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 16:08:00.557935 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.557920    2564 kubelet.go:397] "Adding apiserver pod source"
May 28 16:08:00.557935 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.557928    2564 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 16:08:00.559033 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.559022    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 16:08:00.559069 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.559042    2564 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 16:08:00.564317 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.564292    2564 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 16:08:00.566025 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.566007    2564 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 16:08:00.566762 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.566749    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 16:08:00.566800 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.566769    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 16:08:00.566800 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.566775    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 16:08:00.566800 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.566780    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 16:08:00.566800 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.566788    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 16:08:00.566800 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.566796    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 16:08:00.566800 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.566801    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 16:08:00.566991 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.566807    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 16:08:00.566991 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.566814    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 16:08:00.566991 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.566820    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 16:08:00.566991 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.566835    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 16:08:00.567093 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.567001    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 16:08:00.567789 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.567776    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 16:08:00.567829 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.567790    2564 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 16:08:00.571108 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.571094    2564 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 16:08:00.571187 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.571133    2564 server.go:1295] "Started kubelet"
May 28 16:08:00.573224 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.573167    2564 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 16:08:00.573323 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.573245    2564 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 16:08:00.573406 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.573386    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-47vb6"
May 28 16:08:00.573505 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.573473    2564 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 16:08:00.574190 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.574172    2564 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 16:08:00.575022 ip-10-0-132-51 systemd[1]: Started Kubernetes Kubelet.
May 28 16:08:00.575960 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.575796    2564 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-51.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 16:08:00.576843 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.576826    2564 server.go:317] "Adding debug handlers to kubelet server"
May 28 16:08:00.580274 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.580250    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-47vb6"
May 28 16:08:00.581895 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:00.581855    2564 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-51.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 16:08:00.583319 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.583300    2564 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 16:08:00.583435 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.583320    2564 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 16:08:00.583519 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.583502    2564 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 16:08:00.583588 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.583521    2564 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 16:08:00.583588 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:00.583526    2564 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 16:08:00.583588 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.583571    2564 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 16:08:00.583720 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.583667    2564 reconstruct.go:97] "Volume reconstruction finished"
May 28 16:08:00.583720 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.583675    2564 reconciler.go:26] "Reconciler: start to sync state"
May 28 16:08:00.585728 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:00.584237    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-51.ec2.internal\" not found"
May 28 16:08:00.585728 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:00.585147    2564 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 16:08:00.585889 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.585866    2564 factory.go:55] Registering systemd factory
May 28 16:08:00.585941 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.585914    2564 factory.go:223] Registration of the systemd container factory successfully
May 28 16:08:00.586086 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:00.585245    2564 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-51.ec2.internal.18b3c6744e2626b4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-51.ec2.internal,UID:ip-10-0-132-51.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-51.ec2.internal,},FirstTimestamp:2026-05-28 16:08:00.571106996 +0000 UTC m=+0.420584460,LastTimestamp:2026-05-28 16:08:00.571106996 +0000 UTC m=+0.420584460,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-51.ec2.internal,}"
May 28 16:08:00.586200 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.586166    2564 factory.go:153] Registering CRI-O factory
May 28 16:08:00.586200 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.586177    2564 factory.go:223] Registration of the crio container factory successfully
May 28 16:08:00.586326 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.586227    2564 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 16:08:00.586326 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.586245    2564 factory.go:103] Registering Raw factory
May 28 16:08:00.586326 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.586255    2564 manager.go:1196] Started watching for new ooms in manager
May 28 16:08:00.586715 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.586703    2564 manager.go:319] Starting recovery of all containers
May 28 16:08:00.587880 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.587857    2564 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 16:08:00.592472 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:00.592448    2564 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-132-51.ec2.internal\" not found" node="ip-10-0-132-51.ec2.internal"
May 28 16:08:00.597057 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.597039    2564 manager.go:324] Recovery completed
May 28 16:08:00.598394 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:00.598376    2564 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
May 28 16:08:00.601119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.601103    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 16:08:00.603221 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.603207    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-51.ec2.internal" event="NodeHasSufficientMemory"
May 28 16:08:00.603299 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.603238    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-51.ec2.internal" event="NodeHasNoDiskPressure"
May 28 16:08:00.603299 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.603255    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-51.ec2.internal" event="NodeHasSufficientPID"
May 28 16:08:00.603981 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.603963    2564 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 16:08:00.604089 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.604076    2564 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 16:08:00.604181 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.604173    2564 state_mem.go:36] "Initialized new in-memory state store"
May 28 16:08:00.606865 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.606846    2564 policy_none.go:49] "None policy: Start"
May 28 16:08:00.606865 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.606869    2564 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 16:08:00.606978 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.606881    2564 state_mem.go:35] "Initializing new in-memory state store"
May 28 16:08:00.646969 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.646955    2564 manager.go:341] "Starting Device Plugin manager"
May 28 16:08:00.669308 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:00.646986    2564 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 16:08:00.669308 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.646996    2564 server.go:85] "Starting device plugin registration server"
May 28 16:08:00.669308 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.647214    2564 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 16:08:00.669308 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.647224    2564 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 16:08:00.669308 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.647297    2564 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 16:08:00.669308 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.647404    2564 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 16:08:00.669308 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.647412    2564 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 16:08:00.669308 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:00.647962    2564 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 16:08:00.669308 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:00.647999    2564 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-51.ec2.internal\" not found"
May 28 16:08:00.717389 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.717340    2564 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 16:08:00.718620 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.718602    2564 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 16:08:00.718697 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.718641    2564 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 16:08:00.718697 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.718666    2564 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 16:08:00.718697 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.718676    2564 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 16:08:00.718799 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:00.718772    2564 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 16:08:00.720964 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.720947    2564 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 16:08:00.748334 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.748283    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 16:08:00.749226 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.749208    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-51.ec2.internal" event="NodeHasSufficientMemory"
May 28 16:08:00.749305 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.749240    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-51.ec2.internal" event="NodeHasNoDiskPressure"
May 28 16:08:00.749305 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.749251    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-51.ec2.internal" event="NodeHasSufficientPID"
May 28 16:08:00.749305 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.749280    2564 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-51.ec2.internal"
May 28 16:08:00.759928 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.759913    2564 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-51.ec2.internal"
May 28 16:08:00.759982 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:00.759936    2564 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-51.ec2.internal\": node \"ip-10-0-132-51.ec2.internal\" not found"
May 28 16:08:00.786256 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:00.786232    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-51.ec2.internal\" not found"
May 28 16:08:00.819469 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.819436    2564 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-51.ec2.internal"]
May 28 16:08:00.819551 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.819527    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 16:08:00.820444 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.820426    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-51.ec2.internal" event="NodeHasSufficientMemory"
May 28 16:08:00.820524 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.820455    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-51.ec2.internal" event="NodeHasNoDiskPressure"
May 28 16:08:00.820524 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.820467    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-51.ec2.internal" event="NodeHasSufficientPID"
May 28 16:08:00.821652 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.821641    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 16:08:00.821817 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.821804    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal"
May 28 16:08:00.821863 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.821833    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 16:08:00.822348 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.822332    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-51.ec2.internal" event="NodeHasSufficientMemory"
May 28 16:08:00.822442 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.822382    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-51.ec2.internal" event="NodeHasNoDiskPressure"
May 28 16:08:00.822442 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.822395    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-51.ec2.internal" event="NodeHasSufficientPID"
May 28 16:08:00.822442 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.822341    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-51.ec2.internal" event="NodeHasSufficientMemory"
May 28 16:08:00.822442 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.822429    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-51.ec2.internal" event="NodeHasNoDiskPressure"
May 28 16:08:00.822442 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.822442    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-51.ec2.internal" event="NodeHasSufficientPID"
May 28 16:08:00.823545 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.823530    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-51.ec2.internal"
May 28 16:08:00.823643 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.823552    2564 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 16:08:00.824191 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.824176    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-51.ec2.internal" event="NodeHasSufficientMemory"
May 28 16:08:00.824259 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.824206    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-51.ec2.internal" event="NodeHasNoDiskPressure"
May 28 16:08:00.824259 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.824220    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-51.ec2.internal" event="NodeHasSufficientPID"
May 28 16:08:00.853025 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:00.853000    2564 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-51.ec2.internal\" not found" node="ip-10-0-132-51.ec2.internal"
May 28 16:08:00.857704 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:00.857689    2564 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-51.ec2.internal\" not found" node="ip-10-0-132-51.ec2.internal"
May 28 16:08:00.885778 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.885757    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25b328cb538d5b99ecc3bf8d29f6e7da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal\" (UID: \"25b328cb538d5b99ecc3bf8d29f6e7da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal"
May 28 16:08:00.885853 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.885781    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c3213005fe92cc589ac3dd8a192c485-config\") pod \"kube-apiserver-proxy-ip-10-0-132-51.ec2.internal\" (UID: \"9c3213005fe92cc589ac3dd8a192c485\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-51.ec2.internal"
May 28 16:08:00.885853 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.885804    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/25b328cb538d5b99ecc3bf8d29f6e7da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal\" (UID: \"25b328cb538d5b99ecc3bf8d29f6e7da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal"
May 28 16:08:00.886783 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:00.886767    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-51.ec2.internal\" not found"
May 28 16:08:00.986302 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.986268    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/25b328cb538d5b99ecc3bf8d29f6e7da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal\" (UID: \"25b328cb538d5b99ecc3bf8d29f6e7da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal"
May 28 16:08:00.986302 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.986302    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25b328cb538d5b99ecc3bf8d29f6e7da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal\" (UID: \"25b328cb538d5b99ecc3bf8d29f6e7da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal"
May 28 16:08:00.986524 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.986323    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c3213005fe92cc589ac3dd8a192c485-config\") pod \"kube-apiserver-proxy-ip-10-0-132-51.ec2.internal\" (UID: \"9c3213005fe92cc589ac3dd8a192c485\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-51.ec2.internal"
May 28 16:08:00.986524 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.986392    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25b328cb538d5b99ecc3bf8d29f6e7da-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal\" (UID: \"25b328cb538d5b99ecc3bf8d29f6e7da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal"
May 28 16:08:00.986524 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.986407    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/25b328cb538d5b99ecc3bf8d29f6e7da-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal\" (UID: \"25b328cb538d5b99ecc3bf8d29f6e7da\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal"
May 28 16:08:00.986524 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:00.986445    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/9c3213005fe92cc589ac3dd8a192c485-config\") pod \"kube-apiserver-proxy-ip-10-0-132-51.ec2.internal\" (UID: \"9c3213005fe92cc589ac3dd8a192c485\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-51.ec2.internal"
May 28 16:08:00.987293 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:00.987277    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-51.ec2.internal\" not found"
May 28 16:08:01.088061 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:01.087976    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-51.ec2.internal\" not found"
May 28 16:08:01.155163 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:01.155137    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal"
May 28 16:08:01.159955 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:01.159933    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-51.ec2.internal"
May 28 16:08:01.188235 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:01.188209    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-51.ec2.internal\" not found"
May 28 16:08:01.288665 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:01.288625    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-51.ec2.internal\" not found"
May 28 16:08:01.389117 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:01.389055    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-51.ec2.internal\" not found"
May 28 16:08:01.489510 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:01.489477    2564 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-132-51.ec2.internal\" not found"
May 28 16:08:01.491629 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:01.491611    2564 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 16:08:01.491778 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:01.491762    2564 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 16:08:01.491816 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:01.491791    2564 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 16:08:01.559789 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:01.559762    2564 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 16:08:01.559980 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:01.559943    2564 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 16:08:01.583128 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:01.582958    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 16:03:00 +0000 UTC" deadline="2027-11-02 23:24:45.333040887 +0000 UTC"
May 28 16:08:01.583128 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:01.583120    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12559h16m43.749925073s"
May 28 16:08:01.583520 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:01.583503    2564 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 16:08:01.583947 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:01.583922    2564 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal"
May 28 16:08:01.592272 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:01.592255    2564 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 16:08:01.594000 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:01.593981    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 16:08:01.594996 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:01.594981    2564 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-51.ec2.internal"
May 28 16:08:01.602659 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:01.602638    2564 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 16:08:01.615406 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:01.615388    2564 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-stcgl"
May 28 16:08:01.620249 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:01.620224    2564 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-stcgl"
May 28 16:08:01.622067 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:01.622045    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25b328cb538d5b99ecc3bf8d29f6e7da.slice/crio-7f075ca8aaf4ae404171a5fab263c73919b9c4ff6c537a14dcad23a033f4616e WatchSource:0}: Error finding container 7f075ca8aaf4ae404171a5fab263c73919b9c4ff6c537a14dcad23a033f4616e: Status 404 returned error can't find the container with id 7f075ca8aaf4ae404171a5fab263c73919b9c4ff6c537a14dcad23a033f4616e
May 28 16:08:01.622238 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:01.622221    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c3213005fe92cc589ac3dd8a192c485.slice/crio-da0d9c7ecb0219a5adb61f2ec5c883fb2a09efa1e02759d164d3105aaf017567 WatchSource:0}: Error finding container da0d9c7ecb0219a5adb61f2ec5c883fb2a09efa1e02759d164d3105aaf017567: Status 404 returned error can't find the container with id da0d9c7ecb0219a5adb61f2ec5c883fb2a09efa1e02759d164d3105aaf017567
May 28 16:08:01.625980 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:01.625962    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 16:08:01.721601 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:01.721469    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-51.ec2.internal" event={"ID":"9c3213005fe92cc589ac3dd8a192c485","Type":"ContainerStarted","Data":"da0d9c7ecb0219a5adb61f2ec5c883fb2a09efa1e02759d164d3105aaf017567"}
May 28 16:08:01.722300 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:01.722282    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal" event={"ID":"25b328cb538d5b99ecc3bf8d29f6e7da","Type":"ContainerStarted","Data":"7f075ca8aaf4ae404171a5fab263c73919b9c4ff6c537a14dcad23a033f4616e"}
May 28 16:08:02.558709 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.558676    2564 apiserver.go:52] "Watching apiserver"
May 28 16:08:02.565721 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.565693    2564 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 16:08:02.566141 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.566112    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-z7k9v","kube-system/konnectivity-agent-f78ms","kube-system/kube-apiserver-proxy-ip-10-0-132-51.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9","openshift-multus/network-metrics-daemon-r5nt6","openshift-network-operator/iptables-alerter-bjpfd","openshift-ovn-kubernetes/ovnkube-node-z9v5g","openshift-cluster-node-tuning-operator/tuned-6h8fn","openshift-dns/node-resolver-26bgl","openshift-image-registry/node-ca-9xbl7","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal","openshift-multus/multus-additional-cni-plugins-bh5p5","openshift-multus/multus-chd8b"]
May 28 16:08:02.569823 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.569802    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.570916 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.570807    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f78ms"
May 28 16:08:02.571001 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.570915    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.572489 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.572271    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:02.572489 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:02.572348    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r5nt6" podUID="8e0f7bc7-0a1e-481f-a720-52a99554e9d6"
May 28 16:08:02.572813 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.572791    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 16:08:02.572963 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.572947    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 16:08:02.573135 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.573117    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-dk4bg\""
May 28 16:08:02.573280 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.573265    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 16:08:02.573331 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.573308    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 16:08:02.573553 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.573535    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 16:08:02.573635 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.573573    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 16:08:02.573689 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.573535    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 16:08:02.574136 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.573971    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 16:08:02.574136 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.573981    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-hsqpg\""
May 28 16:08:02.574136 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.573993    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cwgrq\""
May 28 16:08:02.574136 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.573999    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 16:08:02.574136 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.574013    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 16:08:02.574470 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.574290    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 16:08:02.577188 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.576864    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:02.577188 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:02.576941    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7k9v" podUID="a3520fd9-ca91-42b2-a5bb-94ec4ae75e84"
May 28 16:08:02.579061 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.578476    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.580548 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.579952    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-26bgl"
May 28 16:08:02.580548 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.580236    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bjpfd"
May 28 16:08:02.581058 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.580828    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 16:08:02.581058 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.580878    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-m6dcz\""
May 28 16:08:02.581543 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.581335    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 16:08:02.581662 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.581652    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9xbl7"
May 28 16:08:02.581966 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.581945    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 16:08:02.582433 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.582412    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-9tnsc\""
May 28 16:08:02.582597 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.582580    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 16:08:02.582863 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.582842    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qr5xr\""
May 28 16:08:02.583048 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.583016    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 16:08:02.583048 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.583043    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 16:08:02.583290 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.583276    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 16:08:02.583390 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.583325    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.584259 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.584243    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wz8ms\""
May 28 16:08:02.585479 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.584943    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-chd8b"
May 28 16:08:02.585479 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.584956    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 16:08:02.585479 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.584985    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 16:08:02.585479 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.585175    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 16:08:02.585479 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.585320    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 16:08:02.585751 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.585527    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 16:08:02.586000 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.585984    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-zjpsj\""
May 28 16:08:02.586064 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.586010    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 16:08:02.586491 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.586474    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 16:08:02.586591 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.586576    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 16:08:02.587185 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.587167    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 16:08:02.587271 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.587251    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kfl7p\""
May 28 16:08:02.594953 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.594929    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-var-lib-openvswitch\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.595055 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.594971    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-tmp\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.595055 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.594998    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s84jk\" (UniqueName: \"kubernetes.io/projected/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-kube-api-access-s84jk\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.595055 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595027    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-cni-binary-copy\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.595222 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595050    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.595222 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595085    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-socket-dir\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.595222 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595110    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsgt9\" (UniqueName: \"kubernetes.io/projected/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-kube-api-access-wsgt9\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.595222 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595133    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-sysctl-conf\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.595222 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595157    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-cnibin\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.595222 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595178    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-kubelet\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.595222 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595202    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-cni-netd\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.595530 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595225    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/69c4cd92-d370-4093-8058-5d1a06d7b9a4-iptables-alerter-script\") pod \"iptables-alerter-bjpfd\" (UID: \"69c4cd92-d370-4093-8058-5d1a06d7b9a4\") " pod="openshift-network-operator/iptables-alerter-bjpfd"
May 28 16:08:02.595530 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595251    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-host-run-multus-certs\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.595530 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595281    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ddd1f6a7-f065-4ad6-8898-938565dbb25f-ovnkube-script-lib\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.595530 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595303    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-device-dir\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.595530 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595326    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-sysctl-d\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.595530 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595349    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a60f68cf-b6ec-4d94-bab6-0f8bb7e81610-tmp-dir\") pod \"node-resolver-26bgl\" (UID: \"a60f68cf-b6ec-4d94-bab6-0f8bb7e81610\") " pod="openshift-dns/node-resolver-26bgl"
May 28 16:08:02.595530 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595403    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-sysconfig\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.595530 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595425    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9805051e-ef8c-4375-960a-e649c08d76a7-serviceca\") pod \"node-ca-9xbl7\" (UID: \"9805051e-ef8c-4375-960a-e649c08d76a7\") " pod="openshift-image-registry/node-ca-9xbl7"
May 28 16:08:02.595530 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595447    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d94k\" (UniqueName: \"kubernetes.io/projected/9805051e-ef8c-4375-960a-e649c08d76a7-kube-api-access-6d94k\") pod \"node-ca-9xbl7\" (UID: \"9805051e-ef8c-4375-960a-e649c08d76a7\") " pod="openshift-image-registry/node-ca-9xbl7"
May 28 16:08:02.595530 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-run-systemd\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.595530 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595508    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-registration-dir\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.595840 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595541    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-run-netns\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.595840 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595565    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.595840 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595588    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-modprobe-d\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.595840 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595612    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-systemd\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.595840 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595635    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-host\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.595840 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-multus-cni-dir\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.595840 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595681    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c5d4322-4460-4d6c-b66e-303db736b0ca-cni-binary-copy\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.595840 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595714    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.595840 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595754    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs\") pod \"network-metrics-daemon-r5nt6\" (UID: \"8e0f7bc7-0a1e-481f-a720-52a99554e9d6\") " pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:02.595840 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595780    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9805051e-ef8c-4375-960a-e649c08d76a7-host\") pod \"node-ca-9xbl7\" (UID: \"9805051e-ef8c-4375-960a-e649c08d76a7\") " pod="openshift-image-registry/node-ca-9xbl7"
May 28 16:08:02.595840 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595814    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69c4cd92-d370-4093-8058-5d1a06d7b9a4-host-slash\") pod \"iptables-alerter-bjpfd\" (UID: \"69c4cd92-d370-4093-8058-5d1a06d7b9a4\") " pod="openshift-network-operator/iptables-alerter-bjpfd"
May 28 16:08:02.595840 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595838    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfz9j\" (UniqueName: \"kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j\") pod \"network-check-target-z7k9v\" (UID: \"a3520fd9-ca91-42b2-a5bb-94ec4ae75e84\") " pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:02.596232 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595864    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-os-release\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.596232 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595890    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-host-var-lib-cni-multus\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.596232 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595915    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ddd1f6a7-f065-4ad6-8898-938565dbb25f-ovnkube-config\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.596232 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.595975    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8bd98251-309e-42f9-a284-3bb58d1e3e37-agent-certs\") pod \"konnectivity-agent-f78ms\" (UID: \"8bd98251-309e-42f9-a284-3bb58d1e3e37\") " pod="kube-system/konnectivity-agent-f78ms"
May 28 16:08:02.596232 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596021    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-multus-socket-dir-parent\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.596232 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596047    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnbb7\" (UniqueName: \"kubernetes.io/projected/8c5d4322-4460-4d6c-b66e-303db736b0ca-kube-api-access-cnbb7\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.596232 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596071    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-run-ovn\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.596232 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596096    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-slash\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.596232 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596119    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-cnibin\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.596232 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596145    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bg82\" (UniqueName: \"kubernetes.io/projected/69c4cd92-d370-4093-8058-5d1a06d7b9a4-kube-api-access-9bg82\") pod \"iptables-alerter-bjpfd\" (UID: \"69c4cd92-d370-4093-8058-5d1a06d7b9a4\") " pod="openshift-network-operator/iptables-alerter-bjpfd"
May 28 16:08:02.596232 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596168    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-var-lib-kubelet\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.596232 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596191    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-host-run-k8s-cni-cncf-io\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.596232 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596207    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ddd1f6a7-f065-4ad6-8898-938565dbb25f-env-overrides\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.596232 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596221    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ln47\" (UniqueName: \"kubernetes.io/projected/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-kube-api-access-2ln47\") pod \"network-metrics-daemon-r5nt6\" (UID: \"8e0f7bc7-0a1e-481f-a720-52a99554e9d6\") " pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:02.596796 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596238    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8bd98251-309e-42f9-a284-3bb58d1e3e37-konnectivity-ca\") pod \"konnectivity-agent-f78ms\" (UID: \"8bd98251-309e-42f9-a284-3bb58d1e3e37\") " pod="kube-system/konnectivity-agent-f78ms"
May 28 16:08:02.596796 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596253    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a60f68cf-b6ec-4d94-bab6-0f8bb7e81610-hosts-file\") pod \"node-resolver-26bgl\" (UID: \"a60f68cf-b6ec-4d94-bab6-0f8bb7e81610\") " pod="openshift-dns/node-resolver-26bgl"
May 28 16:08:02.596796 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596269    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-etc-openvswitch\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.596796 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596284    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.596796 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596299    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.596796 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596314    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-tuned\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.596796 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596328    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-host-var-lib-kubelet\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.596796 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596342    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c5d4322-4460-4d6c-b66e-303db736b0ca-multus-daemon-config\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.596796 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596374    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-etc-selinux\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.596796 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596400    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-kubernetes\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.596796 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596426    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49nn8\" (UniqueName: \"kubernetes.io/projected/ddd1f6a7-f065-4ad6-8898-938565dbb25f-kube-api-access-49nn8\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.596796 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596445    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-log-socket\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.596796 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596466    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-cni-bin\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.596796 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596490    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-system-cni-dir\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.596796 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596515    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-sys\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.596796 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596539    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-lib-modules\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.597428 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596562    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-systemd-units\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.597428 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596580    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-node-log\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.597428 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596606    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc7tp\" (UniqueName: \"kubernetes.io/projected/a60f68cf-b6ec-4d94-bab6-0f8bb7e81610-kube-api-access-nc7tp\") pod \"node-resolver-26bgl\" (UID: \"a60f68cf-b6ec-4d94-bab6-0f8bb7e81610\") " pod="openshift-dns/node-resolver-26bgl"
May 28 16:08:02.597428 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596658    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-host-run-netns\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.597428 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596682    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-host-var-lib-cni-bin\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.597428 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596705    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-multus-conf-dir\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.597428 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596746    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-run-openvswitch\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.597428 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-run-ovn-kubernetes\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.597428 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596860    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-system-cni-dir\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.597428 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596917    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-hostroot\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.597428 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596936    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-etc-kubernetes\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.597428 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.596976    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-os-release\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.597428 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.597048    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jtkt\" (UniqueName: \"kubernetes.io/projected/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-kube-api-access-6jtkt\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.597428 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.597117    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-sys-fs\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.597428 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.597141    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-run\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.597428 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.597159    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ddd1f6a7-f065-4ad6-8898-938565dbb25f-ovn-node-metrics-cert\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.607543 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.607526    2564 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 16:08:02.620836 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.620807    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 16:03:01 +0000 UTC" deadline="2028-01-01 23:54:04.336254639 +0000 UTC"
May 28 16:08:02.620836 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.620832    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13999h46m1.715426892s"
May 28 16:08:02.684963 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.684938    2564 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 16:08:02.697657 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697629    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-log-socket\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.697789 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697666    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-cni-bin\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.697789 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697687    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-system-cni-dir\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.697789 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697705    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-sys\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.697789 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697732    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-lib-modules\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.697789 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697751    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-log-socket\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.697789 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697766    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-cni-bin\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.697789 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697756    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-systemd-units\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.698119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697783    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-system-cni-dir\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.698119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697810    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-node-log\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.698119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697836    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nc7tp\" (UniqueName: \"kubernetes.io/projected/a60f68cf-b6ec-4d94-bab6-0f8bb7e81610-kube-api-access-nc7tp\") pod \"node-resolver-26bgl\" (UID: \"a60f68cf-b6ec-4d94-bab6-0f8bb7e81610\") " pod="openshift-dns/node-resolver-26bgl"
May 28 16:08:02.698119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697839    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-node-log\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.698119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697836    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-sys\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.698119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697857    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-host-run-netns\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.698119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697879    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-host-var-lib-cni-bin\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.698119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697904    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-multus-conf-dir\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.698119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697792    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-systemd-units\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.698119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697929    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-run-openvswitch\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.698119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697953    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-run-ovn-kubernetes\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.698119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697957    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-host-run-netns\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.698119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697959    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-host-var-lib-cni-bin\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.698119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697913    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-lib-modules\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.698119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.697977    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-system-cni-dir\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.698119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698008    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-run-openvswitch\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.698119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698010    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-run-ovn-kubernetes\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.698119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698030    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-system-cni-dir\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.698940 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698061    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-hostroot\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.698940 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698030    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-hostroot\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.698940 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698064    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-multus-conf-dir\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.698940 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698096    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-etc-kubernetes\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.698940 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698117    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-os-release\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.698940 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698133    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6jtkt\" (UniqueName: \"kubernetes.io/projected/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-kube-api-access-6jtkt\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.698940 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698177    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-etc-kubernetes\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.698940 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698191    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-sys-fs\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.698940 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698241    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-run\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.698940 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698207    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-os-release\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.698940 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698244    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-sys-fs\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.698940 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698269    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ddd1f6a7-f065-4ad6-8898-938565dbb25f-ovn-node-metrics-cert\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.698940 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698303    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-var-lib-openvswitch\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.698940 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698326    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-tmp\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.698940 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698406    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-run\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.698940 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698374    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s84jk\" (UniqueName: \"kubernetes.io/projected/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-kube-api-access-s84jk\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.698940 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698430    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-var-lib-openvswitch\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.698940 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698456    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-cni-binary-copy\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.699768 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698482    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.699768 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698507    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-socket-dir\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.699768 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698529    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wsgt9\" (UniqueName: \"kubernetes.io/projected/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-kube-api-access-wsgt9\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.699768 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698551    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-sysctl-conf\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.699768 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698573    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-cnibin\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.699768 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698595    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-kubelet\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.699768 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698604    2564 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 16:08:02.699768 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698619    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-cni-netd\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.699768 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698644    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/69c4cd92-d370-4093-8058-5d1a06d7b9a4-iptables-alerter-script\") pod \"iptables-alerter-bjpfd\" (UID: \"69c4cd92-d370-4093-8058-5d1a06d7b9a4\") " pod="openshift-network-operator/iptables-alerter-bjpfd"
May 28 16:08:02.699768 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698670    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-host-run-multus-certs\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.699768 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698688    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-cnibin\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.699768 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698695    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ddd1f6a7-f065-4ad6-8898-938565dbb25f-ovnkube-script-lib\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.699768 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.698735    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-device-dir\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.699768 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.699642    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ddd1f6a7-f065-4ad6-8898-938565dbb25f-ovnkube-script-lib\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.703545 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.703516    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-sysctl-d\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.703650 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.703601    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-device-dir\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.703650 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.703625    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.703752 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.703663    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-sysctl-d\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.703752 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.703698    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a60f68cf-b6ec-4d94-bab6-0f8bb7e81610-tmp-dir\") pod \"node-resolver-26bgl\" (UID: \"a60f68cf-b6ec-4d94-bab6-0f8bb7e81610\") " pod="openshift-dns/node-resolver-26bgl"
May 28 16:08:02.703752 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.703724    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-sysconfig\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.703835 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.703762    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9805051e-ef8c-4375-960a-e649c08d76a7-serviceca\") pod \"node-ca-9xbl7\" (UID: \"9805051e-ef8c-4375-960a-e649c08d76a7\") " pod="openshift-image-registry/node-ca-9xbl7"
May 28 16:08:02.703835 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.703793    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6d94k\" (UniqueName: \"kubernetes.io/projected/9805051e-ef8c-4375-960a-e649c08d76a7-kube-api-access-6d94k\") pod \"node-ca-9xbl7\" (UID: \"9805051e-ef8c-4375-960a-e649c08d76a7\") " pod="openshift-image-registry/node-ca-9xbl7"
May 28 16:08:02.703835 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.703824    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-run-systemd\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.703956 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.703853    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-registration-dir\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.703956 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.703877    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-run-netns\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.703956 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.703909    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.703956 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.703939    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-modprobe-d\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.704064 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.703969    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-systemd\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.704064 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.703996    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-host\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.704064 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704021    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-multus-cni-dir\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.704064 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704051    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c5d4322-4460-4d6c-b66e-303db736b0ca-cni-binary-copy\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.704169 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704083    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.704169 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704115    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs\") pod \"network-metrics-daemon-r5nt6\" (UID: \"8e0f7bc7-0a1e-481f-a720-52a99554e9d6\") " pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:02.704169 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704144    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9805051e-ef8c-4375-960a-e649c08d76a7-host\") pod \"node-ca-9xbl7\" (UID: \"9805051e-ef8c-4375-960a-e649c08d76a7\") " pod="openshift-image-registry/node-ca-9xbl7"
May 28 16:08:02.704251 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704168    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69c4cd92-d370-4093-8058-5d1a06d7b9a4-host-slash\") pod \"iptables-alerter-bjpfd\" (UID: \"69c4cd92-d370-4093-8058-5d1a06d7b9a4\") " pod="openshift-network-operator/iptables-alerter-bjpfd"
May 28 16:08:02.704251 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704201    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfz9j\" (UniqueName: \"kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j\") pod \"network-check-target-z7k9v\" (UID: \"a3520fd9-ca91-42b2-a5bb-94ec4ae75e84\") " pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:02.704251 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704231    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-os-release\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.704330 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704262    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-host-var-lib-cni-multus\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.704330 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704291    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ddd1f6a7-f065-4ad6-8898-938565dbb25f-ovnkube-config\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.704330 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704317    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8bd98251-309e-42f9-a284-3bb58d1e3e37-agent-certs\") pod \"konnectivity-agent-f78ms\" (UID: \"8bd98251-309e-42f9-a284-3bb58d1e3e37\") " pod="kube-system/konnectivity-agent-f78ms"
May 28 16:08:02.704469 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704347    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-multus-socket-dir-parent\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.704469 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704397    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cnbb7\" (UniqueName: \"kubernetes.io/projected/8c5d4322-4460-4d6c-b66e-303db736b0ca-kube-api-access-cnbb7\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.704469 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704457    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-run-ovn\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.704565 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704490    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-slash\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.704565 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704498    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-socket-dir\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.704565 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704518    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-cnibin\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.704668 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704569    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-cnibin\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.704668 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704573    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9bg82\" (UniqueName: \"kubernetes.io/projected/69c4cd92-d370-4093-8058-5d1a06d7b9a4-kube-api-access-9bg82\") pod \"iptables-alerter-bjpfd\" (UID: \"69c4cd92-d370-4093-8058-5d1a06d7b9a4\") " pod="openshift-network-operator/iptables-alerter-bjpfd"
May 28 16:08:02.704668 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704608    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-var-lib-kubelet\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.704668 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704658    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-host-run-k8s-cni-cncf-io\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.704777 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704693    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ddd1f6a7-f065-4ad6-8898-938565dbb25f-env-overrides\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.704777 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704729    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2ln47\" (UniqueName: \"kubernetes.io/projected/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-kube-api-access-2ln47\") pod \"network-metrics-daemon-r5nt6\" (UID: \"8e0f7bc7-0a1e-481f-a720-52a99554e9d6\") " pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:02.704777 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704762    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8bd98251-309e-42f9-a284-3bb58d1e3e37-konnectivity-ca\") pod \"konnectivity-agent-f78ms\" (UID: \"8bd98251-309e-42f9-a284-3bb58d1e3e37\") " pod="kube-system/konnectivity-agent-f78ms"
May 28 16:08:02.704881 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704790    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a60f68cf-b6ec-4d94-bab6-0f8bb7e81610-hosts-file\") pod \"node-resolver-26bgl\" (UID: \"a60f68cf-b6ec-4d94-bab6-0f8bb7e81610\") " pod="openshift-dns/node-resolver-26bgl"
May 28 16:08:02.704881 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704823    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-etc-openvswitch\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.704881 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704841    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a60f68cf-b6ec-4d94-bab6-0f8bb7e81610-tmp-dir\") pod \"node-resolver-26bgl\" (UID: \"a60f68cf-b6ec-4d94-bab6-0f8bb7e81610\") " pod="openshift-dns/node-resolver-26bgl"
May 28 16:08:02.704881 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704858    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.704990 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704941    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-var-lib-kubelet\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.705037 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704991    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-tuning-conf-dir\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.705308 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.705286    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-sysctl-conf\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.705419 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.704998    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-host-run-k8s-cni-cncf-io\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.705710 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.705682    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-host-run-multus-certs\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.705818 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.705754    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9805051e-ef8c-4375-960a-e649c08d76a7-host\") pod \"node-ca-9xbl7\" (UID: \"9805051e-ef8c-4375-960a-e649c08d76a7\") " pod="openshift-image-registry/node-ca-9xbl7"
May 28 16:08:02.705818 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.705808    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-systemd\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.705937 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.705830    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-modprobe-d\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.705937 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.705854    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ddd1f6a7-f065-4ad6-8898-938565dbb25f-env-overrides\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.705937 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.705857    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-host\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.705937 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.705900    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-run-systemd\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.705937 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.705901    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/69c4cd92-d370-4093-8058-5d1a06d7b9a4-host-slash\") pod \"iptables-alerter-bjpfd\" (UID: \"69c4cd92-d370-4093-8058-5d1a06d7b9a4\") " pod="openshift-network-operator/iptables-alerter-bjpfd"
May 28 16:08:02.705937 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.705911    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-multus-cni-dir\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.706264 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.705975    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-registration-dir\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.706264 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.705987    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/8bd98251-309e-42f9-a284-3bb58d1e3e37-konnectivity-ca\") pod \"konnectivity-agent-f78ms\" (UID: \"8bd98251-309e-42f9-a284-3bb58d1e3e37\") " pod="kube-system/konnectivity-agent-f78ms"
May 28 16:08:02.706264 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.706013    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-run-netns\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.706264 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.706136    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/69c4cd92-d370-4093-8058-5d1a06d7b9a4-iptables-alerter-script\") pod \"iptables-alerter-bjpfd\" (UID: \"69c4cd92-d370-4093-8058-5d1a06d7b9a4\") " pod="openshift-network-operator/iptables-alerter-bjpfd"
May 28 16:08:02.706264 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.706150    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-os-release\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.706264 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.706202    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-host-var-lib-cni-multus\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.706264 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.706215    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-kubelet\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.706264 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.706262    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-cni-netd\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.706659 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.706524    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8c5d4322-4460-4d6c-b66e-303db736b0ca-cni-binary-copy\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.706659 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.706542    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.706659 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.706593    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-sysconfig\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.707605 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.706947    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-run-ovn\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.707605 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.706977    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a60f68cf-b6ec-4d94-bab6-0f8bb7e81610-hosts-file\") pod \"node-resolver-26bgl\" (UID: \"a60f68cf-b6ec-4d94-bab6-0f8bb7e81610\") " pod="openshift-dns/node-resolver-26bgl"
May 28 16:08:02.707605 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.707021    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.707605 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.707044    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-etc-openvswitch\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.707605 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.707084    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.707605 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:02.707093    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:08:02.707605 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:02.707210    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs podName:8e0f7bc7-0a1e-481f-a720-52a99554e9d6 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:03.207154791 +0000 UTC m=+3.056632261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs") pod "network-metrics-daemon-r5nt6" (UID: "8e0f7bc7-0a1e-481f-a720-52a99554e9d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:08:02.707605 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.707298    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-tuned\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.707605 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.707606    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-host-var-lib-kubelet\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.708084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.707644    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c5d4322-4460-4d6c-b66e-303db736b0ca-multus-daemon-config\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.708084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.707694    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-etc-selinux\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.708084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.707724    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-kubernetes\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.708084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.707743    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-multus-socket-dir-parent\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.708084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.707815    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49nn8\" (UniqueName: \"kubernetes.io/projected/ddd1f6a7-f065-4ad6-8898-938565dbb25f-kube-api-access-49nn8\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.708322 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.708166    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-kubernetes\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.708322 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.708202    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9805051e-ef8c-4375-960a-e649c08d76a7-serviceca\") pod \"node-ca-9xbl7\" (UID: \"9805051e-ef8c-4375-960a-e649c08d76a7\") " pod="openshift-image-registry/node-ca-9xbl7"
May 28 16:08:02.708452 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.708438    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ddd1f6a7-f065-4ad6-8898-938565dbb25f-ovnkube-config\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.708530 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.708513    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8c5d4322-4460-4d6c-b66e-303db736b0ca-host-var-lib-kubelet\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.708606 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.708556    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ddd1f6a7-f065-4ad6-8898-938565dbb25f-host-slash\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.708961 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.708936    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-tmp\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.709040 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.708971    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.709093 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.709056    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-etc-selinux\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.709515 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.709458    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8c5d4322-4460-4d6c-b66e-303db736b0ca-multus-daemon-config\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.709777 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.709756    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsgt9\" (UniqueName: \"kubernetes.io/projected/d2bb212b-20e4-45d8-9caf-b70f68e8fc83-kube-api-access-wsgt9\") pod \"aws-ebs-csi-driver-node-zlfr9\" (UID: \"d2bb212b-20e4-45d8-9caf-b70f68e8fc83\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.710230 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.710208    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s84jk\" (UniqueName: \"kubernetes.io/projected/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-kube-api-access-s84jk\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.710308 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.710209    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc7tp\" (UniqueName: \"kubernetes.io/projected/a60f68cf-b6ec-4d94-bab6-0f8bb7e81610-kube-api-access-nc7tp\") pod \"node-resolver-26bgl\" (UID: \"a60f68cf-b6ec-4d94-bab6-0f8bb7e81610\") " pod="openshift-dns/node-resolver-26bgl"
May 28 16:08:02.710865 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.710844    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-cni-binary-copy\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.711879 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.711663    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/8bd98251-309e-42f9-a284-3bb58d1e3e37-agent-certs\") pod \"konnectivity-agent-f78ms\" (UID: \"8bd98251-309e-42f9-a284-3bb58d1e3e37\") " pod="kube-system/konnectivity-agent-f78ms"
May 28 16:08:02.711879 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.711839    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/8c5f269e-650f-4527-a7fd-5dd9c764f7a1-etc-tuned\") pod \"tuned-6h8fn\" (UID: \"8c5f269e-650f-4527-a7fd-5dd9c764f7a1\") " pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.712846 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.712824    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ddd1f6a7-f065-4ad6-8898-938565dbb25f-ovn-node-metrics-cert\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.714086 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.714058    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jtkt\" (UniqueName: \"kubernetes.io/projected/3bca20c9-0f2d-4f5f-81b0-b26a90596b08-kube-api-access-6jtkt\") pod \"multus-additional-cni-plugins-bh5p5\" (UID: \"3bca20c9-0f2d-4f5f-81b0-b26a90596b08\") " pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.718077 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.718059    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bg82\" (UniqueName: \"kubernetes.io/projected/69c4cd92-d370-4093-8058-5d1a06d7b9a4-kube-api-access-9bg82\") pod \"iptables-alerter-bjpfd\" (UID: \"69c4cd92-d370-4093-8058-5d1a06d7b9a4\") " pod="openshift-network-operator/iptables-alerter-bjpfd"
May 28 16:08:02.725413 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:02.725393    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:08:02.725413 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:02.725415    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:08:02.725567 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:02.725428    2564 projected.go:194] Error preparing data for projected volume kube-api-access-vfz9j for pod openshift-network-diagnostics/network-check-target-z7k9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:08:02.725567 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:02.725503    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j podName:a3520fd9-ca91-42b2-a5bb-94ec4ae75e84 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:03.225485 +0000 UTC m=+3.074962453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vfz9j" (UniqueName: "kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j") pod "network-check-target-z7k9v" (UID: "a3520fd9-ca91-42b2-a5bb-94ec4ae75e84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:08:02.725803 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.725783    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d94k\" (UniqueName: \"kubernetes.io/projected/9805051e-ef8c-4375-960a-e649c08d76a7-kube-api-access-6d94k\") pod \"node-ca-9xbl7\" (UID: \"9805051e-ef8c-4375-960a-e649c08d76a7\") " pod="openshift-image-registry/node-ca-9xbl7"
May 28 16:08:02.731773 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.731745    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49nn8\" (UniqueName: \"kubernetes.io/projected/ddd1f6a7-f065-4ad6-8898-938565dbb25f-kube-api-access-49nn8\") pod \"ovnkube-node-z9v5g\" (UID: \"ddd1f6a7-f065-4ad6-8898-938565dbb25f\") " pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.732301 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.732285    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnbb7\" (UniqueName: \"kubernetes.io/projected/8c5d4322-4460-4d6c-b66e-303db736b0ca-kube-api-access-cnbb7\") pod \"multus-chd8b\" (UID: \"8c5d4322-4460-4d6c-b66e-303db736b0ca\") " pod="openshift-multus/multus-chd8b"
May 28 16:08:02.732397 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.732302    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ln47\" (UniqueName: \"kubernetes.io/projected/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-kube-api-access-2ln47\") pod \"network-metrics-daemon-r5nt6\" (UID: \"8e0f7bc7-0a1e-481f-a720-52a99554e9d6\") " pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:02.885395 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.885290    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:02.892139 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.892114    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f78ms"
May 28 16:08:02.900799 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.900776    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9"
May 28 16:08:02.909491 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.909467    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6h8fn"
May 28 16:08:02.916122 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.916106    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-26bgl"
May 28 16:08:02.924681 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.924660    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-bjpfd"
May 28 16:08:02.931153 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.931132    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-9xbl7"
May 28 16:08:02.938712 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.938692    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-bh5p5"
May 28 16:08:02.943244 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:02.943226    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-chd8b"
May 28 16:08:03.056412 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:03.056385    2564 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 16:08:03.211304 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:03.211217    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs\") pod \"network-metrics-daemon-r5nt6\" (UID: \"8e0f7bc7-0a1e-481f-a720-52a99554e9d6\") " pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:03.211484 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:03.211412    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:08:03.211537 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:03.211490    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs podName:8e0f7bc7-0a1e-481f-a720-52a99554e9d6 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:04.211472127 +0000 UTC m=+4.060949578 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs") pod "network-metrics-daemon-r5nt6" (UID: "8e0f7bc7-0a1e-481f-a720-52a99554e9d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:08:03.282992 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:03.282875    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9805051e_ef8c_4375_960a_e649c08d76a7.slice/crio-a5037852123864001c477f429820560f50c36966483e414172802447bba0d699 WatchSource:0}: Error finding container a5037852123864001c477f429820560f50c36966483e414172802447bba0d699: Status 404 returned error can't find the container with id a5037852123864001c477f429820560f50c36966483e414172802447bba0d699
May 28 16:08:03.284378 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:03.284330    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2bb212b_20e4_45d8_9caf_b70f68e8fc83.slice/crio-0644468942b576359907d7d2a638c56856575bc63c17700c6f7581211a1eba5b WatchSource:0}: Error finding container 0644468942b576359907d7d2a638c56856575bc63c17700c6f7581211a1eba5b: Status 404 returned error can't find the container with id 0644468942b576359907d7d2a638c56856575bc63c17700c6f7581211a1eba5b
May 28 16:08:03.285230 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:03.285203    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddd1f6a7_f065_4ad6_8898_938565dbb25f.slice/crio-af87dfbf24eb13622ee1fb7ac69ea8d6da0c66f5c5d47ef0aa879ebcd5a0cba4 WatchSource:0}: Error finding container af87dfbf24eb13622ee1fb7ac69ea8d6da0c66f5c5d47ef0aa879ebcd5a0cba4: Status 404 returned error can't find the container with id af87dfbf24eb13622ee1fb7ac69ea8d6da0c66f5c5d47ef0aa879ebcd5a0cba4
May 28 16:08:03.294349 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:03.294322    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bd98251_309e_42f9_a284_3bb58d1e3e37.slice/crio-850ce2d84d7ff9671cd93a55b0b3848de1dd72eab2333d038ad15da2518c8a26 WatchSource:0}: Error finding container 850ce2d84d7ff9671cd93a55b0b3848de1dd72eab2333d038ad15da2518c8a26: Status 404 returned error can't find the container with id 850ce2d84d7ff9671cd93a55b0b3848de1dd72eab2333d038ad15da2518c8a26
May 28 16:08:03.295009 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:03.294846    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c5d4322_4460_4d6c_b66e_303db736b0ca.slice/crio-84d2a7e68ea8309abcda502ea9439dda8720012e31b0661d9a261a4f90938e5f WatchSource:0}: Error finding container 84d2a7e68ea8309abcda502ea9439dda8720012e31b0661d9a261a4f90938e5f: Status 404 returned error can't find the container with id 84d2a7e68ea8309abcda502ea9439dda8720012e31b0661d9a261a4f90938e5f
May 28 16:08:03.311584 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:03.311561    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfz9j\" (UniqueName: \"kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j\") pod \"network-check-target-z7k9v\" (UID: \"a3520fd9-ca91-42b2-a5bb-94ec4ae75e84\") " pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:03.311689 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:03.311676    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:08:03.311746 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:03.311692    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:08:03.311746 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:03.311701    2564 projected.go:194] Error preparing data for projected volume kube-api-access-vfz9j for pod openshift-network-diagnostics/network-check-target-z7k9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:08:03.311810 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:03.311757    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j podName:a3520fd9-ca91-42b2-a5bb-94ec4ae75e84 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:04.311738377 +0000 UTC m=+4.161215827 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vfz9j" (UniqueName: "kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j") pod "network-check-target-z7k9v" (UID: "a3520fd9-ca91-42b2-a5bb-94ec4ae75e84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:08:03.621124 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:03.621087    2564 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 16:03:01 +0000 UTC" deadline="2027-12-09 05:17:52.836349917 +0000 UTC"
May 28 16:08:03.621124 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:03.621120    2564 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13429h9m49.215232315s"
May 28 16:08:03.718865 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:03.718832    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:03.719008 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:03.718979    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r5nt6" podUID="8e0f7bc7-0a1e-481f-a720-52a99554e9d6"
May 28 16:08:03.727628 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:03.726922    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-51.ec2.internal" event={"ID":"9c3213005fe92cc589ac3dd8a192c485","Type":"ContainerStarted","Data":"c967c05ec41a38570e0cb567b06542dbf042f70b5a0a978edd4d6791ebd152ac"}
May 28 16:08:03.730686 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:03.730657    2564 generic.go:358] "Generic (PLEG): container finished" podID="25b328cb538d5b99ecc3bf8d29f6e7da" containerID="2712c846e57dbf4bb37a2bd147d1d75c1d805d6f2d896ff0a5d2dc2cc6bdc651" exitCode=0
May 28 16:08:03.730797 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:03.730745    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal" event={"ID":"25b328cb538d5b99ecc3bf8d29f6e7da","Type":"ContainerDied","Data":"2712c846e57dbf4bb37a2bd147d1d75c1d805d6f2d896ff0a5d2dc2cc6bdc651"}
May 28 16:08:03.735402 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:03.733054    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6h8fn" event={"ID":"8c5f269e-650f-4527-a7fd-5dd9c764f7a1","Type":"ContainerStarted","Data":"aba35d1b6e193791cb2c36e825927111add5af6ab7af8cf36561193f93843470"}
May 28 16:08:03.735402 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:03.734455    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bjpfd" event={"ID":"69c4cd92-d370-4093-8058-5d1a06d7b9a4","Type":"ContainerStarted","Data":"a64f5f60cc710a47481fd55dec280e7596a0476c85f0449148b4737474948445"}
May 28 16:08:03.741722 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:03.741649    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-51.ec2.internal" podStartSLOduration=2.74162144 podStartE2EDuration="2.74162144s" podCreationTimestamp="2026-05-28 16:08:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:08:03.740709451 +0000 UTC m=+3.590186924" watchObservedRunningTime="2026-05-28 16:08:03.74162144 +0000 UTC m=+3.591098913"
May 28 16:08:03.744283 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:03.744240    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9xbl7" event={"ID":"9805051e-ef8c-4375-960a-e649c08d76a7","Type":"ContainerStarted","Data":"a5037852123864001c477f429820560f50c36966483e414172802447bba0d699"}
May 28 16:08:03.746581 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:03.746555    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-chd8b" event={"ID":"8c5d4322-4460-4d6c-b66e-303db736b0ca","Type":"ContainerStarted","Data":"84d2a7e68ea8309abcda502ea9439dda8720012e31b0661d9a261a4f90938e5f"}
May 28 16:08:03.747957 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:03.747920    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f78ms" event={"ID":"8bd98251-309e-42f9-a284-3bb58d1e3e37","Type":"ContainerStarted","Data":"850ce2d84d7ff9671cd93a55b0b3848de1dd72eab2333d038ad15da2518c8a26"}
May 28 16:08:03.751476 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:03.751443    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-26bgl" event={"ID":"a60f68cf-b6ec-4d94-bab6-0f8bb7e81610","Type":"ContainerStarted","Data":"ec2f6b338f2015ea996e9d7b4f3788b2fc1ff7aca177708b63a0571a94c9e417"}
May 28 16:08:03.752842 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:03.752809    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bh5p5" event={"ID":"3bca20c9-0f2d-4f5f-81b0-b26a90596b08","Type":"ContainerStarted","Data":"b66ee4af965cf012d25ead13ba2da83ece012f84d34c2ffc8082c99e5c7f2201"}
May 28 16:08:03.755656 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:03.755590    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g" event={"ID":"ddd1f6a7-f065-4ad6-8898-938565dbb25f","Type":"ContainerStarted","Data":"af87dfbf24eb13622ee1fb7ac69ea8d6da0c66f5c5d47ef0aa879ebcd5a0cba4"}
May 28 16:08:03.757060 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:03.757017    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9" event={"ID":"d2bb212b-20e4-45d8-9caf-b70f68e8fc83","Type":"ContainerStarted","Data":"0644468942b576359907d7d2a638c56856575bc63c17700c6f7581211a1eba5b"}
May 28 16:08:04.222210 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:04.222122    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs\") pod \"network-metrics-daemon-r5nt6\" (UID: \"8e0f7bc7-0a1e-481f-a720-52a99554e9d6\") " pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:04.222415 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:04.222263    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:08:04.222415 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:04.222329    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs podName:8e0f7bc7-0a1e-481f-a720-52a99554e9d6 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:06.222309887 +0000 UTC m=+6.071787351 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs") pod "network-metrics-daemon-r5nt6" (UID: "8e0f7bc7-0a1e-481f-a720-52a99554e9d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:08:04.323243 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:04.323202    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfz9j\" (UniqueName: \"kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j\") pod \"network-check-target-z7k9v\" (UID: \"a3520fd9-ca91-42b2-a5bb-94ec4ae75e84\") " pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:04.323453 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:04.323420    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:08:04.323453 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:04.323439    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:08:04.323453 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:04.323452    2564 projected.go:194] Error preparing data for projected volume kube-api-access-vfz9j for pod openshift-network-diagnostics/network-check-target-z7k9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:08:04.323630 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:04.323511    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j podName:a3520fd9-ca91-42b2-a5bb-94ec4ae75e84 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:06.323490191 +0000 UTC m=+6.172967646 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vfz9j" (UniqueName: "kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j") pod "network-check-target-z7k9v" (UID: "a3520fd9-ca91-42b2-a5bb-94ec4ae75e84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:08:04.721581 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:04.721493    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:04.722014 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:04.721640    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7k9v" podUID="a3520fd9-ca91-42b2-a5bb-94ec4ae75e84"
May 28 16:08:04.766336 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:04.766290    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal" event={"ID":"25b328cb538d5b99ecc3bf8d29f6e7da","Type":"ContainerStarted","Data":"27a3e207a681f033b072228ed0f9f9afd7d5099d4a08b487a39fbffab7b680f1"}
May 28 16:08:05.719062 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:05.719024    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:05.719330 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:05.719179    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r5nt6" podUID="8e0f7bc7-0a1e-481f-a720-52a99554e9d6"
May 28 16:08:06.240401 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:06.239824    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs\") pod \"network-metrics-daemon-r5nt6\" (UID: \"8e0f7bc7-0a1e-481f-a720-52a99554e9d6\") " pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:06.240401 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:06.239991    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:08:06.240401 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:06.240054    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs podName:8e0f7bc7-0a1e-481f-a720-52a99554e9d6 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:10.240035435 +0000 UTC m=+10.089512893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs") pod "network-metrics-daemon-r5nt6" (UID: "8e0f7bc7-0a1e-481f-a720-52a99554e9d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:08:06.340540 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:06.340493    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfz9j\" (UniqueName: \"kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j\") pod \"network-check-target-z7k9v\" (UID: \"a3520fd9-ca91-42b2-a5bb-94ec4ae75e84\") " pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:06.340718 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:06.340658    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:08:06.340718 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:06.340681    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:08:06.340718 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:06.340695    2564 projected.go:194] Error preparing data for projected volume kube-api-access-vfz9j for pod openshift-network-diagnostics/network-check-target-z7k9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:08:06.340878 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:06.340755    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j podName:a3520fd9-ca91-42b2-a5bb-94ec4ae75e84 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:10.340735253 +0000 UTC m=+10.190212709 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vfz9j" (UniqueName: "kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j") pod "network-check-target-z7k9v" (UID: "a3520fd9-ca91-42b2-a5bb-94ec4ae75e84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:08:06.720539 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:06.720507    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:06.720722 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:06.720632    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7k9v" podUID="a3520fd9-ca91-42b2-a5bb-94ec4ae75e84"
May 28 16:08:07.719462 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:07.719423    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:07.719870 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:07.719630    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r5nt6" podUID="8e0f7bc7-0a1e-481f-a720-52a99554e9d6"
May 28 16:08:08.719891 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:08.719856    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:08.720345 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:08.720068    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7k9v" podUID="a3520fd9-ca91-42b2-a5bb-94ec4ae75e84"
May 28 16:08:09.719804 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:09.719768    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:09.720013 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:09.719923    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r5nt6" podUID="8e0f7bc7-0a1e-481f-a720-52a99554e9d6"
May 28 16:08:10.274141 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:10.274099    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs\") pod \"network-metrics-daemon-r5nt6\" (UID: \"8e0f7bc7-0a1e-481f-a720-52a99554e9d6\") " pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:10.274336 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:10.274257    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:08:10.274469 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:10.274337    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs podName:8e0f7bc7-0a1e-481f-a720-52a99554e9d6 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:18.274318547 +0000 UTC m=+18.123795996 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs") pod "network-metrics-daemon-r5nt6" (UID: "8e0f7bc7-0a1e-481f-a720-52a99554e9d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:08:10.374788 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:10.374739    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfz9j\" (UniqueName: \"kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j\") pod \"network-check-target-z7k9v\" (UID: \"a3520fd9-ca91-42b2-a5bb-94ec4ae75e84\") " pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:10.374972 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:10.374933    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:08:10.374972 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:10.374953    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:08:10.374972 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:10.374971    2564 projected.go:194] Error preparing data for projected volume kube-api-access-vfz9j for pod openshift-network-diagnostics/network-check-target-z7k9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:08:10.375127 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:10.375023    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j podName:a3520fd9-ca91-42b2-a5bb-94ec4ae75e84 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:18.37500873 +0000 UTC m=+18.224486180 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vfz9j" (UniqueName: "kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j") pod "network-check-target-z7k9v" (UID: "a3520fd9-ca91-42b2-a5bb-94ec4ae75e84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:08:10.720194 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:10.720112    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:10.720649 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:10.720228    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7k9v" podUID="a3520fd9-ca91-42b2-a5bb-94ec4ae75e84"
May 28 16:08:11.719569 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:11.719537    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:11.719762 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:11.719658    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r5nt6" podUID="8e0f7bc7-0a1e-481f-a720-52a99554e9d6"
May 28 16:08:12.719188 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:12.719153    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:12.719708 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:12.719289    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7k9v" podUID="a3520fd9-ca91-42b2-a5bb-94ec4ae75e84"
May 28 16:08:13.720034 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:13.719788    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:13.720470 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:13.720158    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r5nt6" podUID="8e0f7bc7-0a1e-481f-a720-52a99554e9d6"
May 28 16:08:14.719494 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:14.719461    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:14.719638 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:14.719558    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7k9v" podUID="a3520fd9-ca91-42b2-a5bb-94ec4ae75e84"
May 28 16:08:15.719475 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:15.719436    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:15.719948 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:15.719580    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r5nt6" podUID="8e0f7bc7-0a1e-481f-a720-52a99554e9d6"
May 28 16:08:16.719398 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:16.719341    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:16.719579 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:16.719494    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7k9v" podUID="a3520fd9-ca91-42b2-a5bb-94ec4ae75e84"
May 28 16:08:17.719252 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:17.719214    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:17.719469 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:17.719373    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r5nt6" podUID="8e0f7bc7-0a1e-481f-a720-52a99554e9d6"
May 28 16:08:18.331084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:18.331041    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs\") pod \"network-metrics-daemon-r5nt6\" (UID: \"8e0f7bc7-0a1e-481f-a720-52a99554e9d6\") " pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:18.331522 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:18.331223    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:08:18.331522 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:18.331308    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs podName:8e0f7bc7-0a1e-481f-a720-52a99554e9d6 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:34.331285135 +0000 UTC m=+34.180762596 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs") pod "network-metrics-daemon-r5nt6" (UID: "8e0f7bc7-0a1e-481f-a720-52a99554e9d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:08:18.431750 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:18.431628    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfz9j\" (UniqueName: \"kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j\") pod \"network-check-target-z7k9v\" (UID: \"a3520fd9-ca91-42b2-a5bb-94ec4ae75e84\") " pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:18.431906 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:18.431815    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:08:18.431906 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:18.431836    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:08:18.431906 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:18.431849    2564 projected.go:194] Error preparing data for projected volume kube-api-access-vfz9j for pod openshift-network-diagnostics/network-check-target-z7k9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:08:18.431906 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:18.431905    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j podName:a3520fd9-ca91-42b2-a5bb-94ec4ae75e84 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:34.43189155 +0000 UTC m=+34.281368999 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vfz9j" (UniqueName: "kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j") pod "network-check-target-z7k9v" (UID: "a3520fd9-ca91-42b2-a5bb-94ec4ae75e84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:08:18.719305 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:18.719226    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:18.719474 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:18.719338    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7k9v" podUID="a3520fd9-ca91-42b2-a5bb-94ec4ae75e84"
May 28 16:08:19.719905 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:19.719875    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:19.720388 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:19.720007    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r5nt6" podUID="8e0f7bc7-0a1e-481f-a720-52a99554e9d6"
May 28 16:08:20.719738 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:20.719696    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:20.719902 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:20.719799    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7k9v" podUID="a3520fd9-ca91-42b2-a5bb-94ec4ae75e84"
May 28 16:08:21.719459 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:21.719432    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:21.719963 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:21.719541    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r5nt6" podUID="8e0f7bc7-0a1e-481f-a720-52a99554e9d6"
May 28 16:08:21.803184 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:21.803147    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f78ms" event={"ID":"8bd98251-309e-42f9-a284-3bb58d1e3e37","Type":"ContainerStarted","Data":"f60246e00f47060fc707635ed1ccc53a227dc45ad37593cb36fdb12749a8c052"}
May 28 16:08:21.805491 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:21.805462    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-26bgl" event={"ID":"a60f68cf-b6ec-4d94-bab6-0f8bb7e81610","Type":"ContainerStarted","Data":"8fd6051dbcf4e6d8e4be789fcd7bf3b4401cc1faba6822b75b1f5029e741b831"}
May 28 16:08:21.806881 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:21.806854    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bh5p5" event={"ID":"3bca20c9-0f2d-4f5f-81b0-b26a90596b08","Type":"ContainerStarted","Data":"b0dbf5cc8bc51bb4cfaba62c9ecfabe2119bc9389be1bd7a7a6a6e661bf92a3c"}
May 28 16:08:21.808476 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:21.808453    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9" event={"ID":"d2bb212b-20e4-45d8-9caf-b70f68e8fc83","Type":"ContainerStarted","Data":"db02b43dcfa130d6d2105a245320cf88dc2b83f01d41110f447120062f6c4d2b"}
May 28 16:08:21.810267 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:21.810243    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-9xbl7" event={"ID":"9805051e-ef8c-4375-960a-e649c08d76a7","Type":"ContainerStarted","Data":"7b9d00dda5acdd774df96cb81a2a8c1c0a9f8f1b239b9ad567ac28bb296c0828"}
May 28 16:08:21.818460 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:21.818238    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f78ms" podStartSLOduration=3.693525018 podStartE2EDuration="21.818211526s" podCreationTimestamp="2026-05-28 16:08:00 +0000 UTC" firstStartedPulling="2026-05-28 16:08:03.295648764 +0000 UTC m=+3.145126223" lastFinishedPulling="2026-05-28 16:08:21.420335245 +0000 UTC m=+21.269812731" observedRunningTime="2026-05-28 16:08:21.817977263 +0000 UTC m=+21.667454734" watchObservedRunningTime="2026-05-28 16:08:21.818211526 +0000 UTC m=+21.667688992"
May 28 16:08:21.818958 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:21.818931    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-51.ec2.internal" podStartSLOduration=20.818916762 podStartE2EDuration="20.818916762s" podCreationTimestamp="2026-05-28 16:08:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:08:04.78215728 +0000 UTC m=+4.631634753" watchObservedRunningTime="2026-05-28 16:08:21.818916762 +0000 UTC m=+21.668394233"
May 28 16:08:21.831389 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:21.831327    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-9xbl7" podStartSLOduration=8.140808736 podStartE2EDuration="21.83131438s" podCreationTimestamp="2026-05-28 16:08:00 +0000 UTC" firstStartedPulling="2026-05-28 16:08:03.28563585 +0000 UTC m=+3.135113315" lastFinishedPulling="2026-05-28 16:08:16.976141495 +0000 UTC m=+16.825618959" observedRunningTime="2026-05-28 16:08:21.831258902 +0000 UTC m=+21.680736375" watchObservedRunningTime="2026-05-28 16:08:21.83131438 +0000 UTC m=+21.680791852"
May 28 16:08:21.845559 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:21.845519    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-26bgl" podStartSLOduration=3.6804608979999998 podStartE2EDuration="21.84550783s" podCreationTimestamp="2026-05-28 16:08:00 +0000 UTC" firstStartedPulling="2026-05-28 16:08:03.293787064 +0000 UTC m=+3.143264513" lastFinishedPulling="2026-05-28 16:08:21.458833791 +0000 UTC m=+21.308311445" observedRunningTime="2026-05-28 16:08:21.845086736 +0000 UTC m=+21.694564208" watchObservedRunningTime="2026-05-28 16:08:21.84550783 +0000 UTC m=+21.694985302"
May 28 16:08:22.726042 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:22.726015    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:22.726686 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:22.726133    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7k9v" podUID="a3520fd9-ca91-42b2-a5bb-94ec4ae75e84"
May 28 16:08:22.813538 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:22.813501    2564 generic.go:358] "Generic (PLEG): container finished" podID="3bca20c9-0f2d-4f5f-81b0-b26a90596b08" containerID="b0dbf5cc8bc51bb4cfaba62c9ecfabe2119bc9389be1bd7a7a6a6e661bf92a3c" exitCode=0
May 28 16:08:22.813731 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:22.813595    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bh5p5" event={"ID":"3bca20c9-0f2d-4f5f-81b0-b26a90596b08","Type":"ContainerDied","Data":"b0dbf5cc8bc51bb4cfaba62c9ecfabe2119bc9389be1bd7a7a6a6e661bf92a3c"}
May 28 16:08:22.816280 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:22.816264    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/ovn-acl-logging/0.log"
May 28 16:08:22.816609 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:22.816588    2564 generic.go:358] "Generic (PLEG): container finished" podID="ddd1f6a7-f065-4ad6-8898-938565dbb25f" containerID="56c3721a870e63527662ebaaf9fb5fff654f19dc072a60fe332e6ec051c77e1e" exitCode=1
May 28 16:08:22.816716 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:22.816653    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g" event={"ID":"ddd1f6a7-f065-4ad6-8898-938565dbb25f","Type":"ContainerStarted","Data":"065e90ae6bcb70df80317daf1742aa0406b21ac72210d82dce014a4645759080"}
May 28 16:08:22.816716 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:22.816671    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g" event={"ID":"ddd1f6a7-f065-4ad6-8898-938565dbb25f","Type":"ContainerStarted","Data":"aef42694568b608faf28695b2c805ebba5db31725a58ba8117c6cfc282ee0c98"}
May 28 16:08:22.816716 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:22.816679    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g" event={"ID":"ddd1f6a7-f065-4ad6-8898-938565dbb25f","Type":"ContainerStarted","Data":"3e3740739d495fbe5e8610a769945760a408f00e604536cabc82c18c0d9401f9"}
May 28 16:08:22.816716 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:22.816690    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g" event={"ID":"ddd1f6a7-f065-4ad6-8898-938565dbb25f","Type":"ContainerStarted","Data":"dd8bd44442f92f177ec4f1460cef24a7496de7f305dcf67df046bb24446b7868"}
May 28 16:08:22.816716 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:22.816701    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g" event={"ID":"ddd1f6a7-f065-4ad6-8898-938565dbb25f","Type":"ContainerDied","Data":"56c3721a870e63527662ebaaf9fb5fff654f19dc072a60fe332e6ec051c77e1e"}
May 28 16:08:22.816716 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:22.816711    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g" event={"ID":"ddd1f6a7-f065-4ad6-8898-938565dbb25f","Type":"ContainerStarted","Data":"d47a5ed61b1484ab373fdeeba221170d5ede5f5dfc59da55ee48624b42c12179"}
May 28 16:08:22.817937 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:22.817902    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6h8fn" event={"ID":"8c5f269e-650f-4527-a7fd-5dd9c764f7a1","Type":"ContainerStarted","Data":"a32f2bc987f99dff1887fec3178f87851911c81d49ce6078742a8c63839a68fc"}
May 28 16:08:22.820974 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:22.820950    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-chd8b" event={"ID":"8c5d4322-4460-4d6c-b66e-303db736b0ca","Type":"ContainerStarted","Data":"09514f1ba77aaf0b8495c25018a769e22306897b78adc3befc785f52c02e3353"}
May 28 16:08:22.848265 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:22.848220    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6h8fn" podStartSLOduration=4.680638504 podStartE2EDuration="22.848207545s" podCreationTimestamp="2026-05-28 16:08:00 +0000 UTC" firstStartedPulling="2026-05-28 16:08:03.292987485 +0000 UTC m=+3.142464945" lastFinishedPulling="2026-05-28 16:08:21.46055652 +0000 UTC m=+21.310033986" observedRunningTime="2026-05-28 16:08:22.847875282 +0000 UTC m=+22.697352755" watchObservedRunningTime="2026-05-28 16:08:22.848207545 +0000 UTC m=+22.697685017"
May 28 16:08:22.862321 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:22.862285    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-chd8b" podStartSLOduration=4.661781589 podStartE2EDuration="22.86227428s" podCreationTimestamp="2026-05-28 16:08:00 +0000 UTC" firstStartedPulling="2026-05-28 16:08:03.297963985 +0000 UTC m=+3.147441435" lastFinishedPulling="2026-05-28 16:08:21.498456661 +0000 UTC m=+21.347934126" observedRunningTime="2026-05-28 16:08:22.862165351 +0000 UTC m=+22.711642824" watchObservedRunningTime="2026-05-28 16:08:22.86227428 +0000 UTC m=+22.711751751"
May 28 16:08:23.263948 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:23.263791    2564 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 16:08:23.436911 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:23.436832    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f78ms"
May 28 16:08:23.437452 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:23.437436    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f78ms"
May 28 16:08:23.664228 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:23.664114    2564 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T16:08:23.263945334Z","UUID":"b7b16641-7070-4d95-8d0a-869fa62d620c","Handler":null,"Name":"","Endpoint":""}
May 28 16:08:23.665901 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:23.665878    2564 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 16:08:23.665901 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:23.665906    2564 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 16:08:23.719769 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:23.719685    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:23.719929 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:23.719816    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r5nt6" podUID="8e0f7bc7-0a1e-481f-a720-52a99554e9d6"
May 28 16:08:23.824787 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:23.824750    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9" event={"ID":"d2bb212b-20e4-45d8-9caf-b70f68e8fc83","Type":"ContainerStarted","Data":"cf8ca918ab09deb18ea4dda22308eed3a6248f445bb10c3d7042bd3da2a6ec95"}
May 28 16:08:23.826881 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:23.826811    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-bjpfd" event={"ID":"69c4cd92-d370-4093-8058-5d1a06d7b9a4","Type":"ContainerStarted","Data":"938800eaf106332d107397e54c89dafafbd6cffb03c703898712df4f758edefb"}
May 28 16:08:23.827287 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:23.827266    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f78ms"
May 28 16:08:23.827609 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:23.827592    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f78ms"
May 28 16:08:23.841588 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:23.841551    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-bjpfd" podStartSLOduration=5.673722668 podStartE2EDuration="23.841536729s" podCreationTimestamp="2026-05-28 16:08:00 +0000 UTC" firstStartedPulling="2026-05-28 16:08:03.29104029 +0000 UTC m=+3.140517746" lastFinishedPulling="2026-05-28 16:08:21.458854357 +0000 UTC m=+21.308331807" observedRunningTime="2026-05-28 16:08:23.84109675 +0000 UTC m=+23.690574221" watchObservedRunningTime="2026-05-28 16:08:23.841536729 +0000 UTC m=+23.691014203"
May 28 16:08:24.721826 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:24.721797    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:24.721981 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:24.721898    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7k9v" podUID="a3520fd9-ca91-42b2-a5bb-94ec4ae75e84"
May 28 16:08:24.830162 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:24.830073    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9" event={"ID":"d2bb212b-20e4-45d8-9caf-b70f68e8fc83","Type":"ContainerStarted","Data":"2575f723054735a84a40f778062c2654bac84da2fbd525035ab068de2fea34e0"}
May 28 16:08:24.832564 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:24.832541    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/ovn-acl-logging/0.log"
May 28 16:08:24.832855 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:24.832831    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g" event={"ID":"ddd1f6a7-f065-4ad6-8898-938565dbb25f","Type":"ContainerStarted","Data":"6c8b71aa083083d78c92bc1461be529f9d2e3b9479d4d1770e02c609a8e3c522"}
May 28 16:08:25.719346 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:25.719314    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:25.719530 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:25.719455    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r5nt6" podUID="8e0f7bc7-0a1e-481f-a720-52a99554e9d6"
May 28 16:08:26.719568 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:26.719531    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:26.720124 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:26.719660    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7k9v" podUID="a3520fd9-ca91-42b2-a5bb-94ec4ae75e84"
May 28 16:08:27.719631 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:27.719598    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:27.720110 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:27.719740    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r5nt6" podUID="8e0f7bc7-0a1e-481f-a720-52a99554e9d6"
May 28 16:08:28.719261 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:28.719022    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:28.719434 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:28.719283    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7k9v" podUID="a3520fd9-ca91-42b2-a5bb-94ec4ae75e84"
May 28 16:08:28.842927 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:28.842897    2564 generic.go:358] "Generic (PLEG): container finished" podID="3bca20c9-0f2d-4f5f-81b0-b26a90596b08" containerID="469ff4cb04ef28d9f825ffd0c0ad62619d1c0d2f8354a7b858405ebef32de3f8" exitCode=0
May 28 16:08:28.843337 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:28.842971    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bh5p5" event={"ID":"3bca20c9-0f2d-4f5f-81b0-b26a90596b08","Type":"ContainerDied","Data":"469ff4cb04ef28d9f825ffd0c0ad62619d1c0d2f8354a7b858405ebef32de3f8"}
May 28 16:08:28.846053 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:28.846036    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/ovn-acl-logging/0.log"
May 28 16:08:28.846487 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:28.846455    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g" event={"ID":"ddd1f6a7-f065-4ad6-8898-938565dbb25f","Type":"ContainerStarted","Data":"1ab37c4e8a304828d768749a5db5d6ae9cb41e233aaf9d3e5c310db8e5156623"}
May 28 16:08:28.846762 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:28.846740    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:28.846961 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:28.846790    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:28.846961 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:28.846903    2564 scope.go:117] "RemoveContainer" containerID="56c3721a870e63527662ebaaf9fb5fff654f19dc072a60fe332e6ec051c77e1e"
May 28 16:08:28.863182 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:28.863164    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:28.864978 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:28.864922    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zlfr9" podStartSLOduration=7.897647693 podStartE2EDuration="28.864905968s" podCreationTimestamp="2026-05-28 16:08:00 +0000 UTC" firstStartedPulling="2026-05-28 16:08:03.286716166 +0000 UTC m=+3.136193631" lastFinishedPulling="2026-05-28 16:08:24.253974454 +0000 UTC m=+24.103451906" observedRunningTime="2026-05-28 16:08:24.847160371 +0000 UTC m=+24.696637843" watchObservedRunningTime="2026-05-28 16:08:28.864905968 +0000 UTC m=+28.714383442"
May 28 16:08:29.719729 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:29.719696    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:29.719885 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:29.719812    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r5nt6" podUID="8e0f7bc7-0a1e-481f-a720-52a99554e9d6"
May 28 16:08:29.853130 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:29.853098    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/ovn-acl-logging/0.log"
May 28 16:08:29.853640 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:29.853499    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g" event={"ID":"ddd1f6a7-f065-4ad6-8898-938565dbb25f","Type":"ContainerStarted","Data":"f81fbb3b0fddb5bd947552dddd38ffa198313a0bcc45a4d9c3fbc8c0a21ba44b"}
May 28 16:08:29.853968 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:29.853949    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:29.872101 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:29.872048    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:08:29.880344 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:29.880295    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g" podStartSLOduration=11.343387154 podStartE2EDuration="29.88027731s" podCreationTimestamp="2026-05-28 16:08:00 +0000 UTC" firstStartedPulling="2026-05-28 16:08:03.287241096 +0000 UTC m=+3.136718548" lastFinishedPulling="2026-05-28 16:08:21.824131255 +0000 UTC m=+21.673608704" observedRunningTime="2026-05-28 16:08:29.878890256 +0000 UTC m=+29.728367728" watchObservedRunningTime="2026-05-28 16:08:29.88027731 +0000 UTC m=+29.729754783"
May 28 16:08:30.105270 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:30.105070    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r5nt6"]
May 28 16:08:30.105465 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:30.105356    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:30.105538 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:30.105460    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r5nt6" podUID="8e0f7bc7-0a1e-481f-a720-52a99554e9d6"
May 28 16:08:30.107434 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:30.107410    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z7k9v"]
May 28 16:08:30.107560 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:30.107504    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:30.107605 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:30.107569    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7k9v" podUID="a3520fd9-ca91-42b2-a5bb-94ec4ae75e84"
May 28 16:08:30.857144 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:30.857114    2564 generic.go:358] "Generic (PLEG): container finished" podID="3bca20c9-0f2d-4f5f-81b0-b26a90596b08" containerID="39da1c104d106ce1c31cb65015d51de19dbb1973b913fbe34505e3c0d52f0be2" exitCode=0
May 28 16:08:30.857808 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:30.857195    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bh5p5" event={"ID":"3bca20c9-0f2d-4f5f-81b0-b26a90596b08","Type":"ContainerDied","Data":"39da1c104d106ce1c31cb65015d51de19dbb1973b913fbe34505e3c0d52f0be2"}
May 28 16:08:31.719731 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:31.719648    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:31.719878 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:31.719766    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r5nt6" podUID="8e0f7bc7-0a1e-481f-a720-52a99554e9d6"
May 28 16:08:31.719878 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:31.719827    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:31.719992 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:31.719935    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7k9v" podUID="a3520fd9-ca91-42b2-a5bb-94ec4ae75e84"
May 28 16:08:32.862428 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:32.862387    2564 generic.go:358] "Generic (PLEG): container finished" podID="3bca20c9-0f2d-4f5f-81b0-b26a90596b08" containerID="09072b7b6d08033b182c99476be73bda3991d839fee0dd3c75dd04c554d71046" exitCode=0
May 28 16:08:32.863086 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:32.862437    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bh5p5" event={"ID":"3bca20c9-0f2d-4f5f-81b0-b26a90596b08","Type":"ContainerDied","Data":"09072b7b6d08033b182c99476be73bda3991d839fee0dd3c75dd04c554d71046"}
May 28 16:08:33.719585 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:33.719548    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:33.719808 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:33.719631    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:33.719808 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:33.719688    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-z7k9v" podUID="a3520fd9-ca91-42b2-a5bb-94ec4ae75e84"
May 28 16:08:33.719895 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:33.719813    2564 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-r5nt6" podUID="8e0f7bc7-0a1e-481f-a720-52a99554e9d6"
May 28 16:08:34.347770 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.347557    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs\") pod \"network-metrics-daemon-r5nt6\" (UID: \"8e0f7bc7-0a1e-481f-a720-52a99554e9d6\") " pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:34.348226 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:34.347728    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:08:34.348226 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:34.347868    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs podName:8e0f7bc7-0a1e-481f-a720-52a99554e9d6 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:06.347847574 +0000 UTC m=+66.197325036 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs") pod "network-metrics-daemon-r5nt6" (UID: "8e0f7bc7-0a1e-481f-a720-52a99554e9d6") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 16:08:34.431553 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.431527    2564 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-132-51.ec2.internal" event="NodeReady"
May 28 16:08:34.431736 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.431687    2564 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 16:08:34.448544 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.448513    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfz9j\" (UniqueName: \"kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j\") pod \"network-check-target-z7k9v\" (UID: \"a3520fd9-ca91-42b2-a5bb-94ec4ae75e84\") " pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:34.448717 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:34.448674    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 16:08:34.448717 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:34.448695    2564 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 16:08:34.448717 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:34.448707    2564 projected.go:194] Error preparing data for projected volume kube-api-access-vfz9j for pod openshift-network-diagnostics/network-check-target-z7k9v: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:08:34.448871 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:34.448771    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j podName:a3520fd9-ca91-42b2-a5bb-94ec4ae75e84 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:06.448750654 +0000 UTC m=+66.298228110 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vfz9j" (UniqueName: "kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j") pod "network-check-target-z7k9v" (UID: "a3520fd9-ca91-42b2-a5bb-94ec4ae75e84") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 16:08:34.475855 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.475773    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-fcnt9"]
May 28 16:08:34.498354 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.498324    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vn4k4"]
May 28 16:08:34.498553 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.498496    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fcnt9"
May 28 16:08:34.500942 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.500916    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 16:08:34.501085 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.500957    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 16:08:34.501155 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.501133    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rfj6w\""
May 28 16:08:34.512694 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.512669    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fcnt9"]
May 28 16:08:34.512811 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.512701    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vn4k4"]
May 28 16:08:34.512863 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.512815    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vn4k4"
May 28 16:08:34.515316 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.515293    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 16:08:34.515633 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.515611    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 16:08:34.515756 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.515638    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ckq8r\""
May 28 16:08:34.515756 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.515677    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 16:08:34.649560 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.649521    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g4d6r\" (UniqueName: \"kubernetes.io/projected/c309cf42-84d1-47a4-86d3-afcda3b25c50-kube-api-access-g4d6r\") pod \"ingress-canary-vn4k4\" (UID: \"c309cf42-84d1-47a4-86d3-afcda3b25c50\") " pod="openshift-ingress-canary/ingress-canary-vn4k4"
May 28 16:08:34.649740 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.649569    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2e0d243f-62d7-4b28-8bdc-b8315f003fec-config-volume\") pod \"dns-default-fcnt9\" (UID: \"2e0d243f-62d7-4b28-8bdc-b8315f003fec\") " pod="openshift-dns/dns-default-fcnt9"
May 28 16:08:34.649740 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.649590    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls\") pod \"dns-default-fcnt9\" (UID: \"2e0d243f-62d7-4b28-8bdc-b8315f003fec\") " pod="openshift-dns/dns-default-fcnt9"
May 28 16:08:34.649740 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.649606    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert\") pod \"ingress-canary-vn4k4\" (UID: \"c309cf42-84d1-47a4-86d3-afcda3b25c50\") " pod="openshift-ingress-canary/ingress-canary-vn4k4"
May 28 16:08:34.649740 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.649650    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6r5v5\" (UniqueName: \"kubernetes.io/projected/2e0d243f-62d7-4b28-8bdc-b8315f003fec-kube-api-access-6r5v5\") pod \"dns-default-fcnt9\" (UID: \"2e0d243f-62d7-4b28-8bdc-b8315f003fec\") " pod="openshift-dns/dns-default-fcnt9"
May 28 16:08:34.649740 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.649709    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e0d243f-62d7-4b28-8bdc-b8315f003fec-tmp-dir\") pod \"dns-default-fcnt9\" (UID: \"2e0d243f-62d7-4b28-8bdc-b8315f003fec\") " pod="openshift-dns/dns-default-fcnt9"
May 28 16:08:34.750531 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.750501    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g4d6r\" (UniqueName: \"kubernetes.io/projected/c309cf42-84d1-47a4-86d3-afcda3b25c50-kube-api-access-g4d6r\") pod \"ingress-canary-vn4k4\" (UID: \"c309cf42-84d1-47a4-86d3-afcda3b25c50\") " pod="openshift-ingress-canary/ingress-canary-vn4k4"
May 28 16:08:34.750724 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.750550    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2e0d243f-62d7-4b28-8bdc-b8315f003fec-config-volume\") pod \"dns-default-fcnt9\" (UID: \"2e0d243f-62d7-4b28-8bdc-b8315f003fec\") " pod="openshift-dns/dns-default-fcnt9"
May 28 16:08:34.750724 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.750570    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls\") pod \"dns-default-fcnt9\" (UID: \"2e0d243f-62d7-4b28-8bdc-b8315f003fec\") " pod="openshift-dns/dns-default-fcnt9"
May 28 16:08:34.750724 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.750593    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert\") pod \"ingress-canary-vn4k4\" (UID: \"c309cf42-84d1-47a4-86d3-afcda3b25c50\") " pod="openshift-ingress-canary/ingress-canary-vn4k4"
May 28 16:08:34.750724 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.750614    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6r5v5\" (UniqueName: \"kubernetes.io/projected/2e0d243f-62d7-4b28-8bdc-b8315f003fec-kube-api-access-6r5v5\") pod \"dns-default-fcnt9\" (UID: \"2e0d243f-62d7-4b28-8bdc-b8315f003fec\") " pod="openshift-dns/dns-default-fcnt9"
May 28 16:08:34.750724 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.750651    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e0d243f-62d7-4b28-8bdc-b8315f003fec-tmp-dir\") pod \"dns-default-fcnt9\" (UID: \"2e0d243f-62d7-4b28-8bdc-b8315f003fec\") " pod="openshift-dns/dns-default-fcnt9"
May 28 16:08:34.750967 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:34.750724    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:08:34.750967 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:34.750786    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert podName:c309cf42-84d1-47a4-86d3-afcda3b25c50 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:35.250766658 +0000 UTC m=+35.100244108 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert") pod "ingress-canary-vn4k4" (UID: "c309cf42-84d1-47a4-86d3-afcda3b25c50") : secret "canary-serving-cert" not found
May 28 16:08:34.750967 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:34.750725    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:08:34.750967 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:34.750826    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls podName:2e0d243f-62d7-4b28-8bdc-b8315f003fec nodeName:}" failed. No retries permitted until 2026-05-28 16:08:35.250814153 +0000 UTC m=+35.100291614 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls") pod "dns-default-fcnt9" (UID: "2e0d243f-62d7-4b28-8bdc-b8315f003fec") : secret "dns-default-metrics-tls" not found
May 28 16:08:34.751173 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.751026    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2e0d243f-62d7-4b28-8bdc-b8315f003fec-tmp-dir\") pod \"dns-default-fcnt9\" (UID: \"2e0d243f-62d7-4b28-8bdc-b8315f003fec\") " pod="openshift-dns/dns-default-fcnt9"
May 28 16:08:34.751173 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.751149    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/2e0d243f-62d7-4b28-8bdc-b8315f003fec-config-volume\") pod \"dns-default-fcnt9\" (UID: \"2e0d243f-62d7-4b28-8bdc-b8315f003fec\") " pod="openshift-dns/dns-default-fcnt9"
May 28 16:08:34.764887 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.764852    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6r5v5\" (UniqueName: \"kubernetes.io/projected/2e0d243f-62d7-4b28-8bdc-b8315f003fec-kube-api-access-6r5v5\") pod \"dns-default-fcnt9\" (UID: \"2e0d243f-62d7-4b28-8bdc-b8315f003fec\") " pod="openshift-dns/dns-default-fcnt9"
May 28 16:08:34.765023 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:34.764902    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g4d6r\" (UniqueName: \"kubernetes.io/projected/c309cf42-84d1-47a4-86d3-afcda3b25c50-kube-api-access-g4d6r\") pod \"ingress-canary-vn4k4\" (UID: \"c309cf42-84d1-47a4-86d3-afcda3b25c50\") " pod="openshift-ingress-canary/ingress-canary-vn4k4"
May 28 16:08:35.254428 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:35.254391    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls\") pod \"dns-default-fcnt9\" (UID: \"2e0d243f-62d7-4b28-8bdc-b8315f003fec\") " pod="openshift-dns/dns-default-fcnt9"
May 28 16:08:35.254621 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:35.254443    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert\") pod \"ingress-canary-vn4k4\" (UID: \"c309cf42-84d1-47a4-86d3-afcda3b25c50\") " pod="openshift-ingress-canary/ingress-canary-vn4k4"
May 28 16:08:35.254621 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:35.254578    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:08:35.254621 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:35.254583    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:08:35.254781 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:35.254660    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert podName:c309cf42-84d1-47a4-86d3-afcda3b25c50 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:36.25463985 +0000 UTC m=+36.104117306 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert") pod "ingress-canary-vn4k4" (UID: "c309cf42-84d1-47a4-86d3-afcda3b25c50") : secret "canary-serving-cert" not found
May 28 16:08:35.254781 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:35.254680    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls podName:2e0d243f-62d7-4b28-8bdc-b8315f003fec nodeName:}" failed. No retries permitted until 2026-05-28 16:08:36.254669335 +0000 UTC m=+36.104146789 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls") pod "dns-default-fcnt9" (UID: "2e0d243f-62d7-4b28-8bdc-b8315f003fec") : secret "dns-default-metrics-tls" not found
May 28 16:08:35.719257 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:35.719177    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:08:35.719718 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:35.719394    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:08:35.722166 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:35.722142    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 16:08:35.722860 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:35.722829    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 16:08:35.722860 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:35.722840    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qjc5m\""
May 28 16:08:35.723045 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:35.722868    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xz8bh\""
May 28 16:08:35.723045 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:35.722892    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 16:08:36.265313 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:36.265278    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls\") pod \"dns-default-fcnt9\" (UID: \"2e0d243f-62d7-4b28-8bdc-b8315f003fec\") " pod="openshift-dns/dns-default-fcnt9"
May 28 16:08:36.265313 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:36.265320    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert\") pod \"ingress-canary-vn4k4\" (UID: \"c309cf42-84d1-47a4-86d3-afcda3b25c50\") " pod="openshift-ingress-canary/ingress-canary-vn4k4"
May 28 16:08:36.265583 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:36.265453    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:08:36.265583 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:36.265456    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:08:36.265583 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:36.265535    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls podName:2e0d243f-62d7-4b28-8bdc-b8315f003fec nodeName:}" failed. No retries permitted until 2026-05-28 16:08:38.265513768 +0000 UTC m=+38.114991220 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls") pod "dns-default-fcnt9" (UID: "2e0d243f-62d7-4b28-8bdc-b8315f003fec") : secret "dns-default-metrics-tls" not found
May 28 16:08:36.265583 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:36.265554    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert podName:c309cf42-84d1-47a4-86d3-afcda3b25c50 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:38.265545358 +0000 UTC m=+38.115022813 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert") pod "ingress-canary-vn4k4" (UID: "c309cf42-84d1-47a4-86d3-afcda3b25c50") : secret "canary-serving-cert" not found
May 28 16:08:38.279956 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.279902    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls\") pod \"dns-default-fcnt9\" (UID: \"2e0d243f-62d7-4b28-8bdc-b8315f003fec\") " pod="openshift-dns/dns-default-fcnt9"
May 28 16:08:38.279956 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.279958    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert\") pod \"ingress-canary-vn4k4\" (UID: \"c309cf42-84d1-47a4-86d3-afcda3b25c50\") " pod="openshift-ingress-canary/ingress-canary-vn4k4"
May 28 16:08:38.280533 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:38.280124    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:08:38.280533 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:38.280185    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert podName:c309cf42-84d1-47a4-86d3-afcda3b25c50 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:42.280165733 +0000 UTC m=+42.129643195 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert") pod "ingress-canary-vn4k4" (UID: "c309cf42-84d1-47a4-86d3-afcda3b25c50") : secret "canary-serving-cert" not found
May 28 16:08:38.280651 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:38.280622    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:08:38.280704 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:38.280669    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls podName:2e0d243f-62d7-4b28-8bdc-b8315f003fec nodeName:}" failed. No retries permitted until 2026-05-28 16:08:42.280656198 +0000 UTC m=+42.130133653 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls") pod "dns-default-fcnt9" (UID: "2e0d243f-62d7-4b28-8bdc-b8315f003fec") : secret "dns-default-metrics-tls" not found
May 28 16:08:38.399233 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.398467    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f894ff576-s5chn"]
May 28 16:08:38.400647 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.400616    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8557ff54-zt5zt"]
May 28 16:08:38.402424 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.402402    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8557ff54-zt5zt"
May 28 16:08:38.402753 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.402559    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f894ff576-s5chn"
May 28 16:08:38.405700 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.405675    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
May 28 16:08:38.405824 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.405722    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
May 28 16:08:38.405824 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.405785    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
May 28 16:08:38.406084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.405922    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
May 28 16:08:38.406084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.405928    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
May 28 16:08:38.406084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.405993    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-wtms9\""
May 28 16:08:38.413067 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.413036    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f894ff576-s5chn"]
May 28 16:08:38.413193 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.413146    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8557ff54-zt5zt"]
May 28 16:08:38.582315 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.582227    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5b072ac0-8de2-425f-9ad3-cc3778833ff9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b8557ff54-zt5zt\" (UID: \"5b072ac0-8de2-425f-9ad3-cc3778833ff9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8557ff54-zt5zt"
May 28 16:08:38.582510 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.582348    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09a063d2-bd4a-4f79-b6ff-5020d07b8704-tmp\") pod \"klusterlet-addon-workmgr-6f894ff576-s5chn\" (UID: \"09a063d2-bd4a-4f79-b6ff-5020d07b8704\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f894ff576-s5chn"
May 28 16:08:38.582510 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.582407    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pvpd\" (UniqueName: \"kubernetes.io/projected/09a063d2-bd4a-4f79-b6ff-5020d07b8704-kube-api-access-8pvpd\") pod \"klusterlet-addon-workmgr-6f894ff576-s5chn\" (UID: \"09a063d2-bd4a-4f79-b6ff-5020d07b8704\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f894ff576-s5chn"
May 28 16:08:38.582510 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.582465    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/09a063d2-bd4a-4f79-b6ff-5020d07b8704-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f894ff576-s5chn\" (UID: \"09a063d2-bd4a-4f79-b6ff-5020d07b8704\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f894ff576-s5chn"
May 28 16:08:38.582510 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.582497    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xj9bj\" (UniqueName: \"kubernetes.io/projected/5b072ac0-8de2-425f-9ad3-cc3778833ff9-kube-api-access-xj9bj\") pod \"managed-serviceaccount-addon-agent-7b8557ff54-zt5zt\" (UID: \"5b072ac0-8de2-425f-9ad3-cc3778833ff9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8557ff54-zt5zt"
May 28 16:08:38.683388 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.683324    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8pvpd\" (UniqueName: \"kubernetes.io/projected/09a063d2-bd4a-4f79-b6ff-5020d07b8704-kube-api-access-8pvpd\") pod \"klusterlet-addon-workmgr-6f894ff576-s5chn\" (UID: \"09a063d2-bd4a-4f79-b6ff-5020d07b8704\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f894ff576-s5chn"
May 28 16:08:38.683543 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.683417    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/09a063d2-bd4a-4f79-b6ff-5020d07b8704-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f894ff576-s5chn\" (UID: \"09a063d2-bd4a-4f79-b6ff-5020d07b8704\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f894ff576-s5chn"
May 28 16:08:38.683543 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.683450    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xj9bj\" (UniqueName: \"kubernetes.io/projected/5b072ac0-8de2-425f-9ad3-cc3778833ff9-kube-api-access-xj9bj\") pod \"managed-serviceaccount-addon-agent-7b8557ff54-zt5zt\" (UID: \"5b072ac0-8de2-425f-9ad3-cc3778833ff9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8557ff54-zt5zt"
May 28 16:08:38.683543 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.683485    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5b072ac0-8de2-425f-9ad3-cc3778833ff9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b8557ff54-zt5zt\" (UID: \"5b072ac0-8de2-425f-9ad3-cc3778833ff9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8557ff54-zt5zt"
May 28 16:08:38.683673 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.683563    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09a063d2-bd4a-4f79-b6ff-5020d07b8704-tmp\") pod \"klusterlet-addon-workmgr-6f894ff576-s5chn\" (UID: \"09a063d2-bd4a-4f79-b6ff-5020d07b8704\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f894ff576-s5chn"
May 28 16:08:38.683992 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.683963    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09a063d2-bd4a-4f79-b6ff-5020d07b8704-tmp\") pod \"klusterlet-addon-workmgr-6f894ff576-s5chn\" (UID: \"09a063d2-bd4a-4f79-b6ff-5020d07b8704\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f894ff576-s5chn"
May 28 16:08:38.687137 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.687111    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5b072ac0-8de2-425f-9ad3-cc3778833ff9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7b8557ff54-zt5zt\" (UID: \"5b072ac0-8de2-425f-9ad3-cc3778833ff9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8557ff54-zt5zt"
May 28 16:08:38.687254 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.687120    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/09a063d2-bd4a-4f79-b6ff-5020d07b8704-klusterlet-config\") pod \"klusterlet-addon-workmgr-6f894ff576-s5chn\" (UID: \"09a063d2-bd4a-4f79-b6ff-5020d07b8704\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f894ff576-s5chn"
May 28 16:08:38.695576 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.695550    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xj9bj\" (UniqueName: \"kubernetes.io/projected/5b072ac0-8de2-425f-9ad3-cc3778833ff9-kube-api-access-xj9bj\") pod \"managed-serviceaccount-addon-agent-7b8557ff54-zt5zt\" (UID: \"5b072ac0-8de2-425f-9ad3-cc3778833ff9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8557ff54-zt5zt"
May 28 16:08:38.695755 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.695732    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pvpd\" (UniqueName: \"kubernetes.io/projected/09a063d2-bd4a-4f79-b6ff-5020d07b8704-kube-api-access-8pvpd\") pod \"klusterlet-addon-workmgr-6f894ff576-s5chn\" (UID: \"09a063d2-bd4a-4f79-b6ff-5020d07b8704\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f894ff576-s5chn"
May 28 16:08:38.722262 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.722231    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8557ff54-zt5zt"
May 28 16:08:38.729324 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:38.728993    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f894ff576-s5chn"
May 28 16:08:39.813233 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:39.813204    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8557ff54-zt5zt"]
May 28 16:08:39.824999 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:39.824973    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f894ff576-s5chn"]
May 28 16:08:39.890270 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:39.890232    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5b072ac0_8de2_425f_9ad3_cc3778833ff9.slice/crio-c8f1e35370a67b19be6f988b3abb4eb72554727df1e4fe278c5530a831b7d1a3 WatchSource:0}: Error finding container c8f1e35370a67b19be6f988b3abb4eb72554727df1e4fe278c5530a831b7d1a3: Status 404 returned error can't find the container with id c8f1e35370a67b19be6f988b3abb4eb72554727df1e4fe278c5530a831b7d1a3
May 28 16:08:39.891054 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:08:39.890913    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09a063d2_bd4a_4f79_b6ff_5020d07b8704.slice/crio-1e690c149df41bce2cbf81d7ba473488a8a96cd7c61c6e5d1a6ec69dcf715374 WatchSource:0}: Error finding container 1e690c149df41bce2cbf81d7ba473488a8a96cd7c61c6e5d1a6ec69dcf715374: Status 404 returned error can't find the container with id 1e690c149df41bce2cbf81d7ba473488a8a96cd7c61c6e5d1a6ec69dcf715374
May 28 16:08:40.879345 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:40.879300    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f894ff576-s5chn" event={"ID":"09a063d2-bd4a-4f79-b6ff-5020d07b8704","Type":"ContainerStarted","Data":"1e690c149df41bce2cbf81d7ba473488a8a96cd7c61c6e5d1a6ec69dcf715374"}
May 28 16:08:40.881025 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:40.880989    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8557ff54-zt5zt" event={"ID":"5b072ac0-8de2-425f-9ad3-cc3778833ff9","Type":"ContainerStarted","Data":"c8f1e35370a67b19be6f988b3abb4eb72554727df1e4fe278c5530a831b7d1a3"}
May 28 16:08:40.884239 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:40.884201    2564 generic.go:358] "Generic (PLEG): container finished" podID="3bca20c9-0f2d-4f5f-81b0-b26a90596b08" containerID="ce12c3ae0ee722b7d8d825d342423d1047d3a7bad5f36d819797d95f8f3136df" exitCode=0
May 28 16:08:40.884356 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:40.884251    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bh5p5" event={"ID":"3bca20c9-0f2d-4f5f-81b0-b26a90596b08","Type":"ContainerDied","Data":"ce12c3ae0ee722b7d8d825d342423d1047d3a7bad5f36d819797d95f8f3136df"}
May 28 16:08:41.890524 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:41.890422    2564 generic.go:358] "Generic (PLEG): container finished" podID="3bca20c9-0f2d-4f5f-81b0-b26a90596b08" containerID="2eead886f77329c4ab7091be6ab6d158df2d066c71395ee464bc69f555a00b0f" exitCode=0
May 28 16:08:41.890524 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:41.890491    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bh5p5" event={"ID":"3bca20c9-0f2d-4f5f-81b0-b26a90596b08","Type":"ContainerDied","Data":"2eead886f77329c4ab7091be6ab6d158df2d066c71395ee464bc69f555a00b0f"}
May 28 16:08:42.320225 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:42.319965    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls\") pod \"dns-default-fcnt9\" (UID: \"2e0d243f-62d7-4b28-8bdc-b8315f003fec\") " pod="openshift-dns/dns-default-fcnt9"
May 28 16:08:42.320225 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:42.320018    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert\") pod \"ingress-canary-vn4k4\" (UID: \"c309cf42-84d1-47a4-86d3-afcda3b25c50\") " pod="openshift-ingress-canary/ingress-canary-vn4k4"
May 28 16:08:42.320225 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:42.320111    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:08:42.320225 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:42.320161    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:08:42.320225 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:42.320170    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls podName:2e0d243f-62d7-4b28-8bdc-b8315f003fec nodeName:}" failed. No retries permitted until 2026-05-28 16:08:50.320150516 +0000 UTC m=+50.169627983 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls") pod "dns-default-fcnt9" (UID: "2e0d243f-62d7-4b28-8bdc-b8315f003fec") : secret "dns-default-metrics-tls" not found
May 28 16:08:42.320225 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:42.320192    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert podName:c309cf42-84d1-47a4-86d3-afcda3b25c50 nodeName:}" failed. No retries permitted until 2026-05-28 16:08:50.320182452 +0000 UTC m=+50.169659905 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert") pod "ingress-canary-vn4k4" (UID: "c309cf42-84d1-47a4-86d3-afcda3b25c50") : secret "canary-serving-cert" not found
May 28 16:08:44.900830 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:44.900731    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-bh5p5" event={"ID":"3bca20c9-0f2d-4f5f-81b0-b26a90596b08","Type":"ContainerStarted","Data":"918d67a22fd62abd6b7e283feefb0fee5b6e3e1c4a28b419f00d9b6557b7466b"}
May 28 16:08:44.902064 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:44.902039    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f894ff576-s5chn" event={"ID":"09a063d2-bd4a-4f79-b6ff-5020d07b8704","Type":"ContainerStarted","Data":"35b6cecd4f59259a5fd9d5f1c3f4258bda8232714fd81e30d2b4bf2464a7e4bd"}
May 28 16:08:44.902234 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:44.902220    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f894ff576-s5chn"
May 28 16:08:44.903615 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:44.903589    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8557ff54-zt5zt" event={"ID":"5b072ac0-8de2-425f-9ad3-cc3778833ff9","Type":"ContainerStarted","Data":"8e287d31f828a698d1af6fff0affc679be2cc9455332e0cef5656d85d503966e"}
May 28 16:08:44.904128 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:44.904111    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f894ff576-s5chn"
May 28 16:08:44.925158 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:44.925112    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-bh5p5" podStartSLOduration=8.293217407 podStartE2EDuration="44.92509937s" podCreationTimestamp="2026-05-28 16:08:00 +0000 UTC" firstStartedPulling="2026-05-28 16:08:03.290653454 +0000 UTC m=+3.140130915" lastFinishedPulling="2026-05-28 16:08:39.922535412 +0000 UTC m=+39.772012878" observedRunningTime="2026-05-28 16:08:44.924630895 +0000 UTC m=+44.774108365" watchObservedRunningTime="2026-05-28 16:08:44.92509937 +0000 UTC m=+44.774576841"
May 28 16:08:44.941634 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:44.941566    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7b8557ff54-zt5zt" podStartSLOduration=2.291800661 podStartE2EDuration="6.941548963s" podCreationTimestamp="2026-05-28 16:08:38 +0000 UTC" firstStartedPulling="2026-05-28 16:08:39.898743541 +0000 UTC m=+39.748220993" lastFinishedPulling="2026-05-28 16:08:44.548491824 +0000 UTC m=+44.397969295" observedRunningTime="2026-05-28 16:08:44.941211046 +0000 UTC m=+44.790688513" watchObservedRunningTime="2026-05-28 16:08:44.941548963 +0000 UTC m=+44.791026436"
May 28 16:08:44.958837 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:44.958795    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6f894ff576-s5chn" podStartSLOduration=2.296082432 podStartE2EDuration="6.95878201s" podCreationTimestamp="2026-05-28 16:08:38 +0000 UTC" firstStartedPulling="2026-05-28 16:08:39.898648742 +0000 UTC m=+39.748126193" lastFinishedPulling="2026-05-28 16:08:44.561348307 +0000 UTC m=+44.410825771" observedRunningTime="2026-05-28 16:08:44.95805967 +0000 UTC m=+44.807537142" watchObservedRunningTime="2026-05-28 16:08:44.95878201 +0000 UTC m=+44.808259481"
May 28 16:08:50.380134 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:50.380090    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls\") pod \"dns-default-fcnt9\" (UID: \"2e0d243f-62d7-4b28-8bdc-b8315f003fec\") " pod="openshift-dns/dns-default-fcnt9"
May 28 16:08:50.380134 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:08:50.380134    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert\") pod \"ingress-canary-vn4k4\" (UID: \"c309cf42-84d1-47a4-86d3-afcda3b25c50\") " pod="openshift-ingress-canary/ingress-canary-vn4k4"
May 28 16:08:50.380648 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:50.380254    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:08:50.380648 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:50.380321    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls podName:2e0d243f-62d7-4b28-8bdc-b8315f003fec nodeName:}" failed. No retries permitted until 2026-05-28 16:09:06.38030484 +0000 UTC m=+66.229782299 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls") pod "dns-default-fcnt9" (UID: "2e0d243f-62d7-4b28-8bdc-b8315f003fec") : secret "dns-default-metrics-tls" not found
May 28 16:08:50.380648 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:50.380254    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:08:50.380648 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:08:50.380399    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert podName:c309cf42-84d1-47a4-86d3-afcda3b25c50 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:06.380386752 +0000 UTC m=+66.229864211 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert") pod "ingress-canary-vn4k4" (UID: "c309cf42-84d1-47a4-86d3-afcda3b25c50") : secret "canary-serving-cert" not found
May 28 16:09:01.870085 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:01.870052    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-z9v5g"
May 28 16:09:06.392147 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:06.392099    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls\") pod \"dns-default-fcnt9\" (UID: \"2e0d243f-62d7-4b28-8bdc-b8315f003fec\") " pod="openshift-dns/dns-default-fcnt9"
May 28 16:09:06.392147 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:06.392153    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert\") pod \"ingress-canary-vn4k4\" (UID: \"c309cf42-84d1-47a4-86d3-afcda3b25c50\") " pod="openshift-ingress-canary/ingress-canary-vn4k4"
May 28 16:09:06.392754 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:06.392198    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs\") pod \"network-metrics-daemon-r5nt6\" (UID: \"8e0f7bc7-0a1e-481f-a720-52a99554e9d6\") " pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:09:06.392754 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:09:06.392264    2564 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 16:09:06.392754 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:09:06.392314    2564 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 16:09:06.392754 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:09:06.392348    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls podName:2e0d243f-62d7-4b28-8bdc-b8315f003fec nodeName:}" failed. No retries permitted until 2026-05-28 16:09:38.392325787 +0000 UTC m=+98.241803236 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls") pod "dns-default-fcnt9" (UID: "2e0d243f-62d7-4b28-8bdc-b8315f003fec") : secret "dns-default-metrics-tls" not found
May 28 16:09:06.392754 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:09:06.392440    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert podName:c309cf42-84d1-47a4-86d3-afcda3b25c50 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:38.392425181 +0000 UTC m=+98.241902631 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert") pod "ingress-canary-vn4k4" (UID: "c309cf42-84d1-47a4-86d3-afcda3b25c50") : secret "canary-serving-cert" not found
May 28 16:09:06.396256 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:06.396238    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 16:09:06.403230 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:09:06.403206    2564 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 16:09:06.403330 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:09:06.403269    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs podName:8e0f7bc7-0a1e-481f-a720-52a99554e9d6 nodeName:}" failed. No retries permitted until 2026-05-28 16:10:10.403249286 +0000 UTC m=+130.252726735 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs") pod "network-metrics-daemon-r5nt6" (UID: "8e0f7bc7-0a1e-481f-a720-52a99554e9d6") : secret "metrics-daemon-secret" not found
May 28 16:09:06.492834 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:06.492792    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vfz9j\" (UniqueName: \"kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j\") pod \"network-check-target-z7k9v\" (UID: \"a3520fd9-ca91-42b2-a5bb-94ec4ae75e84\") " pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:09:06.495319 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:06.495299    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 16:09:06.505508 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:06.505484    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 16:09:06.516103 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:06.516078    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfz9j\" (UniqueName: \"kubernetes.io/projected/a3520fd9-ca91-42b2-a5bb-94ec4ae75e84-kube-api-access-vfz9j\") pod \"network-check-target-z7k9v\" (UID: \"a3520fd9-ca91-42b2-a5bb-94ec4ae75e84\") " pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:09:06.634839 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:06.634805    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-qjc5m\""
May 28 16:09:06.643015 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:06.642947    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:09:06.780265 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:09:06.780232    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3520fd9_ca91_42b2_a5bb_94ec4ae75e84.slice/crio-6f30264aa105e8e74741954edb71e1bd5f9ea7fd38b8cdf1aa74270d93b97e1f WatchSource:0}: Error finding container 6f30264aa105e8e74741954edb71e1bd5f9ea7fd38b8cdf1aa74270d93b97e1f: Status 404 returned error can't find the container with id 6f30264aa105e8e74741954edb71e1bd5f9ea7fd38b8cdf1aa74270d93b97e1f
May 28 16:09:06.781432 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:06.781314    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-z7k9v"]
May 28 16:09:06.947332 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:06.947243    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z7k9v" event={"ID":"a3520fd9-ca91-42b2-a5bb-94ec4ae75e84","Type":"ContainerStarted","Data":"6f30264aa105e8e74741954edb71e1bd5f9ea7fd38b8cdf1aa74270d93b97e1f"}
May 28 16:09:09.081354 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:09.081314    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-4p82h"]
May 28 16:09:09.083032 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:09.083016    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-4p82h"
May 28 16:09:09.085534 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:09.085508    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 28 16:09:09.086500 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:09.086478    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 28 16:09:09.086605 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:09.086516    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9c7dx\""
May 28 16:09:09.086605 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:09.086526    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 28 16:09:09.094100 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:09.094077    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-4p82h"]
May 28 16:09:09.111355 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:09.111322    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlzws\" (UniqueName: \"kubernetes.io/projected/f183d100-01a5-4b59-8670-c5a469c32ac5-kube-api-access-tlzws\") pod \"cluster-samples-operator-697587599-4p82h\" (UID: \"f183d100-01a5-4b59-8670-c5a469c32ac5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-4p82h"
May 28 16:09:09.111564 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:09.111398    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f183d100-01a5-4b59-8670-c5a469c32ac5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-4p82h\" (UID: \"f183d100-01a5-4b59-8670-c5a469c32ac5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-4p82h"
May 28 16:09:09.212725 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:09.212686    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f183d100-01a5-4b59-8670-c5a469c32ac5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-4p82h\" (UID: \"f183d100-01a5-4b59-8670-c5a469c32ac5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-4p82h"
May 28 16:09:09.212932 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:09.212793    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tlzws\" (UniqueName: \"kubernetes.io/projected/f183d100-01a5-4b59-8670-c5a469c32ac5-kube-api-access-tlzws\") pod \"cluster-samples-operator-697587599-4p82h\" (UID: \"f183d100-01a5-4b59-8670-c5a469c32ac5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-4p82h"
May 28 16:09:09.212932 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:09:09.212871    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 16:09:09.213030 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:09:09.212976    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f183d100-01a5-4b59-8670-c5a469c32ac5-samples-operator-tls podName:f183d100-01a5-4b59-8670-c5a469c32ac5 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:09.712956954 +0000 UTC m=+69.562434404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f183d100-01a5-4b59-8670-c5a469c32ac5-samples-operator-tls") pod "cluster-samples-operator-697587599-4p82h" (UID: "f183d100-01a5-4b59-8670-c5a469c32ac5") : secret "samples-operator-tls" not found
May 28 16:09:09.222621 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:09.222593    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlzws\" (UniqueName: \"kubernetes.io/projected/f183d100-01a5-4b59-8670-c5a469c32ac5-kube-api-access-tlzws\") pod \"cluster-samples-operator-697587599-4p82h\" (UID: \"f183d100-01a5-4b59-8670-c5a469c32ac5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-4p82h"
May 28 16:09:09.717275 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:09.717236    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f183d100-01a5-4b59-8670-c5a469c32ac5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-4p82h\" (UID: \"f183d100-01a5-4b59-8670-c5a469c32ac5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-4p82h"
May 28 16:09:09.717478 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:09:09.717375    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 16:09:09.717478 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:09:09.717455    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f183d100-01a5-4b59-8670-c5a469c32ac5-samples-operator-tls podName:f183d100-01a5-4b59-8670-c5a469c32ac5 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:10.717438287 +0000 UTC m=+70.566915740 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f183d100-01a5-4b59-8670-c5a469c32ac5-samples-operator-tls") pod "cluster-samples-operator-697587599-4p82h" (UID: "f183d100-01a5-4b59-8670-c5a469c32ac5") : secret "samples-operator-tls" not found
May 28 16:09:10.725923 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:10.725808    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f183d100-01a5-4b59-8670-c5a469c32ac5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-4p82h\" (UID: \"f183d100-01a5-4b59-8670-c5a469c32ac5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-4p82h"
May 28 16:09:10.725923 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:09:10.725912    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 16:09:10.726346 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:09:10.725957    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f183d100-01a5-4b59-8670-c5a469c32ac5-samples-operator-tls podName:f183d100-01a5-4b59-8670-c5a469c32ac5 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:12.72594492 +0000 UTC m=+72.575422373 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f183d100-01a5-4b59-8670-c5a469c32ac5-samples-operator-tls") pod "cluster-samples-operator-697587599-4p82h" (UID: "f183d100-01a5-4b59-8670-c5a469c32ac5") : secret "samples-operator-tls" not found
May 28 16:09:10.873194 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:10.873102    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wh527"]
May 28 16:09:10.874837 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:10.874821    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wh527"
May 28 16:09:10.877294 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:10.877273    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 28 16:09:10.877294 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:10.877277    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 28 16:09:10.877523 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:10.877506    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 28 16:09:10.877734 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:10.877718    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 28 16:09:10.878235 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:10.878220    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-frngp\""
May 28 16:09:10.895214 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:10.895192    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wh527"]
May 28 16:09:10.927501 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:10.927461    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5033e923-8bd0-4677-a9ea-67e15b9c1a56-config\") pod \"kube-storage-version-migrator-operator-565644f49-wh527\" (UID: \"5033e923-8bd0-4677-a9ea-67e15b9c1a56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wh527"
May 28 16:09:10.927501 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:10.927497    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7fjpz\" (UniqueName: \"kubernetes.io/projected/5033e923-8bd0-4677-a9ea-67e15b9c1a56-kube-api-access-7fjpz\") pod \"kube-storage-version-migrator-operator-565644f49-wh527\" (UID: \"5033e923-8bd0-4677-a9ea-67e15b9c1a56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wh527"
May 28 16:09:10.927716 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:10.927529    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5033e923-8bd0-4677-a9ea-67e15b9c1a56-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-wh527\" (UID: \"5033e923-8bd0-4677-a9ea-67e15b9c1a56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wh527"
May 28 16:09:10.956721 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:10.956683    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-z7k9v" event={"ID":"a3520fd9-ca91-42b2-a5bb-94ec4ae75e84","Type":"ContainerStarted","Data":"58a0622357e4771eb1ef49202ef8a88dd9550f13579236f9a35799b1369f842e"}
May 28 16:09:10.956865 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:10.956831    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:09:10.975163 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:10.973456    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-z7k9v" podStartSLOduration=67.196362754 podStartE2EDuration="1m10.973439136s" podCreationTimestamp="2026-05-28 16:08:00 +0000 UTC" firstStartedPulling="2026-05-28 16:09:06.781663686 +0000 UTC m=+66.631141148" lastFinishedPulling="2026-05-28 16:09:10.558740078 +0000 UTC m=+70.408217530" observedRunningTime="2026-05-28 16:09:10.972423521 +0000 UTC m=+70.821900993" watchObservedRunningTime="2026-05-28 16:09:10.973439136 +0000 UTC m=+70.822916610"
May 28 16:09:11.028765 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:11.028724    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5033e923-8bd0-4677-a9ea-67e15b9c1a56-config\") pod \"kube-storage-version-migrator-operator-565644f49-wh527\" (UID: \"5033e923-8bd0-4677-a9ea-67e15b9c1a56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wh527"
May 28 16:09:11.028765 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:11.028766    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7fjpz\" (UniqueName: \"kubernetes.io/projected/5033e923-8bd0-4677-a9ea-67e15b9c1a56-kube-api-access-7fjpz\") pod \"kube-storage-version-migrator-operator-565644f49-wh527\" (UID: \"5033e923-8bd0-4677-a9ea-67e15b9c1a56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wh527"
May 28 16:09:11.028982 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:11.028787    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5033e923-8bd0-4677-a9ea-67e15b9c1a56-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-wh527\" (UID: \"5033e923-8bd0-4677-a9ea-67e15b9c1a56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wh527"
May 28 16:09:11.029388 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:11.029330    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/5033e923-8bd0-4677-a9ea-67e15b9c1a56-config\") pod \"kube-storage-version-migrator-operator-565644f49-wh527\" (UID: \"5033e923-8bd0-4677-a9ea-67e15b9c1a56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wh527"
May 28 16:09:11.031113 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:11.031086    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/5033e923-8bd0-4677-a9ea-67e15b9c1a56-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-wh527\" (UID: \"5033e923-8bd0-4677-a9ea-67e15b9c1a56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wh527"
May 28 16:09:11.037078 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:11.037055    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7fjpz\" (UniqueName: \"kubernetes.io/projected/5033e923-8bd0-4677-a9ea-67e15b9c1a56-kube-api-access-7fjpz\") pod \"kube-storage-version-migrator-operator-565644f49-wh527\" (UID: \"5033e923-8bd0-4677-a9ea-67e15b9c1a56\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wh527"
May 28 16:09:11.183957 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:11.183867    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wh527"
May 28 16:09:11.304639 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:11.304609    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wh527"]
May 28 16:09:11.307289 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:09:11.307263    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5033e923_8bd0_4677_a9ea_67e15b9c1a56.slice/crio-0cc8d3db96f4d98fd46e9da2365017bfab846ab3e64885fe3667966b68628c59 WatchSource:0}: Error finding container 0cc8d3db96f4d98fd46e9da2365017bfab846ab3e64885fe3667966b68628c59: Status 404 returned error can't find the container with id 0cc8d3db96f4d98fd46e9da2365017bfab846ab3e64885fe3667966b68628c59
May 28 16:09:11.960117 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:11.960076    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wh527" event={"ID":"5033e923-8bd0-4677-a9ea-67e15b9c1a56","Type":"ContainerStarted","Data":"0cc8d3db96f4d98fd46e9da2365017bfab846ab3e64885fe3667966b68628c59"}
May 28 16:09:12.742448 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:12.742409    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f183d100-01a5-4b59-8670-c5a469c32ac5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-4p82h\" (UID: \"f183d100-01a5-4b59-8670-c5a469c32ac5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-4p82h"
May 28 16:09:12.742618 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:09:12.742551    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 16:09:12.742658 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:09:12.742622    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f183d100-01a5-4b59-8670-c5a469c32ac5-samples-operator-tls podName:f183d100-01a5-4b59-8670-c5a469c32ac5 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:16.742606302 +0000 UTC m=+76.592083751 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f183d100-01a5-4b59-8670-c5a469c32ac5-samples-operator-tls") pod "cluster-samples-operator-697587599-4p82h" (UID: "f183d100-01a5-4b59-8670-c5a469c32ac5") : secret "samples-operator-tls" not found
May 28 16:09:13.964515 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:13.964480    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wh527" event={"ID":"5033e923-8bd0-4677-a9ea-67e15b9c1a56","Type":"ContainerStarted","Data":"0fed503d5c64067c835c8508c066ff5cce15b8b38b743edbed257babc633ad04"}
May 28 16:09:15.574296 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:15.574233    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wh527" podStartSLOduration=3.398973855 podStartE2EDuration="5.574212316s" podCreationTimestamp="2026-05-28 16:09:10 +0000 UTC" firstStartedPulling="2026-05-28 16:09:11.308980757 +0000 UTC m=+71.158458207" lastFinishedPulling="2026-05-28 16:09:13.484219218 +0000 UTC m=+73.333696668" observedRunningTime="2026-05-28 16:09:13.978699169 +0000 UTC m=+73.828176641" watchObservedRunningTime="2026-05-28 16:09:15.574212316 +0000 UTC m=+75.423689787"
May 28 16:09:15.575356 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:15.575329    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-jd5k6"]
May 28 16:09:15.577228 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:15.577206    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jd5k6"
May 28 16:09:15.579494 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:15.579473    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-45kpx\""
May 28 16:09:15.579578 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:15.579474    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 28 16:09:15.580382 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:15.580348    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 28 16:09:15.584895 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:15.584840    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-jd5k6"]
May 28 16:09:15.644615 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:15.644591    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-26bgl_a60f68cf-b6ec-4d94-bab6-0f8bb7e81610/dns-node-resolver/0.log"
May 28 16:09:15.663428 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:15.663398    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tf99\" (UniqueName: \"kubernetes.io/projected/858042ce-ced6-4bed-8a87-356ebe7386a6-kube-api-access-9tf99\") pod \"migrator-b985f5d89-jd5k6\" (UID: \"858042ce-ced6-4bed-8a87-356ebe7386a6\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jd5k6"
May 28 16:09:15.764674 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:15.764636    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9tf99\" (UniqueName: \"kubernetes.io/projected/858042ce-ced6-4bed-8a87-356ebe7386a6-kube-api-access-9tf99\") pod \"migrator-b985f5d89-jd5k6\" (UID: \"858042ce-ced6-4bed-8a87-356ebe7386a6\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jd5k6"
May 28 16:09:15.773310 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:15.773281    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tf99\" (UniqueName: \"kubernetes.io/projected/858042ce-ced6-4bed-8a87-356ebe7386a6-kube-api-access-9tf99\") pod \"migrator-b985f5d89-jd5k6\" (UID: \"858042ce-ced6-4bed-8a87-356ebe7386a6\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jd5k6"
May 28 16:09:15.886500 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:15.886416    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jd5k6"
May 28 16:09:16.005345 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:16.005310    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-jd5k6"]
May 28 16:09:16.013836 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:09:16.013807    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod858042ce_ced6_4bed_8a87_356ebe7386a6.slice/crio-2fb8c0cea3b3709eda3fa3b18d189d22ed9b180ef3b24f01f2d14897c339c44a WatchSource:0}: Error finding container 2fb8c0cea3b3709eda3fa3b18d189d22ed9b180ef3b24f01f2d14897c339c44a: Status 404 returned error can't find the container with id 2fb8c0cea3b3709eda3fa3b18d189d22ed9b180ef3b24f01f2d14897c339c44a
May 28 16:09:16.441915 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:16.441890    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9xbl7_9805051e-ef8c-4375-960a-e649c08d76a7/node-ca/0.log"
May 28 16:09:16.773092 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:16.773058    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f183d100-01a5-4b59-8670-c5a469c32ac5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-4p82h\" (UID: \"f183d100-01a5-4b59-8670-c5a469c32ac5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-4p82h"
May 28 16:09:16.773574 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:09:16.773218    2564 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 16:09:16.773574 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:09:16.773288    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f183d100-01a5-4b59-8670-c5a469c32ac5-samples-operator-tls podName:f183d100-01a5-4b59-8670-c5a469c32ac5 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:24.773272475 +0000 UTC m=+84.622749928 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f183d100-01a5-4b59-8670-c5a469c32ac5-samples-operator-tls") pod "cluster-samples-operator-697587599-4p82h" (UID: "f183d100-01a5-4b59-8670-c5a469c32ac5") : secret "samples-operator-tls" not found
May 28 16:09:16.971025 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:16.970987    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jd5k6" event={"ID":"858042ce-ced6-4bed-8a87-356ebe7386a6","Type":"ContainerStarted","Data":"2fb8c0cea3b3709eda3fa3b18d189d22ed9b180ef3b24f01f2d14897c339c44a"}
May 28 16:09:17.975540 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:17.975453    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jd5k6" event={"ID":"858042ce-ced6-4bed-8a87-356ebe7386a6","Type":"ContainerStarted","Data":"de9b9c7687a365b59a206e47206749e3ad9bc686ef7811dcdd69d5eeed8e1680"}
May 28 16:09:17.975540 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:17.975488    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jd5k6" event={"ID":"858042ce-ced6-4bed-8a87-356ebe7386a6","Type":"ContainerStarted","Data":"ba4e2bb58630f32d3beb792789940532e34bfc055c8cb1d5b72cf5eed7dcb84e"}
May 28 16:09:17.990633 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:17.990585    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-jd5k6" podStartSLOduration=1.4131851659999999 podStartE2EDuration="2.990572081s" podCreationTimestamp="2026-05-28 16:09:15 +0000 UTC" firstStartedPulling="2026-05-28 16:09:16.015684101 +0000 UTC m=+75.865161550" lastFinishedPulling="2026-05-28 16:09:17.593071015 +0000 UTC m=+77.442548465" observedRunningTime="2026-05-28 16:09:17.988619547 +0000 UTC m=+77.838097019" watchObservedRunningTime="2026-05-28 16:09:17.990572081 +0000 UTC m=+77.840049573"
May 28 16:09:19.943414 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:19.943381    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-8nsfc"]
May 28 16:09:19.949673 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:19.949647    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-8nsfc"
May 28 16:09:19.953253 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:19.953231    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 28 16:09:19.953390 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:19.953375    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 28 16:09:19.954414 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:19.954393    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-pksgc\""
May 28 16:09:19.954631 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:19.954404    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 28 16:09:19.954708 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:19.954435    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 28 16:09:19.957108 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:19.957085    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-8nsfc"]
May 28 16:09:19.999081 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:19.999035    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c14c6ed1-fb08-43aa-8ba2-e1fb40f23aab-signing-key\") pod \"service-ca-67d667c7d-8nsfc\" (UID: \"c14c6ed1-fb08-43aa-8ba2-e1fb40f23aab\") " pod="openshift-service-ca/service-ca-67d667c7d-8nsfc"
May 28 16:09:19.999276 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:19.999173    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c14c6ed1-fb08-43aa-8ba2-e1fb40f23aab-signing-cabundle\") pod \"service-ca-67d667c7d-8nsfc\" (UID: \"c14c6ed1-fb08-43aa-8ba2-e1fb40f23aab\") " pod="openshift-service-ca/service-ca-67d667c7d-8nsfc"
May 28 16:09:19.999276 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:19.999254    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plrlq\" (UniqueName: \"kubernetes.io/projected/c14c6ed1-fb08-43aa-8ba2-e1fb40f23aab-kube-api-access-plrlq\") pod \"service-ca-67d667c7d-8nsfc\" (UID: \"c14c6ed1-fb08-43aa-8ba2-e1fb40f23aab\") " pod="openshift-service-ca/service-ca-67d667c7d-8nsfc"
May 28 16:09:20.100332 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:20.100298    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c14c6ed1-fb08-43aa-8ba2-e1fb40f23aab-signing-key\") pod \"service-ca-67d667c7d-8nsfc\" (UID: \"c14c6ed1-fb08-43aa-8ba2-e1fb40f23aab\") " pod="openshift-service-ca/service-ca-67d667c7d-8nsfc"
May 28 16:09:20.100445 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:20.100393    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c14c6ed1-fb08-43aa-8ba2-e1fb40f23aab-signing-cabundle\") pod \"service-ca-67d667c7d-8nsfc\" (UID: \"c14c6ed1-fb08-43aa-8ba2-e1fb40f23aab\") " pod="openshift-service-ca/service-ca-67d667c7d-8nsfc"
May 28 16:09:20.100445 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:20.100431    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-plrlq\" (UniqueName: \"kubernetes.io/projected/c14c6ed1-fb08-43aa-8ba2-e1fb40f23aab-kube-api-access-plrlq\") pod \"service-ca-67d667c7d-8nsfc\" (UID: \"c14c6ed1-fb08-43aa-8ba2-e1fb40f23aab\") " pod="openshift-service-ca/service-ca-67d667c7d-8nsfc"
May 28 16:09:20.101129 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:20.101105    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c14c6ed1-fb08-43aa-8ba2-e1fb40f23aab-signing-cabundle\") pod \"service-ca-67d667c7d-8nsfc\" (UID: \"c14c6ed1-fb08-43aa-8ba2-e1fb40f23aab\") " pod="openshift-service-ca/service-ca-67d667c7d-8nsfc"
May 28 16:09:20.102916 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:20.102893    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c14c6ed1-fb08-43aa-8ba2-e1fb40f23aab-signing-key\") pod \"service-ca-67d667c7d-8nsfc\" (UID: \"c14c6ed1-fb08-43aa-8ba2-e1fb40f23aab\") " pod="openshift-service-ca/service-ca-67d667c7d-8nsfc"
May 28 16:09:20.107892 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:20.107871    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plrlq\" (UniqueName: \"kubernetes.io/projected/c14c6ed1-fb08-43aa-8ba2-e1fb40f23aab-kube-api-access-plrlq\") pod \"service-ca-67d667c7d-8nsfc\" (UID: \"c14c6ed1-fb08-43aa-8ba2-e1fb40f23aab\") " pod="openshift-service-ca/service-ca-67d667c7d-8nsfc"
May 28 16:09:20.258522 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:20.258481    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-8nsfc"
May 28 16:09:20.382176 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:20.382138    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-8nsfc"]
May 28 16:09:20.385799 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:09:20.385762    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc14c6ed1_fb08_43aa_8ba2_e1fb40f23aab.slice/crio-aff8eb4e63f9cd14514f328456c7ef8c7337b9a52661908532059687b8bbae0f WatchSource:0}: Error finding container aff8eb4e63f9cd14514f328456c7ef8c7337b9a52661908532059687b8bbae0f: Status 404 returned error can't find the container with id aff8eb4e63f9cd14514f328456c7ef8c7337b9a52661908532059687b8bbae0f
May 28 16:09:20.985110 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:20.985070    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-8nsfc" event={"ID":"c14c6ed1-fb08-43aa-8ba2-e1fb40f23aab","Type":"ContainerStarted","Data":"aff8eb4e63f9cd14514f328456c7ef8c7337b9a52661908532059687b8bbae0f"}
May 28 16:09:22.993032 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:22.992980    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-8nsfc" event={"ID":"c14c6ed1-fb08-43aa-8ba2-e1fb40f23aab","Type":"ContainerStarted","Data":"e7b69b967ec10a759c93dc77e4e34834933378bd28a1cf54854e4445cbdb5613"}
May 28 16:09:23.007840 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:23.007773    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-8nsfc" podStartSLOduration=2.085316811 podStartE2EDuration="4.007752927s" podCreationTimestamp="2026-05-28 16:09:19 +0000 UTC" firstStartedPulling="2026-05-28 16:09:20.387582677 +0000 UTC m=+80.237060126" lastFinishedPulling="2026-05-28 16:09:22.310018789 +0000 UTC m=+82.159496242" observedRunningTime="2026-05-28 16:09:23.006990927 +0000 UTC m=+82.856468396" watchObservedRunningTime="2026-05-28 16:09:23.007752927 +0000 UTC m=+82.857230398"
May 28 16:09:24.842754 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:24.842711    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f183d100-01a5-4b59-8670-c5a469c32ac5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-4p82h\" (UID: \"f183d100-01a5-4b59-8670-c5a469c32ac5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-4p82h"
May 28 16:09:24.845340 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:24.845316    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f183d100-01a5-4b59-8670-c5a469c32ac5-samples-operator-tls\") pod \"cluster-samples-operator-697587599-4p82h\" (UID: \"f183d100-01a5-4b59-8670-c5a469c32ac5\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-4p82h"
May 28 16:09:24.995405 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:24.995348    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-4p82h"
May 28 16:09:25.115888 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:25.115796    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-4p82h"]
May 28 16:09:26.001413 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:26.001376    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-4p82h" event={"ID":"f183d100-01a5-4b59-8670-c5a469c32ac5","Type":"ContainerStarted","Data":"b252c4d3a01ed367b58f206a0cb3548d45b9ed979c4b9dfab5c87132594ef697"}
May 28 16:09:28.007978 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:28.007942    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-4p82h" event={"ID":"f183d100-01a5-4b59-8670-c5a469c32ac5","Type":"ContainerStarted","Data":"7d7c20548cce1720ffc83ceb12f94216139df9608a24c15c6a44272d707c89eb"}
May 28 16:09:28.007978 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:28.007981    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-4p82h" event={"ID":"f183d100-01a5-4b59-8670-c5a469c32ac5","Type":"ContainerStarted","Data":"69a4d1b615c4aacf5d0f4fe5f57e486716ae65f0573fc565e6c41755a1a1bae0"}
May 28 16:09:28.024816 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:28.024757    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-4p82h" podStartSLOduration=16.648540071 podStartE2EDuration="19.02474323s" podCreationTimestamp="2026-05-28 16:09:09 +0000 UTC" firstStartedPulling="2026-05-28 16:09:25.156002092 +0000 UTC m=+85.005479555" lastFinishedPulling="2026-05-28 16:09:27.532205264 +0000 UTC m=+87.381682714" observedRunningTime="2026-05-28 16:09:28.023806147 +0000 UTC m=+87.873283617" watchObservedRunningTime="2026-05-28 16:09:28.02474323 +0000 UTC m=+87.874220750"
May 28 16:09:38.443661 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:38.443620    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls\") pod \"dns-default-fcnt9\" (UID: \"2e0d243f-62d7-4b28-8bdc-b8315f003fec\") " pod="openshift-dns/dns-default-fcnt9"
May 28 16:09:38.443661 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:38.443663    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert\") pod \"ingress-canary-vn4k4\" (UID: \"c309cf42-84d1-47a4-86d3-afcda3b25c50\") " pod="openshift-ingress-canary/ingress-canary-vn4k4"
May 28 16:09:38.446244 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:38.446223    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/2e0d243f-62d7-4b28-8bdc-b8315f003fec-metrics-tls\") pod \"dns-default-fcnt9\" (UID: \"2e0d243f-62d7-4b28-8bdc-b8315f003fec\") " pod="openshift-dns/dns-default-fcnt9"
May 28 16:09:38.446393 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:38.446356    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c309cf42-84d1-47a4-86d3-afcda3b25c50-cert\") pod \"ingress-canary-vn4k4\" (UID: \"c309cf42-84d1-47a4-86d3-afcda3b25c50\") " pod="openshift-ingress-canary/ingress-canary-vn4k4"
May 28 16:09:38.713862 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:38.713776    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rfj6w\""
May 28 16:09:38.721068 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:38.721040    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-fcnt9"
May 28 16:09:38.725080 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:38.725060    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ckq8r\""
May 28 16:09:38.733734 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:38.733713    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vn4k4"
May 28 16:09:38.855575 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:38.855544    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-fcnt9"]
May 28 16:09:38.858655 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:09:38.858615    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e0d243f_62d7_4b28_8bdc_b8315f003fec.slice/crio-3b0249da0007f986eed25c0d2a05cbb6971a1f7e7a72f4f526929f3919100edd WatchSource:0}: Error finding container 3b0249da0007f986eed25c0d2a05cbb6971a1f7e7a72f4f526929f3919100edd: Status 404 returned error can't find the container with id 3b0249da0007f986eed25c0d2a05cbb6971a1f7e7a72f4f526929f3919100edd
May 28 16:09:38.874078 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:38.874052    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vn4k4"]
May 28 16:09:38.877371 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:09:38.877333    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc309cf42_84d1_47a4_86d3_afcda3b25c50.slice/crio-e4b6f753f2f66867dec8d7d9a73807174a89e9f30205907dac18cac3efe075f5 WatchSource:0}: Error finding container e4b6f753f2f66867dec8d7d9a73807174a89e9f30205907dac18cac3efe075f5: Status 404 returned error can't find the container with id e4b6f753f2f66867dec8d7d9a73807174a89e9f30205907dac18cac3efe075f5
May 28 16:09:39.035756 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:39.035719    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vn4k4" event={"ID":"c309cf42-84d1-47a4-86d3-afcda3b25c50","Type":"ContainerStarted","Data":"e4b6f753f2f66867dec8d7d9a73807174a89e9f30205907dac18cac3efe075f5"}
May 28 16:09:39.036600 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:39.036575    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fcnt9" event={"ID":"2e0d243f-62d7-4b28-8bdc-b8315f003fec","Type":"ContainerStarted","Data":"3b0249da0007f986eed25c0d2a05cbb6971a1f7e7a72f4f526929f3919100edd"}
May 28 16:09:40.009263 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.009225    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-5t4th"]
May 28 16:09:40.015957 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.015933    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5t4th"
May 28 16:09:40.018546 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.018522    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 16:09:40.018676 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.018581    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 16:09:40.019722 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.019697    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 16:09:40.019875 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.019774    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 16:09:40.019875 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.019807    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-4lxdz\""
May 28 16:09:40.023577 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.023554    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5t4th"]
May 28 16:09:40.157840 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.157761    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cb7cdab9-921d-4430-9d7a-f7160261c482-crio-socket\") pod \"insights-runtime-extractor-5t4th\" (UID: \"cb7cdab9-921d-4430-9d7a-f7160261c482\") " pod="openshift-insights/insights-runtime-extractor-5t4th"
May 28 16:09:40.157840 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.157800    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scc96\" (UniqueName: \"kubernetes.io/projected/cb7cdab9-921d-4430-9d7a-f7160261c482-kube-api-access-scc96\") pod \"insights-runtime-extractor-5t4th\" (UID: \"cb7cdab9-921d-4430-9d7a-f7160261c482\") " pod="openshift-insights/insights-runtime-extractor-5t4th"
May 28 16:09:40.158074 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.157873    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb7cdab9-921d-4430-9d7a-f7160261c482-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5t4th\" (UID: \"cb7cdab9-921d-4430-9d7a-f7160261c482\") " pod="openshift-insights/insights-runtime-extractor-5t4th"
May 28 16:09:40.158074 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.157939    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb7cdab9-921d-4430-9d7a-f7160261c482-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5t4th\" (UID: \"cb7cdab9-921d-4430-9d7a-f7160261c482\") " pod="openshift-insights/insights-runtime-extractor-5t4th"
May 28 16:09:40.158074 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.157969    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb7cdab9-921d-4430-9d7a-f7160261c482-data-volume\") pod \"insights-runtime-extractor-5t4th\" (UID: \"cb7cdab9-921d-4430-9d7a-f7160261c482\") " pod="openshift-insights/insights-runtime-extractor-5t4th"
May 28 16:09:40.259208 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.259167    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb7cdab9-921d-4430-9d7a-f7160261c482-data-volume\") pod \"insights-runtime-extractor-5t4th\" (UID: \"cb7cdab9-921d-4430-9d7a-f7160261c482\") " pod="openshift-insights/insights-runtime-extractor-5t4th"
May 28 16:09:40.259465 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.259258    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cb7cdab9-921d-4430-9d7a-f7160261c482-crio-socket\") pod \"insights-runtime-extractor-5t4th\" (UID: \"cb7cdab9-921d-4430-9d7a-f7160261c482\") " pod="openshift-insights/insights-runtime-extractor-5t4th"
May 28 16:09:40.259465 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.259290    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scc96\" (UniqueName: \"kubernetes.io/projected/cb7cdab9-921d-4430-9d7a-f7160261c482-kube-api-access-scc96\") pod \"insights-runtime-extractor-5t4th\" (UID: \"cb7cdab9-921d-4430-9d7a-f7160261c482\") " pod="openshift-insights/insights-runtime-extractor-5t4th"
May 28 16:09:40.259465 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.259325    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb7cdab9-921d-4430-9d7a-f7160261c482-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5t4th\" (UID: \"cb7cdab9-921d-4430-9d7a-f7160261c482\") " pod="openshift-insights/insights-runtime-extractor-5t4th"
May 28 16:09:40.259465 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.259406    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb7cdab9-921d-4430-9d7a-f7160261c482-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5t4th\" (UID: \"cb7cdab9-921d-4430-9d7a-f7160261c482\") " pod="openshift-insights/insights-runtime-extractor-5t4th"
May 28 16:09:40.259682 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.259573    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/cb7cdab9-921d-4430-9d7a-f7160261c482-data-volume\") pod \"insights-runtime-extractor-5t4th\" (UID: \"cb7cdab9-921d-4430-9d7a-f7160261c482\") " pod="openshift-insights/insights-runtime-extractor-5t4th"
May 28 16:09:40.259864 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.259814    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/cb7cdab9-921d-4430-9d7a-f7160261c482-crio-socket\") pod \"insights-runtime-extractor-5t4th\" (UID: \"cb7cdab9-921d-4430-9d7a-f7160261c482\") " pod="openshift-insights/insights-runtime-extractor-5t4th"
May 28 16:09:40.260277 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.260235    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/cb7cdab9-921d-4430-9d7a-f7160261c482-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-5t4th\" (UID: \"cb7cdab9-921d-4430-9d7a-f7160261c482\") " pod="openshift-insights/insights-runtime-extractor-5t4th"
May 28 16:09:40.264712 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.264688    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/cb7cdab9-921d-4430-9d7a-f7160261c482-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-5t4th\" (UID: \"cb7cdab9-921d-4430-9d7a-f7160261c482\") " pod="openshift-insights/insights-runtime-extractor-5t4th"
May 28 16:09:40.268523 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.268498    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scc96\" (UniqueName: \"kubernetes.io/projected/cb7cdab9-921d-4430-9d7a-f7160261c482-kube-api-access-scc96\") pod \"insights-runtime-extractor-5t4th\" (UID: \"cb7cdab9-921d-4430-9d7a-f7160261c482\") " pod="openshift-insights/insights-runtime-extractor-5t4th"
May 28 16:09:40.327791 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:40.327757    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-5t4th"
May 28 16:09:41.157047 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:41.156999    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-5t4th"]
May 28 16:09:41.163560 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:09:41.163532    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb7cdab9_921d_4430_9d7a_f7160261c482.slice/crio-206a194b8500758fe2baf3d40c37dda868cbdcd9a3da060576d782a708f3defb WatchSource:0}: Error finding container 206a194b8500758fe2baf3d40c37dda868cbdcd9a3da060576d782a708f3defb: Status 404 returned error can't find the container with id 206a194b8500758fe2baf3d40c37dda868cbdcd9a3da060576d782a708f3defb
May 28 16:09:41.963294 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:41.963215    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-z7k9v"
May 28 16:09:42.052576 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:42.052538    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fcnt9" event={"ID":"2e0d243f-62d7-4b28-8bdc-b8315f003fec","Type":"ContainerStarted","Data":"ff840fb9119e872519443828ab616f532eab595c55192e54a6da925daf4c8543"}
May 28 16:09:42.052576 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:42.052575    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-fcnt9" event={"ID":"2e0d243f-62d7-4b28-8bdc-b8315f003fec","Type":"ContainerStarted","Data":"f4a76edaab3c1b1dcbd0f3d01bf69e22075439173d0a88ff53012e597a80cd39"}
May 28 16:09:42.052814 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:42.052685    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-fcnt9"
May 28 16:09:42.053920 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:42.053897    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vn4k4" event={"ID":"c309cf42-84d1-47a4-86d3-afcda3b25c50","Type":"ContainerStarted","Data":"68a3c29273c3ccc6eaa0e5cdb07177dbfa2e249b7eb08081151cc1bed99ae10a"}
May 28 16:09:42.055312 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:42.055294    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5t4th" event={"ID":"cb7cdab9-921d-4430-9d7a-f7160261c482","Type":"ContainerStarted","Data":"5c383f46a39711a05984ee1805b597577820939f8b406d965358072795fec163"}
May 28 16:09:42.055404 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:42.055315    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5t4th" event={"ID":"cb7cdab9-921d-4430-9d7a-f7160261c482","Type":"ContainerStarted","Data":"1263b64c063ab89effa8489b5988b74d25dd457bb39bde316c7edb4cce6766f9"}
May 28 16:09:42.055404 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:42.055323    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5t4th" event={"ID":"cb7cdab9-921d-4430-9d7a-f7160261c482","Type":"ContainerStarted","Data":"206a194b8500758fe2baf3d40c37dda868cbdcd9a3da060576d782a708f3defb"}
May 28 16:09:42.069271 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:42.069228    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-fcnt9" podStartSLOduration=65.919063405 podStartE2EDuration="1m8.069213913s" podCreationTimestamp="2026-05-28 16:08:34 +0000 UTC" firstStartedPulling="2026-05-28 16:09:38.860506241 +0000 UTC m=+98.709983705" lastFinishedPulling="2026-05-28 16:09:41.010656764 +0000 UTC m=+100.860134213" observedRunningTime="2026-05-28 16:09:42.068810749 +0000 UTC m=+101.918288221" watchObservedRunningTime="2026-05-28 16:09:42.069213913 +0000 UTC m=+101.918691385"
May 28 16:09:42.084033 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:42.083969    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vn4k4" podStartSLOduration=65.946818601 podStartE2EDuration="1m8.083955479s" podCreationTimestamp="2026-05-28 16:08:34 +0000 UTC" firstStartedPulling="2026-05-28 16:09:38.878826178 +0000 UTC m=+98.728303628" lastFinishedPulling="2026-05-28 16:09:41.015963057 +0000 UTC m=+100.865440506" observedRunningTime="2026-05-28 16:09:42.083677136 +0000 UTC m=+101.933154607" watchObservedRunningTime="2026-05-28 16:09:42.083955479 +0000 UTC m=+101.933432951"
May 28 16:09:43.059568 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:43.059529    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-5t4th" event={"ID":"cb7cdab9-921d-4430-9d7a-f7160261c482","Type":"ContainerStarted","Data":"bb0fe631d587f082ea81ac3ade3d728f0c0118fc8db27c095d26bbe5c79fcb8c"}
May 28 16:09:43.078413 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:43.078347    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-5t4th" podStartSLOduration=2.38206185 podStartE2EDuration="4.078334987s" podCreationTimestamp="2026-05-28 16:09:39 +0000 UTC" firstStartedPulling="2026-05-28 16:09:41.217046092 +0000 UTC m=+101.066523541" lastFinishedPulling="2026-05-28 16:09:42.913319213 +0000 UTC m=+102.762796678" observedRunningTime="2026-05-28 16:09:43.076659589 +0000 UTC m=+102.926137060" watchObservedRunningTime="2026-05-28 16:09:43.078334987 +0000 UTC m=+102.927812494"
May 28 16:09:51.261695 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.261654    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t"]
May 28 16:09:51.264624 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.264603    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t"
May 28 16:09:51.268007 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.267985    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 16:09:51.268239 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.268223    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-g5jzn\""
May 28 16:09:51.268239 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.268234    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 28 16:09:51.269147 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.269128    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 16:09:51.269244 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.269147    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 28 16:09:51.269244 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.269161    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 16:09:51.279528 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.279504    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t"]
May 28 16:09:51.291239 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.291203    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bnnhr"]
May 28 16:09:51.293501 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.293478    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.295895 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.295849    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 16:09:51.296602 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.296580    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-w2gpp\""
May 28 16:09:51.296805 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.296783    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 16:09:51.296892 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.296828    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 16:09:51.445771 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.445722    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f14129de-0641-48fc-8917-eaf200859c51-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-8kd4t\" (UID: \"f14129de-0641-48fc-8917-eaf200859c51\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t"
May 28 16:09:51.445972 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.445781    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dbb55557-741a-431b-aa0d-17204d8cb4d9-node-exporter-textfile\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.445972 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.445817    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dbb55557-741a-431b-aa0d-17204d8cb4d9-node-exporter-tls\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.445972 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.445857    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbb55557-741a-431b-aa0d-17204d8cb4d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.445972 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.445914    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dbb55557-741a-431b-aa0d-17204d8cb4d9-node-exporter-wtmp\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.445972 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.445959    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f14129de-0641-48fc-8917-eaf200859c51-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-8kd4t\" (UID: \"f14129de-0641-48fc-8917-eaf200859c51\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t"
May 28 16:09:51.446169 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.445985    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f14129de-0641-48fc-8917-eaf200859c51-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-8kd4t\" (UID: \"f14129de-0641-48fc-8917-eaf200859c51\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t"
May 28 16:09:51.446169 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.446007    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dbb55557-741a-431b-aa0d-17204d8cb4d9-root\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.446169 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.446055    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbb55557-741a-431b-aa0d-17204d8cb4d9-sys\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.446169 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.446079    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbb55557-741a-431b-aa0d-17204d8cb4d9-metrics-client-ca\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.446169 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.446094    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dbb55557-741a-431b-aa0d-17204d8cb4d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.446169 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.446109    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzhfd\" (UniqueName: \"kubernetes.io/projected/dbb55557-741a-431b-aa0d-17204d8cb4d9-kube-api-access-wzhfd\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.446169 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.446157    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82zxz\" (UniqueName: \"kubernetes.io/projected/f14129de-0641-48fc-8917-eaf200859c51-kube-api-access-82zxz\") pod \"openshift-state-metrics-9c959559f-8kd4t\" (UID: \"f14129de-0641-48fc-8917-eaf200859c51\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t"
May 28 16:09:51.547576 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.547473    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f14129de-0641-48fc-8917-eaf200859c51-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-8kd4t\" (UID: \"f14129de-0641-48fc-8917-eaf200859c51\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t"
May 28 16:09:51.547576 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.547514    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dbb55557-741a-431b-aa0d-17204d8cb4d9-root\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.547576 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.547534    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbb55557-741a-431b-aa0d-17204d8cb4d9-sys\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.547576 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.547553    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbb55557-741a-431b-aa0d-17204d8cb4d9-metrics-client-ca\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.547576 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.547576    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dbb55557-741a-431b-aa0d-17204d8cb4d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.547999 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.547602    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wzhfd\" (UniqueName: \"kubernetes.io/projected/dbb55557-741a-431b-aa0d-17204d8cb4d9-kube-api-access-wzhfd\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.547999 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.547615    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/dbb55557-741a-431b-aa0d-17204d8cb4d9-root\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.547999 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.547631    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dbb55557-741a-431b-aa0d-17204d8cb4d9-sys\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.547999 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.547637    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-82zxz\" (UniqueName: \"kubernetes.io/projected/f14129de-0641-48fc-8917-eaf200859c51-kube-api-access-82zxz\") pod \"openshift-state-metrics-9c959559f-8kd4t\" (UID: \"f14129de-0641-48fc-8917-eaf200859c51\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t"
May 28 16:09:51.547999 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.547793    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f14129de-0641-48fc-8917-eaf200859c51-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-8kd4t\" (UID: \"f14129de-0641-48fc-8917-eaf200859c51\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t"
May 28 16:09:51.547999 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.547839    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dbb55557-741a-431b-aa0d-17204d8cb4d9-node-exporter-textfile\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.547999 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.547886    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dbb55557-741a-431b-aa0d-17204d8cb4d9-node-exporter-tls\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.547999 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.547928    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbb55557-741a-431b-aa0d-17204d8cb4d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.547999 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.547970    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dbb55557-741a-431b-aa0d-17204d8cb4d9-node-exporter-wtmp\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.547999 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.548004    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f14129de-0641-48fc-8917-eaf200859c51-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-8kd4t\" (UID: \"f14129de-0641-48fc-8917-eaf200859c51\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t"
May 28 16:09:51.548496 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.548268    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/dbb55557-741a-431b-aa0d-17204d8cb4d9-node-exporter-accelerators-collector-config\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.548496 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.548442    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/dbb55557-741a-431b-aa0d-17204d8cb4d9-node-exporter-wtmp\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.548793 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.548744    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/dbb55557-741a-431b-aa0d-17204d8cb4d9-node-exporter-textfile\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.548911 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.548794    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbb55557-741a-431b-aa0d-17204d8cb4d9-metrics-client-ca\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.549498 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.549477    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f14129de-0641-48fc-8917-eaf200859c51-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-8kd4t\" (UID: \"f14129de-0641-48fc-8917-eaf200859c51\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t"
May 28 16:09:51.550978 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.550950    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/dbb55557-741a-431b-aa0d-17204d8cb4d9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.551093 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.550979    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f14129de-0641-48fc-8917-eaf200859c51-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-8kd4t\" (UID: \"f14129de-0641-48fc-8917-eaf200859c51\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t"
May 28 16:09:51.551093 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.550981    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f14129de-0641-48fc-8917-eaf200859c51-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-8kd4t\" (UID: \"f14129de-0641-48fc-8917-eaf200859c51\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t"
May 28 16:09:51.551093 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.551039    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/dbb55557-741a-431b-aa0d-17204d8cb4d9-node-exporter-tls\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.555451 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.555422    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-82zxz\" (UniqueName: \"kubernetes.io/projected/f14129de-0641-48fc-8917-eaf200859c51-kube-api-access-82zxz\") pod \"openshift-state-metrics-9c959559f-8kd4t\" (UID: \"f14129de-0641-48fc-8917-eaf200859c51\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t"
May 28 16:09:51.555555 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.555535    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzhfd\" (UniqueName: \"kubernetes.io/projected/dbb55557-741a-431b-aa0d-17204d8cb4d9-kube-api-access-wzhfd\") pod \"node-exporter-bnnhr\" (UID: \"dbb55557-741a-431b-aa0d-17204d8cb4d9\") " pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.574557 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.574527    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t"
May 28 16:09:51.603459 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.603414    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bnnhr"
May 28 16:09:51.612953 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:09:51.612920    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb55557_741a_431b_aa0d_17204d8cb4d9.slice/crio-4abc1c30abaf03ce44c73cf81cf8496b4a4eba5359005cfc9bc68569254e0c01 WatchSource:0}: Error finding container 4abc1c30abaf03ce44c73cf81cf8496b4a4eba5359005cfc9bc68569254e0c01: Status 404 returned error can't find the container with id 4abc1c30abaf03ce44c73cf81cf8496b4a4eba5359005cfc9bc68569254e0c01
May 28 16:09:51.745562 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:51.745531    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t"]
May 28 16:09:51.748198 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:09:51.748165    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf14129de_0641_48fc_8917_eaf200859c51.slice/crio-85250efb0158c903656e9b63fc1ca0c54447b25951b467402a534569695fd02b WatchSource:0}: Error finding container 85250efb0158c903656e9b63fc1ca0c54447b25951b467402a534569695fd02b: Status 404 returned error can't find the container with id 85250efb0158c903656e9b63fc1ca0c54447b25951b467402a534569695fd02b
May 28 16:09:52.062042 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:52.061953    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-fcnt9"
May 28 16:09:52.083775 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:52.083735    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bnnhr" event={"ID":"dbb55557-741a-431b-aa0d-17204d8cb4d9","Type":"ContainerStarted","Data":"4abc1c30abaf03ce44c73cf81cf8496b4a4eba5359005cfc9bc68569254e0c01"}
May 28 16:09:52.085349 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:52.085327    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t" event={"ID":"f14129de-0641-48fc-8917-eaf200859c51","Type":"ContainerStarted","Data":"1ba6904b3550e8575b65d52efee0b0ea373228d166331a4c6201060603354051"}
May 28 16:09:52.085520 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:52.085355    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t" event={"ID":"f14129de-0641-48fc-8917-eaf200859c51","Type":"ContainerStarted","Data":"d975bf31606cfaa1985a3ab45275b22d32158b6b5011dc188661c86cc0275129"}
May 28 16:09:52.085520 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:52.085394    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t" event={"ID":"f14129de-0641-48fc-8917-eaf200859c51","Type":"ContainerStarted","Data":"85250efb0158c903656e9b63fc1ca0c54447b25951b467402a534569695fd02b"}
May 28 16:09:53.089528 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:53.089493    2564 generic.go:358] "Generic (PLEG): container finished" podID="dbb55557-741a-431b-aa0d-17204d8cb4d9" containerID="03291da7b6660eaf5aea68d0896e94f7c20c1317d1c5a85e640ed8545e6aa2ef" exitCode=0
May 28 16:09:53.089997 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:53.089570    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bnnhr" event={"ID":"dbb55557-741a-431b-aa0d-17204d8cb4d9","Type":"ContainerDied","Data":"03291da7b6660eaf5aea68d0896e94f7c20c1317d1c5a85e640ed8545e6aa2ef"}
May 28 16:09:53.091459 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:53.091424    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t" event={"ID":"f14129de-0641-48fc-8917-eaf200859c51","Type":"ContainerStarted","Data":"33009b8fbae3250f69ed6e9f72564ad714456f5e92d004111e735705d8bf21c1"}
May 28 16:09:53.131554 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:53.131503    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-8kd4t" podStartSLOduration=1.084153939 podStartE2EDuration="2.131489731s" podCreationTimestamp="2026-05-28 16:09:51 +0000 UTC" firstStartedPulling="2026-05-28 16:09:51.882043544 +0000 UTC m=+111.731520993" lastFinishedPulling="2026-05-28 16:09:52.929379322 +0000 UTC m=+112.778856785" observedRunningTime="2026-05-28 16:09:53.125950557 +0000 UTC m=+112.975428028" watchObservedRunningTime="2026-05-28 16:09:53.131489731 +0000 UTC m=+112.980967202"
May 28 16:09:54.096377 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.096322    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bnnhr" event={"ID":"dbb55557-741a-431b-aa0d-17204d8cb4d9","Type":"ContainerStarted","Data":"9c88cd197ca64b0a8aad9506c69ef982950f0413a370ef2e1460efa3e492b278"}
May 28 16:09:54.096377 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.096381    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bnnhr" event={"ID":"dbb55557-741a-431b-aa0d-17204d8cb4d9","Type":"ContainerStarted","Data":"ce0c9a1517994f0eaa8c13cb427a355470c3aa3f41f3c6adc2d936fe4d9990e4"}
May 28 16:09:54.115263 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.115213    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bnnhr" podStartSLOduration=2.116755579 podStartE2EDuration="3.115198855s" podCreationTimestamp="2026-05-28 16:09:51 +0000 UTC" firstStartedPulling="2026-05-28 16:09:51.614997622 +0000 UTC m=+111.464475087" lastFinishedPulling="2026-05-28 16:09:52.613440914 +0000 UTC m=+112.462918363" observedRunningTime="2026-05-28 16:09:54.114038511 +0000 UTC m=+113.963515983" watchObservedRunningTime="2026-05-28 16:09:54.115198855 +0000 UTC m=+113.964676324"
May 28 16:09:54.258869 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.258831    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"]
May 28 16:09:54.262167 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.262143    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.264704 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.264673    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
May 28 16:09:54.264857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.264678    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-t2kg6\""
May 28 16:09:54.264930 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.264902    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-24pehlj6suqb9\""
May 28 16:09:54.265013 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.265001    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
May 28 16:09:54.265080 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.265040    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
May 28 16:09:54.265080 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.265045    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
May 28 16:09:54.265179 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.265108    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
May 28 16:09:54.273559 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.273535    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"]
May 28 16:09:54.371230 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.371126    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dlh7\" (UniqueName: \"kubernetes.io/projected/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-kube-api-access-6dlh7\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.371230 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.371176    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-secret-grpc-tls\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.371230 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.371197    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.371553 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.371258    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-metrics-client-ca\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.371553 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.371336    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-secret-thanos-querier-tls\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.371553 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.371429    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.371553 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.371491    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.371553 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.371525    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.472704 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.472650    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.472704 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.472712    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.472973 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.472734    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.472973 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.472781    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6dlh7\" (UniqueName: \"kubernetes.io/projected/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-kube-api-access-6dlh7\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.472973 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.472800    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-secret-grpc-tls\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.472973 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.472822    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.472973 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.472846    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-metrics-client-ca\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.473256 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.472977    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-secret-thanos-querier-tls\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.473809 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.473782    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-metrics-client-ca\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.475513 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.475483    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.475789 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.475756    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.475934 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.475896    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.476016 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.475997    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-secret-grpc-tls\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.476069 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.476047    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.476142 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.476127    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-secret-thanos-querier-tls\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.481133 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.481106    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dlh7\" (UniqueName: \"kubernetes.io/projected/47a7c1bf-cc53-4138-9ba5-c0d43a2cc101-kube-api-access-6dlh7\") pod \"thanos-querier-6bf7699dfb-j9vtd\" (UID: \"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101\") " pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.572565 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.572524    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:54.705593 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:54.705558    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"]
May 28 16:09:54.709793 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:09:54.709761    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47a7c1bf_cc53_4138_9ba5_c0d43a2cc101.slice/crio-8e297588eddc25ebc8f37c2329e9ca804e406a0f61ded69f697fa6c5dd16238d WatchSource:0}: Error finding container 8e297588eddc25ebc8f37c2329e9ca804e406a0f61ded69f697fa6c5dd16238d: Status 404 returned error can't find the container with id 8e297588eddc25ebc8f37c2329e9ca804e406a0f61ded69f697fa6c5dd16238d
May 28 16:09:55.100994 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:55.100931    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd" event={"ID":"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101","Type":"ContainerStarted","Data":"8e297588eddc25ebc8f37c2329e9ca804e406a0f61ded69f697fa6c5dd16238d"}
May 28 16:09:56.060803 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.060767    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-ml7f5"]
May 28 16:09:56.064046 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.064022    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-ml7f5"
May 28 16:09:56.066191 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.066165    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
May 28 16:09:56.066475 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.066457    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-bx779\""
May 28 16:09:56.070984 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.070959    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-ml7f5"]
May 28 16:09:56.188106 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.188066    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01554ed1-6197-4bbf-85a4-a6060e9710e1-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-ml7f5\" (UID: \"01554ed1-6197-4bbf-85a4-a6060e9710e1\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-ml7f5"
May 28 16:09:56.289417 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.289356    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01554ed1-6197-4bbf-85a4-a6060e9710e1-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-ml7f5\" (UID: \"01554ed1-6197-4bbf-85a4-a6060e9710e1\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-ml7f5"
May 28 16:09:56.289595 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:09:56.289508    2564 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
May 28 16:09:56.289639 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:09:56.289602    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01554ed1-6197-4bbf-85a4-a6060e9710e1-monitoring-plugin-cert podName:01554ed1-6197-4bbf-85a4-a6060e9710e1 nodeName:}" failed. No retries permitted until 2026-05-28 16:09:56.789583868 +0000 UTC m=+116.639061321 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/01554ed1-6197-4bbf-85a4-a6060e9710e1-monitoring-plugin-cert") pod "monitoring-plugin-665c9c8584-ml7f5" (UID: "01554ed1-6197-4bbf-85a4-a6060e9710e1") : secret "monitoring-plugin-cert" not found
May 28 16:09:56.494259 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.494179    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"]
May 28 16:09:56.498299 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.498275    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.500771 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.500727    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 28 16:09:56.500922 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.500826    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 28 16:09:56.500922 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.500831    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 28 16:09:56.500922 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.500860    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-ffq24\""
May 28 16:09:56.501086 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.500954    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 28 16:09:56.501158 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.501141    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 28 16:09:56.507095 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.507075    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 28 16:09:56.508085 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.508061    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"]
May 28 16:09:56.692594 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.692557    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/129dae84-c84b-4bfb-b330-20485e2e83ea-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.692690 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.692650    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/129dae84-c84b-4bfb-b330-20485e2e83ea-federate-client-tls\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.692736 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.692713    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/129dae84-c84b-4bfb-b330-20485e2e83ea-secret-telemeter-client\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.692771 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.692758    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/129dae84-c84b-4bfb-b330-20485e2e83ea-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.692806 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.692793    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/129dae84-c84b-4bfb-b330-20485e2e83ea-metrics-client-ca\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.692840 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.692830    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nndk9\" (UniqueName: \"kubernetes.io/projected/129dae84-c84b-4bfb-b330-20485e2e83ea-kube-api-access-nndk9\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.692872 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.692862    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/129dae84-c84b-4bfb-b330-20485e2e83ea-telemeter-client-tls\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.692941 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.692925    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/129dae84-c84b-4bfb-b330-20485e2e83ea-serving-certs-ca-bundle\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.793421 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.793353    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/129dae84-c84b-4bfb-b330-20485e2e83ea-secret-telemeter-client\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.793556 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.793432    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/129dae84-c84b-4bfb-b330-20485e2e83ea-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.793556 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.793457    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/129dae84-c84b-4bfb-b330-20485e2e83ea-metrics-client-ca\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.793556 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.793477    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nndk9\" (UniqueName: \"kubernetes.io/projected/129dae84-c84b-4bfb-b330-20485e2e83ea-kube-api-access-nndk9\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.793556 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.793506    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/129dae84-c84b-4bfb-b330-20485e2e83ea-telemeter-client-tls\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.793763 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.793632    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/129dae84-c84b-4bfb-b330-20485e2e83ea-serving-certs-ca-bundle\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.793763 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.793710    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/129dae84-c84b-4bfb-b330-20485e2e83ea-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.793871 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.793761    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/129dae84-c84b-4bfb-b330-20485e2e83ea-federate-client-tls\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.794340 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.794043    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01554ed1-6197-4bbf-85a4-a6060e9710e1-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-ml7f5\" (UID: \"01554ed1-6197-4bbf-85a4-a6060e9710e1\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-ml7f5"
May 28 16:09:56.794584 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.794558    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/129dae84-c84b-4bfb-b330-20485e2e83ea-metrics-client-ca\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.794794 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.794743    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/129dae84-c84b-4bfb-b330-20485e2e83ea-serving-certs-ca-bundle\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.795313 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.795283    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/129dae84-c84b-4bfb-b330-20485e2e83ea-telemeter-trusted-ca-bundle\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.796623 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.796594    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/129dae84-c84b-4bfb-b330-20485e2e83ea-secret-telemeter-client\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.796792 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.796736    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/129dae84-c84b-4bfb-b330-20485e2e83ea-telemeter-client-tls\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.796861 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.796795    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/129dae84-c84b-4bfb-b330-20485e2e83ea-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.797499 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.797474    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/129dae84-c84b-4bfb-b330-20485e2e83ea-federate-client-tls\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.797687 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.797671    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/01554ed1-6197-4bbf-85a4-a6060e9710e1-monitoring-plugin-cert\") pod \"monitoring-plugin-665c9c8584-ml7f5\" (UID: \"01554ed1-6197-4bbf-85a4-a6060e9710e1\") " pod="openshift-monitoring/monitoring-plugin-665c9c8584-ml7f5"
May 28 16:09:56.801221 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.801198    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nndk9\" (UniqueName: \"kubernetes.io/projected/129dae84-c84b-4bfb-b330-20485e2e83ea-kube-api-access-nndk9\") pod \"telemeter-client-67f55c79d8-mxnnd\" (UID: \"129dae84-c84b-4bfb-b330-20485e2e83ea\") " pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.811115 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.811089    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"
May 28 16:09:56.951909 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.951854    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-67f55c79d8-mxnnd"]
May 28 16:09:56.955529 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:09:56.955501    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod129dae84_c84b_4bfb_b330_20485e2e83ea.slice/crio-68bb94c159e9ce7722d26133dd584af0d1f2c1b651420de52414e128d07f02b1 WatchSource:0}: Error finding container 68bb94c159e9ce7722d26133dd584af0d1f2c1b651420de52414e128d07f02b1: Status 404 returned error can't find the container with id 68bb94c159e9ce7722d26133dd584af0d1f2c1b651420de52414e128d07f02b1
May 28 16:09:56.977013 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:56.976963    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-665c9c8584-ml7f5"
May 28 16:09:57.102962 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.102929    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-665c9c8584-ml7f5"]
May 28 16:09:57.106228 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:09:57.106199    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01554ed1_6197_4bbf_85a4_a6060e9710e1.slice/crio-ab49b66140568fdd931dad405d30e8a55a64a99e8739e60bb27c8ab1b7614c30 WatchSource:0}: Error finding container ab49b66140568fdd931dad405d30e8a55a64a99e8739e60bb27c8ab1b7614c30: Status 404 returned error can't find the container with id ab49b66140568fdd931dad405d30e8a55a64a99e8739e60bb27c8ab1b7614c30
May 28 16:09:57.107293 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.107263    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd" event={"ID":"129dae84-c84b-4bfb-b330-20485e2e83ea","Type":"ContainerStarted","Data":"68bb94c159e9ce7722d26133dd584af0d1f2c1b651420de52414e128d07f02b1"}
May 28 16:09:57.109219 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.109189    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd" event={"ID":"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101","Type":"ContainerStarted","Data":"46705922f95223b8c67ae019de8b50cff89d4ae51605ba9f28ad2a01ad9bde5f"}
May 28 16:09:57.109296 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.109223    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd" event={"ID":"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101","Type":"ContainerStarted","Data":"76a15142f72171c412c6703a70722c88c3e5ae0dfb0d5f04e97c6bcc79fa9d5c"}
May 28 16:09:57.109296 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.109237    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd" event={"ID":"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101","Type":"ContainerStarted","Data":"033ae7ab39e649754119111ee6babf46c11b7fffb8368d81825f6a7dbe58fa29"}
May 28 16:09:57.463063 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.462946    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 16:09:57.467025 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.467001    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.469574 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.469549    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 28 16:09:57.469697 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.469634    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 28 16:09:57.473984 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.473394    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dp9f59f3662kd\""
May 28 16:09:57.473984 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.473400    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8w4nr\""
May 28 16:09:57.473984 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.473439    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 16:09:57.473984 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.473464    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 28 16:09:57.473984 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.473659    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 28 16:09:57.473984 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.473800    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 28 16:09:57.473984 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.473917    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 28 16:09:57.474394 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.474017    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 28 16:09:57.474394 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.474016    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 28 16:09:57.474394 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.474253    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 28 16:09:57.474394 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.474261    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 28 16:09:57.474913 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.474891    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 28 16:09:57.476991 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.476972    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 28 16:09:57.479980 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.479956    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 16:09:57.601471 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.601431    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5b01f19-34c1-4114-92ec-ab93a2711a03-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.601471 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.601472    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5b01f19-34c1-4114-92ec-ab93a2711a03-config-out\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.601666 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.601526    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.601666 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.601614    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.601666 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.601638    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.601666 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.601655    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.601785 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.601669    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.601785 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.601692    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.601785 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.601708    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2txk\" (UniqueName: \"kubernetes.io/projected/c5b01f19-34c1-4114-92ec-ab93a2711a03-kube-api-access-s2txk\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.601785 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.601752    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.601892 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.601813    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5b01f19-34c1-4114-92ec-ab93a2711a03-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.601892 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.601835    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.601892 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.601852    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.601984 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.601892    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.601984 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.601922    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.601984 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.601946    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-web-config\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.602068 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.601992    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.602068 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.602014    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-config\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.703349 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.703316    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.703477 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.703383    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5b01f19-34c1-4114-92ec-ab93a2711a03-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.703477 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.703410    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.703477 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.703427    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.703477 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.703453    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.706176 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.703744    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.706176 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.703900    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-web-config\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.706176 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.703954    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.706176 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.703992    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-config\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.706176 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.704026    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5b01f19-34c1-4114-92ec-ab93a2711a03-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.706176 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.704064    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5b01f19-34c1-4114-92ec-ab93a2711a03-config-out\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.706176 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.704096    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.706176 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.704170    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.706176 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.704200    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.706176 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.704228    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.706176 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.704254    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.706176 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.704321    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.706176 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.704380    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s2txk\" (UniqueName: \"kubernetes.io/projected/c5b01f19-34c1-4114-92ec-ab93a2711a03-kube-api-access-s2txk\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.706176 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.704643    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.706176 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.706147    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.707309 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.706607    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.707309 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.707153    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5b01f19-34c1-4114-92ec-ab93a2711a03-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.708349 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.707571    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.708349 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.707923    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.708349 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.708306    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.708591 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.708441    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-web-config\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.708865 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.708821    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.709698 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.709654    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-config\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.709787 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.709700    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.709907 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.709888    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.710324 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.710307    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5b01f19-34c1-4114-92ec-ab93a2711a03-config-out\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.710710 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.710688    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.710923 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.710906    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5b01f19-34c1-4114-92ec-ab93a2711a03-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.711016 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.710984    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.711927 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.711906    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.713017 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.712995    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2txk\" (UniqueName: \"kubernetes.io/projected/c5b01f19-34c1-4114-92ec-ab93a2711a03-kube-api-access-s2txk\") pod \"prometheus-k8s-0\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.778478 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.778445    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:09:57.952953 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:57.952784    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 16:09:57.955804 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:09:57.955768    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5b01f19_34c1_4114_92ec_ab93a2711a03.slice/crio-ddef3afe8c0bbff94a73d266e621afa9c5de4f1f42d48d8ce269cc032dd0e04b WatchSource:0}: Error finding container ddef3afe8c0bbff94a73d266e621afa9c5de4f1f42d48d8ce269cc032dd0e04b: Status 404 returned error can't find the container with id ddef3afe8c0bbff94a73d266e621afa9c5de4f1f42d48d8ce269cc032dd0e04b
May 28 16:09:58.112726 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:58.112690    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-ml7f5" event={"ID":"01554ed1-6197-4bbf-85a4-a6060e9710e1","Type":"ContainerStarted","Data":"ab49b66140568fdd931dad405d30e8a55a64a99e8739e60bb27c8ab1b7614c30"}
May 28 16:09:58.113825 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:58.113790    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5b01f19-34c1-4114-92ec-ab93a2711a03","Type":"ContainerStarted","Data":"ddef3afe8c0bbff94a73d266e621afa9c5de4f1f42d48d8ce269cc032dd0e04b"}
May 28 16:09:58.116139 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:58.116113    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd" event={"ID":"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101","Type":"ContainerStarted","Data":"427fc254010a4d7f950c725b2fb21155d4ef6abebc34d0422c1e667ee48f3b2b"}
May 28 16:09:58.116257 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:58.116143    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd" event={"ID":"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101","Type":"ContainerStarted","Data":"3221fef0012e77a1f7e703dddcfc88458fdded5e4755b0cd92fbbf2989361b09"}
May 28 16:09:58.116257 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:58.116153    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd" event={"ID":"47a7c1bf-cc53-4138-9ba5-c0d43a2cc101","Type":"ContainerStarted","Data":"957389c3b488eeaca59f9d986eef8f27751fb097af9466afb1adbaa5dffe2d2f"}
May 28 16:09:58.116347 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:58.116310    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:09:58.137278 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:09:58.137225    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd" podStartSLOduration=1.221602733 podStartE2EDuration="4.137212843s" podCreationTimestamp="2026-05-28 16:09:54 +0000 UTC" firstStartedPulling="2026-05-28 16:09:54.711984171 +0000 UTC m=+114.561461636" lastFinishedPulling="2026-05-28 16:09:57.627594294 +0000 UTC m=+117.477071746" observedRunningTime="2026-05-28 16:09:58.136228723 +0000 UTC m=+117.985706207" watchObservedRunningTime="2026-05-28 16:09:58.137212843 +0000 UTC m=+117.986690354"
May 28 16:10:00.123994 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:00.123893    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd" event={"ID":"129dae84-c84b-4bfb-b330-20485e2e83ea","Type":"ContainerStarted","Data":"9dc53334de610744a7af832f55338140fcebbc10ee996ebfba7c91095c9d325f"}
May 28 16:10:00.123994 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:00.123937    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd" event={"ID":"129dae84-c84b-4bfb-b330-20485e2e83ea","Type":"ContainerStarted","Data":"dd887c614bb90e69a6f931f33cdae1db3ab0e09784d23441d5ce21ae9ad1b8a1"}
May 28 16:10:00.123994 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:00.123951    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd" event={"ID":"129dae84-c84b-4bfb-b330-20485e2e83ea","Type":"ContainerStarted","Data":"447161619d212f5cef02ed89a341777826055f6e04d047eb36e8203223ca3b59"}
May 28 16:10:00.125347 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:00.125326    2564 generic.go:358] "Generic (PLEG): container finished" podID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerID="f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091" exitCode=0
May 28 16:10:00.125439 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:00.125401    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5b01f19-34c1-4114-92ec-ab93a2711a03","Type":"ContainerDied","Data":"f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091"}
May 28 16:10:00.126754 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:00.126732    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-665c9c8584-ml7f5" event={"ID":"01554ed1-6197-4bbf-85a4-a6060e9710e1","Type":"ContainerStarted","Data":"d60553fdac946b486fa177d4bc2289d3c53047a5c7c645b4f32584bc0bda80f8"}
May 28 16:10:00.126967 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:00.126941    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-ml7f5"
May 28 16:10:00.132389 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:00.132351    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-665c9c8584-ml7f5"
May 28 16:10:00.145949 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:00.145896    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-67f55c79d8-mxnnd" podStartSLOduration=1.479844634 podStartE2EDuration="4.14587826s" podCreationTimestamp="2026-05-28 16:09:56 +0000 UTC" firstStartedPulling="2026-05-28 16:09:56.957529891 +0000 UTC m=+116.807007340" lastFinishedPulling="2026-05-28 16:09:59.623563516 +0000 UTC m=+119.473040966" observedRunningTime="2026-05-28 16:10:00.14488741 +0000 UTC m=+119.994364901" watchObservedRunningTime="2026-05-28 16:10:00.14587826 +0000 UTC m=+119.995355732"
May 28 16:10:00.187211 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:00.187156    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-665c9c8584-ml7f5" podStartSLOduration=1.669826151 podStartE2EDuration="4.18713994s" podCreationTimestamp="2026-05-28 16:09:56 +0000 UTC" firstStartedPulling="2026-05-28 16:09:57.108024069 +0000 UTC m=+116.957501519" lastFinishedPulling="2026-05-28 16:09:59.625337843 +0000 UTC m=+119.474815308" observedRunningTime="2026-05-28 16:10:00.186523264 +0000 UTC m=+120.036000733" watchObservedRunningTime="2026-05-28 16:10:00.18713994 +0000 UTC m=+120.036617412"
May 28 16:10:04.125730 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:04.125698    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6bf7699dfb-j9vtd"
May 28 16:10:04.146579 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:04.146487    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5b01f19-34c1-4114-92ec-ab93a2711a03","Type":"ContainerStarted","Data":"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264"}
May 28 16:10:04.146579 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:04.146525    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5b01f19-34c1-4114-92ec-ab93a2711a03","Type":"ContainerStarted","Data":"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e"}
May 28 16:10:04.146579 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:04.146534    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5b01f19-34c1-4114-92ec-ab93a2711a03","Type":"ContainerStarted","Data":"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2"}
May 28 16:10:04.146579 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:04.146542    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5b01f19-34c1-4114-92ec-ab93a2711a03","Type":"ContainerStarted","Data":"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7"}
May 28 16:10:04.146579 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:04.146550    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5b01f19-34c1-4114-92ec-ab93a2711a03","Type":"ContainerStarted","Data":"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012"}
May 28 16:10:04.146579 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:04.146557    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5b01f19-34c1-4114-92ec-ab93a2711a03","Type":"ContainerStarted","Data":"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d"}
May 28 16:10:04.181541 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:04.181482    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.51903349 podStartE2EDuration="7.18146576s" podCreationTimestamp="2026-05-28 16:09:57 +0000 UTC" firstStartedPulling="2026-05-28 16:09:57.958502013 +0000 UTC m=+117.807979463" lastFinishedPulling="2026-05-28 16:10:03.620934278 +0000 UTC m=+123.470411733" observedRunningTime="2026-05-28 16:10:04.179127186 +0000 UTC m=+124.028604657" watchObservedRunningTime="2026-05-28 16:10:04.18146576 +0000 UTC m=+124.030943231"
May 28 16:10:07.778863 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:07.778820    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:10:10.423169 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:10.423128    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs\") pod \"network-metrics-daemon-r5nt6\" (UID: \"8e0f7bc7-0a1e-481f-a720-52a99554e9d6\") " pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:10:10.425727 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:10.425704    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8e0f7bc7-0a1e-481f-a720-52a99554e9d6-metrics-certs\") pod \"network-metrics-daemon-r5nt6\" (UID: \"8e0f7bc7-0a1e-481f-a720-52a99554e9d6\") " pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:10:10.541060 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:10.541025    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xz8bh\""
May 28 16:10:10.549233 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:10.549203    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-r5nt6"
May 28 16:10:10.679930 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:10.679879    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-r5nt6"]
May 28 16:10:10.682490 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:10:10.682461    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e0f7bc7_0a1e_481f_a720_52a99554e9d6.slice/crio-cc2b5fda393e3d18510c7234bd748cb1da6ad7697cdf4e545909918e6bbde989 WatchSource:0}: Error finding container cc2b5fda393e3d18510c7234bd748cb1da6ad7697cdf4e545909918e6bbde989: Status 404 returned error can't find the container with id cc2b5fda393e3d18510c7234bd748cb1da6ad7697cdf4e545909918e6bbde989
May 28 16:10:11.170480 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:11.170433    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r5nt6" event={"ID":"8e0f7bc7-0a1e-481f-a720-52a99554e9d6","Type":"ContainerStarted","Data":"cc2b5fda393e3d18510c7234bd748cb1da6ad7697cdf4e545909918e6bbde989"}
May 28 16:10:12.180053 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:12.180014    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r5nt6" event={"ID":"8e0f7bc7-0a1e-481f-a720-52a99554e9d6","Type":"ContainerStarted","Data":"d98c5a520b7f1e916f2b997378f4c5131f20244fd2e9e1fff2f8d323fef6f90c"}
May 28 16:10:12.180053 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:12.180055    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-r5nt6" event={"ID":"8e0f7bc7-0a1e-481f-a720-52a99554e9d6","Type":"ContainerStarted","Data":"55784b41ee42cde0215da038d5526bcec202df009b362e1e5dcc1b5f6bc83bf8"}
May 28 16:10:12.195239 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:12.195181    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-r5nt6" podStartSLOduration=131.188958087 podStartE2EDuration="2m12.195166291s" podCreationTimestamp="2026-05-28 16:08:00 +0000 UTC" firstStartedPulling="2026-05-28 16:10:10.68442355 +0000 UTC m=+130.533900999" lastFinishedPulling="2026-05-28 16:10:11.690631751 +0000 UTC m=+131.540109203" observedRunningTime="2026-05-28 16:10:12.193849707 +0000 UTC m=+132.043327177" watchObservedRunningTime="2026-05-28 16:10:12.195166291 +0000 UTC m=+132.044643761"
May 28 16:10:40.265322 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:40.265287    2564 generic.go:358] "Generic (PLEG): container finished" podID="5033e923-8bd0-4677-a9ea-67e15b9c1a56" containerID="0fed503d5c64067c835c8508c066ff5cce15b8b38b743edbed257babc633ad04" exitCode=0
May 28 16:10:40.265784 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:40.265340    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wh527" event={"ID":"5033e923-8bd0-4677-a9ea-67e15b9c1a56","Type":"ContainerDied","Data":"0fed503d5c64067c835c8508c066ff5cce15b8b38b743edbed257babc633ad04"}
May 28 16:10:40.265784 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:40.265684    2564 scope.go:117] "RemoveContainer" containerID="0fed503d5c64067c835c8508c066ff5cce15b8b38b743edbed257babc633ad04"
May 28 16:10:41.270301 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:41.270265    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-wh527" event={"ID":"5033e923-8bd0-4677-a9ea-67e15b9c1a56","Type":"ContainerStarted","Data":"6fa4f62415b4a11b4c373561adf8fea3a86b61b062f4ce79aff422fbc998da02"}
May 28 16:10:57.779152 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:57.779103    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:10:57.801756 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:57.801725    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:10:58.337887 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:10:58.337849    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:15.784589 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:15.784545    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 16:11:15.785107 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:15.784986    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="prometheus" containerID="cri-o://964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d" gracePeriod=600
May 28 16:11:15.785107 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:15.785007    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="kube-rbac-proxy" containerID="cri-o://f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e" gracePeriod=600
May 28 16:11:15.785107 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:15.785022    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="thanos-sidecar" containerID="cri-o://a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7" gracePeriod=600
May 28 16:11:15.785107 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:15.785047    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="config-reloader" containerID="cri-o://15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012" gracePeriod=600
May 28 16:11:15.785314 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:15.785144    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="kube-rbac-proxy-thanos" containerID="cri-o://735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264" gracePeriod=600
May 28 16:11:15.785314 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:15.785164    2564 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="kube-rbac-proxy-web" containerID="cri-o://94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2" gracePeriod=600
May 28 16:11:16.025619 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.025592    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.075663 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.075580    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-config\") pod \"c5b01f19-34c1-4114-92ec-ab93a2711a03\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") "
May 28 16:11:16.075663 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.075619    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c5b01f19-34c1-4114-92ec-ab93a2711a03\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") "
May 28 16:11:16.075663 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.075649    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-configmap-serving-certs-ca-bundle\") pod \"c5b01f19-34c1-4114-92ec-ab93a2711a03\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") "
May 28 16:11:16.075953 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.075675    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-grpc-tls\") pod \"c5b01f19-34c1-4114-92ec-ab93a2711a03\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") "
May 28 16:11:16.075953 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.075725    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5b01f19-34c1-4114-92ec-ab93a2711a03-config-out\") pod \"c5b01f19-34c1-4114-92ec-ab93a2711a03\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") "
May 28 16:11:16.075953 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.075753    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c5b01f19-34c1-4114-92ec-ab93a2711a03\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") "
May 28 16:11:16.075953 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.075779    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-metrics-client-certs\") pod \"c5b01f19-34c1-4114-92ec-ab93a2711a03\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") "
May 28 16:11:16.075953 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.075803    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-prometheus-k8s-tls\") pod \"c5b01f19-34c1-4114-92ec-ab93a2711a03\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") "
May 28 16:11:16.075953 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.075846    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5b01f19-34c1-4114-92ec-ab93a2711a03-prometheus-k8s-db\") pod \"c5b01f19-34c1-4114-92ec-ab93a2711a03\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") "
May 28 16:11:16.075953 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.075871    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-thanos-prometheus-http-client-file\") pod \"c5b01f19-34c1-4114-92ec-ab93a2711a03\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") "
May 28 16:11:16.075953 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.075913    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-configmap-kubelet-serving-ca-bundle\") pod \"c5b01f19-34c1-4114-92ec-ab93a2711a03\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") "
May 28 16:11:16.075953 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.075935    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-kube-rbac-proxy\") pod \"c5b01f19-34c1-4114-92ec-ab93a2711a03\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") "
May 28 16:11:16.076399 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.075962    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2txk\" (UniqueName: \"kubernetes.io/projected/c5b01f19-34c1-4114-92ec-ab93a2711a03-kube-api-access-s2txk\") pod \"c5b01f19-34c1-4114-92ec-ab93a2711a03\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") "
May 28 16:11:16.076399 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.075993    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5b01f19-34c1-4114-92ec-ab93a2711a03-tls-assets\") pod \"c5b01f19-34c1-4114-92ec-ab93a2711a03\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") "
May 28 16:11:16.076399 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.076022    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-prometheus-k8s-rulefiles-0\") pod \"c5b01f19-34c1-4114-92ec-ab93a2711a03\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") "
May 28 16:11:16.076399 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.076053    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-configmap-metrics-client-ca\") pod \"c5b01f19-34c1-4114-92ec-ab93a2711a03\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") "
May 28 16:11:16.076399 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.076113    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-prometheus-trusted-ca-bundle\") pod \"c5b01f19-34c1-4114-92ec-ab93a2711a03\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") "
May 28 16:11:16.076399 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.076140    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-web-config\") pod \"c5b01f19-34c1-4114-92ec-ab93a2711a03\" (UID: \"c5b01f19-34c1-4114-92ec-ab93a2711a03\") "
May 28 16:11:16.076399 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.076137    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c5b01f19-34c1-4114-92ec-ab93a2711a03" (UID: "c5b01f19-34c1-4114-92ec-ab93a2711a03"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:11:16.076399 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.076442    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-132-51.ec2.internal\" DevicePath \"\""
May 28 16:11:16.079743 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.077989    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c5b01f19-34c1-4114-92ec-ab93a2711a03" (UID: "c5b01f19-34c1-4114-92ec-ab93a2711a03"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:11:16.079743 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.078620    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c5b01f19-34c1-4114-92ec-ab93a2711a03" (UID: "c5b01f19-34c1-4114-92ec-ab93a2711a03"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:11:16.080159 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.080122    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5b01f19-34c1-4114-92ec-ab93a2711a03-config-out" (OuterVolumeSpecName: "config-out") pod "c5b01f19-34c1-4114-92ec-ab93a2711a03" (UID: "c5b01f19-34c1-4114-92ec-ab93a2711a03"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:11:16.080328 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.080144    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c5b01f19-34c1-4114-92ec-ab93a2711a03" (UID: "c5b01f19-34c1-4114-92ec-ab93a2711a03"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:11:16.080486 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.080206    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5b01f19-34c1-4114-92ec-ab93a2711a03-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c5b01f19-34c1-4114-92ec-ab93a2711a03" (UID: "c5b01f19-34c1-4114-92ec-ab93a2711a03"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 16:11:16.080596 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.080372    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c5b01f19-34c1-4114-92ec-ab93a2711a03" (UID: "c5b01f19-34c1-4114-92ec-ab93a2711a03"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 16:11:16.080821 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.080773    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c5b01f19-34c1-4114-92ec-ab93a2711a03" (UID: "c5b01f19-34c1-4114-92ec-ab93a2711a03"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:11:16.080934 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.080878    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5b01f19-34c1-4114-92ec-ab93a2711a03-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c5b01f19-34c1-4114-92ec-ab93a2711a03" (UID: "c5b01f19-34c1-4114-92ec-ab93a2711a03"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:11:16.080934 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.080896    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-config" (OuterVolumeSpecName: "config") pod "c5b01f19-34c1-4114-92ec-ab93a2711a03" (UID: "c5b01f19-34c1-4114-92ec-ab93a2711a03"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:11:16.081133 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.081106    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c5b01f19-34c1-4114-92ec-ab93a2711a03" (UID: "c5b01f19-34c1-4114-92ec-ab93a2711a03"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:11:16.081315 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.081287    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c5b01f19-34c1-4114-92ec-ab93a2711a03" (UID: "c5b01f19-34c1-4114-92ec-ab93a2711a03"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:11:16.081557 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.081534    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c5b01f19-34c1-4114-92ec-ab93a2711a03" (UID: "c5b01f19-34c1-4114-92ec-ab93a2711a03"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:11:16.081945 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.081814    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c5b01f19-34c1-4114-92ec-ab93a2711a03" (UID: "c5b01f19-34c1-4114-92ec-ab93a2711a03"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:11:16.081945 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.081907    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c5b01f19-34c1-4114-92ec-ab93a2711a03" (UID: "c5b01f19-34c1-4114-92ec-ab93a2711a03"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:11:16.082228 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.082205    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5b01f19-34c1-4114-92ec-ab93a2711a03-kube-api-access-s2txk" (OuterVolumeSpecName: "kube-api-access-s2txk") pod "c5b01f19-34c1-4114-92ec-ab93a2711a03" (UID: "c5b01f19-34c1-4114-92ec-ab93a2711a03"). InnerVolumeSpecName "kube-api-access-s2txk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:11:16.082798 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.082774    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c5b01f19-34c1-4114-92ec-ab93a2711a03" (UID: "c5b01f19-34c1-4114-92ec-ab93a2711a03"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:11:16.092820 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.092789    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-web-config" (OuterVolumeSpecName: "web-config") pod "c5b01f19-34c1-4114-92ec-ab93a2711a03" (UID: "c5b01f19-34c1-4114-92ec-ab93a2711a03"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 16:11:16.177030 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.176988    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c5b01f19-34c1-4114-92ec-ab93a2711a03-prometheus-k8s-db\") on node \"ip-10-0-132-51.ec2.internal\" DevicePath \"\""
May 28 16:11:16.177030 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.177027    2564 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-thanos-prometheus-http-client-file\") on node \"ip-10-0-132-51.ec2.internal\" DevicePath \"\""
May 28 16:11:16.177279 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.177044    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-132-51.ec2.internal\" DevicePath \"\""
May 28 16:11:16.177279 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.177057    2564 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-kube-rbac-proxy\") on node \"ip-10-0-132-51.ec2.internal\" DevicePath \"\""
May 28 16:11:16.177279 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.177069    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2txk\" (UniqueName: \"kubernetes.io/projected/c5b01f19-34c1-4114-92ec-ab93a2711a03-kube-api-access-s2txk\") on node \"ip-10-0-132-51.ec2.internal\" DevicePath \"\""
May 28 16:11:16.177279 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.177083    2564 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c5b01f19-34c1-4114-92ec-ab93a2711a03-tls-assets\") on node \"ip-10-0-132-51.ec2.internal\" DevicePath \"\""
May 28 16:11:16.177279 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.177094    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-132-51.ec2.internal\" DevicePath \"\""
May 28 16:11:16.177279 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.177105    2564 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-configmap-metrics-client-ca\") on node \"ip-10-0-132-51.ec2.internal\" DevicePath \"\""
May 28 16:11:16.177279 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.177118    2564 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c5b01f19-34c1-4114-92ec-ab93a2711a03-prometheus-trusted-ca-bundle\") on node \"ip-10-0-132-51.ec2.internal\" DevicePath \"\""
May 28 16:11:16.177279 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.177132    2564 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-web-config\") on node \"ip-10-0-132-51.ec2.internal\" DevicePath \"\""
May 28 16:11:16.177279 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.177143    2564 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-config\") on node \"ip-10-0-132-51.ec2.internal\" DevicePath \"\""
May 28 16:11:16.177279 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.177154    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-132-51.ec2.internal\" DevicePath \"\""
May 28 16:11:16.177279 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.177166    2564 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-grpc-tls\") on node \"ip-10-0-132-51.ec2.internal\" DevicePath \"\""
May 28 16:11:16.177279 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.177178    2564 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c5b01f19-34c1-4114-92ec-ab93a2711a03-config-out\") on node \"ip-10-0-132-51.ec2.internal\" DevicePath \"\""
May 28 16:11:16.177279 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.177190    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-132-51.ec2.internal\" DevicePath \"\""
May 28 16:11:16.177279 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.177202    2564 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-metrics-client-certs\") on node \"ip-10-0-132-51.ec2.internal\" DevicePath \"\""
May 28 16:11:16.177279 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.177216    2564 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c5b01f19-34c1-4114-92ec-ab93a2711a03-secret-prometheus-k8s-tls\") on node \"ip-10-0-132-51.ec2.internal\" DevicePath \"\""
May 28 16:11:16.374506 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.374415    2564 generic.go:358] "Generic (PLEG): container finished" podID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerID="735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264" exitCode=0
May 28 16:11:16.374506 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.374451    2564 generic.go:358] "Generic (PLEG): container finished" podID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerID="f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e" exitCode=0
May 28 16:11:16.374506 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.374463    2564 generic.go:358] "Generic (PLEG): container finished" podID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerID="94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2" exitCode=0
May 28 16:11:16.374506 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.374472    2564 generic.go:358] "Generic (PLEG): container finished" podID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerID="a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7" exitCode=0
May 28 16:11:16.374506 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.374479    2564 generic.go:358] "Generic (PLEG): container finished" podID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerID="15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012" exitCode=0
May 28 16:11:16.374506 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.374486    2564 generic.go:358] "Generic (PLEG): container finished" podID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerID="964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d" exitCode=0
May 28 16:11:16.374817 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.374497    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5b01f19-34c1-4114-92ec-ab93a2711a03","Type":"ContainerDied","Data":"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264"}
May 28 16:11:16.374817 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.374542    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5b01f19-34c1-4114-92ec-ab93a2711a03","Type":"ContainerDied","Data":"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e"}
May 28 16:11:16.374817 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.374555    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5b01f19-34c1-4114-92ec-ab93a2711a03","Type":"ContainerDied","Data":"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2"}
May 28 16:11:16.374817 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.374566    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5b01f19-34c1-4114-92ec-ab93a2711a03","Type":"ContainerDied","Data":"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7"}
May 28 16:11:16.374817 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.374576    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5b01f19-34c1-4114-92ec-ab93a2711a03","Type":"ContainerDied","Data":"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012"}
May 28 16:11:16.374817 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.374586    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5b01f19-34c1-4114-92ec-ab93a2711a03","Type":"ContainerDied","Data":"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d"}
May 28 16:11:16.374817 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.374594    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c5b01f19-34c1-4114-92ec-ab93a2711a03","Type":"ContainerDied","Data":"ddef3afe8c0bbff94a73d266e621afa9c5de4f1f42d48d8ce269cc032dd0e04b"}
May 28 16:11:16.374817 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.374555    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.374817 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.374612    2564 scope.go:117] "RemoveContainer" containerID="735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264"
May 28 16:11:16.383429 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.383411    2564 scope.go:117] "RemoveContainer" containerID="f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e"
May 28 16:11:16.391406 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.391387    2564 scope.go:117] "RemoveContainer" containerID="94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2"
May 28 16:11:16.398298 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.398281    2564 scope.go:117] "RemoveContainer" containerID="a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7"
May 28 16:11:16.405249 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.405226    2564 scope.go:117] "RemoveContainer" containerID="15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012"
May 28 16:11:16.409346 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.409325    2564 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 16:11:16.413468 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.413453    2564 scope.go:117] "RemoveContainer" containerID="964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d"
May 28 16:11:16.415771 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.415748    2564 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 16:11:16.420822 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.420806    2564 scope.go:117] "RemoveContainer" containerID="f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091"
May 28 16:11:16.427604 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.427584    2564 scope.go:117] "RemoveContainer" containerID="735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264"
May 28 16:11:16.427875 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:11:16.427856    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264\": container with ID starting with 735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264 not found: ID does not exist" containerID="735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264"
May 28 16:11:16.427920 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.427884    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264"} err="failed to get container status \"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264\": rpc error: code = NotFound desc = could not find container \"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264\": container with ID starting with 735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264 not found: ID does not exist"
May 28 16:11:16.427965 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.427918    2564 scope.go:117] "RemoveContainer" containerID="f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e"
May 28 16:11:16.428117 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:11:16.428101    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e\": container with ID starting with f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e not found: ID does not exist" containerID="f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e"
May 28 16:11:16.428167 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.428121    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e"} err="failed to get container status \"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e\": rpc error: code = NotFound desc = could not find container \"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e\": container with ID starting with f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e not found: ID does not exist"
May 28 16:11:16.428167 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.428135    2564 scope.go:117] "RemoveContainer" containerID="94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2"
May 28 16:11:16.428385 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:11:16.428350    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2\": container with ID starting with 94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2 not found: ID does not exist" containerID="94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2"
May 28 16:11:16.428432 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.428391    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2"} err="failed to get container status \"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2\": rpc error: code = NotFound desc = could not find container \"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2\": container with ID starting with 94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2 not found: ID does not exist"
May 28 16:11:16.428432 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.428407    2564 scope.go:117] "RemoveContainer" containerID="a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7"
May 28 16:11:16.428618 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:11:16.428598    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7\": container with ID starting with a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7 not found: ID does not exist" containerID="a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7"
May 28 16:11:16.428682 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.428627    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7"} err="failed to get container status \"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7\": rpc error: code = NotFound desc = could not find container \"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7\": container with ID starting with a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7 not found: ID does not exist"
May 28 16:11:16.428682 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.428655    2564 scope.go:117] "RemoveContainer" containerID="15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012"
May 28 16:11:16.428939 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:11:16.428921    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012\": container with ID starting with 15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012 not found: ID does not exist" containerID="15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012"
May 28 16:11:16.428974 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.428946    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012"} err="failed to get container status \"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012\": rpc error: code = NotFound desc = could not find container \"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012\": container with ID starting with 15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012 not found: ID does not exist"
May 28 16:11:16.428974 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.428961    2564 scope.go:117] "RemoveContainer" containerID="964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d"
May 28 16:11:16.429165 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:11:16.429146    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d\": container with ID starting with 964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d not found: ID does not exist" containerID="964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d"
May 28 16:11:16.429206 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.429172    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d"} err="failed to get container status \"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d\": rpc error: code = NotFound desc = could not find container \"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d\": container with ID starting with 964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d not found: ID does not exist"
May 28 16:11:16.429206 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.429189    2564 scope.go:117] "RemoveContainer" containerID="f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091"
May 28 16:11:16.429407 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:11:16.429392    2564 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091\": container with ID starting with f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091 not found: ID does not exist" containerID="f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091"
May 28 16:11:16.429453 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.429412    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091"} err="failed to get container status \"f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091\": rpc error: code = NotFound desc = could not find container \"f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091\": container with ID starting with f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091 not found: ID does not exist"
May 28 16:11:16.429453 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.429425    2564 scope.go:117] "RemoveContainer" containerID="735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264"
May 28 16:11:16.429678 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.429661    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264"} err="failed to get container status \"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264\": rpc error: code = NotFound desc = could not find container \"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264\": container with ID starting with 735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264 not found: ID does not exist"
May 28 16:11:16.429678 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.429677    2564 scope.go:117] "RemoveContainer" containerID="f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e"
May 28 16:11:16.429863 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.429846    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e"} err="failed to get container status \"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e\": rpc error: code = NotFound desc = could not find container \"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e\": container with ID starting with f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e not found: ID does not exist"
May 28 16:11:16.429904 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.429863    2564 scope.go:117] "RemoveContainer" containerID="94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2"
May 28 16:11:16.430040 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.430025    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2"} err="failed to get container status \"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2\": rpc error: code = NotFound desc = could not find container \"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2\": container with ID starting with 94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2 not found: ID does not exist"
May 28 16:11:16.430083 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.430041    2564 scope.go:117] "RemoveContainer" containerID="a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7"
May 28 16:11:16.430222 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.430208    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7"} err="failed to get container status \"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7\": rpc error: code = NotFound desc = could not find container \"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7\": container with ID starting with a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7 not found: ID does not exist"
May 28 16:11:16.430264 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.430222    2564 scope.go:117] "RemoveContainer" containerID="15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012"
May 28 16:11:16.430423 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.430408    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012"} err="failed to get container status \"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012\": rpc error: code = NotFound desc = could not find container \"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012\": container with ID starting with 15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012 not found: ID does not exist"
May 28 16:11:16.430480 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.430423    2564 scope.go:117] "RemoveContainer" containerID="964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d"
May 28 16:11:16.430654 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.430634    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d"} err="failed to get container status \"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d\": rpc error: code = NotFound desc = could not find container \"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d\": container with ID starting with 964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d not found: ID does not exist"
May 28 16:11:16.430701 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.430655    2564 scope.go:117] "RemoveContainer" containerID="f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091"
May 28 16:11:16.430862 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.430846    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091"} err="failed to get container status \"f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091\": rpc error: code = NotFound desc = could not find container \"f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091\": container with ID starting with f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091 not found: ID does not exist"
May 28 16:11:16.430862 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.430862    2564 scope.go:117] "RemoveContainer" containerID="735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264"
May 28 16:11:16.431074 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.431057    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264"} err="failed to get container status \"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264\": rpc error: code = NotFound desc = could not find container \"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264\": container with ID starting with 735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264 not found: ID does not exist"
May 28 16:11:16.431108 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.431076    2564 scope.go:117] "RemoveContainer" containerID="f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e"
May 28 16:11:16.431249 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.431233    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e"} err="failed to get container status \"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e\": rpc error: code = NotFound desc = could not find container \"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e\": container with ID starting with f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e not found: ID does not exist"
May 28 16:11:16.431288 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.431249    2564 scope.go:117] "RemoveContainer" containerID="94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2"
May 28 16:11:16.431483 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.431465    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2"} err="failed to get container status \"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2\": rpc error: code = NotFound desc = could not find container \"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2\": container with ID starting with 94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2 not found: ID does not exist"
May 28 16:11:16.431552 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.431484    2564 scope.go:117] "RemoveContainer" containerID="a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7"
May 28 16:11:16.431710 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.431694    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7"} err="failed to get container status \"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7\": rpc error: code = NotFound desc = could not find container \"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7\": container with ID starting with a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7 not found: ID does not exist"
May 28 16:11:16.431753 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.431710    2564 scope.go:117] "RemoveContainer" containerID="15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012"
May 28 16:11:16.431912 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.431894    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012"} err="failed to get container status \"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012\": rpc error: code = NotFound desc = could not find container \"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012\": container with ID starting with 15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012 not found: ID does not exist"
May 28 16:11:16.431956 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.431912    2564 scope.go:117] "RemoveContainer" containerID="964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d"
May 28 16:11:16.432133 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.432111    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d"} err="failed to get container status \"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d\": rpc error: code = NotFound desc = could not find container \"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d\": container with ID starting with 964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d not found: ID does not exist"
May 28 16:11:16.432184 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.432135    2564 scope.go:117] "RemoveContainer" containerID="f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091"
May 28 16:11:16.432376 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.432345    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091"} err="failed to get container status \"f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091\": rpc error: code = NotFound desc = could not find container \"f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091\": container with ID starting with f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091 not found: ID does not exist"
May 28 16:11:16.432425 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.432383    2564 scope.go:117] "RemoveContainer" containerID="735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264"
May 28 16:11:16.432605 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.432590    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264"} err="failed to get container status \"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264\": rpc error: code = NotFound desc = could not find container \"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264\": container with ID starting with 735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264 not found: ID does not exist"
May 28 16:11:16.432655 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.432605    2564 scope.go:117] "RemoveContainer" containerID="f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e"
May 28 16:11:16.432809 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.432791    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e"} err="failed to get container status \"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e\": rpc error: code = NotFound desc = could not find container \"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e\": container with ID starting with f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e not found: ID does not exist"
May 28 16:11:16.432849 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.432809    2564 scope.go:117] "RemoveContainer" containerID="94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2"
May 28 16:11:16.433006 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.432989    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2"} err="failed to get container status \"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2\": rpc error: code = NotFound desc = could not find container \"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2\": container with ID starting with 94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2 not found: ID does not exist"
May 28 16:11:16.433045 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.433006    2564 scope.go:117] "RemoveContainer" containerID="a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7"
May 28 16:11:16.433208 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.433191    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7"} err="failed to get container status \"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7\": rpc error: code = NotFound desc = could not find container \"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7\": container with ID starting with a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7 not found: ID does not exist"
May 28 16:11:16.433250 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.433208    2564 scope.go:117] "RemoveContainer" containerID="15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012"
May 28 16:11:16.433471 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.433413    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012"} err="failed to get container status \"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012\": rpc error: code = NotFound desc = could not find container \"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012\": container with ID starting with 15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012 not found: ID does not exist"
May 28 16:11:16.433471 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.433436    2564 scope.go:117] "RemoveContainer" containerID="964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d"
May 28 16:11:16.433777 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.433753    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d"} err="failed to get container status \"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d\": rpc error: code = NotFound desc = could not find container \"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d\": container with ID starting with 964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d not found: ID does not exist"
May 28 16:11:16.433864 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.433779    2564 scope.go:117] "RemoveContainer" containerID="f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091"
May 28 16:11:16.434075 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.434030    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091"} err="failed to get container status \"f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091\": rpc error: code = NotFound desc = could not find container \"f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091\": container with ID starting with f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091 not found: ID does not exist"
May 28 16:11:16.434075 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.434075    2564 scope.go:117] "RemoveContainer" containerID="735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264"
May 28 16:11:16.434339 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.434321    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264"} err="failed to get container status \"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264\": rpc error: code = NotFound desc = could not find container \"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264\": container with ID starting with 735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264 not found: ID does not exist"
May 28 16:11:16.434447 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.434340    2564 scope.go:117] "RemoveContainer" containerID="f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e"
May 28 16:11:16.434636 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.434595    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e"} err="failed to get container status \"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e\": rpc error: code = NotFound desc = could not find container \"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e\": container with ID starting with f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e not found: ID does not exist"
May 28 16:11:16.434636 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.434628    2564 scope.go:117] "RemoveContainer" containerID="94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2"
May 28 16:11:16.434891 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.434873    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2"} err="failed to get container status \"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2\": rpc error: code = NotFound desc = could not find container \"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2\": container with ID starting with 94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2 not found: ID does not exist"
May 28 16:11:16.434942 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.434892    2564 scope.go:117] "RemoveContainer" containerID="a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7"
May 28 16:11:16.435132 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.435112    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7"} err="failed to get container status \"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7\": rpc error: code = NotFound desc = could not find container \"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7\": container with ID starting with a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7 not found: ID does not exist"
May 28 16:11:16.435132 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.435131    2564 scope.go:117] "RemoveContainer" containerID="15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012"
May 28 16:11:16.435404 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.435386    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012"} err="failed to get container status \"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012\": rpc error: code = NotFound desc = could not find container \"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012\": container with ID starting with 15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012 not found: ID does not exist"
May 28 16:11:16.435488 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.435406    2564 scope.go:117] "RemoveContainer" containerID="964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d"
May 28 16:11:16.435650 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.435633    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d"} err="failed to get container status \"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d\": rpc error: code = NotFound desc = could not find container \"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d\": container with ID starting with 964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d not found: ID does not exist"
May 28 16:11:16.435724 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.435663    2564 scope.go:117] "RemoveContainer" containerID="f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091"
May 28 16:11:16.435921 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.435902    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091"} err="failed to get container status \"f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091\": rpc error: code = NotFound desc = could not find container \"f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091\": container with ID starting with f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091 not found: ID does not exist"
May 28 16:11:16.435988 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.435922    2564 scope.go:117] "RemoveContainer" containerID="735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264"
May 28 16:11:16.436036 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436008    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 16:11:16.436173 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436128    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264"} err="failed to get container status \"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264\": rpc error: code = NotFound desc = could not find container \"735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264\": container with ID starting with 735e90f818df1952d32cabe024d4dde9cde839ca2f822aab8dded924bf9af264 not found: ID does not exist"
May 28 16:11:16.436173 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436147    2564 scope.go:117] "RemoveContainer" containerID="f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e"
May 28 16:11:16.436405 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436389    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="init-config-reloader"
May 28 16:11:16.436461 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436409    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="init-config-reloader"
May 28 16:11:16.436461 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436427    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="prometheus"
May 28 16:11:16.436461 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436421    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e"} err="failed to get container status \"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e\": rpc error: code = NotFound desc = could not find container \"f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e\": container with ID starting with f9df8a114fcb8cd5571e8731ada34746c1fd8a7926db73a4fad3c60418a8967e not found: ID does not exist"
May 28 16:11:16.436461 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436447    2564 scope.go:117] "RemoveContainer" containerID="94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2"
May 28 16:11:16.436620 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436435    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="prometheus"
May 28 16:11:16.436620 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436497    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="kube-rbac-proxy"
May 28 16:11:16.436620 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436506    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="kube-rbac-proxy"
May 28 16:11:16.436620 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436524    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="config-reloader"
May 28 16:11:16.436620 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436532    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="config-reloader"
May 28 16:11:16.436620 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436538    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="thanos-sidecar"
May 28 16:11:16.436620 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436543    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="thanos-sidecar"
May 28 16:11:16.436620 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436552    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="kube-rbac-proxy-web"
May 28 16:11:16.436620 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436558    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="kube-rbac-proxy-web"
May 28 16:11:16.436620 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436572    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="kube-rbac-proxy-thanos"
May 28 16:11:16.436620 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436577    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="kube-rbac-proxy-thanos"
May 28 16:11:16.436996 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436646    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="kube-rbac-proxy-web"
May 28 16:11:16.436996 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436661    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="thanos-sidecar"
May 28 16:11:16.436996 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436671    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="config-reloader"
May 28 16:11:16.436996 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436681    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="kube-rbac-proxy-thanos"
May 28 16:11:16.436996 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436675    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2"} err="failed to get container status \"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2\": rpc error: code = NotFound desc = could not find container \"94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2\": container with ID starting with 94b248480dcf3de387f20df7c64dc3ce3310e1d9b37149487946688573b71fa2 not found: ID does not exist"
May 28 16:11:16.436996 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436694    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="kube-rbac-proxy"
May 28 16:11:16.436996 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436705    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" containerName="prometheus"
May 28 16:11:16.436996 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436694    2564 scope.go:117] "RemoveContainer" containerID="a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7"
May 28 16:11:16.436996 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436959    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7"} err="failed to get container status \"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7\": rpc error: code = NotFound desc = could not find container \"a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7\": container with ID starting with a9bcca16afc3cde05eb9bb6b087cd82e663e9884c14ec671f7f7f5e373546fa7 not found: ID does not exist"
May 28 16:11:16.436996 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.436977    2564 scope.go:117] "RemoveContainer" containerID="15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012"
May 28 16:11:16.437292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.437190    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012"} err="failed to get container status \"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012\": rpc error: code = NotFound desc = could not find container \"15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012\": container with ID starting with 15f8adc60205cbfd7b38308201c0d9aaf53b148279ba1e54805d949fbc75c012 not found: ID does not exist"
May 28 16:11:16.437292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.437207    2564 scope.go:117] "RemoveContainer" containerID="964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d"
May 28 16:11:16.437454 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.437435    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d"} err="failed to get container status \"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d\": rpc error: code = NotFound desc = could not find container \"964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d\": container with ID starting with 964c494d4fb4b268f086b198a9112b6557b1525cd42fc7ba16c36c8b348bda0d not found: ID does not exist"
May 28 16:11:16.437502 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.437455    2564 scope.go:117] "RemoveContainer" containerID="f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091"
May 28 16:11:16.437681 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.437661    2564 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091"} err="failed to get container status \"f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091\": rpc error: code = NotFound desc = could not find container \"f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091\": container with ID starting with f9595b135453e4840652206d39b2c1dae07c500e3708ee69aa39c0e84007d091 not found: ID does not exist"
May 28 16:11:16.441532 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.441518    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.444956 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.444933    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 28 16:11:16.444956 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.444949    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dp9f59f3662kd\""
May 28 16:11:16.445119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.444933    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-8w4nr\""
May 28 16:11:16.445119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.444978    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 28 16:11:16.445119 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.444933    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 28 16:11:16.445318 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.445129    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 28 16:11:16.445318 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.445144    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 28 16:11:16.445318 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.445148    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 28 16:11:16.445318 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.445233    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 16:11:16.445519 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.445389    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 28 16:11:16.445684 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.445665    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 28 16:11:16.445772 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.445704    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 28 16:11:16.445772 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.445709    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 28 16:11:16.449791 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.449771    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 28 16:11:16.454064 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.454044    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 28 16:11:16.455833 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.455803    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 16:11:16.479373 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.479338    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.479503 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.479411    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.479503 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.479435    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c10b0f1-9b41-4839-a216-95daf02b0eeb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.479503 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.479454    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.479503 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.479478    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c10b0f1-9b41-4839-a216-95daf02b0eeb-config-out\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.479678 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.479569    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c10b0f1-9b41-4839-a216-95daf02b0eeb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.479678 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.479614    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5p8n\" (UniqueName: \"kubernetes.io/projected/0c10b0f1-9b41-4839-a216-95daf02b0eeb-kube-api-access-x5p8n\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.479678 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.479643    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0c10b0f1-9b41-4839-a216-95daf02b0eeb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.479678 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.479673    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c10b0f1-9b41-4839-a216-95daf02b0eeb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.479837 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.479699    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c10b0f1-9b41-4839-a216-95daf02b0eeb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.479837 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.479725    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-config\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.479837 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.479750    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.479837 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.479774    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.480007 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.479871    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0c10b0f1-9b41-4839-a216-95daf02b0eeb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.480007 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.479919    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-web-config\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.480007 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.479956    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c10b0f1-9b41-4839-a216-95daf02b0eeb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.480007 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.479984    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.480184 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.480037    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.581092 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.581048    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.581264 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.581108    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.581264 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.581131    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.581264 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.581229    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.581462 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.581272    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c10b0f1-9b41-4839-a216-95daf02b0eeb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.581462 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.581299    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.581462 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.581326    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c10b0f1-9b41-4839-a216-95daf02b0eeb-config-out\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.581462 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.581352    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c10b0f1-9b41-4839-a216-95daf02b0eeb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.581462 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.581411    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x5p8n\" (UniqueName: \"kubernetes.io/projected/0c10b0f1-9b41-4839-a216-95daf02b0eeb-kube-api-access-x5p8n\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.581462 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.581437    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0c10b0f1-9b41-4839-a216-95daf02b0eeb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.581755 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.581469    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c10b0f1-9b41-4839-a216-95daf02b0eeb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.581755 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.581496    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c10b0f1-9b41-4839-a216-95daf02b0eeb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.581755 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.581524    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-config\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.581755 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.581550    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.581755 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.581577    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.581755 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.581614    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0c10b0f1-9b41-4839-a216-95daf02b0eeb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.581755 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.581657    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-web-config\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.581755 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.581694    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c10b0f1-9b41-4839-a216-95daf02b0eeb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.584043 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.582228    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c10b0f1-9b41-4839-a216-95daf02b0eeb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.584043 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.582574    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c10b0f1-9b41-4839-a216-95daf02b0eeb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.584043 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.583096    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0c10b0f1-9b41-4839-a216-95daf02b0eeb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.584043 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.583816    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/0c10b0f1-9b41-4839-a216-95daf02b0eeb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.584910 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.584883    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.585022 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.584933    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c10b0f1-9b41-4839-a216-95daf02b0eeb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.585449 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.585423    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.585534 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.585430    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.585741 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.585694    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-web-config\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.586055 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.586029    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.586272 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.586242    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.586534 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.586514    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.586602 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.586571    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0c10b0f1-9b41-4839-a216-95daf02b0eeb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.586780 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.586756    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/0c10b0f1-9b41-4839-a216-95daf02b0eeb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.587117 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.587097    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-config\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.587576 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.587555    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/0c10b0f1-9b41-4839-a216-95daf02b0eeb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.587648 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.587558    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0c10b0f1-9b41-4839-a216-95daf02b0eeb-config-out\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.590546 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.590526    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5p8n\" (UniqueName: \"kubernetes.io/projected/0c10b0f1-9b41-4839-a216-95daf02b0eeb-kube-api-access-x5p8n\") pod \"prometheus-k8s-0\" (UID: \"0c10b0f1-9b41-4839-a216-95daf02b0eeb\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.723074 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.722990    2564 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5b01f19-34c1-4114-92ec-ab93a2711a03" path="/var/lib/kubelet/pods/c5b01f19-34c1-4114-92ec-ab93a2711a03/volumes"
May 28 16:11:16.752652 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.752611    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:16.896889 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:16.896297    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 16:11:16.897897 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:11:16.897867    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c10b0f1_9b41_4839_a216_95daf02b0eeb.slice/crio-d2be1997b6ae0111c5c104c2605cb280e25a4a1933310acff475b3928c33ffb9 WatchSource:0}: Error finding container d2be1997b6ae0111c5c104c2605cb280e25a4a1933310acff475b3928c33ffb9: Status 404 returned error can't find the container with id d2be1997b6ae0111c5c104c2605cb280e25a4a1933310acff475b3928c33ffb9
May 28 16:11:17.379620 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:17.379549    2564 generic.go:358] "Generic (PLEG): container finished" podID="0c10b0f1-9b41-4839-a216-95daf02b0eeb" containerID="6475e2bbc539dc03fa0dd5aab3fbbe804ea6c26dbb95c21ebe15a190a02aa680" exitCode=0
May 28 16:11:17.380007 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:17.379967    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c10b0f1-9b41-4839-a216-95daf02b0eeb","Type":"ContainerDied","Data":"6475e2bbc539dc03fa0dd5aab3fbbe804ea6c26dbb95c21ebe15a190a02aa680"}
May 28 16:11:17.380198 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:17.380143    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c10b0f1-9b41-4839-a216-95daf02b0eeb","Type":"ContainerStarted","Data":"d2be1997b6ae0111c5c104c2605cb280e25a4a1933310acff475b3928c33ffb9"}
May 28 16:11:18.389178 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:18.389143    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c10b0f1-9b41-4839-a216-95daf02b0eeb","Type":"ContainerStarted","Data":"ee0dc24840fca8c2a10a9a345efe02698721f2ea918f58c177d2618e75346af7"}
May 28 16:11:18.389178 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:18.389181    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c10b0f1-9b41-4839-a216-95daf02b0eeb","Type":"ContainerStarted","Data":"129e7ecfff7d1a5e5438373f726148a1a67be73cb041d1ed3ab8295973c96f9b"}
May 28 16:11:18.389595 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:18.389191    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c10b0f1-9b41-4839-a216-95daf02b0eeb","Type":"ContainerStarted","Data":"73f5fa586968f8d3559f204af5555d01c6cf909f77ce579d1bc8e15cafa37b9d"}
May 28 16:11:18.389595 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:18.389199    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c10b0f1-9b41-4839-a216-95daf02b0eeb","Type":"ContainerStarted","Data":"e132eff0e0523345028145eee978b143f4cbaf75c35716ee61af7b2045e0ac33"}
May 28 16:11:18.389595 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:18.389208    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c10b0f1-9b41-4839-a216-95daf02b0eeb","Type":"ContainerStarted","Data":"1b5f8b5d84ab94997b775e46b777fa1833221580f90b521c8b1d1e0a55ba3d42"}
May 28 16:11:18.389595 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:18.389215    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"0c10b0f1-9b41-4839-a216-95daf02b0eeb","Type":"ContainerStarted","Data":"535eeefd2d33f3da65cc72f686227c4a1636cb0656bdd173adbb48f1993c83ac"}
May 28 16:11:18.418625 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:18.418544    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.41852887 podStartE2EDuration="2.41852887s" podCreationTimestamp="2026-05-28 16:11:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:11:18.416402388 +0000 UTC m=+198.265879857" watchObservedRunningTime="2026-05-28 16:11:18.41852887 +0000 UTC m=+198.268006383"
May 28 16:11:21.753720 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:21.753676    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:11:45.338349 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:45.338311    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-nqkbf"]
May 28 16:11:45.341554 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:45.341532    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nqkbf"
May 28 16:11:45.343956 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:45.343928    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 16:11:45.346918 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:45.346893    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nqkbf"]
May 28 16:11:45.414495 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:45.414452    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/303ed01b-d012-4cbe-968c-cfef86ee805b-original-pull-secret\") pod \"global-pull-secret-syncer-nqkbf\" (UID: \"303ed01b-d012-4cbe-968c-cfef86ee805b\") " pod="kube-system/global-pull-secret-syncer-nqkbf"
May 28 16:11:45.414684 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:45.414517    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/303ed01b-d012-4cbe-968c-cfef86ee805b-kubelet-config\") pod \"global-pull-secret-syncer-nqkbf\" (UID: \"303ed01b-d012-4cbe-968c-cfef86ee805b\") " pod="kube-system/global-pull-secret-syncer-nqkbf"
May 28 16:11:45.414684 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:45.414568    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/303ed01b-d012-4cbe-968c-cfef86ee805b-dbus\") pod \"global-pull-secret-syncer-nqkbf\" (UID: \"303ed01b-d012-4cbe-968c-cfef86ee805b\") " pod="kube-system/global-pull-secret-syncer-nqkbf"
May 28 16:11:45.515520 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:45.515472    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/303ed01b-d012-4cbe-968c-cfef86ee805b-dbus\") pod \"global-pull-secret-syncer-nqkbf\" (UID: \"303ed01b-d012-4cbe-968c-cfef86ee805b\") " pod="kube-system/global-pull-secret-syncer-nqkbf"
May 28 16:11:45.515723 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:45.515561    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/303ed01b-d012-4cbe-968c-cfef86ee805b-original-pull-secret\") pod \"global-pull-secret-syncer-nqkbf\" (UID: \"303ed01b-d012-4cbe-968c-cfef86ee805b\") " pod="kube-system/global-pull-secret-syncer-nqkbf"
May 28 16:11:45.515723 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:45.515601    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/303ed01b-d012-4cbe-968c-cfef86ee805b-kubelet-config\") pod \"global-pull-secret-syncer-nqkbf\" (UID: \"303ed01b-d012-4cbe-968c-cfef86ee805b\") " pod="kube-system/global-pull-secret-syncer-nqkbf"
May 28 16:11:45.515723 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:45.515672    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/303ed01b-d012-4cbe-968c-cfef86ee805b-dbus\") pod \"global-pull-secret-syncer-nqkbf\" (UID: \"303ed01b-d012-4cbe-968c-cfef86ee805b\") " pod="kube-system/global-pull-secret-syncer-nqkbf"
May 28 16:11:45.515723 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:45.515684    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/303ed01b-d012-4cbe-968c-cfef86ee805b-kubelet-config\") pod \"global-pull-secret-syncer-nqkbf\" (UID: \"303ed01b-d012-4cbe-968c-cfef86ee805b\") " pod="kube-system/global-pull-secret-syncer-nqkbf"
May 28 16:11:45.518126 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:45.518104    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/303ed01b-d012-4cbe-968c-cfef86ee805b-original-pull-secret\") pod \"global-pull-secret-syncer-nqkbf\" (UID: \"303ed01b-d012-4cbe-968c-cfef86ee805b\") " pod="kube-system/global-pull-secret-syncer-nqkbf"
May 28 16:11:45.652292 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:45.652185    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-nqkbf"
May 28 16:11:45.783443 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:45.783412    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-nqkbf"]
May 28 16:11:45.785984 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:11:45.785954    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod303ed01b_d012_4cbe_968c_cfef86ee805b.slice/crio-6d8590c766ccdfcd8414fdf1a670a505ea2e97003a25f74b3223660701a57fa7 WatchSource:0}: Error finding container 6d8590c766ccdfcd8414fdf1a670a505ea2e97003a25f74b3223660701a57fa7: Status 404 returned error can't find the container with id 6d8590c766ccdfcd8414fdf1a670a505ea2e97003a25f74b3223660701a57fa7
May 28 16:11:46.472834 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:46.472800    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nqkbf" event={"ID":"303ed01b-d012-4cbe-968c-cfef86ee805b","Type":"ContainerStarted","Data":"6d8590c766ccdfcd8414fdf1a670a505ea2e97003a25f74b3223660701a57fa7"}
May 28 16:11:50.485402 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:50.485332    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-nqkbf" event={"ID":"303ed01b-d012-4cbe-968c-cfef86ee805b","Type":"ContainerStarted","Data":"1c22b608b2a34711a2b7e609cfccd9f4c72d2fa6afb49c2d1f00fc48e0793d57"}
May 28 16:11:50.499558 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:11:50.499498    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-nqkbf" podStartSLOduration=1.591955679 podStartE2EDuration="5.499482789s" podCreationTimestamp="2026-05-28 16:11:45 +0000 UTC" firstStartedPulling="2026-05-28 16:11:45.787650502 +0000 UTC m=+225.637127952" lastFinishedPulling="2026-05-28 16:11:49.695177606 +0000 UTC m=+229.544655062" observedRunningTime="2026-05-28 16:11:50.498602108 +0000 UTC m=+230.348079580" watchObservedRunningTime="2026-05-28 16:11:50.499482789 +0000 UTC m=+230.348960261"
May 28 16:12:16.753117 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:12:16.753006    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:12:16.770011 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:12:16.769978    2564 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:12:17.584131 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:12:17.584103    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 16:13:00.605426 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:00.605397    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/ovn-acl-logging/0.log"
May 28 16:13:00.607902 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:00.607873    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/ovn-acl-logging/0.log"
May 28 16:13:00.610109 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:00.610076    2564 kubelet.go:1628] "Image garbage collection succeeded"
May 28 16:13:28.598025 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:28.597992    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-95cfdd646-kqp97"]
May 28 16:13:28.601125 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:28.601074    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-kqp97"
May 28 16:13:28.608255 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:28.608230    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 28 16:13:28.608469 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:28.608240    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 28 16:13:28.608469 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:28.608276    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 28 16:13:28.608469 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:28.608306    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 28 16:13:28.608469 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:28.608422    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pb8rq\""
May 28 16:13:28.621300 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:28.621272    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-95cfdd646-kqp97"]
May 28 16:13:28.705787 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:28.705743    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95wm2\" (UniqueName: \"kubernetes.io/projected/ff3dd3f9-4ba0-491e-965a-ae93dd39df1b-kube-api-access-95wm2\") pod \"opendatahub-operator-controller-manager-95cfdd646-kqp97\" (UID: \"ff3dd3f9-4ba0-491e-965a-ae93dd39df1b\") " pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-kqp97"
May 28 16:13:28.705961 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:28.705846    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff3dd3f9-4ba0-491e-965a-ae93dd39df1b-webhook-cert\") pod \"opendatahub-operator-controller-manager-95cfdd646-kqp97\" (UID: \"ff3dd3f9-4ba0-491e-965a-ae93dd39df1b\") " pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-kqp97"
May 28 16:13:28.705961 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:28.705904    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ff3dd3f9-4ba0-491e-965a-ae93dd39df1b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-95cfdd646-kqp97\" (UID: \"ff3dd3f9-4ba0-491e-965a-ae93dd39df1b\") " pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-kqp97"
May 28 16:13:28.806386 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:28.806319    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ff3dd3f9-4ba0-491e-965a-ae93dd39df1b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-95cfdd646-kqp97\" (UID: \"ff3dd3f9-4ba0-491e-965a-ae93dd39df1b\") " pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-kqp97"
May 28 16:13:28.806568 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:28.806413    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95wm2\" (UniqueName: \"kubernetes.io/projected/ff3dd3f9-4ba0-491e-965a-ae93dd39df1b-kube-api-access-95wm2\") pod \"opendatahub-operator-controller-manager-95cfdd646-kqp97\" (UID: \"ff3dd3f9-4ba0-491e-965a-ae93dd39df1b\") " pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-kqp97"
May 28 16:13:28.806568 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:28.806475    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff3dd3f9-4ba0-491e-965a-ae93dd39df1b-webhook-cert\") pod \"opendatahub-operator-controller-manager-95cfdd646-kqp97\" (UID: \"ff3dd3f9-4ba0-491e-965a-ae93dd39df1b\") " pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-kqp97"
May 28 16:13:28.809017 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:28.808996    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ff3dd3f9-4ba0-491e-965a-ae93dd39df1b-webhook-cert\") pod \"opendatahub-operator-controller-manager-95cfdd646-kqp97\" (UID: \"ff3dd3f9-4ba0-491e-965a-ae93dd39df1b\") " pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-kqp97"
May 28 16:13:28.809109 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:28.809092    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ff3dd3f9-4ba0-491e-965a-ae93dd39df1b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-95cfdd646-kqp97\" (UID: \"ff3dd3f9-4ba0-491e-965a-ae93dd39df1b\") " pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-kqp97"
May 28 16:13:28.815418 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:28.815387    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95wm2\" (UniqueName: \"kubernetes.io/projected/ff3dd3f9-4ba0-491e-965a-ae93dd39df1b-kube-api-access-95wm2\") pod \"opendatahub-operator-controller-manager-95cfdd646-kqp97\" (UID: \"ff3dd3f9-4ba0-491e-965a-ae93dd39df1b\") " pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-kqp97"
May 28 16:13:28.911393 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:28.911278    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-kqp97"
May 28 16:13:29.085959 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:29.085926    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-95cfdd646-kqp97"]
May 28 16:13:29.090198 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:13:29.090167    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff3dd3f9_4ba0_491e_965a_ae93dd39df1b.slice/crio-924e5c165235b4f00bdd3d224dcaecbf54321afd256ecb8603f4e68d15689cc4 WatchSource:0}: Error finding container 924e5c165235b4f00bdd3d224dcaecbf54321afd256ecb8603f4e68d15689cc4: Status 404 returned error can't find the container with id 924e5c165235b4f00bdd3d224dcaecbf54321afd256ecb8603f4e68d15689cc4
May 28 16:13:29.091991 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:29.091971    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 16:13:29.781486 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:29.781429    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-kqp97" event={"ID":"ff3dd3f9-4ba0-491e-965a-ae93dd39df1b","Type":"ContainerStarted","Data":"924e5c165235b4f00bdd3d224dcaecbf54321afd256ecb8603f4e68d15689cc4"}
May 28 16:13:31.791104 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:31.791011    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-kqp97" event={"ID":"ff3dd3f9-4ba0-491e-965a-ae93dd39df1b","Type":"ContainerStarted","Data":"2a4ee2b7d47e36dc7afd51dcacd9477d3bad8a7466e329603a16fd5727cada8f"}
May 28 16:13:31.791477 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:31.791112    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-kqp97"
May 28 16:13:31.817534 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:31.817479    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-kqp97" podStartSLOduration=1.409413367 podStartE2EDuration="3.817461366s" podCreationTimestamp="2026-05-28 16:13:28 +0000 UTC" firstStartedPulling="2026-05-28 16:13:29.092105015 +0000 UTC m=+328.941582479" lastFinishedPulling="2026-05-28 16:13:31.500153027 +0000 UTC m=+331.349630478" observedRunningTime="2026-05-28 16:13:31.81556511 +0000 UTC m=+331.665042595" watchObservedRunningTime="2026-05-28 16:13:31.817461366 +0000 UTC m=+331.666938884"
May 28 16:13:34.557510 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.557473    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d"]
May 28 16:13:34.560821 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.560798    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d"
May 28 16:13:34.563309 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.563283    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 28 16:13:34.564609 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.564579    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 28 16:13:34.564694 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.564599    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 28 16:13:34.564754 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.564717    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 28 16:13:34.564810 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.564764    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 28 16:13:34.564863 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.564817    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5v92j\""
May 28 16:13:34.569804 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.569783    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d"]
May 28 16:13:34.661663 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.661621    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a2a51e4-4f64-437e-8547-db5f14f389e0-cert\") pod \"lws-controller-manager-677666f8d9-l9c5d\" (UID: \"8a2a51e4-4f64-437e-8547-db5f14f389e0\") " pod="openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d"
May 28 16:13:34.661873 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.661678    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8a2a51e4-4f64-437e-8547-db5f14f389e0-metrics-cert\") pod \"lws-controller-manager-677666f8d9-l9c5d\" (UID: \"8a2a51e4-4f64-437e-8547-db5f14f389e0\") " pod="openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d"
May 28 16:13:34.661873 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.661772    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjbpr\" (UniqueName: \"kubernetes.io/projected/8a2a51e4-4f64-437e-8547-db5f14f389e0-kube-api-access-gjbpr\") pod \"lws-controller-manager-677666f8d9-l9c5d\" (UID: \"8a2a51e4-4f64-437e-8547-db5f14f389e0\") " pod="openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d"
May 28 16:13:34.661873 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.661820    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8a2a51e4-4f64-437e-8547-db5f14f389e0-manager-config\") pod \"lws-controller-manager-677666f8d9-l9c5d\" (UID: \"8a2a51e4-4f64-437e-8547-db5f14f389e0\") " pod="openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d"
May 28 16:13:34.762710 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.762662    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a2a51e4-4f64-437e-8547-db5f14f389e0-cert\") pod \"lws-controller-manager-677666f8d9-l9c5d\" (UID: \"8a2a51e4-4f64-437e-8547-db5f14f389e0\") " pod="openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d"
May 28 16:13:34.762908 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.762724    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8a2a51e4-4f64-437e-8547-db5f14f389e0-metrics-cert\") pod \"lws-controller-manager-677666f8d9-l9c5d\" (UID: \"8a2a51e4-4f64-437e-8547-db5f14f389e0\") " pod="openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d"
May 28 16:13:34.762908 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.762760    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gjbpr\" (UniqueName: \"kubernetes.io/projected/8a2a51e4-4f64-437e-8547-db5f14f389e0-kube-api-access-gjbpr\") pod \"lws-controller-manager-677666f8d9-l9c5d\" (UID: \"8a2a51e4-4f64-437e-8547-db5f14f389e0\") " pod="openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d"
May 28 16:13:34.762908 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.762779    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8a2a51e4-4f64-437e-8547-db5f14f389e0-manager-config\") pod \"lws-controller-manager-677666f8d9-l9c5d\" (UID: \"8a2a51e4-4f64-437e-8547-db5f14f389e0\") " pod="openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d"
May 28 16:13:34.763499 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.763479    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/8a2a51e4-4f64-437e-8547-db5f14f389e0-manager-config\") pod \"lws-controller-manager-677666f8d9-l9c5d\" (UID: \"8a2a51e4-4f64-437e-8547-db5f14f389e0\") " pod="openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d"
May 28 16:13:34.765285 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.765264    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/8a2a51e4-4f64-437e-8547-db5f14f389e0-cert\") pod \"lws-controller-manager-677666f8d9-l9c5d\" (UID: \"8a2a51e4-4f64-437e-8547-db5f14f389e0\") " pod="openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d"
May 28 16:13:34.765346 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.765325    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/8a2a51e4-4f64-437e-8547-db5f14f389e0-metrics-cert\") pod \"lws-controller-manager-677666f8d9-l9c5d\" (UID: \"8a2a51e4-4f64-437e-8547-db5f14f389e0\") " pod="openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d"
May 28 16:13:34.771279 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.771246    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjbpr\" (UniqueName: \"kubernetes.io/projected/8a2a51e4-4f64-437e-8547-db5f14f389e0-kube-api-access-gjbpr\") pod \"lws-controller-manager-677666f8d9-l9c5d\" (UID: \"8a2a51e4-4f64-437e-8547-db5f14f389e0\") " pod="openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d"
May 28 16:13:34.870524 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:34.870413    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d"
May 28 16:13:35.001260 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:35.001223    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d"]
May 28 16:13:35.004421 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:13:35.004393    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a2a51e4_4f64_437e_8547_db5f14f389e0.slice/crio-79d12f8234168cf313b0b3b0df6a6b16e701d3306e9f61ccbedfc98e53eb4dd5 WatchSource:0}: Error finding container 79d12f8234168cf313b0b3b0df6a6b16e701d3306e9f61ccbedfc98e53eb4dd5: Status 404 returned error can't find the container with id 79d12f8234168cf313b0b3b0df6a6b16e701d3306e9f61ccbedfc98e53eb4dd5
May 28 16:13:35.806154 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:35.806116    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d" event={"ID":"8a2a51e4-4f64-437e-8547-db5f14f389e0","Type":"ContainerStarted","Data":"79d12f8234168cf313b0b3b0df6a6b16e701d3306e9f61ccbedfc98e53eb4dd5"}
May 28 16:13:37.815763 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:37.815660    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d" event={"ID":"8a2a51e4-4f64-437e-8547-db5f14f389e0","Type":"ContainerStarted","Data":"15ba443b9dbde9e93140753bab2446e04b6d88ae3d55e8ef7f59097962ec63f1"}
May 28 16:13:37.815763 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:37.815730    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d"
May 28 16:13:37.836777 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:37.836730    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d" podStartSLOduration=1.3266485000000001 podStartE2EDuration="3.836712591s" podCreationTimestamp="2026-05-28 16:13:34 +0000 UTC" firstStartedPulling="2026-05-28 16:13:35.006322201 +0000 UTC m=+334.855799665" lastFinishedPulling="2026-05-28 16:13:37.516386305 +0000 UTC m=+337.365863756" observedRunningTime="2026-05-28 16:13:37.836114638 +0000 UTC m=+337.685592111" watchObservedRunningTime="2026-05-28 16:13:37.836712591 +0000 UTC m=+337.686190056"
May 28 16:13:42.796380 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:42.796289    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-95cfdd646-kqp97"
May 28 16:13:46.157264 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:46.157225    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6949b9c5f6-95bvn"]
May 28 16:13:46.159757 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:46.159736    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-95bvn"
May 28 16:13:46.162970 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:46.162942    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 28 16:13:46.163124 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:46.162997    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d08fe4f-f955-4846-aaad-36d44e14a31a-tmp\") pod \"kube-auth-proxy-6949b9c5f6-95bvn\" (UID: \"2d08fe4f-f955-4846-aaad-36d44e14a31a\") " pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-95bvn"
May 28 16:13:46.163124 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:46.163059    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d08fe4f-f955-4846-aaad-36d44e14a31a-tls-certs\") pod \"kube-auth-proxy-6949b9c5f6-95bvn\" (UID: \"2d08fe4f-f955-4846-aaad-36d44e14a31a\") " pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-95bvn"
May 28 16:13:46.163124 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:46.163111    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56c88\" (UniqueName: \"kubernetes.io/projected/2d08fe4f-f955-4846-aaad-36d44e14a31a-kube-api-access-56c88\") pod \"kube-auth-proxy-6949b9c5f6-95bvn\" (UID: \"2d08fe4f-f955-4846-aaad-36d44e14a31a\") " pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-95bvn"
May 28 16:13:46.164038 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:46.164014    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 28 16:13:46.164182 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:46.164047    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 28 16:13:46.164182 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:46.164098    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-x4nhq\""
May 28 16:13:46.164182 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:46.164143    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 28 16:13:46.175238 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:46.175211    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6949b9c5f6-95bvn"]
May 28 16:13:46.264129 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:46.264085    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d08fe4f-f955-4846-aaad-36d44e14a31a-tls-certs\") pod \"kube-auth-proxy-6949b9c5f6-95bvn\" (UID: \"2d08fe4f-f955-4846-aaad-36d44e14a31a\") " pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-95bvn"
May 28 16:13:46.264129 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:46.264137    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-56c88\" (UniqueName: \"kubernetes.io/projected/2d08fe4f-f955-4846-aaad-36d44e14a31a-kube-api-access-56c88\") pod \"kube-auth-proxy-6949b9c5f6-95bvn\" (UID: \"2d08fe4f-f955-4846-aaad-36d44e14a31a\") " pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-95bvn"
May 28 16:13:46.264448 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:46.264299    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d08fe4f-f955-4846-aaad-36d44e14a31a-tmp\") pod \"kube-auth-proxy-6949b9c5f6-95bvn\" (UID: \"2d08fe4f-f955-4846-aaad-36d44e14a31a\") " pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-95bvn"
May 28 16:13:46.266671 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:46.266634    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2d08fe4f-f955-4846-aaad-36d44e14a31a-tmp\") pod \"kube-auth-proxy-6949b9c5f6-95bvn\" (UID: \"2d08fe4f-f955-4846-aaad-36d44e14a31a\") " pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-95bvn"
May 28 16:13:46.266921 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:46.266900    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2d08fe4f-f955-4846-aaad-36d44e14a31a-tls-certs\") pod \"kube-auth-proxy-6949b9c5f6-95bvn\" (UID: \"2d08fe4f-f955-4846-aaad-36d44e14a31a\") " pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-95bvn"
May 28 16:13:46.273781 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:46.273746    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-56c88\" (UniqueName: \"kubernetes.io/projected/2d08fe4f-f955-4846-aaad-36d44e14a31a-kube-api-access-56c88\") pod \"kube-auth-proxy-6949b9c5f6-95bvn\" (UID: \"2d08fe4f-f955-4846-aaad-36d44e14a31a\") " pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-95bvn"
May 28 16:13:46.470065 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:46.469980    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-95bvn"
May 28 16:13:46.600492 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:46.600295    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6949b9c5f6-95bvn"]
May 28 16:13:46.603456 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:13:46.603422    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d08fe4f_f955_4846_aaad_36d44e14a31a.slice/crio-35bf46e31e85a9240ffeb635356629b8cf46f37f8e611480b2fa2a6d8b58247a WatchSource:0}: Error finding container 35bf46e31e85a9240ffeb635356629b8cf46f37f8e611480b2fa2a6d8b58247a: Status 404 returned error can't find the container with id 35bf46e31e85a9240ffeb635356629b8cf46f37f8e611480b2fa2a6d8b58247a
May 28 16:13:46.846087 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:46.846045    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-95bvn" event={"ID":"2d08fe4f-f955-4846-aaad-36d44e14a31a","Type":"ContainerStarted","Data":"35bf46e31e85a9240ffeb635356629b8cf46f37f8e611480b2fa2a6d8b58247a"}
May 28 16:13:48.821192 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:48.821163    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-677666f8d9-l9c5d"
May 28 16:13:49.860509 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:49.860418    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-95bvn" event={"ID":"2d08fe4f-f955-4846-aaad-36d44e14a31a","Type":"ContainerStarted","Data":"b2fdc17f1af069c33a5c37d927e406fcb9fccf209a8a99da43c27f0a10d03f4f"}
May 28 16:13:49.880454 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:13:49.880407    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6949b9c5f6-95bvn" podStartSLOduration=0.923647239 podStartE2EDuration="3.88039235s" podCreationTimestamp="2026-05-28 16:13:46 +0000 UTC" firstStartedPulling="2026-05-28 16:13:46.605058961 +0000 UTC m=+346.454536411" lastFinishedPulling="2026-05-28 16:13:49.561804072 +0000 UTC m=+349.411281522" observedRunningTime="2026-05-28 16:13:49.878664476 +0000 UTC m=+349.728141949" watchObservedRunningTime="2026-05-28 16:13:49.88039235 +0000 UTC m=+349.729869821"
May 28 16:15:32.653092 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:32.653000    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-l457h"]
May 28 16:15:32.655569 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:32.655546    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-l457h"
May 28 16:15:32.660956 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:32.660935    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 16:15:32.662258 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:32.661996    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 16:15:32.662258 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:32.662233    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
May 28 16:15:32.662258 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:32.662248    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2lxkv\""
May 28 16:15:32.662446 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:32.662431    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
May 28 16:15:32.668619 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:32.668597    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-l457h"]
May 28 16:15:32.710022 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:32.709990    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb38cb50-0108-494f-b8e6-31455123a466-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-l457h\" (UID: \"bb38cb50-0108-494f-b8e6-31455123a466\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-l457h"
May 28 16:15:32.710160 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:32.710023    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xtrp\" (UniqueName: \"kubernetes.io/projected/bb38cb50-0108-494f-b8e6-31455123a466-kube-api-access-2xtrp\") pod \"kuadrant-console-plugin-6cb54b5c86-l457h\" (UID: \"bb38cb50-0108-494f-b8e6-31455123a466\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-l457h"
May 28 16:15:32.710160 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:32.710080    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bb38cb50-0108-494f-b8e6-31455123a466-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-l457h\" (UID: \"bb38cb50-0108-494f-b8e6-31455123a466\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-l457h"
May 28 16:15:32.811108 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:32.811055    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb38cb50-0108-494f-b8e6-31455123a466-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-l457h\" (UID: \"bb38cb50-0108-494f-b8e6-31455123a466\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-l457h"
May 28 16:15:32.811108 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:32.811115    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2xtrp\" (UniqueName: \"kubernetes.io/projected/bb38cb50-0108-494f-b8e6-31455123a466-kube-api-access-2xtrp\") pod \"kuadrant-console-plugin-6cb54b5c86-l457h\" (UID: \"bb38cb50-0108-494f-b8e6-31455123a466\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-l457h"
May 28 16:15:32.811406 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:32.811210    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bb38cb50-0108-494f-b8e6-31455123a466-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-l457h\" (UID: \"bb38cb50-0108-494f-b8e6-31455123a466\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-l457h"
May 28 16:15:32.811468 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:15:32.811413    2564 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
May 28 16:15:32.811520 ip-10-0-132-51 kubenswrapper[2564]: E0528 16:15:32.811496    2564 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bb38cb50-0108-494f-b8e6-31455123a466-plugin-serving-cert podName:bb38cb50-0108-494f-b8e6-31455123a466 nodeName:}" failed. No retries permitted until 2026-05-28 16:15:33.311469372 +0000 UTC m=+453.160946825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/bb38cb50-0108-494f-b8e6-31455123a466-plugin-serving-cert") pod "kuadrant-console-plugin-6cb54b5c86-l457h" (UID: "bb38cb50-0108-494f-b8e6-31455123a466") : secret "plugin-serving-cert" not found
May 28 16:15:32.811922 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:32.811901    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/bb38cb50-0108-494f-b8e6-31455123a466-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-l457h\" (UID: \"bb38cb50-0108-494f-b8e6-31455123a466\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-l457h"
May 28 16:15:32.820875 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:32.820855    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xtrp\" (UniqueName: \"kubernetes.io/projected/bb38cb50-0108-494f-b8e6-31455123a466-kube-api-access-2xtrp\") pod \"kuadrant-console-plugin-6cb54b5c86-l457h\" (UID: \"bb38cb50-0108-494f-b8e6-31455123a466\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-l457h"
May 28 16:15:33.315491 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:33.315436    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb38cb50-0108-494f-b8e6-31455123a466-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-l457h\" (UID: \"bb38cb50-0108-494f-b8e6-31455123a466\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-l457h"
May 28 16:15:33.317977 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:33.317953    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/bb38cb50-0108-494f-b8e6-31455123a466-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-l457h\" (UID: \"bb38cb50-0108-494f-b8e6-31455123a466\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-l457h"
May 28 16:15:33.564723 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:33.564686    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-l457h"
May 28 16:15:33.692617 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:33.692586    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-l457h"]
May 28 16:15:33.695220 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:15:33.695185    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbb38cb50_0108_494f_b8e6_31455123a466.slice/crio-0e8517f255369458c350f4a06ce1ece057ce1d99c28095fc37b3e2c4d5c9a9ee WatchSource:0}: Error finding container 0e8517f255369458c350f4a06ce1ece057ce1d99c28095fc37b3e2c4d5c9a9ee: Status 404 returned error can't find the container with id 0e8517f255369458c350f4a06ce1ece057ce1d99c28095fc37b3e2c4d5c9a9ee
May 28 16:15:34.211299 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:34.211254    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-l457h" event={"ID":"bb38cb50-0108-494f-b8e6-31455123a466","Type":"ContainerStarted","Data":"0e8517f255369458c350f4a06ce1ece057ce1d99c28095fc37b3e2c4d5c9a9ee"}
May 28 16:15:58.299379 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:58.299336    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-l457h" event={"ID":"bb38cb50-0108-494f-b8e6-31455123a466","Type":"ContainerStarted","Data":"5a56fbd1b74a4d8824db2eba772457c7a23aede46e0ccaf13ffdec28de51dcc6"}
May 28 16:15:58.314502 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:15:58.314447    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-l457h" podStartSLOduration=2.644276378 podStartE2EDuration="26.314433316s" podCreationTimestamp="2026-05-28 16:15:32 +0000 UTC" firstStartedPulling="2026-05-28 16:15:33.696518624 +0000 UTC m=+453.545996075" lastFinishedPulling="2026-05-28 16:15:57.366675546 +0000 UTC m=+477.216153013" observedRunningTime="2026-05-28 16:15:58.313411343 +0000 UTC m=+478.162888827" watchObservedRunningTime="2026-05-28 16:15:58.314433316 +0000 UTC m=+478.163910787"
May 28 16:16:25.317620 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:16:25.317580    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:16:25.469858 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:16:25.469815    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:16:25.469858 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:16:25.469851    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:16:25.470137 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:16:25.469961    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-sxrhs"
May 28 16:16:25.472383 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:16:25.472340    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 28 16:16:25.571449 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:16:25.571346    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/790104a1-9ac1-435f-b1c8-fda610cefb3d-config-file\") pod \"limitador-limitador-78c99df468-sxrhs\" (UID: \"790104a1-9ac1-435f-b1c8-fda610cefb3d\") " pod="kuadrant-system/limitador-limitador-78c99df468-sxrhs"
May 28 16:16:25.571449 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:16:25.571422    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t4wk\" (UniqueName: \"kubernetes.io/projected/790104a1-9ac1-435f-b1c8-fda610cefb3d-kube-api-access-4t4wk\") pod \"limitador-limitador-78c99df468-sxrhs\" (UID: \"790104a1-9ac1-435f-b1c8-fda610cefb3d\") " pod="kuadrant-system/limitador-limitador-78c99df468-sxrhs"
May 28 16:16:25.672499 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:16:25.672464    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/790104a1-9ac1-435f-b1c8-fda610cefb3d-config-file\") pod \"limitador-limitador-78c99df468-sxrhs\" (UID: \"790104a1-9ac1-435f-b1c8-fda610cefb3d\") " pod="kuadrant-system/limitador-limitador-78c99df468-sxrhs"
May 28 16:16:25.672661 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:16:25.672510    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4t4wk\" (UniqueName: \"kubernetes.io/projected/790104a1-9ac1-435f-b1c8-fda610cefb3d-kube-api-access-4t4wk\") pod \"limitador-limitador-78c99df468-sxrhs\" (UID: \"790104a1-9ac1-435f-b1c8-fda610cefb3d\") " pod="kuadrant-system/limitador-limitador-78c99df468-sxrhs"
May 28 16:16:25.673054 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:16:25.673033    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/790104a1-9ac1-435f-b1c8-fda610cefb3d-config-file\") pod \"limitador-limitador-78c99df468-sxrhs\" (UID: \"790104a1-9ac1-435f-b1c8-fda610cefb3d\") " pod="kuadrant-system/limitador-limitador-78c99df468-sxrhs"
May 28 16:16:25.681038 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:16:25.681007    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t4wk\" (UniqueName: \"kubernetes.io/projected/790104a1-9ac1-435f-b1c8-fda610cefb3d-kube-api-access-4t4wk\") pod \"limitador-limitador-78c99df468-sxrhs\" (UID: \"790104a1-9ac1-435f-b1c8-fda610cefb3d\") " pod="kuadrant-system/limitador-limitador-78c99df468-sxrhs"
May 28 16:16:25.781061 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:16:25.781024    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-sxrhs"
May 28 16:16:25.914530 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:16:25.914494    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:16:25.918080 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:16:25.918051    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod790104a1_9ac1_435f_b1c8_fda610cefb3d.slice/crio-8a16b6139dad1e358118e8584e5f91c8e50bbb29c9ef4c40c6d3159b16a50b4b WatchSource:0}: Error finding container 8a16b6139dad1e358118e8584e5f91c8e50bbb29c9ef4c40c6d3159b16a50b4b: Status 404 returned error can't find the container with id 8a16b6139dad1e358118e8584e5f91c8e50bbb29c9ef4c40c6d3159b16a50b4b
May 28 16:16:26.393540 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:16:26.393493    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-sxrhs" event={"ID":"790104a1-9ac1-435f-b1c8-fda610cefb3d","Type":"ContainerStarted","Data":"8a16b6139dad1e358118e8584e5f91c8e50bbb29c9ef4c40c6d3159b16a50b4b"}
May 28 16:16:29.405415 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:16:29.405347    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-sxrhs" event={"ID":"790104a1-9ac1-435f-b1c8-fda610cefb3d","Type":"ContainerStarted","Data":"859c82f72ce1fb3aae89b5a17850a74aa96ba3e61e5a2ee1141ee8be7fddb6da"}
May 28 16:16:29.405875 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:16:29.405529    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-sxrhs"
May 28 16:16:29.423409 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:16:29.423338    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-sxrhs" podStartSLOduration=1.948646938 podStartE2EDuration="4.423325018s" podCreationTimestamp="2026-05-28 16:16:25 +0000 UTC" firstStartedPulling="2026-05-28 16:16:25.92015022 +0000 UTC m=+505.769627670" lastFinishedPulling="2026-05-28 16:16:28.394828292 +0000 UTC m=+508.244305750" observedRunningTime="2026-05-28 16:16:29.421560986 +0000 UTC m=+509.271038477" watchObservedRunningTime="2026-05-28 16:16:29.423325018 +0000 UTC m=+509.272802490"
May 28 16:16:40.410471 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:16:40.410442    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-sxrhs"
May 28 16:17:34.296895 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:17:34.296854    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:17:46.664107 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:17:46.664073    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:18:00.635721 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:00.635692    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/ovn-acl-logging/0.log"
May 28 16:18:00.636640 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:00.636602    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/ovn-acl-logging/0.log"
May 28 16:18:04.864285 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:04.864239    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:18:12.850492 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:12.850411    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"]
May 28 16:18:12.853045 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:12.853029    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:12.856642 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:12.856605    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 28 16:18:12.858813 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:12.858787    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-fqmhw\""
May 28 16:18:12.858941 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:12.858789    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 28 16:18:12.858941 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:12.858790    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 28 16:18:12.862178 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:12.862158    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"]
May 28 16:18:12.995078 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:12.995043    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e011c69d-25e1-4181-a952-4b7a9fb5fad6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8\" (UID: \"e011c69d-25e1-4181-a952-4b7a9fb5fad6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:12.995266 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:12.995091    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e011c69d-25e1-4181-a952-4b7a9fb5fad6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8\" (UID: \"e011c69d-25e1-4181-a952-4b7a9fb5fad6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:12.995266 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:12.995129    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr55s\" (UniqueName: \"kubernetes.io/projected/e011c69d-25e1-4181-a952-4b7a9fb5fad6-kube-api-access-kr55s\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8\" (UID: \"e011c69d-25e1-4181-a952-4b7a9fb5fad6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:12.995266 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:12.995191    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e011c69d-25e1-4181-a952-4b7a9fb5fad6-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8\" (UID: \"e011c69d-25e1-4181-a952-4b7a9fb5fad6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:12.995464 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:12.995303    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e011c69d-25e1-4181-a952-4b7a9fb5fad6-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8\" (UID: \"e011c69d-25e1-4181-a952-4b7a9fb5fad6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:12.995464 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:12.995334    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e011c69d-25e1-4181-a952-4b7a9fb5fad6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8\" (UID: \"e011c69d-25e1-4181-a952-4b7a9fb5fad6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:13.095867 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:13.095835    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e011c69d-25e1-4181-a952-4b7a9fb5fad6-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8\" (UID: \"e011c69d-25e1-4181-a952-4b7a9fb5fad6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:13.096010 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:13.095891    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e011c69d-25e1-4181-a952-4b7a9fb5fad6-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8\" (UID: \"e011c69d-25e1-4181-a952-4b7a9fb5fad6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:13.096010 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:13.095954    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e011c69d-25e1-4181-a952-4b7a9fb5fad6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8\" (UID: \"e011c69d-25e1-4181-a952-4b7a9fb5fad6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:13.096010 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:13.096001    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e011c69d-25e1-4181-a952-4b7a9fb5fad6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8\" (UID: \"e011c69d-25e1-4181-a952-4b7a9fb5fad6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:13.096131 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:13.096049    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e011c69d-25e1-4181-a952-4b7a9fb5fad6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8\" (UID: \"e011c69d-25e1-4181-a952-4b7a9fb5fad6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:13.096131 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:13.096112    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kr55s\" (UniqueName: \"kubernetes.io/projected/e011c69d-25e1-4181-a952-4b7a9fb5fad6-kube-api-access-kr55s\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8\" (UID: \"e011c69d-25e1-4181-a952-4b7a9fb5fad6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:13.096340 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:13.096319    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e011c69d-25e1-4181-a952-4b7a9fb5fad6-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8\" (UID: \"e011c69d-25e1-4181-a952-4b7a9fb5fad6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:13.096494 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:13.096411    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e011c69d-25e1-4181-a952-4b7a9fb5fad6-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8\" (UID: \"e011c69d-25e1-4181-a952-4b7a9fb5fad6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:13.096494 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:13.096467    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e011c69d-25e1-4181-a952-4b7a9fb5fad6-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8\" (UID: \"e011c69d-25e1-4181-a952-4b7a9fb5fad6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:13.098287 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:13.098267    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e011c69d-25e1-4181-a952-4b7a9fb5fad6-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8\" (UID: \"e011c69d-25e1-4181-a952-4b7a9fb5fad6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:13.098635 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:13.098616    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e011c69d-25e1-4181-a952-4b7a9fb5fad6-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8\" (UID: \"e011c69d-25e1-4181-a952-4b7a9fb5fad6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:13.106897 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:13.106835    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr55s\" (UniqueName: \"kubernetes.io/projected/e011c69d-25e1-4181-a952-4b7a9fb5fad6-kube-api-access-kr55s\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8\" (UID: \"e011c69d-25e1-4181-a952-4b7a9fb5fad6\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:13.163646 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:13.163616    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:13.293732 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:13.293702    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"]
May 28 16:18:13.295353 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:18:13.295329    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode011c69d_25e1_4181_a952_4b7a9fb5fad6.slice/crio-26d0a593a8de970d9e32604221f85d29f7d02468e820782be829a84c5eae07a2 WatchSource:0}: Error finding container 26d0a593a8de970d9e32604221f85d29f7d02468e820782be829a84c5eae07a2: Status 404 returned error can't find the container with id 26d0a593a8de970d9e32604221f85d29f7d02468e820782be829a84c5eae07a2
May 28 16:18:13.655314 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:13.655279    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:18:13.754305 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:13.754267    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8" event={"ID":"e011c69d-25e1-4181-a952-4b7a9fb5fad6","Type":"ContainerStarted","Data":"26d0a593a8de970d9e32604221f85d29f7d02468e820782be829a84c5eae07a2"}
May 28 16:18:19.777424 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:19.777374    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8" event={"ID":"e011c69d-25e1-4181-a952-4b7a9fb5fad6","Type":"ContainerStarted","Data":"4b8b2fde507be6901b5b5158ea30aa000e831345a80e5f38721a6735ebaeb352"}
May 28 16:18:20.801693 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:20.801653    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:18:24.794205 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:24.794169    2564 generic.go:358] "Generic (PLEG): container finished" podID="e011c69d-25e1-4181-a952-4b7a9fb5fad6" containerID="4b8b2fde507be6901b5b5158ea30aa000e831345a80e5f38721a6735ebaeb352" exitCode=0
May 28 16:18:24.794686 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:24.794208    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8" event={"ID":"e011c69d-25e1-4181-a952-4b7a9fb5fad6","Type":"ContainerDied","Data":"4b8b2fde507be6901b5b5158ea30aa000e831345a80e5f38721a6735ebaeb352"}
May 28 16:18:26.803583 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:26.803546    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8" event={"ID":"e011c69d-25e1-4181-a952-4b7a9fb5fad6","Type":"ContainerStarted","Data":"2937303fb1718172b789a302d070da4c02c17e67f3a4d0c98b0e4f1beeeff631"}
May 28 16:18:26.804009 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:26.803773    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:26.828735 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:26.828681    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8" podStartSLOduration=2.154845171 podStartE2EDuration="14.828669375s" podCreationTimestamp="2026-05-28 16:18:12 +0000 UTC" firstStartedPulling="2026-05-28 16:18:13.297205271 +0000 UTC m=+613.146682721" lastFinishedPulling="2026-05-28 16:18:25.971029473 +0000 UTC m=+625.820506925" observedRunningTime="2026-05-28 16:18:26.82849478 +0000 UTC m=+626.677972256" watchObservedRunningTime="2026-05-28 16:18:26.828669375 +0000 UTC m=+626.678146847"
May 28 16:18:37.819533 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:37.819502    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8"
May 28 16:18:40.556777 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.556744    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"]
May 28 16:18:40.559200 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.559183    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:40.568212 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.568187    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"]
May 28 16:18:40.574219 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.574197    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 28 16:18:40.629319 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.629289    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5252e993-03af-4aa1-9636-201327569856-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8\" (UID: \"5252e993-03af-4aa1-9636-201327569856\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:40.629467 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.629330    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5252e993-03af-4aa1-9636-201327569856-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8\" (UID: \"5252e993-03af-4aa1-9636-201327569856\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:40.629467 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.629356    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5252e993-03af-4aa1-9636-201327569856-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8\" (UID: \"5252e993-03af-4aa1-9636-201327569856\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:40.629547 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.629461    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kt5v5\" (UniqueName: \"kubernetes.io/projected/5252e993-03af-4aa1-9636-201327569856-kube-api-access-kt5v5\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8\" (UID: \"5252e993-03af-4aa1-9636-201327569856\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:40.629547 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.629506    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5252e993-03af-4aa1-9636-201327569856-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8\" (UID: \"5252e993-03af-4aa1-9636-201327569856\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:40.629613 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.629558    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5252e993-03af-4aa1-9636-201327569856-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8\" (UID: \"5252e993-03af-4aa1-9636-201327569856\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:40.730671 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.730637    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5252e993-03af-4aa1-9636-201327569856-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8\" (UID: \"5252e993-03af-4aa1-9636-201327569856\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:40.730865 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.730679    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5252e993-03af-4aa1-9636-201327569856-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8\" (UID: \"5252e993-03af-4aa1-9636-201327569856\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:40.730865 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.730703    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5252e993-03af-4aa1-9636-201327569856-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8\" (UID: \"5252e993-03af-4aa1-9636-201327569856\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:40.730865 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.730742    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kt5v5\" (UniqueName: \"kubernetes.io/projected/5252e993-03af-4aa1-9636-201327569856-kube-api-access-kt5v5\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8\" (UID: \"5252e993-03af-4aa1-9636-201327569856\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:40.730865 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.730771    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5252e993-03af-4aa1-9636-201327569856-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8\" (UID: \"5252e993-03af-4aa1-9636-201327569856\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:40.730865 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.730809    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5252e993-03af-4aa1-9636-201327569856-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8\" (UID: \"5252e993-03af-4aa1-9636-201327569856\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:40.731142 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.731075    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/5252e993-03af-4aa1-9636-201327569856-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8\" (UID: \"5252e993-03af-4aa1-9636-201327569856\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:40.731213 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.731190    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5252e993-03af-4aa1-9636-201327569856-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8\" (UID: \"5252e993-03af-4aa1-9636-201327569856\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:40.731257 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.731217    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5252e993-03af-4aa1-9636-201327569856-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8\" (UID: \"5252e993-03af-4aa1-9636-201327569856\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:40.733159 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.733136    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5252e993-03af-4aa1-9636-201327569856-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8\" (UID: \"5252e993-03af-4aa1-9636-201327569856\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:40.733293 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.733274    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5252e993-03af-4aa1-9636-201327569856-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8\" (UID: \"5252e993-03af-4aa1-9636-201327569856\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:40.749815 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.749790    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kt5v5\" (UniqueName: \"kubernetes.io/projected/5252e993-03af-4aa1-9636-201327569856-kube-api-access-kt5v5\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8\" (UID: \"5252e993-03af-4aa1-9636-201327569856\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:40.869499 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:40.869417    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:41.000936 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:41.000764    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"]
May 28 16:18:41.003207 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:18:41.003183    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5252e993_03af_4aa1_9636_201327569856.slice/crio-4dc19008499040bbcb56d5c2d3d78936e60d1d7e53b2e0f692cddff7fe1670f0 WatchSource:0}: Error finding container 4dc19008499040bbcb56d5c2d3d78936e60d1d7e53b2e0f692cddff7fe1670f0: Status 404 returned error can't find the container with id 4dc19008499040bbcb56d5c2d3d78936e60d1d7e53b2e0f692cddff7fe1670f0
May 28 16:18:41.004927 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:41.004912    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 16:18:41.775735 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:41.775701    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:18:41.857375 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:41.857322    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8" event={"ID":"5252e993-03af-4aa1-9636-201327569856","Type":"ContainerStarted","Data":"a83344377d9d10a17a9ee2d4322b263523259af085311d56a05bf0eff80ed5c1"}
May 28 16:18:41.857536 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:41.857386    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8" event={"ID":"5252e993-03af-4aa1-9636-201327569856","Type":"ContainerStarted","Data":"4dc19008499040bbcb56d5c2d3d78936e60d1d7e53b2e0f692cddff7fe1670f0"}
May 28 16:18:49.887380 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:49.887329    2564 generic.go:358] "Generic (PLEG): container finished" podID="5252e993-03af-4aa1-9636-201327569856" containerID="a83344377d9d10a17a9ee2d4322b263523259af085311d56a05bf0eff80ed5c1" exitCode=0
May 28 16:18:49.887762 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:49.887394    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8" event={"ID":"5252e993-03af-4aa1-9636-201327569856","Type":"ContainerDied","Data":"a83344377d9d10a17a9ee2d4322b263523259af085311d56a05bf0eff80ed5c1"}
May 28 16:18:50.892195 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:50.892153    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8" event={"ID":"5252e993-03af-4aa1-9636-201327569856","Type":"ContainerStarted","Data":"2777f1febd6f43100b5714f6248e5a70393ef817b44d1a07c3ecaaf93c15bff9"}
May 28 16:18:50.892703 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:50.892377    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:18:50.909911 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:50.909856    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8" podStartSLOduration=10.627981811 podStartE2EDuration="10.909841205s" podCreationTimestamp="2026-05-28 16:18:40 +0000 UTC" firstStartedPulling="2026-05-28 16:18:49.88811459 +0000 UTC m=+649.737592039" lastFinishedPulling="2026-05-28 16:18:50.169973981 +0000 UTC m=+650.019451433" observedRunningTime="2026-05-28 16:18:50.908503824 +0000 UTC m=+650.757981296" watchObservedRunningTime="2026-05-28 16:18:50.909841205 +0000 UTC m=+650.759318677"
May 28 16:18:52.054028 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:18:52.053992    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:19:01.909465 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:19:01.909433    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8"
May 28 16:20:01.264666 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:20:01.264582    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:20:11.750688 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:20:11.750647    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:20:20.858353 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:20:20.858312    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:20:31.457286 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:20:31.457239    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:20:39.342515 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:20:39.342477    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:20:50.151588 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:20:50.151554    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:22:03.847303 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:22:03.847265    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:22:18.352008 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:22:18.351972    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:22:57.445303 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:22:57.445212    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:23:00.663575 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:23:00.663543    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/ovn-acl-logging/0.log"
May 28 16:23:00.664967 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:23:00.664941    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/ovn-acl-logging/0.log"
May 28 16:23:14.649934 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:23:14.649902    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:23:28.354441 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:23:28.354411    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:23:44.665888 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:23:44.665854    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:24:39.057677 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:24:39.057587    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:24:47.653374 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:24:47.653334    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:25:04.750222 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:25:04.750185    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:25:13.350926 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:25:13.350887    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:25:29.656965 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:25:29.656926    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:25:38.652207 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:25:38.652166    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:26:11.446466 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:26:11.446425    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:26:20.246870 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:26:20.246830    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:26:28.746353 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:26:28.746319    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:26:36.844737 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:26:36.844696    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:26:44.852237 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:26:44.852205    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:27:02.648189 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:27:02.648154    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:27:12.656339 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:27:12.656255    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:27:59.952913 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:27:59.952883    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:28:00.688810 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:28:00.688781    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/ovn-acl-logging/0.log"
May 28 16:28:00.691846 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:28:00.691824    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/ovn-acl-logging/0.log"
May 28 16:28:04.352376 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:28:04.352328    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:28:10.854142 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:28:10.854112    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:28:20.352845 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:28:20.352810    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:28:29.452702 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:28:29.452670    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:28:37.462143 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:28:37.462105    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:28:46.846962 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:28:46.846928    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:28:54.949596 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:28:54.949557    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:29:04.059401 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:29:04.059354    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:29:12.651580 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:29:12.651548    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:29:22.350173 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:29:22.350139    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:29:30.547377 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:29:30.547327    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:29:39.857279 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:29:39.857245    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:29:48.247537 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:29:48.247504    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:29:56.458338 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:29:56.458306    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:30:00.139470 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:00.139436    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29666430-4g89m"]
May 28 16:30:00.141803 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:00.141788    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666430-4g89m"
May 28 16:30:00.144247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:00.144226    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-ffzxh\""
May 28 16:30:00.158065 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:00.158046    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666430-4g89m"]
May 28 16:30:00.211054 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:00.211025    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4bls\" (UniqueName: \"kubernetes.io/projected/47318642-4e1a-4f2b-a8b1-1e6815e71bfe-kube-api-access-l4bls\") pod \"maas-api-key-cleanup-29666430-4g89m\" (UID: \"47318642-4e1a-4f2b-a8b1-1e6815e71bfe\") " pod="opendatahub/maas-api-key-cleanup-29666430-4g89m"
May 28 16:30:00.311938 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:00.311913    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4bls\" (UniqueName: \"kubernetes.io/projected/47318642-4e1a-4f2b-a8b1-1e6815e71bfe-kube-api-access-l4bls\") pod \"maas-api-key-cleanup-29666430-4g89m\" (UID: \"47318642-4e1a-4f2b-a8b1-1e6815e71bfe\") " pod="opendatahub/maas-api-key-cleanup-29666430-4g89m"
May 28 16:30:00.320643 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:00.320618    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4bls\" (UniqueName: \"kubernetes.io/projected/47318642-4e1a-4f2b-a8b1-1e6815e71bfe-kube-api-access-l4bls\") pod \"maas-api-key-cleanup-29666430-4g89m\" (UID: \"47318642-4e1a-4f2b-a8b1-1e6815e71bfe\") " pod="opendatahub/maas-api-key-cleanup-29666430-4g89m"
May 28 16:30:00.451750 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:00.451682    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666430-4g89m"
May 28 16:30:00.577482 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:00.577450    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29666430-4g89m"]
May 28 16:30:00.579859 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:30:00.579836    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47318642_4e1a_4f2b_a8b1_1e6815e71bfe.slice/crio-a7f08c75719d58d29846bce600be662c36b2138ceb53ee8945463846734bd27a WatchSource:0}: Error finding container a7f08c75719d58d29846bce600be662c36b2138ceb53ee8945463846734bd27a: Status 404 returned error can't find the container with id a7f08c75719d58d29846bce600be662c36b2138ceb53ee8945463846734bd27a
May 28 16:30:00.581643 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:00.581627    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 16:30:01.184668 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:01.184633    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666430-4g89m" event={"ID":"47318642-4e1a-4f2b-a8b1-1e6815e71bfe","Type":"ContainerStarted","Data":"a7f08c75719d58d29846bce600be662c36b2138ceb53ee8945463846734bd27a"}
May 28 16:30:04.650605 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:04.650572    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:30:05.199710 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:05.199677    2564 generic.go:358] "Generic (PLEG): container finished" podID="47318642-4e1a-4f2b-a8b1-1e6815e71bfe" containerID="6ceb09b4a4ea0268185ce549f5c7a23191e866c35176e2c0af2cf3df5176a643" exitCode=0
May 28 16:30:05.199890 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:05.199767    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666430-4g89m" event={"ID":"47318642-4e1a-4f2b-a8b1-1e6815e71bfe","Type":"ContainerDied","Data":"6ceb09b4a4ea0268185ce549f5c7a23191e866c35176e2c0af2cf3df5176a643"}
May 28 16:30:06.331154 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:06.331132    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666430-4g89m"
May 28 16:30:06.465235 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:06.465142    2564 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4bls\" (UniqueName: \"kubernetes.io/projected/47318642-4e1a-4f2b-a8b1-1e6815e71bfe-kube-api-access-l4bls\") pod \"47318642-4e1a-4f2b-a8b1-1e6815e71bfe\" (UID: \"47318642-4e1a-4f2b-a8b1-1e6815e71bfe\") "
May 28 16:30:06.467473 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:06.467446    2564 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47318642-4e1a-4f2b-a8b1-1e6815e71bfe-kube-api-access-l4bls" (OuterVolumeSpecName: "kube-api-access-l4bls") pod "47318642-4e1a-4f2b-a8b1-1e6815e71bfe" (UID: "47318642-4e1a-4f2b-a8b1-1e6815e71bfe"). InnerVolumeSpecName "kube-api-access-l4bls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 16:30:06.565961 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:06.565921    2564 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4bls\" (UniqueName: \"kubernetes.io/projected/47318642-4e1a-4f2b-a8b1-1e6815e71bfe-kube-api-access-l4bls\") on node \"ip-10-0-132-51.ec2.internal\" DevicePath \"\""
May 28 16:30:07.208046 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:07.208013    2564 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29666430-4g89m"
May 28 16:30:07.208046 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:07.208033    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29666430-4g89m" event={"ID":"47318642-4e1a-4f2b-a8b1-1e6815e71bfe","Type":"ContainerDied","Data":"a7f08c75719d58d29846bce600be662c36b2138ceb53ee8945463846734bd27a"}
May 28 16:30:07.208247 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:07.208063    2564 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7f08c75719d58d29846bce600be662c36b2138ceb53ee8945463846734bd27a"
May 28 16:30:14.643793 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:14.643713    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:30:23.052002 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:30:23.051971    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:32:39.951520 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:32:39.951480    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:32:45.052463 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:32:45.052412    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:33:00.716447 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:33:00.716415    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/ovn-acl-logging/0.log"
May 28 16:33:00.720975 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:33:00.720952    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/ovn-acl-logging/0.log"
May 28 16:33:11.150266 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:33:11.150179    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:33:18.051342 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:33:18.051301    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:33:27.553186 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:33:27.553144    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:33:38.252591 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:33:38.252555    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:33:47.049451 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:33:47.049415    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:33:57.853421 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:33:57.853385    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:34:07.047462 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:34:07.047424    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:34:16.446927 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:34:16.446884    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:34:25.452337 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:34:25.452302    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:34:36.153490 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:34:36.153457    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:34:45.639143 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:34:45.639045    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:35:21.442506 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:35:21.442467    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:36:04.150037 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:36:04.149996    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:36:11.749167 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:36:11.749085    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:36:21.150007 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:36:21.149969    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:36:29.153967 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:36:29.153932    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:36:37.813339 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:36:37.813292    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:36:51.245375 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:36:51.245323    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:37:00.439847 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:37:00.439811    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:37:07.746276 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:37:07.746243    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:37:16.449026 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:37:16.448990    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:37:24.049803 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:37:24.049766    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:37:33.150602 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:37:33.150564    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:37:43.746259 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:37:43.746179    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:38:00.746422 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:38:00.746390    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/ovn-acl-logging/0.log"
May 28 16:38:00.752533 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:38:00.752508    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/ovn-acl-logging/0.log"
May 28 16:38:01.046478 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:38:01.046381    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:38:10.347066 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:38:10.347031    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:38:18.351257 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:38:18.351222    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:38:26.549891 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:38:26.549857    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:38:43.944378 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:38:43.944337    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:38:51.950174 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:38:51.950137    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:39:01.143334 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:39:01.143294    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:39:09.446834 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:39:09.446794    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:39:18.252985 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:39:18.252894    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:39:26.742598 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:39:26.742564    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:39:35.846922 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:39:35.846888    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:39:47.249474 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:39:47.249440    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:39:56.261806 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:39:56.261767    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:40:09.445625 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:40:09.445589    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:40:18.547897 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:40:18.547862    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:40:26.846277 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:40:26.846242    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:40:36.741495 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:40:36.741460    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:40:42.545437 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:40:42.545344    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:41:00.539848 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:41:00.539800    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:41:09.147664 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:41:09.147627    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:41:16.954091 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:41:16.954053    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:41:23.847673 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:41:23.847631    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:41:49.046922 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:41:49.046886    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:42:01.846978 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:01.846944    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-sxrhs"]
May 28 16:42:10.815182 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:10.815090    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666430-4g89m_47318642-4e1a-4f2b-a8b1-1e6815e71bfe/cleanup/0.log"
May 28 16:42:11.176944 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:11.176875    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-95cfdd646-kqp97_ff3dd3f9-4ba0-491e-965a-ae93dd39df1b/manager/0.log"
May 28 16:42:13.185774 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:13.185745    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-l457h_bb38cb50-0108-494f-b8e6-31455123a466/kuadrant-console-plugin/0.log"
May 28 16:42:13.588879 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:13.588845    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-sxrhs_790104a1-9ac1-435f-b1c8-fda610cefb3d/limitador/0.log"
May 28 16:42:14.320556 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:14.320524    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6949b9c5f6-95bvn_2d08fe4f-f955-4846-aaad-36d44e14a31a/kube-auth-proxy/0.log"
May 28 16:42:15.190742 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:15.190713    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8_e011c69d-25e1-4181-a952-4b7a9fb5fad6/main/0.log"
May 28 16:42:15.196537 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:15.196514    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-2glg8_e011c69d-25e1-4181-a952-4b7a9fb5fad6/storage-initializer/0.log"
May 28 16:42:15.808969 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:15.808941    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8_5252e993-03af-4aa1-9636-201327569856/storage-initializer/0.log"
May 28 16:42:15.815339 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:15.815322    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-s9pp8_5252e993-03af-4aa1-9636-201327569856/main/0.log"
May 28 16:42:19.851671 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:19.851637    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ds4l8/must-gather-rljjt"]
May 28 16:42:19.852285 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:19.851992    2564 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47318642-4e1a-4f2b-a8b1-1e6815e71bfe" containerName="cleanup"
May 28 16:42:19.852285 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:19.852004    2564 state_mem.go:107] "Deleted CPUSet assignment" podUID="47318642-4e1a-4f2b-a8b1-1e6815e71bfe" containerName="cleanup"
May 28 16:42:19.852285 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:19.852057    2564 memory_manager.go:356] "RemoveStaleState removing state" podUID="47318642-4e1a-4f2b-a8b1-1e6815e71bfe" containerName="cleanup"
May 28 16:42:19.855178 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:19.855161    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ds4l8/must-gather-rljjt"
May 28 16:42:19.857632 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:19.857608    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ds4l8\"/\"kube-root-ca.crt\""
May 28 16:42:19.858488 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:19.858462    2564 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-ds4l8\"/\"default-dockercfg-9xvg7\""
May 28 16:42:19.858488 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:19.858465    2564 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-ds4l8\"/\"openshift-service-ca.crt\""
May 28 16:42:19.868589 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:19.868568    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ds4l8/must-gather-rljjt"]
May 28 16:42:19.909441 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:19.909417    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jz4jl\" (UniqueName: \"kubernetes.io/projected/7f808c6b-e145-41c9-bd87-e3ef201e6831-kube-api-access-jz4jl\") pod \"must-gather-rljjt\" (UID: \"7f808c6b-e145-41c9-bd87-e3ef201e6831\") " pod="openshift-must-gather-ds4l8/must-gather-rljjt"
May 28 16:42:19.909570 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:19.909455    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7f808c6b-e145-41c9-bd87-e3ef201e6831-must-gather-output\") pod \"must-gather-rljjt\" (UID: \"7f808c6b-e145-41c9-bd87-e3ef201e6831\") " pod="openshift-must-gather-ds4l8/must-gather-rljjt"
May 28 16:42:20.010328 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:20.010289    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jz4jl\" (UniqueName: \"kubernetes.io/projected/7f808c6b-e145-41c9-bd87-e3ef201e6831-kube-api-access-jz4jl\") pod \"must-gather-rljjt\" (UID: \"7f808c6b-e145-41c9-bd87-e3ef201e6831\") " pod="openshift-must-gather-ds4l8/must-gather-rljjt"
May 28 16:42:20.010504 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:20.010347    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7f808c6b-e145-41c9-bd87-e3ef201e6831-must-gather-output\") pod \"must-gather-rljjt\" (UID: \"7f808c6b-e145-41c9-bd87-e3ef201e6831\") " pod="openshift-must-gather-ds4l8/must-gather-rljjt"
May 28 16:42:20.010751 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:20.010729    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/7f808c6b-e145-41c9-bd87-e3ef201e6831-must-gather-output\") pod \"must-gather-rljjt\" (UID: \"7f808c6b-e145-41c9-bd87-e3ef201e6831\") " pod="openshift-must-gather-ds4l8/must-gather-rljjt"
May 28 16:42:20.017926 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:20.017905    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jz4jl\" (UniqueName: \"kubernetes.io/projected/7f808c6b-e145-41c9-bd87-e3ef201e6831-kube-api-access-jz4jl\") pod \"must-gather-rljjt\" (UID: \"7f808c6b-e145-41c9-bd87-e3ef201e6831\") " pod="openshift-must-gather-ds4l8/must-gather-rljjt"
May 28 16:42:20.165240 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:20.165163    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ds4l8/must-gather-rljjt"
May 28 16:42:20.290674 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:20.290654    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ds4l8/must-gather-rljjt"]
May 28 16:42:20.292839 ip-10-0-132-51 kubenswrapper[2564]: W0528 16:42:20.292815    2564 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f808c6b_e145_41c9_bd87_e3ef201e6831.slice/crio-9fb61f6db3a7b6fca4c9a877b2af7d12252fd06b62b1c99a1d084251491e1ba7 WatchSource:0}: Error finding container 9fb61f6db3a7b6fca4c9a877b2af7d12252fd06b62b1c99a1d084251491e1ba7: Status 404 returned error can't find the container with id 9fb61f6db3a7b6fca4c9a877b2af7d12252fd06b62b1c99a1d084251491e1ba7
May 28 16:42:20.294567 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:20.294549    2564 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 16:42:20.693396 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:20.693347    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ds4l8/must-gather-rljjt" event={"ID":"7f808c6b-e145-41c9-bd87-e3ef201e6831","Type":"ContainerStarted","Data":"9fb61f6db3a7b6fca4c9a877b2af7d12252fd06b62b1c99a1d084251491e1ba7"}
May 28 16:42:21.699281 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:21.699246    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ds4l8/must-gather-rljjt" event={"ID":"7f808c6b-e145-41c9-bd87-e3ef201e6831","Type":"ContainerStarted","Data":"c548c9d1cba8a525deb56e5bb095b6426800319b9032134a353ac90653de28f8"}
May 28 16:42:21.699281 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:21.699288    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ds4l8/must-gather-rljjt" event={"ID":"7f808c6b-e145-41c9-bd87-e3ef201e6831","Type":"ContainerStarted","Data":"b8a99a0d9eb476ebfcc89c1c92cc9c067454c746db7decfe6891c1ff254608ae"}
May 28 16:42:21.715125 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:21.715074    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-ds4l8/must-gather-rljjt" podStartSLOduration=1.862032517 podStartE2EDuration="2.715054939s" podCreationTimestamp="2026-05-28 16:42:19 +0000 UTC" firstStartedPulling="2026-05-28 16:42:20.294702162 +0000 UTC m=+2060.144179611" lastFinishedPulling="2026-05-28 16:42:21.14772458 +0000 UTC m=+2060.997202033" observedRunningTime="2026-05-28 16:42:21.713885506 +0000 UTC m=+2061.563362979" watchObservedRunningTime="2026-05-28 16:42:21.715054939 +0000 UTC m=+2061.564532412"
May 28 16:42:22.728329 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:22.728283    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-nqkbf_303ed01b-d012-4cbe-968c-cfef86ee805b/global-pull-secret-syncer/0.log"
May 28 16:42:22.840160 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:22.840136    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f78ms_8bd98251-309e-42f9-a284-3bb58d1e3e37/konnectivity-agent/0.log"
May 28 16:42:22.938807 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:22.938775    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-51.ec2.internal_9c3213005fe92cc589ac3dd8a192c485/haproxy/0.log"
May 28 16:42:27.447472 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:27.447440    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-l457h_bb38cb50-0108-494f-b8e6-31455123a466/kuadrant-console-plugin/0.log"
May 28 16:42:27.607637 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:27.607525    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-sxrhs_790104a1-9ac1-435f-b1c8-fda610cefb3d/limitador/0.log"
May 28 16:42:29.289859 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.289832    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-665c9c8584-ml7f5_01554ed1-6197-4bbf-85a4-a6060e9710e1/monitoring-plugin/0.log"
May 28 16:42:29.317011 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.316946    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bnnhr_dbb55557-741a-431b-aa0d-17204d8cb4d9/node-exporter/0.log"
May 28 16:42:29.334405 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.334380    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bnnhr_dbb55557-741a-431b-aa0d-17204d8cb4d9/kube-rbac-proxy/0.log"
May 28 16:42:29.352034 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.352010    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bnnhr_dbb55557-741a-431b-aa0d-17204d8cb4d9/init-textfile/0.log"
May 28 16:42:29.522148 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.522121    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-8kd4t_f14129de-0641-48fc-8917-eaf200859c51/kube-rbac-proxy-main/0.log"
May 28 16:42:29.540610 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.540541    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-8kd4t_f14129de-0641-48fc-8917-eaf200859c51/kube-rbac-proxy-self/0.log"
May 28 16:42:29.558183 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.558155    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-8kd4t_f14129de-0641-48fc-8917-eaf200859c51/openshift-state-metrics/0.log"
May 28 16:42:29.586007 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.585979    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c10b0f1-9b41-4839-a216-95daf02b0eeb/prometheus/0.log"
May 28 16:42:29.604163 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.604134    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c10b0f1-9b41-4839-a216-95daf02b0eeb/config-reloader/0.log"
May 28 16:42:29.623139 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.623115    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c10b0f1-9b41-4839-a216-95daf02b0eeb/thanos-sidecar/0.log"
May 28 16:42:29.641809 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.641785    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c10b0f1-9b41-4839-a216-95daf02b0eeb/kube-rbac-proxy-web/0.log"
May 28 16:42:29.664980 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.664957    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c10b0f1-9b41-4839-a216-95daf02b0eeb/kube-rbac-proxy/0.log"
May 28 16:42:29.683222 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.683201    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c10b0f1-9b41-4839-a216-95daf02b0eeb/kube-rbac-proxy-thanos/0.log"
May 28 16:42:29.701584 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.701562    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_0c10b0f1-9b41-4839-a216-95daf02b0eeb/init-config-reloader/0.log"
May 28 16:42:29.791427 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.791338    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67f55c79d8-mxnnd_129dae84-c84b-4bfb-b330-20485e2e83ea/telemeter-client/0.log"
May 28 16:42:29.809580 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.809554    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67f55c79d8-mxnnd_129dae84-c84b-4bfb-b330-20485e2e83ea/reload/0.log"
May 28 16:42:29.846987 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.846961    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-67f55c79d8-mxnnd_129dae84-c84b-4bfb-b330-20485e2e83ea/kube-rbac-proxy/0.log"
May 28 16:42:29.874650 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.874607    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bf7699dfb-j9vtd_47a7c1bf-cc53-4138-9ba5-c0d43a2cc101/thanos-query/0.log"
May 28 16:42:29.891840 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.891798    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bf7699dfb-j9vtd_47a7c1bf-cc53-4138-9ba5-c0d43a2cc101/kube-rbac-proxy-web/0.log"
May 28 16:42:29.909168 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.909142    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bf7699dfb-j9vtd_47a7c1bf-cc53-4138-9ba5-c0d43a2cc101/kube-rbac-proxy/0.log"
May 28 16:42:29.926427 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.926404    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bf7699dfb-j9vtd_47a7c1bf-cc53-4138-9ba5-c0d43a2cc101/prom-label-proxy/0.log"
May 28 16:42:29.944404 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.944353    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bf7699dfb-j9vtd_47a7c1bf-cc53-4138-9ba5-c0d43a2cc101/kube-rbac-proxy-rules/0.log"
May 28 16:42:29.964572 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:29.964548    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6bf7699dfb-j9vtd_47a7c1bf-cc53-4138-9ba5-c0d43a2cc101/kube-rbac-proxy-metrics/0.log"
May 28 16:42:30.833177 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:30.833143    2564 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"]
May 28 16:42:30.839956 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:30.839914    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"
May 28 16:42:30.845832 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:30.845757    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"]
May 28 16:42:30.914694 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:30.914474    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c-lib-modules\") pod \"perf-node-gather-daemonset-sb492\" (UID: \"ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"
May 28 16:42:30.914694 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:30.914549    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c-proc\") pod \"perf-node-gather-daemonset-sb492\" (UID: \"ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"
May 28 16:42:30.914694 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:30.914592    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c-sys\") pod \"perf-node-gather-daemonset-sb492\" (UID: \"ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"
May 28 16:42:30.914694 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:30.914645    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzgft\" (UniqueName: \"kubernetes.io/projected/ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c-kube-api-access-tzgft\") pod \"perf-node-gather-daemonset-sb492\" (UID: \"ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"
May 28 16:42:30.915048 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:30.914736    2564 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c-podres\") pod \"perf-node-gather-daemonset-sb492\" (UID: \"ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"
May 28 16:42:31.015500 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:31.015460    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c-podres\") pod \"perf-node-gather-daemonset-sb492\" (UID: \"ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"
May 28 16:42:31.015697 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:31.015553    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c-lib-modules\") pod \"perf-node-gather-daemonset-sb492\" (UID: \"ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"
May 28 16:42:31.015697 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:31.015608    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c-proc\") pod \"perf-node-gather-daemonset-sb492\" (UID: \"ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"
May 28 16:42:31.015697 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:31.015647    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c-sys\") pod \"perf-node-gather-daemonset-sb492\" (UID: \"ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"
May 28 16:42:31.015697 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:31.015660    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c-podres\") pod \"perf-node-gather-daemonset-sb492\" (UID: \"ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"
May 28 16:42:31.015697 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:31.015687    2564 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzgft\" (UniqueName: \"kubernetes.io/projected/ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c-kube-api-access-tzgft\") pod \"perf-node-gather-daemonset-sb492\" (UID: \"ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"
May 28 16:42:31.015968 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:31.015732    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c-sys\") pod \"perf-node-gather-daemonset-sb492\" (UID: \"ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"
May 28 16:42:31.015968 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:31.015735    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c-lib-modules\") pod \"perf-node-gather-daemonset-sb492\" (UID: \"ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"
May 28 16:42:31.015968 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:31.015762    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c-proc\") pod \"perf-node-gather-daemonset-sb492\" (UID: \"ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"
May 28 16:42:31.023557 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:31.023532    2564 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzgft\" (UniqueName: \"kubernetes.io/projected/ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c-kube-api-access-tzgft\") pod \"perf-node-gather-daemonset-sb492\" (UID: \"ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c\") " pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"
May 28 16:42:31.159013 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:31.158931    2564 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"
May 28 16:42:31.324473 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:31.324445    2564 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"]
May 28 16:42:31.756562 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:31.756526    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492" event={"ID":"ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c","Type":"ContainerStarted","Data":"3027fd257eb55324ecec80f9389f0caea79b82db9c03e706f26171e401505077"}
May 28 16:42:31.756562 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:31.756571    2564 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492" event={"ID":"ec0c5686-3f67-4e7a-bbeb-37fdf0b7d36c","Type":"ContainerStarted","Data":"2b3b6c1a135ff2a4cba459e56062ae8aa1d06b75cc13abbcd99f98dd94cca54e"}
May 28 16:42:31.757335 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:31.757313    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"
May 28 16:42:31.771510 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:31.771454    2564 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492" podStartSLOduration=1.771437593 podStartE2EDuration="1.771437593s" podCreationTimestamp="2026-05-28 16:42:30 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 16:42:31.770731694 +0000 UTC m=+2071.620209166" watchObservedRunningTime="2026-05-28 16:42:31.771437593 +0000 UTC m=+2071.620915064"
May 28 16:42:33.234749 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:33.234724    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fcnt9_2e0d243f-62d7-4b28-8bdc-b8315f003fec/dns/0.log"
May 28 16:42:33.252620 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:33.252597    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-fcnt9_2e0d243f-62d7-4b28-8bdc-b8315f003fec/kube-rbac-proxy/0.log"
May 28 16:42:33.272101 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:33.272079    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-26bgl_a60f68cf-b6ec-4d94-bab6-0f8bb7e81610/dns-node-resolver/0.log"
May 28 16:42:33.777902 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:33.777877    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-9xbl7_9805051e-ef8c-4375-960a-e649c08d76a7/node-ca/0.log"
May 28 16:42:34.670178 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:34.670152    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6949b9c5f6-95bvn_2d08fe4f-f955-4846-aaad-36d44e14a31a/kube-auth-proxy/0.log"
May 28 16:42:35.328380 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:35.328338    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vn4k4_c309cf42-84d1-47a4-86d3-afcda3b25c50/serve-healthcheck-canary/0.log"
May 28 16:42:35.776166 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:35.776135    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5t4th_cb7cdab9-921d-4430-9d7a-f7160261c482/kube-rbac-proxy/0.log"
May 28 16:42:35.796446 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:35.796419    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5t4th_cb7cdab9-921d-4430-9d7a-f7160261c482/exporter/0.log"
May 28 16:42:35.817205 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:35.817184    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-5t4th_cb7cdab9-921d-4430-9d7a-f7160261c482/extractor/0.log"
May 28 16:42:37.723666 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:37.723638    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29666430-4g89m_47318642-4e1a-4f2b-a8b1-1e6815e71bfe/cleanup/0.log"
May 28 16:42:37.838944 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:37.838918    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-95cfdd646-kqp97_ff3dd3f9-4ba0-491e-965a-ae93dd39df1b/manager/0.log"
May 28 16:42:38.776181 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:38.776151    2564 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-ds4l8/perf-node-gather-daemonset-sb492"
May 28 16:42:38.945654 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:38.945629    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-677666f8d9-l9c5d_8a2a51e4-4f64-437e-8547-db5f14f389e0/manager/0.log"
May 28 16:42:42.985471 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:42.985444    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-jd5k6_858042ce-ced6-4bed-8a87-356ebe7386a6/migrator/0.log"
May 28 16:42:43.003936 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:43.003913    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-jd5k6_858042ce-ced6-4bed-8a87-356ebe7386a6/graceful-termination/0.log"
May 28 16:42:43.320746 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:43.320718    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-wh527_5033e923-8bd0-4677-a9ea-67e15b9c1a56/kube-storage-version-migrator-operator/1.log"
May 28 16:42:43.322422 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:43.322395    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-wh527_5033e923-8bd0-4677-a9ea-67e15b9c1a56/kube-storage-version-migrator-operator/0.log"
May 28 16:42:44.209394 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:44.209349    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bh5p5_3bca20c9-0f2d-4f5f-81b0-b26a90596b08/kube-multus-additional-cni-plugins/0.log"
May 28 16:42:44.228084 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:44.228058    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bh5p5_3bca20c9-0f2d-4f5f-81b0-b26a90596b08/egress-router-binary-copy/0.log"
May 28 16:42:44.247415 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:44.247392    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bh5p5_3bca20c9-0f2d-4f5f-81b0-b26a90596b08/cni-plugins/0.log"
May 28 16:42:44.267005 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:44.266981    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bh5p5_3bca20c9-0f2d-4f5f-81b0-b26a90596b08/bond-cni-plugin/0.log"
May 28 16:42:44.284311 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:44.284288    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bh5p5_3bca20c9-0f2d-4f5f-81b0-b26a90596b08/routeoverride-cni/0.log"
May 28 16:42:44.301852 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:44.301828    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bh5p5_3bca20c9-0f2d-4f5f-81b0-b26a90596b08/whereabouts-cni-bincopy/0.log"
May 28 16:42:44.320810 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:44.320786    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-bh5p5_3bca20c9-0f2d-4f5f-81b0-b26a90596b08/whereabouts-cni/0.log"
May 28 16:42:44.650645 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:44.650616    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-chd8b_8c5d4322-4460-4d6c-b66e-303db736b0ca/kube-multus/0.log"
May 28 16:42:44.776345 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:44.776314    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r5nt6_8e0f7bc7-0a1e-481f-a720-52a99554e9d6/network-metrics-daemon/0.log"
May 28 16:42:44.793616 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:44.793589    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-r5nt6_8e0f7bc7-0a1e-481f-a720-52a99554e9d6/kube-rbac-proxy/0.log"
May 28 16:42:46.082698 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:46.082666    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/ovn-controller/0.log"
May 28 16:42:46.100036 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:46.100014    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/ovn-acl-logging/0.log"
May 28 16:42:46.108867 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:46.108829    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/ovn-acl-logging/1.log"
May 28 16:42:46.126170 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:46.126152    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/kube-rbac-proxy-node/0.log"
May 28 16:42:46.145857 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:46.145828    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/kube-rbac-proxy-ovn-metrics/0.log"
May 28 16:42:46.163620 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:46.163600    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/northd/0.log"
May 28 16:42:46.182626 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:46.182606    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/nbdb/0.log"
May 28 16:42:46.202701 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:46.202663    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/sbdb/0.log"
May 28 16:42:46.296213 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:46.296185    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-z9v5g_ddd1f6a7-f065-4ad6-8898-938565dbb25f/ovnkube-controller/0.log"
May 28 16:42:47.501440 ip-10-0-132-51 kubenswrapper[2564]: I0528 16:42:47.501408    2564 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-z7k9v_a3520fd9-ca91-42b2-a5bb-94ec4ae75e84/network-check-target-container/0.log"