May 28 17:14:23.379619 ip-10-0-133-205 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 28 17:14:23.379633 ip-10-0-133-205 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 28 17:14:23.379642 ip-10-0-133-205 systemd[1]: kubelet.service: Failed with result 'resources'.
May 28 17:14:23.379926 ip-10-0-133-205 systemd[1]: Failed to start Kubernetes Kubelet.
May 28 17:14:33.389757 ip-10-0-133-205 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
May 28 17:14:33.389773 ip-10-0-133-205 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot d6ec9a9e941e4a1d9e3e6d6fc0cb19bf --
May 28 17:16:53.893594 ip-10-0-133-205 systemd[1]: Starting Kubernetes Kubelet...
May 28 17:16:54.390746 ip-10-0-133-205 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 17:16:54.390746 ip-10-0-133-205 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 28 17:16:54.390746 ip-10-0-133-205 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 17:16:54.390746 ip-10-0-133-205 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 28 17:16:54.390746 ip-10-0-133-205 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 28 17:16:54.392494 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.392415    2556 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 28 17:16:54.396093 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396075    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 17:16:54.396093 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396090    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 17:16:54.396093 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396094    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 17:16:54.396093 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396098    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 17:16:54.396337 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396102    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 17:16:54.396337 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396107    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 17:16:54.396337 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396111    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 17:16:54.396337 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396114    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 17:16:54.396337 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396118    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 17:16:54.396337 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396122    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 17:16:54.396337 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396126    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 17:16:54.396337 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396129    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 17:16:54.396337 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396133    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 28 17:16:54.396337 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396137    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 17:16:54.396337 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396140    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 17:16:54.396337 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396144    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 17:16:54.396337 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396160    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 17:16:54.396337 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396164    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 17:16:54.396337 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396168    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 17:16:54.396337 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396172    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 17:16:54.396337 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396176    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 17:16:54.396337 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396180    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 17:16:54.396337 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396183    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 17:16:54.396337 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396187    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 17:16:54.397124 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396191    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 17:16:54.397124 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396195    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 17:16:54.397124 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396199    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 17:16:54.397124 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396202    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 17:16:54.397124 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396206    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 17:16:54.397124 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396211    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 17:16:54.397124 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396215    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 17:16:54.397124 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396219    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 17:16:54.397124 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396223    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 17:16:54.397124 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396227    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 17:16:54.397124 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396231    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 17:16:54.397124 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396235    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 17:16:54.397124 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396239    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 17:16:54.397124 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396244    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 17:16:54.397124 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396249    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 17:16:54.397124 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396253    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 17:16:54.397124 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396257    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 17:16:54.397124 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396261    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 17:16:54.397124 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396265    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 17:16:54.397124 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396268    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 17:16:54.398001 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396272    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 17:16:54.398001 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396276    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 17:16:54.398001 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396281    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 17:16:54.398001 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396285    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 17:16:54.398001 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396289    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 17:16:54.398001 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396303    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 17:16:54.398001 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396323    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 17:16:54.398001 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396327    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 17:16:54.398001 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396331    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 17:16:54.398001 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396335    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 17:16:54.398001 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396339    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 17:16:54.398001 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396342    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 17:16:54.398001 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396348    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 17:16:54.398001 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396352    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 17:16:54.398001 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396356    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 17:16:54.398001 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396360    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 17:16:54.398001 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396364    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 17:16:54.398001 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396368    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 17:16:54.398001 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396375    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 17:16:54.398823 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396382    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 17:16:54.398823 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396388    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 17:16:54.398823 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396393    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 17:16:54.398823 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396397    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 17:16:54.398823 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396401    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 17:16:54.398823 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396405    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 17:16:54.398823 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396410    2556 feature_gate.go:328] unrecognized feature gate: Example
May 28 17:16:54.398823 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396414    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 17:16:54.398823 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396419    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 17:16:54.398823 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396423    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 17:16:54.398823 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396427    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 17:16:54.398823 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396438    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 17:16:54.398823 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396443    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 17:16:54.398823 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396446    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 17:16:54.398823 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396451    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 17:16:54.398823 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396455    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 17:16:54.398823 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396459    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 17:16:54.398823 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396463    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 17:16:54.398823 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396467    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 17:16:54.399464 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396479    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 17:16:54.399464 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396483    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 17:16:54.399464 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396487    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 17:16:54.399464 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.396491    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 17:16:54.399464 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397145    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 17:16:54.399464 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397153    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 17:16:54.399464 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397157    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 17:16:54.399464 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397162    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 17:16:54.399464 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397166    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 17:16:54.399464 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397170    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 17:16:54.399464 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397174    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 17:16:54.399464 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397178    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 17:16:54.399464 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397182    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 17:16:54.399464 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397186    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 17:16:54.399464 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397192    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 17:16:54.399464 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397199    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 17:16:54.399464 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397204    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 17:16:54.399464 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397209    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 17:16:54.399464 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397213    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 17:16:54.399965 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397217    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 17:16:54.399965 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397222    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 17:16:54.399965 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397226    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 17:16:54.399965 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397230    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 17:16:54.399965 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397234    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 17:16:54.399965 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397239    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 17:16:54.399965 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397244    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 17:16:54.399965 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397248    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 17:16:54.399965 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397252    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 17:16:54.399965 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397256    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 17:16:54.399965 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397260    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 17:16:54.399965 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397264    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 17:16:54.399965 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397268    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 17:16:54.399965 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397274    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 17:16:54.399965 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397279    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 17:16:54.399965 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397283    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 17:16:54.399965 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397287    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 17:16:54.399965 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397291    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 17:16:54.399965 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397295    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 17:16:54.400574 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397299    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 17:16:54.400574 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397303    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 17:16:54.400574 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397335    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 17:16:54.400574 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397339    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 17:16:54.400574 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397343    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 17:16:54.400574 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397348    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 17:16:54.400574 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397352    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 17:16:54.400574 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397356    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 17:16:54.400574 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397360    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 17:16:54.400574 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397364    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 17:16:54.400574 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397368    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 17:16:54.400574 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397371    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 17:16:54.400574 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397375    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 17:16:54.400574 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397379    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 17:16:54.400574 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397384    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 17:16:54.400574 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397389    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 17:16:54.400574 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397393    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 17:16:54.400574 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397397    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 17:16:54.400574 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397400    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 17:16:54.400574 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397404    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 17:16:54.401067 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397408    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 17:16:54.401067 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397412    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 17:16:54.401067 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397418    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 17:16:54.401067 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397422    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 17:16:54.401067 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397426    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 17:16:54.401067 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397430    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 17:16:54.401067 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397434    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 17:16:54.401067 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397439    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 17:16:54.401067 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397443    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 17:16:54.401067 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397447    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 17:16:54.401067 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397450    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 17:16:54.401067 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397454    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 17:16:54.401067 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397458    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 17:16:54.401067 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397463    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 17:16:54.401067 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397468    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 17:16:54.401067 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397472    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 17:16:54.401067 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397477    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 17:16:54.401067 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397481    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 17:16:54.401067 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397486    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 17:16:54.401067 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397490    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397494    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397498    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397502    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397506    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397510    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397514    2556 feature_gate.go:328] unrecognized feature gate: Example
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397519    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397523    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397527    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397530    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397535    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.397539    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397635    2556 flags.go:64] FLAG: --address="0.0.0.0"
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397645    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397658    2556 flags.go:64] FLAG: --anonymous-auth="true"
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397665    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397671    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397676    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397682    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397689    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 28 17:16:54.401655 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397694    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397699    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397705    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397710    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397715    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397719    2556 flags.go:64] FLAG: --cgroup-root=""
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397724    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397729    2556 flags.go:64] FLAG: --client-ca-file=""
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397733    2556 flags.go:64] FLAG: --cloud-config=""
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397738    2556 flags.go:64] FLAG: --cloud-provider="external"
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397743    2556 flags.go:64] FLAG: --cluster-dns="[]"
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397749    2556 flags.go:64] FLAG: --cluster-domain=""
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397754    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397759    2556 flags.go:64] FLAG: --config-dir=""
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397763    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397769    2556 flags.go:64] FLAG: --container-log-max-files="5"
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397775    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397780    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397785    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397790    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397795    2556 flags.go:64] FLAG: --contention-profiling="false"
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397800    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397805    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397810    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397815    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 28 17:16:54.402179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397821    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397826    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397831    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397835    2556 flags.go:64] FLAG: --enable-load-reader="false"
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397840    2556 flags.go:64] FLAG: --enable-server="true"
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397845    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397851    2556 flags.go:64] FLAG: --event-burst="100"
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397856    2556 flags.go:64] FLAG: --event-qps="50"
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397862    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397867    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397871    2556 flags.go:64] FLAG: --eviction-hard=""
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397877    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397882    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397891    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397903    2556 flags.go:64] FLAG: --eviction-soft=""
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397909    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397913    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397918    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397923    2556 flags.go:64] FLAG: --experimental-mounter-path=""
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397927    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397932    2556 flags.go:64] FLAG: --fail-swap-on="true"
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397936    2556 flags.go:64] FLAG: --feature-gates=""
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397960    2556 flags.go:64] FLAG: --file-check-frequency="20s"
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397965    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397970    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 28 17:16:54.402877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397975    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397980    2556 flags.go:64] FLAG: --healthz-port="10248"
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397985    2556 flags.go:64] FLAG: --help="false"
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397990    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-133-205.ec2.internal"
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397995    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.397999    2556 flags.go:64] FLAG: --http-check-frequency="20s"
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398003    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398008    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398013    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398018    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398022    2556 flags.go:64] FLAG: --image-service-endpoint=""
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398027    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398031    2556 flags.go:64] FLAG: --kube-api-burst="100"
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398036    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398042    2556 flags.go:64] FLAG: --kube-api-qps="50"
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398046    2556 flags.go:64] FLAG: --kube-reserved=""
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398052    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398056    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398062    2556 flags.go:64] FLAG: --kubelet-cgroups=""
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398066    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398073    2556 flags.go:64] FLAG: --lock-file=""
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398077    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398082    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398087    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 28 17:16:54.403549 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398095    2556 flags.go:64] FLAG: --log-json-split-stream="false"
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398101    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398106    2556 flags.go:64] FLAG: --log-text-split-stream="false"
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398111    2556 flags.go:64] FLAG: --logging-format="text"
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398115    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398122    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398127    2556 flags.go:64] FLAG: --manifest-url=""
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398131    2556 flags.go:64] FLAG: --manifest-url-header=""
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398138    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398143    2556 flags.go:64] FLAG: --max-open-files="1000000"
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398149    2556 flags.go:64] FLAG: --max-pods="110"
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398154    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398159    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398164    2556 flags.go:64] FLAG: --memory-manager-policy="None"
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398168    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398173    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398179    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398183    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398199    2556 flags.go:64] FLAG: --node-status-max-images="50"
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398205    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398209    2556 flags.go:64] FLAG: --oom-score-adj="-999"
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398214    2556 flags.go:64] FLAG: --pod-cidr=""
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398219    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 28 17:16:54.404432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398227    2556 flags.go:64] FLAG: --pod-manifest-path=""
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398232    2556 flags.go:64] FLAG: --pod-max-pids="-1"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398240    2556 flags.go:64] FLAG: --pods-per-core="0"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398245    2556 flags.go:64] FLAG: --port="10250"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398250    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398254    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08fa7cb011fd488e1"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398261    2556 flags.go:64] FLAG: --qos-reserved=""
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398266    2556 flags.go:64] FLAG: --read-only-port="10255"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398271    2556 flags.go:64] FLAG: --register-node="true"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398275    2556 flags.go:64] FLAG: --register-schedulable="true"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398280    2556 flags.go:64] FLAG: --register-with-taints=""
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398286    2556 flags.go:64] FLAG: --registry-burst="10"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398291    2556 flags.go:64] FLAG: --registry-qps="5"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398295    2556 flags.go:64] FLAG: --reserved-cpus=""
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398300    2556 flags.go:64] FLAG: --reserved-memory=""
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398321    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398327    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398331    2556 flags.go:64] FLAG: --rotate-certificates="false"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398336    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398340    2556 flags.go:64] FLAG: --runonce="false"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398345    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398350    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398355    2556 flags.go:64] FLAG: --seccomp-default="false"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398359    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398364    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398369    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 28 17:16:54.405237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398374    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398378    2556 flags.go:64] FLAG: --storage-driver-password="root"
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398383    2556 flags.go:64] FLAG: --storage-driver-secure="false"
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398388    2556 flags.go:64] FLAG: --storage-driver-table="stats"
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398392    2556 flags.go:64] FLAG: --storage-driver-user="root"
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398397    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398402    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398407    2556 flags.go:64] FLAG: --system-cgroups=""
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398413    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398423    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398428    2556 flags.go:64] FLAG: --tls-cert-file=""
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398433    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398440    2556 flags.go:64] FLAG: --tls-min-version=""
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398445    2556 flags.go:64] FLAG: --tls-private-key-file=""
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398450    2556 flags.go:64] FLAG: --topology-manager-policy="none"
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398455    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398460    2556 flags.go:64] FLAG: --topology-manager-scope="container"
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398465    2556 flags.go:64] FLAG: --v="2"
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398472    2556 flags.go:64] FLAG: --version="false"
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398478    2556 flags.go:64] FLAG: --vmodule=""
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398484    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.398489    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398638    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398645    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398650    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 17:16:54.406350 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398655    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 17:16:54.406987 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398660    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 17:16:54.406987 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398664    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 17:16:54.406987 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398668    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 17:16:54.406987 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398673    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 17:16:54.406987 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398677    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 17:16:54.406987 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398681    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 17:16:54.406987 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398685    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 17:16:54.406987 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398690    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 17:16:54.406987 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398694    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 17:16:54.406987 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398698    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 17:16:54.406987 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398702    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 17:16:54.406987 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398707    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 17:16:54.406987 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398711    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 17:16:54.406987 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398716    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 17:16:54.406987 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398722    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 17:16:54.406987 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398726    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 17:16:54.406987 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398731    2556 feature_gate.go:328] unrecognized feature gate: Example
May 28 17:16:54.406987 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398735    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 17:16:54.406987 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398741    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 17:16:54.406987 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398745    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 17:16:54.407552 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398750    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 17:16:54.407552 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398754    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 17:16:54.407552 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398758    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 17:16:54.407552 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398762    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 17:16:54.407552 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398766    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 17:16:54.407552 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398771    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 17:16:54.407552 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398775    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 17:16:54.407552 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398779    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 17:16:54.407552 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398783    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 17:16:54.407552 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398787    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 17:16:54.407552 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398791    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 17:16:54.407552 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398795    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 17:16:54.407552 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398799    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 17:16:54.407552 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398804    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 17:16:54.407552 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398808    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 17:16:54.407552 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398812    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 17:16:54.407552 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398816    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 17:16:54.407552 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398820    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 17:16:54.407552 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398823    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 17:16:54.407552 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398827    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 17:16:54.408026 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398831    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 17:16:54.408026 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398834    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 17:16:54.408026 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398838    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 17:16:54.408026 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398842    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 17:16:54.408026 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398846    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 17:16:54.408026 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398851    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 17:16:54.408026 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398859    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 17:16:54.408026 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398865    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 17:16:54.408026 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398869    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 17:16:54.408026 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398875    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 17:16:54.408026 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398881    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 17:16:54.408026 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398885    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 17:16:54.408026 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398890    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 17:16:54.408026 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398894    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 17:16:54.408026 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398898    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 17:16:54.408026 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398902    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 17:16:54.408026 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398907    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 28 17:16:54.408026 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398913    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 17:16:54.408026 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398918    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 17:16:54.408589 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398922    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 17:16:54.408589 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398926    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 17:16:54.408589 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398930    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 17:16:54.408589 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398934    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 17:16:54.408589 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398938    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 17:16:54.408589 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398943    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 17:16:54.408589 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398948    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 17:16:54.408589 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398952    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 17:16:54.408589 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398956    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 17:16:54.408589 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398961    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 17:16:54.408589 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398965    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 17:16:54.408589 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398969    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 17:16:54.408589 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398973    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 17:16:54.408589 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398977    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 17:16:54.408589 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398981    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 17:16:54.408589 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398985    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 17:16:54.408589 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398989    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 17:16:54.408589 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398993    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 17:16:54.408589 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.398998    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 17:16:54.408589 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.399004    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 17:16:54.409066 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.399008    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 17:16:54.409066 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.399012    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 17:16:54.409066 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.399016    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 17:16:54.409066 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.399033    2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 17:16:54.409066 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.407707    2556 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 28 17:16:54.409066 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.407723    2556 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 28 17:16:54.409066 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407767    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 17:16:54.409066 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407771    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 17:16:54.409066 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407774    2556 feature_gate.go:328] unrecognized feature gate: Example
May 28 17:16:54.409066 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407777    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 17:16:54.409066 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407780    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 17:16:54.409066 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407783    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 17:16:54.409066 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407786    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 17:16:54.409066 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407789    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 17:16:54.409066 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407792    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 17:16:54.409448 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407795    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 17:16:54.409448 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407797    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 17:16:54.409448 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407800    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 17:16:54.409448 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407802    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 17:16:54.409448 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407805    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 17:16:54.409448 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407807    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 17:16:54.409448 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407810    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 17:16:54.409448 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407813    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 17:16:54.409448 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407815    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 17:16:54.409448 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407819    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 17:16:54.409448 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407823    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 17:16:54.409448 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407826    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 17:16:54.409448 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407829    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 17:16:54.409448 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407832    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 17:16:54.409448 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407835    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 28 17:16:54.409448 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407838    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 17:16:54.409448 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407841    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 17:16:54.409448 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407844    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 17:16:54.409448 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407846    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 17:16:54.409448 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407849    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 17:16:54.409961 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407851    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 17:16:54.409961 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407854    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 17:16:54.409961 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407857    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 17:16:54.409961 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407860    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 17:16:54.409961 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407863    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 17:16:54.409961 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407865    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 17:16:54.409961 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407868    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 17:16:54.409961 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407870    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 17:16:54.409961 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407873    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 17:16:54.409961 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407875    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 17:16:54.409961 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407878    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 17:16:54.409961 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407880    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 17:16:54.409961 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407883    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 17:16:54.409961 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407885    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 17:16:54.409961 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407888    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 17:16:54.409961 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407891    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 17:16:54.409961 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407893    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 17:16:54.409961 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407896    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 17:16:54.409961 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407898    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 17:16:54.409961 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407901    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 17:16:54.410517 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407904    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 17:16:54.410517 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407906    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 17:16:54.410517 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407909    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 17:16:54.410517 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407911    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 17:16:54.410517 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407913    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 17:16:54.410517 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407916    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 17:16:54.410517 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407918    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 17:16:54.410517 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407920    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 17:16:54.410517 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407923    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 17:16:54.410517 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407926    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 17:16:54.410517 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407928    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 17:16:54.410517 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407930    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 17:16:54.410517 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407933    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 17:16:54.410517 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407936    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 17:16:54.410517 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407938    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 17:16:54.410517 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407941    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 17:16:54.410517 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407944    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 17:16:54.410517 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407946    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 17:16:54.410517 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407949    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 17:16:54.410517 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407951    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 17:16:54.411039 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407953    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 17:16:54.411039 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407956    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 17:16:54.411039 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407959    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 17:16:54.411039 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407963    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 17:16:54.411039 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407965    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 17:16:54.411039 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407968    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 17:16:54.411039 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407970    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 17:16:54.411039 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407973    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 17:16:54.411039 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407975    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 17:16:54.411039 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407978    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 17:16:54.411039 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407980    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 17:16:54.411039 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407983    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 17:16:54.411039 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407986    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 17:16:54.411039 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407988    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 17:16:54.411039 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407990    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 17:16:54.411039 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407993    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 17:16:54.411039 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.407995    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 17:16:54.411481 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.408000    2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 17:16:54.411481 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408086    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 28 17:16:54.411481 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408091    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 28 17:16:54.411481 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408095    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 28 17:16:54.411481 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408098    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 28 17:16:54.411481 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408100    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 28 17:16:54.411481 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408103    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 28 17:16:54.411481 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408107    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 28 17:16:54.411481 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408110    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 28 17:16:54.411481 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408114    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 28 17:16:54.411481 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408117    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 28 17:16:54.411481 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408119    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 28 17:16:54.411481 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408122    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 28 17:16:54.411481 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408125    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 28 17:16:54.411481 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408128    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 28 17:16:54.411838 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408130    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 28 17:16:54.411838 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408133    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 28 17:16:54.411838 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408135    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 28 17:16:54.411838 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408138    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 28 17:16:54.411838 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408140    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 28 17:16:54.411838 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408143    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 28 17:16:54.411838 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408145    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
May 28 17:16:54.411838 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408148    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 28 17:16:54.411838 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408151    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 28 17:16:54.411838 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408153    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 28 17:16:54.411838 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408156    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 28 17:16:54.411838 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408158    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 28 17:16:54.411838 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408161    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 28 17:16:54.411838 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408163    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 28 17:16:54.411838 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408165    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 28 17:16:54.411838 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408168    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 28 17:16:54.411838 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408171    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
May 28 17:16:54.411838 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408174    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 28 17:16:54.411838 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408177    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 28 17:16:54.411838 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408179    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 28 17:16:54.412297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408181    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 28 17:16:54.412297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408184    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 28 17:16:54.412297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408186    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 28 17:16:54.412297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408189    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 28 17:16:54.412297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408191    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 28 17:16:54.412297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408193    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 28 17:16:54.412297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408196    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 28 17:16:54.412297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408199    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 28 17:16:54.412297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408201    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 28 17:16:54.412297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408203    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 28 17:16:54.412297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408206    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 28 17:16:54.412297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408208    2556 feature_gate.go:328] unrecognized feature gate: Example2
May 28 17:16:54.412297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408211    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 28 17:16:54.412297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408214    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 28 17:16:54.412297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408216    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 28 17:16:54.412297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408218    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 28 17:16:54.412297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408221    2556 feature_gate.go:328] unrecognized feature gate: Example
May 28 17:16:54.412297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408223    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 28 17:16:54.412297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408226    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 28 17:16:54.412297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408228    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 28 17:16:54.412791 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408230    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 28 17:16:54.412791 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408233    2556 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 28 17:16:54.412791 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408236    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 28 17:16:54.412791 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408238    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 28 17:16:54.412791 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408240    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 28 17:16:54.412791 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408243    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 28 17:16:54.412791 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408246    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 28 17:16:54.412791 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408248    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 28 17:16:54.412791 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408250    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 28 17:16:54.412791 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408253    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 28 17:16:54.412791 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408255    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 28 17:16:54.412791 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408259    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 28 17:16:54.412791 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408262    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 28 17:16:54.412791 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408265    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 28 17:16:54.412791 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408267    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 28 17:16:54.412791 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408270    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 28 17:16:54.412791 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408272    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 28 17:16:54.412791 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408275    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 28 17:16:54.412791 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408277    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 28 17:16:54.413232 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408279    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 28 17:16:54.413232 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408282    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 28 17:16:54.413232 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408285    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 28 17:16:54.413232 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408289    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 28 17:16:54.413232 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408291    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 28 17:16:54.413232 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408294    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 28 17:16:54.413232 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408296    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 28 17:16:54.413232 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408298    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 28 17:16:54.413232 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408301    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 28 17:16:54.413232 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408303    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 28 17:16:54.413232 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408321    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 28 17:16:54.413232 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408325    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 28 17:16:54.413232 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:54.408328    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 28 17:16:54.413232 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.408332    2556 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 28 17:16:54.413232 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.409097    2556 server.go:962] "Client rotation is on, will bootstrap in background"
May 28 17:16:54.415620 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.415606    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 28 17:16:54.416672 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.416661    2556 server.go:1019] "Starting client certificate rotation"
May 28 17:16:54.416779 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.416763    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 17:16:54.416808 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.416802    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 28 17:16:54.444384 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.444368    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 17:16:54.446078 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.446062    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 28 17:16:54.460013 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.459996    2556 log.go:25] "Validated CRI v1 runtime API"
May 28 17:16:54.465246 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.465231    2556 log.go:25] "Validated CRI v1 image API"
May 28 17:16:54.466648 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.466629    2556 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 28 17:16:54.473649 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.473629    2556 fs.go:135] Filesystem UUIDs: map[45a2b76d-ae64-4371-9003-84703996608e:/dev/nvme0n1p4 754b5bd0-49dc-45cb-b38b-37f19878e735:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
May 28 17:16:54.473709 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.473650    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 28 17:16:54.477811 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.477712    2556 manager.go:217] Machine: {Timestamp:2026-05-28 17:16:54.477218841 +0000 UTC m=+0.453023186 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199988 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28947af107239457f72dbc249c7110 SystemUUID:ec28947a-f107-2394-57f7-2dbc249c7110 BootID:d6ec9a9e-941e-4a1d-9e3e-6d6fc0cb19bf Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:cd:26:13:c8:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:cd:26:13:c8:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:a6:de:cb:22:ad Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 28 17:16:54.478238 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.478222    2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 17:16:54.478566 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.478553    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 28 17:16:54.478651 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.478639    2556 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 28 17:16:54.481297 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.481272    2556 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 28 17:16:54.481438 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.481300    2556 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-133-205.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 28 17:16:54.481480 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.481448    2556 topology_manager.go:138] "Creating topology manager with none policy"
May 28 17:16:54.481480 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.481456    2556 container_manager_linux.go:306] "Creating device plugin manager"
May 28 17:16:54.481480 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.481464    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 17:16:54.482219 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.482210    2556 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 28 17:16:54.483830 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.483821    2556 state_mem.go:36] "Initialized new in-memory state store"
May 28 17:16:54.483945 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.483936    2556 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 28 17:16:54.486540 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.486530    2556 kubelet.go:491] "Attempting to sync node with API server"
May 28 17:16:54.486580 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.486544    2556 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 28 17:16:54.486580 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.486555    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 28 17:16:54.486580 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.486563    2556 kubelet.go:397] "Adding apiserver pod source"
May 28 17:16:54.486580 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.486573    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 28 17:16:54.487738 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.487726    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 17:16:54.487777 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.487753    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 28 17:16:54.491079 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.491065    2556 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 28 17:16:54.493260 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.493244    2556 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 28 17:16:54.495434 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.495423    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 28 17:16:54.495488 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.495441    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 28 17:16:54.495488 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.495447    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 28 17:16:54.495488 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.495452    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 28 17:16:54.495488 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.495463    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 28 17:16:54.495488 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.495471    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 28 17:16:54.495488 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.495479    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 28 17:16:54.495488 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.495484    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 28 17:16:54.495488 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.495490    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 28 17:16:54.495690 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.495498    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 28 17:16:54.495690 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.495511    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 28 17:16:54.495690 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.495516    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 28 17:16:54.496794 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.496784    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 28 17:16:54.496794 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.496794    2556 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 28 17:16:54.499287 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:54.499267    2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 28 17:16:54.499477 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:54.499460    2556 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-133-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 28 17:16:54.499525 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.499494    2556 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-133-205.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 28 17:16:54.499769 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.499757    2556 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 28 17:16:54.499803 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.499791    2556 server.go:1295] "Started kubelet"
May 28 17:16:54.499882 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.499837    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 28 17:16:54.499969 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.499915    2556 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 28 17:16:54.500014 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.499994    2556 server_v1.go:47] "podresources" method="list" useActivePods=true
May 28 17:16:54.500444 ip-10-0-133-205 systemd[1]: Started Kubernetes Kubelet.
May 28 17:16:54.501485 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.501466    2556 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 28 17:16:54.502061 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.502044    2556 server.go:317] "Adding debug handlers to kubelet server"
May 28 17:16:54.508888 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.508871    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 28 17:16:54.508888 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:54.508865    2556 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 28 17:16:54.509771 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.509751    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 28 17:16:54.510379 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.510358    2556 volume_manager.go:295] "The desired_state_of_world populator starts"
May 28 17:16:54.510379 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.510378    2556 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 28 17:16:54.510964 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.510948    2556 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 28 17:16:54.511066 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:54.510942    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-205.ec2.internal\" not found"
May 28 17:16:54.511190 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.511173    2556 reconstruct.go:97] "Volume reconstruction finished"
May 28 17:16:54.511251 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.511191    2556 reconciler.go:26] "Reconciler: start to sync state"
May 28 17:16:54.511893 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.511865    2556 factory.go:153] Registering CRI-O factory
May 28 17:16:54.511893 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.511887    2556 factory.go:223] Registration of the crio container factory successfully
May 28 17:16:54.512005 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.511936    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 28 17:16:54.512005 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.511944    2556 factory.go:55] Registering systemd factory
May 28 17:16:54.512005 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.511958    2556 factory.go:223] Registration of the systemd container factory successfully
May 28 17:16:54.512005 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.511974    2556 factory.go:103] Registering Raw factory
May 28 17:16:54.512005 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.511988    2556 manager.go:1196] Started watching for new ooms in manager
May 28 17:16:54.512810 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.512789    2556 manager.go:319] Starting recovery of all containers
May 28 17:16:54.514892 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:54.514866    2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-133-205.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 28 17:16:54.514959 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:54.514933    2556 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 28 17:16:54.516165 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:54.515014    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-205.ec2.internal.18b3ca36cf7f9ead  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-205.ec2.internal,UID:ip-10-0-133-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-133-205.ec2.internal,},FirstTimestamp:2026-05-28 17:16:54.499770029 +0000 UTC m=+0.475574375,LastTimestamp:2026-05-28 17:16:54.499770029 +0000 UTC m=+0.475574375,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-205.ec2.internal,}"
May 28 17:16:54.523572 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.523419    2556 manager.go:324] Recovery completed
May 28 17:16:54.525189 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:54.525155    2556 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
May 28 17:16:54.528086 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.528072    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 17:16:54.530479 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.530461    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-205.ec2.internal" event="NodeHasSufficientMemory"
May 28 17:16:54.530551 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.530496    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-205.ec2.internal" event="NodeHasNoDiskPressure"
May 28 17:16:54.530551 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.530512    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-205.ec2.internal" event="NodeHasSufficientPID"
May 28 17:16:54.531331 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.531317    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 28 17:16:54.531331 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.531331    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 28 17:16:54.531431 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.531349    2556 state_mem.go:36] "Initialized new in-memory state store"
May 28 17:16:54.531946 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.531932    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wfgvm"
May 28 17:16:54.532415 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:54.532349    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-205.ec2.internal.18b3ca36d1543857  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-205.ec2.internal,UID:ip-10-0-133-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-133-205.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-133-205.ec2.internal,},FirstTimestamp:2026-05-28 17:16:54.530480215 +0000 UTC m=+0.506284567,LastTimestamp:2026-05-28 17:16:54.530480215 +0000 UTC m=+0.506284567,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-205.ec2.internal,}"
May 28 17:16:54.535002 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.534990    2556 policy_none.go:49] "None policy: Start"
May 28 17:16:54.535055 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.535008    2556 memory_manager.go:186] "Starting memorymanager" policy="None"
May 28 17:16:54.535055 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.535019    2556 state_mem.go:35] "Initializing new in-memory state store"
May 28 17:16:54.542374 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.542352    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wfgvm"
May 28 17:16:54.546294 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:54.546236    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-133-205.ec2.internal.18b3ca36d154934e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-133-205.ec2.internal,UID:ip-10-0-133-205.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-133-205.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-133-205.ec2.internal,},FirstTimestamp:2026-05-28 17:16:54.530503502 +0000 UTC m=+0.506307853,LastTimestamp:2026-05-28 17:16:54.530503502 +0000 UTC m=+0.506307853,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-133-205.ec2.internal,}"
May 28 17:16:54.571837 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.571825    2556 manager.go:341] "Starting Device Plugin manager"
May 28 17:16:54.587904 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:54.571850    2556 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 28 17:16:54.587904 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.571859    2556 server.go:85] "Starting device plugin registration server"
May 28 17:16:54.587904 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.572065    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
May 28 17:16:54.587904 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.572078    2556 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 28 17:16:54.587904 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.572146    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 28 17:16:54.587904 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.572229    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 28 17:16:54.587904 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.572238    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 28 17:16:54.587904 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:54.572761    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 28 17:16:54.587904 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:54.572797    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-133-205.ec2.internal\" not found"
May 28 17:16:54.625264 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.625238    2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 28 17:16:54.626338 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.626322    2556 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 28 17:16:54.626420 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.626344    2556 status_manager.go:230] "Starting to sync pod status with apiserver"
May 28 17:16:54.626420 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.626357    2556 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 28 17:16:54.626420 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.626365    2556 kubelet.go:2451] "Starting kubelet main sync loop"
May 28 17:16:54.626420 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:54.626393    2556 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 28 17:16:54.629253 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.629234    2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:16:54.672376 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.672334    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 17:16:54.673665 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.673650    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-205.ec2.internal" event="NodeHasSufficientMemory"
May 28 17:16:54.673736 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.673680    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-205.ec2.internal" event="NodeHasNoDiskPressure"
May 28 17:16:54.673736 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.673692    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-205.ec2.internal" event="NodeHasSufficientPID"
May 28 17:16:54.673736 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.673710    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-133-205.ec2.internal"
May 28 17:16:54.681052 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.681039    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-133-205.ec2.internal"
May 28 17:16:54.681099 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:54.681056    2556 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-133-205.ec2.internal\": node \"ip-10-0-133-205.ec2.internal\" not found"
May 28 17:16:54.698111 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:54.698091    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-205.ec2.internal\" not found"
May 28 17:16:54.727163 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.727131    2556 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-133-205.ec2.internal"]
May 28 17:16:54.727216 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.727196    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 17:16:54.728659 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.728646    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-205.ec2.internal" event="NodeHasSufficientMemory"
May 28 17:16:54.728727 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.728670    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-205.ec2.internal" event="NodeHasNoDiskPressure"
May 28 17:16:54.728727 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.728684    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-205.ec2.internal" event="NodeHasSufficientPID"
May 28 17:16:54.729838 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.729825    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 17:16:54.729998 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.729985    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal"
May 28 17:16:54.730036 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.730012    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 17:16:54.732015 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.731999    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-205.ec2.internal" event="NodeHasSufficientMemory"
May 28 17:16:54.732094 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.732025    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-205.ec2.internal" event="NodeHasNoDiskPressure"
May 28 17:16:54.732094 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.732029    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-205.ec2.internal" event="NodeHasSufficientMemory"
May 28 17:16:54.732094 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.732040    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-205.ec2.internal" event="NodeHasSufficientPID"
May 28 17:16:54.732094 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.732047    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-205.ec2.internal" event="NodeHasNoDiskPressure"
May 28 17:16:54.732094 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.732057    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-205.ec2.internal" event="NodeHasSufficientPID"
May 28 17:16:54.733030 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.733013    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-205.ec2.internal"
May 28 17:16:54.733105 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.733037    2556 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 28 17:16:54.733689 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.733674    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-205.ec2.internal" event="NodeHasSufficientMemory"
May 28 17:16:54.733768 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.733698    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-205.ec2.internal" event="NodeHasNoDiskPressure"
May 28 17:16:54.733768 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.733707    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-205.ec2.internal" event="NodeHasSufficientPID"
May 28 17:16:54.757771 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:54.757752    2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-205.ec2.internal\" not found" node="ip-10-0-133-205.ec2.internal"
May 28 17:16:54.762125 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:54.762107    2556 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-133-205.ec2.internal\" not found" node="ip-10-0-133-205.ec2.internal"
May 28 17:16:54.798351 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:54.798334    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-205.ec2.internal\" not found"
May 28 17:16:54.812711 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.812694    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dfd02ee13fee587202cfff6243d462ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal\" (UID: \"dfd02ee13fee587202cfff6243d462ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal"
May 28 17:16:54.812796 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.812719    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfd02ee13fee587202cfff6243d462ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal\" (UID: \"dfd02ee13fee587202cfff6243d462ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal"
May 28 17:16:54.812796 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.812735    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/09c2e9e5d3d1eb649c292303ae36692a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-205.ec2.internal\" (UID: \"09c2e9e5d3d1eb649c292303ae36692a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-205.ec2.internal"
May 28 17:16:54.899446 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:54.899426    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-205.ec2.internal\" not found"
May 28 17:16:54.913790 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.913776    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfd02ee13fee587202cfff6243d462ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal\" (UID: \"dfd02ee13fee587202cfff6243d462ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal"
May 28 17:16:54.913843 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.913797    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/09c2e9e5d3d1eb649c292303ae36692a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-205.ec2.internal\" (UID: \"09c2e9e5d3d1eb649c292303ae36692a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-205.ec2.internal"
May 28 17:16:54.913843 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.913824    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/09c2e9e5d3d1eb649c292303ae36692a-config\") pod \"kube-apiserver-proxy-ip-10-0-133-205.ec2.internal\" (UID: \"09c2e9e5d3d1eb649c292303ae36692a\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-133-205.ec2.internal"
May 28 17:16:54.913916 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.913856    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dfd02ee13fee587202cfff6243d462ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal\" (UID: \"dfd02ee13fee587202cfff6243d462ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal"
May 28 17:16:54.913916 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.913857    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dfd02ee13fee587202cfff6243d462ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal\" (UID: \"dfd02ee13fee587202cfff6243d462ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal"
May 28 17:16:54.913916 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:54.913884    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/dfd02ee13fee587202cfff6243d462ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal\" (UID: \"dfd02ee13fee587202cfff6243d462ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal"
May 28 17:16:55.000155 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:55.000112    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-205.ec2.internal\" not found"
May 28 17:16:55.060561 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:55.060535    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal"
May 28 17:16:55.064858 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:55.064846    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-205.ec2.internal"
May 28 17:16:55.100297 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:55.100277    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-205.ec2.internal\" not found"
May 28 17:16:55.200824 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:55.200804    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-205.ec2.internal\" not found"
May 28 17:16:55.301358 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:55.301335    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-205.ec2.internal\" not found"
May 28 17:16:55.401864 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:55.401837    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-205.ec2.internal\" not found"
May 28 17:16:55.416230 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:55.416210    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 28 17:16:55.416394 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:55.416377    2556 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 28 17:16:55.502084 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:55.502065    2556 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-133-205.ec2.internal\" not found"
May 28 17:16:55.504873 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:55.504856    2556 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:16:55.509648 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:55.509629    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 28 17:16:55.510220 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:55.510204    2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal"
May 28 17:16:55.521705 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:55.521684    2556 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 28 17:16:55.526324 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:55.526298    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 17:16:55.528714 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:55.528700    2556 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-205.ec2.internal"
May 28 17:16:55.537653 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:55.537634    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 28 17:16:55.544723 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:55.544692    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-27 17:11:54 +0000 UTC" deadline="2027-11-16 07:57:58.712869993 +0000 UTC"
May 28 17:16:55.544788 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:55.544718    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12878h41m3.168155739s"
May 28 17:16:55.545735 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:55.545720    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-pb4n7"
May 28 17:16:55.553790 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:55.553749    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-pb4n7"
May 28 17:16:55.673201 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:55.673173    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09c2e9e5d3d1eb649c292303ae36692a.slice/crio-d6dba1632944fbc947b02573da2881c116cc539d2b7993ee1f0acc83431e5198 WatchSource:0}: Error finding container d6dba1632944fbc947b02573da2881c116cc539d2b7993ee1f0acc83431e5198: Status 404 returned error can't find the container with id d6dba1632944fbc947b02573da2881c116cc539d2b7993ee1f0acc83431e5198
May 28 17:16:55.673438 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:55.673419    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddfd02ee13fee587202cfff6243d462ff.slice/crio-0759d81dc19f5c66beb4b783d99f6217fd7a3601c220613001785acd42044935 WatchSource:0}: Error finding container 0759d81dc19f5c66beb4b783d99f6217fd7a3601c220613001785acd42044935: Status 404 returned error can't find the container with id 0759d81dc19f5c66beb4b783d99f6217fd7a3601c220613001785acd42044935
May 28 17:16:55.677870 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:55.677851    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 17:16:55.881269 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:55.881208    2556 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:16:56.010544 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.010523    2556 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:16:56.384220 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.384191    2556 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 28 17:16:56.488020 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.487993    2556 apiserver.go:52] "Watching apiserver"
May 28 17:16:56.493952 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.493912    2556 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 28 17:16:56.494414 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.494293    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-q4lcb","kube-system/kube-apiserver-proxy-ip-10-0-133-205.ec2.internal","openshift-cluster-node-tuning-operator/tuned-2hs5x","openshift-image-registry/node-ca-4lf2r","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal","openshift-multus/multus-additional-cni-plugins-zz2qt","openshift-network-diagnostics/network-check-target-wg777","openshift-network-operator/iptables-alerter-65gkm","kube-system/konnectivity-agent-9wdmt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29","openshift-dns/node-resolver-hhc9v","openshift-multus/multus-c8zvb","openshift-multus/network-metrics-daemon-jqgk7"]
May 28 17:16:56.496910 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.496887    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:16:56.497004 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:56.496983    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg777" podUID="dde1c12c-f6e7-4715-a1df-6bdb3f905c35"
May 28 17:16:56.501111 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.501087    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.503502 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.503477    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4lf2r"
May 28 17:16:56.503824 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.503803    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ss4xm\""
May 28 17:16:56.503910 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.503856    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 28 17:16:56.504480 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.503960    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.504480 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.503982    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 28 17:16:56.505976 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.505958    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 28 17:16:56.506068 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.505980    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 28 17:16:56.506810 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.506322    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bx6ph\""
May 28 17:16:56.506810 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.506359    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 28 17:16:56.506810 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.506433    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 28 17:16:56.506810 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.506489    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 28 17:16:56.506810 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.506533    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 28 17:16:56.506810 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.506608    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-jvlzp\""
May 28 17:16:56.506810 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.506692    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 28 17:16:56.506810 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.506735    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 28 17:16:56.507220 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.507093    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.509187 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.509147    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 28 17:16:56.509513 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.509494    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 28 17:16:56.509598 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.509521    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 28 17:16:56.509704 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.509677    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6lq8v\""
May 28 17:16:56.509989 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.509972    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 28 17:16:56.510070 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.510034    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 28 17:16:56.510125 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.510092    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 28 17:16:56.511813 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.511567    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9wdmt"
May 28 17:16:56.513400 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.513385    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 28 17:16:56.513521 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.513414    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-p7vz4\""
May 28 17:16:56.513585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.513465    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 28 17:16:56.513703 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.513684    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-65gkm"
May 28 17:16:56.513830 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.513814    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hhc9v"
May 28 17:16:56.515627 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.515582    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 28 17:16:56.516168 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.515920    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 28 17:16:56.516168 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.515955    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 28 17:16:56.516168 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.516084    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wgwlr\""
May 28 17:16:56.516168 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.516152    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 28 17:16:56.516465 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.516186    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 28 17:16:56.516465 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.516230    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sswzk\""
May 28 17:16:56.518689 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.518228    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.518689 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.518413    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:16:56.518689 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:56.518494    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqgk7" podUID="a2131092-689a-4370-bea0-90a62c5af33a"
May 28 17:16:56.520245 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.520226    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 28 17:16:56.520631 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.520614    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lnx7k\""
May 28 17:16:56.520747 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.520733    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.522932 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.522857    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-27pb5\""
May 28 17:16:56.523019 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.522932    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 28 17:16:56.523019 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.522939    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 28 17:16:56.523092 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.523052    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 28 17:16:56.524085 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524063    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6cf25fc1-cd37-4ba5-8f18-f78847e3b4c5-iptables-alerter-script\") pod \"iptables-alerter-65gkm\" (UID: \"6cf25fc1-cd37-4ba5-8f18-f78847e3b4c5\") " pod="openshift-network-operator/iptables-alerter-65gkm"
May 28 17:16:56.524195 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524101    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21807015-9b41-44d2-aae3-21e5e93a8986-host\") pod \"node-ca-4lf2r\" (UID: \"21807015-9b41-44d2-aae3-21e5e93a8986\") " pod="openshift-image-registry/node-ca-4lf2r"
May 28 17:16:56.524195 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524128    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.524195 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524153    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-sysconfig\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.524195 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524177    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-sysctl-conf\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.524459 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524199    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-systemd\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.524459 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524221    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-tuned\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.524459 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524243    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-systemd-units\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.524459 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524266    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-run-ovn\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.524459 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524288    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-var-lib-kubelet\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.524459 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524328    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc42e373-26f0-4d12-8cb7-b2502f183d73-tmp\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.524459 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524350    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-slash\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.524459 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524373    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-cni-bin\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.524459 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524413    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-cni-netd\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.524459 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524435    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-ovnkube-config\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.524942 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524482    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-ovn-node-metrics-cert\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.524942 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524515    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-ovnkube-script-lib\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.524942 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524543    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-host\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.524942 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524583    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-kubernetes\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.524942 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524612    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqgk7\" (UniqueName: \"kubernetes.io/projected/21807015-9b41-44d2-aae3-21e5e93a8986-kube-api-access-xqgk7\") pod \"node-ca-4lf2r\" (UID: \"21807015-9b41-44d2-aae3-21e5e93a8986\") " pod="openshift-image-registry/node-ca-4lf2r"
May 28 17:16:56.524942 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524640    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-var-lib-openvswitch\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.524942 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524662    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/58dae7ec-c6ea-43d6-9666-96ff58564769-agent-certs\") pod \"konnectivity-agent-9wdmt\" (UID: \"58dae7ec-c6ea-43d6-9666-96ff58564769\") " pod="kube-system/konnectivity-agent-9wdmt"
May 28 17:16:56.524942 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524700    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-system-cni-dir\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.524942 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524722    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-os-release\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.524942 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524771    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.524942 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524800    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-run-systemd\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.524942 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524823    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-etc-openvswitch\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.524942 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524847    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n5pb\" (UniqueName: \"kubernetes.io/projected/6cf25fc1-cd37-4ba5-8f18-f78847e3b4c5-kube-api-access-2n5pb\") pod \"iptables-alerter-65gkm\" (UID: \"6cf25fc1-cd37-4ba5-8f18-f78847e3b4c5\") " pod="openshift-network-operator/iptables-alerter-65gkm"
May 28 17:16:56.524942 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524871    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.524942 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524894    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.524942 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524916    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-sys\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.525588 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524942    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-sysctl-d\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.525588 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524964    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwsmv\" (UniqueName: \"kubernetes.io/projected/fc42e373-26f0-4d12-8cb7-b2502f183d73-kube-api-access-wwsmv\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.525588 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.524996    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-kubelet\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.525588 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.525027    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scrdk\" (UniqueName: \"kubernetes.io/projected/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-kube-api-access-scrdk\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.525588 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.525055    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.525588 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.525082    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-env-overrides\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.525588 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.525104    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cf25fc1-cd37-4ba5-8f18-f78847e3b4c5-host-slash\") pod \"iptables-alerter-65gkm\" (UID: \"6cf25fc1-cd37-4ba5-8f18-f78847e3b4c5\") " pod="openshift-network-operator/iptables-alerter-65gkm"
May 28 17:16:56.525588 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.525126    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/58dae7ec-c6ea-43d6-9666-96ff58564769-konnectivity-ca\") pod \"konnectivity-agent-9wdmt\" (UID: \"58dae7ec-c6ea-43d6-9666-96ff58564769\") " pod="kube-system/konnectivity-agent-9wdmt"
May 28 17:16:56.525588 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.525148    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/21807015-9b41-44d2-aae3-21e5e93a8986-serviceca\") pod \"node-ca-4lf2r\" (UID: \"21807015-9b41-44d2-aae3-21e5e93a8986\") " pod="openshift-image-registry/node-ca-4lf2r"
May 28 17:16:56.525588 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.525171    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m99gk\" (UniqueName: \"kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk\") pod \"network-check-target-wg777\" (UID: \"dde1c12c-f6e7-4715-a1df-6bdb3f905c35\") " pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:16:56.525588 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.525194    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4t7w\" (UniqueName: \"kubernetes.io/projected/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-kube-api-access-j4t7w\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.525588 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.525218    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-run-openvswitch\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.525588 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.525239    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-node-log\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.525588 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.525261    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-modprobe-d\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.525588 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.525281    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-run\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.525588 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.525321    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-lib-modules\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.526334 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.525346    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-cnibin\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.526334 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.525368    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-run-netns\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.526334 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.525389    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-log-socket\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.526334 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.525410    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-run-ovn-kubernetes\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.554412 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.554381    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 17:11:55 +0000 UTC" deadline="2028-01-08 22:10:33.763925221 +0000 UTC"
May 28 17:16:56.554412 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.554411    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14164h53m37.209517634s"
May 28 17:16:56.612648 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.612626    2556 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 28 17:16:56.625926 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.625890    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.626061 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.625961    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-env-overrides\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.626061 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.625990    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j4t7w\" (UniqueName: \"kubernetes.io/projected/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-kube-api-access-j4t7w\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.626061 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626016    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-node-log\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.626061 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626023    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.626061 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626045    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-multus-conf-dir\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.626334 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626073    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-modprobe-d\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.626334 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626097    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-lib-modules\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.626334 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626122    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-multus-cni-dir\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.626334 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626168    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-node-log\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.626334 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626245    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-modprobe-d\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.626334 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626281    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/30363fc7-9248-4a84-b318-49ac3fd22773-multus-daemon-config\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.626334 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626297    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-lib-modules\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.626334 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626327    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7267ece4-c719-4d1b-8f1b-117e894dd45a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.626698 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626359    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7267ece4-c719-4d1b-8f1b-117e894dd45a-sys-fs\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.626698 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626383    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gbbk\" (UniqueName: \"kubernetes.io/projected/7267ece4-c719-4d1b-8f1b-117e894dd45a-kube-api-access-9gbbk\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.626698 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626420    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-ovnkube-script-lib\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.626698 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626442    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7044d69e-088f-4778-9f23-833010990847-tmp-dir\") pod \"node-resolver-hhc9v\" (UID: \"7044d69e-088f-4778-9f23-833010990847\") " pod="openshift-dns/node-resolver-hhc9v"
May 28 17:16:56.626698 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626465    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21807015-9b41-44d2-aae3-21e5e93a8986-host\") pod \"node-ca-4lf2r\" (UID: \"21807015-9b41-44d2-aae3-21e5e93a8986\") " pod="openshift-image-registry/node-ca-4lf2r"
May 28 17:16:56.626698 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626486    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.626698 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626513    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-sysctl-conf\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.626698 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626523    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/21807015-9b41-44d2-aae3-21e5e93a8986-host\") pod \"node-ca-4lf2r\" (UID: \"21807015-9b41-44d2-aae3-21e5e93a8986\") " pod="openshift-image-registry/node-ca-4lf2r"
May 28 17:16:56.626698 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626526    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-env-overrides\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.626698 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626537    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-systemd-units\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.626698 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626600    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-systemd-units\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.626698 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626637    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-run-ovn\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.626698 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626672    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqbf2\" (UniqueName: \"kubernetes.io/projected/a2131092-689a-4370-bea0-90a62c5af33a-kube-api-access-qqbf2\") pod \"network-metrics-daemon-jqgk7\" (UID: \"a2131092-689a-4370-bea0-90a62c5af33a\") " pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:16:56.626698 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626680    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-sysctl-conf\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.627553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626715    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-var-lib-kubelet\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.627553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626756    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-run-ovn\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.627553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626803    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc42e373-26f0-4d12-8cb7-b2502f183d73-tmp\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.627553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626820    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-var-lib-kubelet\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.627553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626861    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-ovnkube-config\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.627553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626891    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-kubernetes\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.627553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626917    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqgk7\" (UniqueName: \"kubernetes.io/projected/21807015-9b41-44d2-aae3-21e5e93a8986-kube-api-access-xqgk7\") pod \"node-ca-4lf2r\" (UID: \"21807015-9b41-44d2-aae3-21e5e93a8986\") " pod="openshift-image-registry/node-ca-4lf2r"
May 28 17:16:56.627553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626943    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-host-run-multus-certs\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.627553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626968    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-system-cni-dir\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.627553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626995    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2n5pb\" (UniqueName: \"kubernetes.io/projected/6cf25fc1-cd37-4ba5-8f18-f78847e3b4c5-kube-api-access-2n5pb\") pod \"iptables-alerter-65gkm\" (UID: \"6cf25fc1-cd37-4ba5-8f18-f78847e3b4c5\") " pod="openshift-network-operator/iptables-alerter-65gkm"
May 28 17:16:56.627553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627020    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-system-cni-dir\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.627553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627036    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.627553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627045    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-etc-kubernetes\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.627553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627078    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.627553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627095    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 28 17:16:56.627553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627105    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.627553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627109    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-system-cni-dir\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.628401 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.626968    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-ovnkube-script-lib\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.628401 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627130    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-sys\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.628401 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627188    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-sys\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.628401 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627249    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-kubernetes\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.628401 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627324    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wwsmv\" (UniqueName: \"kubernetes.io/projected/fc42e373-26f0-4d12-8cb7-b2502f183d73-kube-api-access-wwsmv\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.628401 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627353    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-kubelet\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.628401 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627324    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-ovnkube-config\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.628401 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627378    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scrdk\" (UniqueName: \"kubernetes.io/projected/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-kube-api-access-scrdk\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.628401 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627403    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-os-release\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.628401 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627428    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cf25fc1-cd37-4ba5-8f18-f78847e3b4c5-host-slash\") pod \"iptables-alerter-65gkm\" (UID: \"6cf25fc1-cd37-4ba5-8f18-f78847e3b4c5\") " pod="openshift-network-operator/iptables-alerter-65gkm"
May 28 17:16:56.628401 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627496    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-kubelet\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.628401 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627597    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x9vsk\" (UniqueName: \"kubernetes.io/projected/7044d69e-088f-4778-9f23-833010990847-kube-api-access-x9vsk\") pod \"node-resolver-hhc9v\" (UID: \"7044d69e-088f-4778-9f23-833010990847\") " pod="openshift-dns/node-resolver-hhc9v"
May 28 17:16:56.628401 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627628    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-multus-socket-dir-parent\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.628401 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627638    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.628401 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627652    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghfkv\" (UniqueName: \"kubernetes.io/projected/30363fc7-9248-4a84-b318-49ac3fd22773-kube-api-access-ghfkv\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.628401 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627641    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cf25fc1-cd37-4ba5-8f18-f78847e3b4c5-host-slash\") pod \"iptables-alerter-65gkm\" (UID: \"6cf25fc1-cd37-4ba5-8f18-f78847e3b4c5\") " pod="openshift-network-operator/iptables-alerter-65gkm"
May 28 17:16:56.628401 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627695    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7267ece4-c719-4d1b-8f1b-117e894dd45a-socket-dir\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.629165 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627696    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.629165 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627723    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7267ece4-c719-4d1b-8f1b-117e894dd45a-etc-selinux\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.629165 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627764    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/21807015-9b41-44d2-aae3-21e5e93a8986-serviceca\") pod \"node-ca-4lf2r\" (UID: \"21807015-9b41-44d2-aae3-21e5e93a8986\") " pod="openshift-image-registry/node-ca-4lf2r"
May 28 17:16:56.629165 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627787    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m99gk\" (UniqueName: \"kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk\") pod \"network-check-target-wg777\" (UID: \"dde1c12c-f6e7-4715-a1df-6bdb3f905c35\") " pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:16:56.629165 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627807    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-run-openvswitch\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.629165 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627824    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7044d69e-088f-4778-9f23-833010990847-hosts-file\") pod \"node-resolver-hhc9v\" (UID: \"7044d69e-088f-4778-9f23-833010990847\") " pod="openshift-dns/node-resolver-hhc9v"
May 28 17:16:56.629165 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627838    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-run\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.629165 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627860    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-cnibin\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.629165 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627879    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-run-netns\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.629165 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627895    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-log-socket\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.629165 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627909    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-run-ovn-kubernetes\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.629165 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627923    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6cf25fc1-cd37-4ba5-8f18-f78847e3b4c5-iptables-alerter-script\") pod \"iptables-alerter-65gkm\" (UID: \"6cf25fc1-cd37-4ba5-8f18-f78847e3b4c5\") " pod="openshift-network-operator/iptables-alerter-65gkm"
May 28 17:16:56.629165 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627938    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30363fc7-9248-4a84-b318-49ac3fd22773-cni-binary-copy\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.629165 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627953    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-cni-bin\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.629165 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627967    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-sysconfig\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.629165 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627981    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-systemd\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.629165 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.627998    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-tuned\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.629918 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628012    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-cnibin\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.629918 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628026    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7267ece4-c719-4d1b-8f1b-117e894dd45a-device-dir\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.629918 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628047    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-slash\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.629918 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628076    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-cni-netd\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.629918 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628084    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-run-ovn-kubernetes\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.629918 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628099    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-ovn-node-metrics-cert\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.629918 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628152    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-run\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.629918 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628167    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/21807015-9b41-44d2-aae3-21e5e93a8986-serviceca\") pod \"node-ca-4lf2r\" (UID: \"21807015-9b41-44d2-aae3-21e5e93a8986\") " pod="openshift-image-registry/node-ca-4lf2r"
May 28 17:16:56.629918 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628187    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-host-run-k8s-cni-cncf-io\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.629918 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628214    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-hostroot\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.629918 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628224    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-systemd\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.629918 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628239    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-host\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.629918 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628266    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-var-lib-openvswitch\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.629918 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628290    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/58dae7ec-c6ea-43d6-9666-96ff58564769-agent-certs\") pod \"konnectivity-agent-9wdmt\" (UID: \"58dae7ec-c6ea-43d6-9666-96ff58564769\") " pod="kube-system/konnectivity-agent-9wdmt"
May 28 17:16:56.629918 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628298    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-cnibin\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.629918 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628333    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-host-run-netns\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.629918 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628359    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-os-release\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.630666 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628378    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-log-socket\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.630666 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628389    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.630666 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628403    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-run-openvswitch\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.630666 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628418    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-run-systemd\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.630666 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628460    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-cni-bin\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.630666 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628476    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-sysconfig\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.630666 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628491    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-etc-openvswitch\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.630666 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628523    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-host\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.630666 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628529    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-run-systemd\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.630666 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628538    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-os-release\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.630666 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628540    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-run-netns\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.630666 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628524    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-var-lib-openvswitch\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.630666 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628594    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs\") pod \"network-metrics-daemon-jqgk7\" (UID: \"a2131092-689a-4370-bea0-90a62c5af33a\") " pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:16:56.630666 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628619    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-host-var-lib-cni-bin\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.630666 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628621    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.630666 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628653    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7267ece4-c719-4d1b-8f1b-117e894dd45a-registration-dir\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.630666 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628657    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-cni-netd\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.631467 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628664    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-host-slash\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.631467 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628698    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-sysctl-d\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.631467 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628700    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-etc-openvswitch\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.631467 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628737    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/58dae7ec-c6ea-43d6-9666-96ff58564769-konnectivity-ca\") pod \"konnectivity-agent-9wdmt\" (UID: \"58dae7ec-c6ea-43d6-9666-96ff58564769\") " pod="kube-system/konnectivity-agent-9wdmt"
May 28 17:16:56.631467 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628802    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-host-var-lib-cni-multus\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.631467 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628839    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-sysctl-d\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.631467 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.628892    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-host-var-lib-kubelet\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.631467 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.629236    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/58dae7ec-c6ea-43d6-9666-96ff58564769-konnectivity-ca\") pod \"konnectivity-agent-9wdmt\" (UID: \"58dae7ec-c6ea-43d6-9666-96ff58564769\") " pod="kube-system/konnectivity-agent-9wdmt"
May 28 17:16:56.631467 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.629562    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6cf25fc1-cd37-4ba5-8f18-f78847e3b4c5-iptables-alerter-script\") pod \"iptables-alerter-65gkm\" (UID: \"6cf25fc1-cd37-4ba5-8f18-f78847e3b4c5\") " pod="openshift-network-operator/iptables-alerter-65gkm"
May 28 17:16:56.631467 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.630940    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fc42e373-26f0-4d12-8cb7-b2502f183d73-tmp\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.631990 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.631595    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/58dae7ec-c6ea-43d6-9666-96ff58564769-agent-certs\") pod \"konnectivity-agent-9wdmt\" (UID: \"58dae7ec-c6ea-43d6-9666-96ff58564769\") " pod="kube-system/konnectivity-agent-9wdmt"
May 28 17:16:56.632212 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.632178    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-ovn-node-metrics-cert\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.632682 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.632660    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fc42e373-26f0-4d12-8cb7-b2502f183d73-etc-tuned\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.633027 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:56.633008    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:16:56.633143 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:56.633030    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:16:56.633143 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:56.633042    2556 projected.go:194] Error preparing data for projected volume kube-api-access-m99gk for pod openshift-network-diagnostics/network-check-target-wg777: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:16:56.633143 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:56.633118    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk podName:dde1c12c-f6e7-4715-a1df-6bdb3f905c35 nodeName:}" failed. No retries permitted until 2026-05-28 17:16:57.133090306 +0000 UTC m=+3.108894654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-m99gk" (UniqueName: "kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk") pod "network-check-target-wg777" (UID: "dde1c12c-f6e7-4715-a1df-6bdb3f905c35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:16:56.633827 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.633787    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-205.ec2.internal" event={"ID":"09c2e9e5d3d1eb649c292303ae36692a","Type":"ContainerStarted","Data":"d6dba1632944fbc947b02573da2881c116cc539d2b7993ee1f0acc83431e5198"}
May 28 17:16:56.634651 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.634602    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4t7w\" (UniqueName: \"kubernetes.io/projected/6c0202c2-7ee3-45df-8026-eb1e9f10ff6b-kube-api-access-j4t7w\") pod \"multus-additional-cni-plugins-zz2qt\" (UID: \"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b\") " pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.634804 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.634783    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal" event={"ID":"dfd02ee13fee587202cfff6243d462ff","Type":"ContainerStarted","Data":"0759d81dc19f5c66beb4b783d99f6217fd7a3601c220613001785acd42044935"}
May 28 17:16:56.635106 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.635084    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwsmv\" (UniqueName: \"kubernetes.io/projected/fc42e373-26f0-4d12-8cb7-b2502f183d73-kube-api-access-wwsmv\") pod \"tuned-2hs5x\" (UID: \"fc42e373-26f0-4d12-8cb7-b2502f183d73\") " pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.635524 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.635501    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n5pb\" (UniqueName: \"kubernetes.io/projected/6cf25fc1-cd37-4ba5-8f18-f78847e3b4c5-kube-api-access-2n5pb\") pod \"iptables-alerter-65gkm\" (UID: \"6cf25fc1-cd37-4ba5-8f18-f78847e3b4c5\") " pod="openshift-network-operator/iptables-alerter-65gkm"
May 28 17:16:56.636176 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.636159    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqgk7\" (UniqueName: \"kubernetes.io/projected/21807015-9b41-44d2-aae3-21e5e93a8986-kube-api-access-xqgk7\") pod \"node-ca-4lf2r\" (UID: \"21807015-9b41-44d2-aae3-21e5e93a8986\") " pod="openshift-image-registry/node-ca-4lf2r"
May 28 17:16:56.636502 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.636486    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scrdk\" (UniqueName: \"kubernetes.io/projected/9bd29f05-c1e0-4fe5-82e8-62974c41bd76-kube-api-access-scrdk\") pod \"ovnkube-node-q4lcb\" (UID: \"9bd29f05-c1e0-4fe5-82e8-62974c41bd76\") " pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.729132 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729105    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7044d69e-088f-4778-9f23-833010990847-hosts-file\") pod \"node-resolver-hhc9v\" (UID: \"7044d69e-088f-4778-9f23-833010990847\") " pod="openshift-dns/node-resolver-hhc9v"
May 28 17:16:56.729272 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729151    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30363fc7-9248-4a84-b318-49ac3fd22773-cni-binary-copy\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.729272 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729179    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-cnibin\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.729272 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729200    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7267ece4-c719-4d1b-8f1b-117e894dd45a-device-dir\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.729272 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729226    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-host-run-k8s-cni-cncf-io\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.729272 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729230    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7044d69e-088f-4778-9f23-833010990847-hosts-file\") pod \"node-resolver-hhc9v\" (UID: \"7044d69e-088f-4778-9f23-833010990847\") " pod="openshift-dns/node-resolver-hhc9v"
May 28 17:16:56.729507 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729277    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-cnibin\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.729507 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729278    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-host-run-k8s-cni-cncf-io\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.729507 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729326    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-hostroot\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.729507 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729329    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7267ece4-c719-4d1b-8f1b-117e894dd45a-device-dir\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.729507 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729359    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-host-run-netns\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.729507 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729368    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-hostroot\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.729507 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729391    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs\") pod \"network-metrics-daemon-jqgk7\" (UID: \"a2131092-689a-4370-bea0-90a62c5af33a\") " pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:16:56.729507 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729400    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-host-run-netns\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.729507 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729417    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-host-var-lib-cni-bin\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.729507 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729440    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7267ece4-c719-4d1b-8f1b-117e894dd45a-registration-dir\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.729507 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729464    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-host-var-lib-cni-multus\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.729507 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:56.729481    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:16:56.729507 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729486    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-host-var-lib-kubelet\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.729507 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729511    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-multus-conf-dir\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730099 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:56.729543    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs podName:a2131092-689a-4370-bea0-90a62c5af33a nodeName:}" failed. No retries permitted until 2026-05-28 17:16:57.229526544 +0000 UTC m=+3.205330901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs") pod "network-metrics-daemon-jqgk7" (UID: "a2131092-689a-4370-bea0-90a62c5af33a") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:16:56.730099 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729551    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-multus-conf-dir\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730099 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729560    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-multus-cni-dir\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730099 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729586    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/30363fc7-9248-4a84-b318-49ac3fd22773-multus-daemon-config\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730099 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729611    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7267ece4-c719-4d1b-8f1b-117e894dd45a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.730099 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729626    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7267ece4-c719-4d1b-8f1b-117e894dd45a-registration-dir\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.730099 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729635    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7267ece4-c719-4d1b-8f1b-117e894dd45a-sys-fs\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.730099 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729661    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9gbbk\" (UniqueName: \"kubernetes.io/projected/7267ece4-c719-4d1b-8f1b-117e894dd45a-kube-api-access-9gbbk\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.730099 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729688    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7044d69e-088f-4778-9f23-833010990847-tmp-dir\") pod \"node-resolver-hhc9v\" (UID: \"7044d69e-088f-4778-9f23-833010990847\") " pod="openshift-dns/node-resolver-hhc9v"
May 28 17:16:56.730099 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729708    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/30363fc7-9248-4a84-b318-49ac3fd22773-cni-binary-copy\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730099 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729587    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-host-var-lib-cni-bin\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730099 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729714    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qqbf2\" (UniqueName: \"kubernetes.io/projected/a2131092-689a-4370-bea0-90a62c5af33a-kube-api-access-qqbf2\") pod \"network-metrics-daemon-jqgk7\" (UID: \"a2131092-689a-4370-bea0-90a62c5af33a\") " pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:16:56.730099 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729784    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-host-run-multus-certs\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730099 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729814    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-system-cni-dir\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730099 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729838    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-etc-kubernetes\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730099 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729864    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-os-release\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730099 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729869    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7267ece4-c719-4d1b-8f1b-117e894dd45a-sys-fs\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.730585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729889    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x9vsk\" (UniqueName: \"kubernetes.io/projected/7044d69e-088f-4778-9f23-833010990847-kube-api-access-x9vsk\") pod \"node-resolver-hhc9v\" (UID: \"7044d69e-088f-4778-9f23-833010990847\") " pod="openshift-dns/node-resolver-hhc9v"
May 28 17:16:56.730585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729917    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-multus-socket-dir-parent\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729951    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ghfkv\" (UniqueName: \"kubernetes.io/projected/30363fc7-9248-4a84-b318-49ac3fd22773-kube-api-access-ghfkv\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729974    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7267ece4-c719-4d1b-8f1b-117e894dd45a-socket-dir\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.730585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729976    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-multus-cni-dir\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.730004    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7267ece4-c719-4d1b-8f1b-117e894dd45a-etc-selinux\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.730585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729662    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-host-var-lib-cni-multus\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.730102    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7267ece4-c719-4d1b-8f1b-117e894dd45a-etc-selinux\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.730585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.729689    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-host-var-lib-kubelet\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.730173    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-os-release\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.730216    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-host-run-multus-certs\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.730262    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-system-cni-dir\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.730322    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7267ece4-c719-4d1b-8f1b-117e894dd45a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.730585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.730327    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7044d69e-088f-4778-9f23-833010990847-tmp-dir\") pod \"node-resolver-hhc9v\" (UID: \"7044d69e-088f-4778-9f23-833010990847\") " pod="openshift-dns/node-resolver-hhc9v"
May 28 17:16:56.730585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.730375    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-etc-kubernetes\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.730477    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/30363fc7-9248-4a84-b318-49ac3fd22773-multus-daemon-config\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.730544    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/30363fc7-9248-4a84-b318-49ac3fd22773-multus-socket-dir-parent\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.730585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.730551    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7267ece4-c719-4d1b-8f1b-117e894dd45a-socket-dir\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.739607 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.739421    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqbf2\" (UniqueName: \"kubernetes.io/projected/a2131092-689a-4370-bea0-90a62c5af33a-kube-api-access-qqbf2\") pod \"network-metrics-daemon-jqgk7\" (UID: \"a2131092-689a-4370-bea0-90a62c5af33a\") " pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:16:56.739607 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.739566    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghfkv\" (UniqueName: \"kubernetes.io/projected/30363fc7-9248-4a84-b318-49ac3fd22773-kube-api-access-ghfkv\") pod \"multus-c8zvb\" (UID: \"30363fc7-9248-4a84-b318-49ac3fd22773\") " pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.740054 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.740038    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x9vsk\" (UniqueName: \"kubernetes.io/projected/7044d69e-088f-4778-9f23-833010990847-kube-api-access-x9vsk\") pod \"node-resolver-hhc9v\" (UID: \"7044d69e-088f-4778-9f23-833010990847\") " pod="openshift-dns/node-resolver-hhc9v"
May 28 17:16:56.740183 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.740138    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gbbk\" (UniqueName: \"kubernetes.io/projected/7267ece4-c719-4d1b-8f1b-117e894dd45a-kube-api-access-9gbbk\") pod \"aws-ebs-csi-driver-node-kqv29\" (UID: \"7267ece4-c719-4d1b-8f1b-117e894dd45a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:56.822296 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.822271    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2hs5x"
May 28 17:16:56.828916 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.828894    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-4lf2r"
May 28 17:16:56.838535 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.838509    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-zz2qt"
May 28 17:16:56.844117 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.844101    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:16:56.851605 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.851587    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9wdmt"
May 28 17:16:56.860064 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.860047    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-65gkm"
May 28 17:16:56.867557 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.867542    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hhc9v"
May 28 17:16:56.873033 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.873017    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c8zvb"
May 28 17:16:56.879545 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:56.879528    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29"
May 28 17:16:57.233180 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:57.233145    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs\") pod \"network-metrics-daemon-jqgk7\" (UID: \"a2131092-689a-4370-bea0-90a62c5af33a\") " pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:16:57.233356 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:57.233199    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m99gk\" (UniqueName: \"kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk\") pod \"network-check-target-wg777\" (UID: \"dde1c12c-f6e7-4715-a1df-6bdb3f905c35\") " pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:16:57.233356 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:57.233274    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:16:57.233356 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:57.233286    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:16:57.233356 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:57.233302    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:16:57.233356 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:57.233332    2556 projected.go:194] Error preparing data for projected volume kube-api-access-m99gk for pod openshift-network-diagnostics/network-check-target-wg777: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:16:57.233356 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:57.233352    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs podName:a2131092-689a-4370-bea0-90a62c5af33a nodeName:}" failed. No retries permitted until 2026-05-28 17:16:58.233335245 +0000 UTC m=+4.209139580 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs") pod "network-metrics-daemon-jqgk7" (UID: "a2131092-689a-4370-bea0-90a62c5af33a") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:16:57.233614 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:57.233379    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk podName:dde1c12c-f6e7-4715-a1df-6bdb3f905c35 nodeName:}" failed. No retries permitted until 2026-05-28 17:16:58.233364992 +0000 UTC m=+4.209169342 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-m99gk" (UniqueName: "kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk") pod "network-check-target-wg777" (UID: "dde1c12c-f6e7-4715-a1df-6bdb3f905c35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:16:57.384269 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:57.384237    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc42e373_26f0_4d12_8cb7_b2502f183d73.slice/crio-df1e685cef65c96b3252d9aa65aaf4de0eb687ddadd393390f69b0e18aa0017b WatchSource:0}: Error finding container df1e685cef65c96b3252d9aa65aaf4de0eb687ddadd393390f69b0e18aa0017b: Status 404 returned error can't find the container with id df1e685cef65c96b3252d9aa65aaf4de0eb687ddadd393390f69b0e18aa0017b
May 28 17:16:57.385784 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:57.385762    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf25fc1_cd37_4ba5_8f18_f78847e3b4c5.slice/crio-98af3d1383b7a9bce24a6f19e59353308f3604df2205b5f630087fd4442536a3 WatchSource:0}: Error finding container 98af3d1383b7a9bce24a6f19e59353308f3604df2205b5f630087fd4442536a3: Status 404 returned error can't find the container with id 98af3d1383b7a9bce24a6f19e59353308f3604df2205b5f630087fd4442536a3
May 28 17:16:57.387565 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:57.387530    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c0202c2_7ee3_45df_8026_eb1e9f10ff6b.slice/crio-e4abff89e2b15bdd02b3105dad8dcad6b365233b25cca3e75e8f273a1d1c2645 WatchSource:0}: Error finding container e4abff89e2b15bdd02b3105dad8dcad6b365233b25cca3e75e8f273a1d1c2645: Status 404 returned error can't find the container with id e4abff89e2b15bdd02b3105dad8dcad6b365233b25cca3e75e8f273a1d1c2645
May 28 17:16:57.389022 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:57.388916    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd29f05_c1e0_4fe5_82e8_62974c41bd76.slice/crio-d9cfe2a40dcef0607b1baacc755a861a192a164aae88af3b0429e2cdca93f86f WatchSource:0}: Error finding container d9cfe2a40dcef0607b1baacc755a861a192a164aae88af3b0429e2cdca93f86f: Status 404 returned error can't find the container with id d9cfe2a40dcef0607b1baacc755a861a192a164aae88af3b0429e2cdca93f86f
May 28 17:16:57.390201 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:57.390177    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7044d69e_088f_4778_9f23_833010990847.slice/crio-b5f42dfc9874f35bb511bc2fb14ced3962d1ca5ca1fd89274045ac4fb845d146 WatchSource:0}: Error finding container b5f42dfc9874f35bb511bc2fb14ced3962d1ca5ca1fd89274045ac4fb845d146: Status 404 returned error can't find the container with id b5f42dfc9874f35bb511bc2fb14ced3962d1ca5ca1fd89274045ac4fb845d146
May 28 17:16:57.391217 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:57.391081    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21807015_9b41_44d2_aae3_21e5e93a8986.slice/crio-72f3afa383199196db8122821ecac8f4a87966e49ffd0296edb97480c071e863 WatchSource:0}: Error finding container 72f3afa383199196db8122821ecac8f4a87966e49ffd0296edb97480c071e863: Status 404 returned error can't find the container with id 72f3afa383199196db8122821ecac8f4a87966e49ffd0296edb97480c071e863
May 28 17:16:57.392136 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:57.391947    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7267ece4_c719_4d1b_8f1b_117e894dd45a.slice/crio-b47919b76d2c080ee8336bea80dc1f27edf5565e149492d651cb7cd294a039b0 WatchSource:0}: Error finding container b47919b76d2c080ee8336bea80dc1f27edf5565e149492d651cb7cd294a039b0: Status 404 returned error can't find the container with id b47919b76d2c080ee8336bea80dc1f27edf5565e149492d651cb7cd294a039b0
May 28 17:16:57.394095 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:57.394076    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30363fc7_9248_4a84_b318_49ac3fd22773.slice/crio-3d216488cd54a0fb56d4731a5f282c3ebc579d92c068f1dc5f11c99d09420ddd WatchSource:0}: Error finding container 3d216488cd54a0fb56d4731a5f282c3ebc579d92c068f1dc5f11c99d09420ddd: Status 404 returned error can't find the container with id 3d216488cd54a0fb56d4731a5f282c3ebc579d92c068f1dc5f11c99d09420ddd
May 28 17:16:57.394993 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:16:57.394891    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58dae7ec_c6ea_43d6_9666_96ff58564769.slice/crio-51ba7564675b4feec8b647c50cf3a712ef8671f0db69dfbd0cfbf6ee7d80ecd2 WatchSource:0}: Error finding container 51ba7564675b4feec8b647c50cf3a712ef8671f0db69dfbd0cfbf6ee7d80ecd2: Status 404 returned error can't find the container with id 51ba7564675b4feec8b647c50cf3a712ef8671f0db69dfbd0cfbf6ee7d80ecd2
May 28 17:16:57.555256 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:57.555112    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-27 17:11:55 +0000 UTC" deadline="2028-01-05 12:06:00.928156869 +0000 UTC"
May 28 17:16:57.555256 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:57.555254    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14082h49m3.372904804s"
May 28 17:16:57.626574 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:57.626549    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:16:57.626724 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:57.626553    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:16:57.626724 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:57.626708    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqgk7" podUID="a2131092-689a-4370-bea0-90a62c5af33a"
May 28 17:16:57.626817 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:57.626740    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg777" podUID="dde1c12c-f6e7-4715-a1df-6bdb3f905c35"
May 28 17:16:57.637210 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:57.637191    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29" event={"ID":"7267ece4-c719-4d1b-8f1b-117e894dd45a","Type":"ContainerStarted","Data":"b47919b76d2c080ee8336bea80dc1f27edf5565e149492d651cb7cd294a039b0"}
May 28 17:16:57.638327 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:57.638292    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4lf2r" event={"ID":"21807015-9b41-44d2-aae3-21e5e93a8986","Type":"ContainerStarted","Data":"72f3afa383199196db8122821ecac8f4a87966e49ffd0296edb97480c071e863"}
May 28 17:16:57.639585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:57.639565    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hhc9v" event={"ID":"7044d69e-088f-4778-9f23-833010990847","Type":"ContainerStarted","Data":"b5f42dfc9874f35bb511bc2fb14ced3962d1ca5ca1fd89274045ac4fb845d146"}
May 28 17:16:57.640945 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:57.640925    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz2qt" event={"ID":"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b","Type":"ContainerStarted","Data":"e4abff89e2b15bdd02b3105dad8dcad6b365233b25cca3e75e8f273a1d1c2645"}
May 28 17:16:57.644980 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:57.644653    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2hs5x" event={"ID":"fc42e373-26f0-4d12-8cb7-b2502f183d73","Type":"ContainerStarted","Data":"df1e685cef65c96b3252d9aa65aaf4de0eb687ddadd393390f69b0e18aa0017b"}
May 28 17:16:57.646699 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:57.646678    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-205.ec2.internal" event={"ID":"09c2e9e5d3d1eb649c292303ae36692a","Type":"ContainerStarted","Data":"54935c9f3492941081b6a0136b2f10746592b3cb385fdb86cbd0d12b2e75bcc6"}
May 28 17:16:57.647690 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:57.647670    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9wdmt" event={"ID":"58dae7ec-c6ea-43d6-9666-96ff58564769","Type":"ContainerStarted","Data":"51ba7564675b4feec8b647c50cf3a712ef8671f0db69dfbd0cfbf6ee7d80ecd2"}
May 28 17:16:57.648710 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:57.648691    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb" event={"ID":"9bd29f05-c1e0-4fe5-82e8-62974c41bd76","Type":"ContainerStarted","Data":"d9cfe2a40dcef0607b1baacc755a861a192a164aae88af3b0429e2cdca93f86f"}
May 28 17:16:57.649589 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:57.649560    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-65gkm" event={"ID":"6cf25fc1-cd37-4ba5-8f18-f78847e3b4c5","Type":"ContainerStarted","Data":"98af3d1383b7a9bce24a6f19e59353308f3604df2205b5f630087fd4442536a3"}
May 28 17:16:57.650442 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:57.650421    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c8zvb" event={"ID":"30363fc7-9248-4a84-b318-49ac3fd22773","Type":"ContainerStarted","Data":"3d216488cd54a0fb56d4731a5f282c3ebc579d92c068f1dc5f11c99d09420ddd"}
May 28 17:16:57.661193 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:57.661153    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-133-205.ec2.internal" podStartSLOduration=2.661143034 podStartE2EDuration="2.661143034s" podCreationTimestamp="2026-05-28 17:16:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:16:57.660937146 +0000 UTC m=+3.636741503" watchObservedRunningTime="2026-05-28 17:16:57.661143034 +0000 UTC m=+3.636947390"
May 28 17:16:58.240652 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:58.240611    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m99gk\" (UniqueName: \"kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk\") pod \"network-check-target-wg777\" (UID: \"dde1c12c-f6e7-4715-a1df-6bdb3f905c35\") " pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:16:58.240830 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:58.240685    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs\") pod \"network-metrics-daemon-jqgk7\" (UID: \"a2131092-689a-4370-bea0-90a62c5af33a\") " pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:16:58.240905 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:58.240827    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:16:58.240905 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:58.240890    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs podName:a2131092-689a-4370-bea0-90a62c5af33a nodeName:}" failed. No retries permitted until 2026-05-28 17:17:00.240869421 +0000 UTC m=+6.216673760 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs") pod "network-metrics-daemon-jqgk7" (UID: "a2131092-689a-4370-bea0-90a62c5af33a") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:16:58.241357 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:58.241338    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:16:58.241442 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:58.241362    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:16:58.241442 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:58.241375    2556 projected.go:194] Error preparing data for projected volume kube-api-access-m99gk for pod openshift-network-diagnostics/network-check-target-wg777: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:16:58.241442 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:58.241423    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk podName:dde1c12c-f6e7-4715-a1df-6bdb3f905c35 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:00.241408687 +0000 UTC m=+6.217213021 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-m99gk" (UniqueName: "kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk") pod "network-check-target-wg777" (UID: "dde1c12c-f6e7-4715-a1df-6bdb3f905c35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:16:58.676136 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:58.676098    2556 generic.go:358] "Generic (PLEG): container finished" podID="dfd02ee13fee587202cfff6243d462ff" containerID="a5f27c3320688857cb098ad2cd280b569ddb14b2f4c98510adf09edaa15062b4" exitCode=0
May 28 17:16:58.676687 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:58.676361    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal" event={"ID":"dfd02ee13fee587202cfff6243d462ff","Type":"ContainerDied","Data":"a5f27c3320688857cb098ad2cd280b569ddb14b2f4c98510adf09edaa15062b4"}
May 28 17:16:59.627416 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:59.627333    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:16:59.627591 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:59.627466    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqgk7" podUID="a2131092-689a-4370-bea0-90a62c5af33a"
May 28 17:16:59.627880 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:59.627860    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:16:59.627975 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:16:59.627955    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg777" podUID="dde1c12c-f6e7-4715-a1df-6bdb3f905c35"
May 28 17:16:59.686357 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:16:59.685937    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal" event={"ID":"dfd02ee13fee587202cfff6243d462ff","Type":"ContainerStarted","Data":"f397fd43d9cbfebe73f38f154d0d5f40574616d9402158f3583c1abf74fdc103"}
May 28 17:17:00.256341 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:00.256076    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m99gk\" (UniqueName: \"kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk\") pod \"network-check-target-wg777\" (UID: \"dde1c12c-f6e7-4715-a1df-6bdb3f905c35\") " pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:17:00.256341 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:00.256134    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs\") pod \"network-metrics-daemon-jqgk7\" (UID: \"a2131092-689a-4370-bea0-90a62c5af33a\") " pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:17:00.256341 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:00.256272    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:00.256341 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:00.256342    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs podName:a2131092-689a-4370-bea0-90a62c5af33a nodeName:}" failed. No retries permitted until 2026-05-28 17:17:04.256323931 +0000 UTC m=+10.232128272 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs") pod "network-metrics-daemon-jqgk7" (UID: "a2131092-689a-4370-bea0-90a62c5af33a") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:00.256836 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:00.256776    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:17:00.256836 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:00.256799    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:17:00.256836 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:00.256810    2556 projected.go:194] Error preparing data for projected volume kube-api-access-m99gk for pod openshift-network-diagnostics/network-check-target-wg777: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:00.257031 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:00.256859    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk podName:dde1c12c-f6e7-4715-a1df-6bdb3f905c35 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:04.256842502 +0000 UTC m=+10.232646837 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-m99gk" (UniqueName: "kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk") pod "network-check-target-wg777" (UID: "dde1c12c-f6e7-4715-a1df-6bdb3f905c35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:01.626915 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:01.626877    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:17:01.627401 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:01.627012    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg777" podUID="dde1c12c-f6e7-4715-a1df-6bdb3f905c35"
May 28 17:17:01.627536 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:01.627513    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:17:01.627652 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:01.627630    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqgk7" podUID="a2131092-689a-4370-bea0-90a62c5af33a"
May 28 17:17:03.627108 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:03.627077    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:17:03.627630 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:03.627210    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg777" podUID="dde1c12c-f6e7-4715-a1df-6bdb3f905c35"
May 28 17:17:03.627630 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:03.627570    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:17:03.627742 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:03.627677    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqgk7" podUID="a2131092-689a-4370-bea0-90a62c5af33a"
May 28 17:17:04.291824 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:04.291396    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m99gk\" (UniqueName: \"kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk\") pod \"network-check-target-wg777\" (UID: \"dde1c12c-f6e7-4715-a1df-6bdb3f905c35\") " pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:17:04.291824 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:04.291463    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs\") pod \"network-metrics-daemon-jqgk7\" (UID: \"a2131092-689a-4370-bea0-90a62c5af33a\") " pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:17:04.291824 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:04.291552    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:17:04.291824 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:04.291577    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:17:04.291824 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:04.291579    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:04.291824 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:04.291592    2556 projected.go:194] Error preparing data for projected volume kube-api-access-m99gk for pod openshift-network-diagnostics/network-check-target-wg777: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:04.291824 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:04.291637    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs podName:a2131092-689a-4370-bea0-90a62c5af33a nodeName:}" failed. No retries permitted until 2026-05-28 17:17:12.291619126 +0000 UTC m=+18.267423465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs") pod "network-metrics-daemon-jqgk7" (UID: "a2131092-689a-4370-bea0-90a62c5af33a") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:04.291824 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:04.291655    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk podName:dde1c12c-f6e7-4715-a1df-6bdb3f905c35 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:12.291645754 +0000 UTC m=+18.267450087 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-m99gk" (UniqueName: "kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk") pod "network-check-target-wg777" (UID: "dde1c12c-f6e7-4715-a1df-6bdb3f905c35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:05.627527 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:05.627495    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:17:05.627938 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:05.627628    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqgk7" podUID="a2131092-689a-4370-bea0-90a62c5af33a"
May 28 17:17:05.628011 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:05.627991    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:17:05.628104 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:05.628084    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg777" podUID="dde1c12c-f6e7-4715-a1df-6bdb3f905c35"
May 28 17:17:07.626548 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:07.626508    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:17:07.626960 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:07.626624    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg777" podUID="dde1c12c-f6e7-4715-a1df-6bdb3f905c35"
May 28 17:17:07.626960 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:07.626655    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:17:07.626960 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:07.626718    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqgk7" podUID="a2131092-689a-4370-bea0-90a62c5af33a"
May 28 17:17:09.626606 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:09.626565    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:17:09.627001 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:09.626577    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:17:09.627001 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:09.626661    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg777" podUID="dde1c12c-f6e7-4715-a1df-6bdb3f905c35"
May 28 17:17:09.627001 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:09.626792    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqgk7" podUID="a2131092-689a-4370-bea0-90a62c5af33a"
May 28 17:17:11.626794 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:11.626755    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:17:11.627203 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:11.626769    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:17:11.627203 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:11.626881    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg777" podUID="dde1c12c-f6e7-4715-a1df-6bdb3f905c35"
May 28 17:17:11.627203 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:11.626977    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqgk7" podUID="a2131092-689a-4370-bea0-90a62c5af33a"
May 28 17:17:12.152192 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:12.152137    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-133-205.ec2.internal" podStartSLOduration=17.152118535 podStartE2EDuration="17.152118535s" podCreationTimestamp="2026-05-28 17:16:55 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:16:59.718067477 +0000 UTC m=+5.693871836" watchObservedRunningTime="2026-05-28 17:17:12.152118535 +0000 UTC m=+18.127922892"
May 28 17:17:12.153012 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:12.152993    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-h22jp"]
May 28 17:17:12.238607 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:12.238579    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:12.238766 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:12.238662    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h22jp" podUID="9270f234-63b6-44fc-853c-45cf68ef063d"
May 28 17:17:12.356382 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:12.356354    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m99gk\" (UniqueName: \"kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk\") pod \"network-check-target-wg777\" (UID: \"dde1c12c-f6e7-4715-a1df-6bdb3f905c35\") " pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:17:12.356545 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:12.356406    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9270f234-63b6-44fc-853c-45cf68ef063d-kubelet-config\") pod \"global-pull-secret-syncer-h22jp\" (UID: \"9270f234-63b6-44fc-853c-45cf68ef063d\") " pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:12.356545 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:12.356436    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret\") pod \"global-pull-secret-syncer-h22jp\" (UID: \"9270f234-63b6-44fc-853c-45cf68ef063d\") " pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:12.356545 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:12.356464    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs\") pod \"network-metrics-daemon-jqgk7\" (UID: \"a2131092-689a-4370-bea0-90a62c5af33a\") " pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:17:12.356545 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:12.356491    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9270f234-63b6-44fc-853c-45cf68ef063d-dbus\") pod \"global-pull-secret-syncer-h22jp\" (UID: \"9270f234-63b6-44fc-853c-45cf68ef063d\") " pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:12.356545 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:12.356509    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:17:12.356545 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:12.356529    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:17:12.356545 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:12.356542    2556 projected.go:194] Error preparing data for projected volume kube-api-access-m99gk for pod openshift-network-diagnostics/network-check-target-wg777: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:12.356899 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:12.356581    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:12.356899 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:12.356593    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk podName:dde1c12c-f6e7-4715-a1df-6bdb3f905c35 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:28.356577971 +0000 UTC m=+34.332382306 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-m99gk" (UniqueName: "kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk") pod "network-check-target-wg777" (UID: "dde1c12c-f6e7-4715-a1df-6bdb3f905c35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:12.356899 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:12.356628    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs podName:a2131092-689a-4370-bea0-90a62c5af33a nodeName:}" failed. No retries permitted until 2026-05-28 17:17:28.356609627 +0000 UTC m=+34.332413964 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs") pod "network-metrics-daemon-jqgk7" (UID: "a2131092-689a-4370-bea0-90a62c5af33a") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:12.457778 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:12.457696    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9270f234-63b6-44fc-853c-45cf68ef063d-kubelet-config\") pod \"global-pull-secret-syncer-h22jp\" (UID: \"9270f234-63b6-44fc-853c-45cf68ef063d\") " pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:12.457778 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:12.457738    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret\") pod \"global-pull-secret-syncer-h22jp\" (UID: \"9270f234-63b6-44fc-853c-45cf68ef063d\") " pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:12.457986 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:12.457787    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9270f234-63b6-44fc-853c-45cf68ef063d-dbus\") pod \"global-pull-secret-syncer-h22jp\" (UID: \"9270f234-63b6-44fc-853c-45cf68ef063d\") " pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:12.457986 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:12.457828    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9270f234-63b6-44fc-853c-45cf68ef063d-kubelet-config\") pod \"global-pull-secret-syncer-h22jp\" (UID: \"9270f234-63b6-44fc-853c-45cf68ef063d\") " pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:12.457986 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:12.457923    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 17:17:12.457986 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:12.457936    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9270f234-63b6-44fc-853c-45cf68ef063d-dbus\") pod \"global-pull-secret-syncer-h22jp\" (UID: \"9270f234-63b6-44fc-853c-45cf68ef063d\") " pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:12.458155 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:12.457995    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret podName:9270f234-63b6-44fc-853c-45cf68ef063d nodeName:}" failed. No retries permitted until 2026-05-28 17:17:12.957975944 +0000 UTC m=+18.933780283 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret") pod "global-pull-secret-syncer-h22jp" (UID: "9270f234-63b6-44fc-853c-45cf68ef063d") : object "kube-system"/"original-pull-secret" not registered
May 28 17:17:12.962436 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:12.962404    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret\") pod \"global-pull-secret-syncer-h22jp\" (UID: \"9270f234-63b6-44fc-853c-45cf68ef063d\") " pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:12.962860 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:12.962564    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 17:17:12.962860 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:12.962645    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret podName:9270f234-63b6-44fc-853c-45cf68ef063d nodeName:}" failed. No retries permitted until 2026-05-28 17:17:13.962626397 +0000 UTC m=+19.938430731 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret") pod "global-pull-secret-syncer-h22jp" (UID: "9270f234-63b6-44fc-853c-45cf68ef063d") : object "kube-system"/"original-pull-secret" not registered
May 28 17:17:13.626868 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:13.626837    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:17:13.627026 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:13.626838    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:17:13.627026 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:13.626931    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg777" podUID="dde1c12c-f6e7-4715-a1df-6bdb3f905c35"
May 28 17:17:13.627026 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:13.626838    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:13.627026 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:13.627017    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqgk7" podUID="a2131092-689a-4370-bea0-90a62c5af33a"
May 28 17:17:13.627164 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:13.627108    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h22jp" podUID="9270f234-63b6-44fc-853c-45cf68ef063d"
May 28 17:17:13.969507 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:13.969421    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret\") pod \"global-pull-secret-syncer-h22jp\" (UID: \"9270f234-63b6-44fc-853c-45cf68ef063d\") " pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:13.969895 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:13.969574    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 17:17:13.969895 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:13.969636    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret podName:9270f234-63b6-44fc-853c-45cf68ef063d nodeName:}" failed. No retries permitted until 2026-05-28 17:17:15.96962077 +0000 UTC m=+21.945425108 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret") pod "global-pull-secret-syncer-h22jp" (UID: "9270f234-63b6-44fc-853c-45cf68ef063d") : object "kube-system"/"original-pull-secret" not registered
May 28 17:17:15.627191 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.626971    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:15.627734 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.627046    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:17:15.627734 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:15.627210    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h22jp" podUID="9270f234-63b6-44fc-853c-45cf68ef063d"
May 28 17:17:15.627734 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:15.627294    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqgk7" podUID="a2131092-689a-4370-bea0-90a62c5af33a"
May 28 17:17:15.627734 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.627062    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:17:15.627734 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:15.627382    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg777" podUID="dde1c12c-f6e7-4715-a1df-6bdb3f905c35"
May 28 17:17:15.714099 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.714050    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hhc9v" event={"ID":"7044d69e-088f-4778-9f23-833010990847","Type":"ContainerStarted","Data":"58719de7d5d242ea1b46468f5414cc53fc94157aebdca8d0bc82e0d96a9be933"}
May 28 17:17:15.715333 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.715294    2556 generic.go:358] "Generic (PLEG): container finished" podID="6c0202c2-7ee3-45df-8026-eb1e9f10ff6b" containerID="0c3e3a8f185c5aedc1262a6eb8586128e1eff47433705a97094b1c513057da5b" exitCode=0
May 28 17:17:15.715446 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.715386    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz2qt" event={"ID":"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b","Type":"ContainerDied","Data":"0c3e3a8f185c5aedc1262a6eb8586128e1eff47433705a97094b1c513057da5b"}
May 28 17:17:15.716789 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.716770    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2hs5x" event={"ID":"fc42e373-26f0-4d12-8cb7-b2502f183d73","Type":"ContainerStarted","Data":"0d9cc92a5cadd7373b45602537bd5739cc157956ec2fea580553ff35e0e5f724"}
May 28 17:17:15.717916 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.717898    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9wdmt" event={"ID":"58dae7ec-c6ea-43d6-9666-96ff58564769","Type":"ContainerStarted","Data":"2399e84993668801e7c01aea7ecbb6311c6e22a1524c31d6b5bf15807fd1dc71"}
May 28 17:17:15.719577 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.719562    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4lcb_9bd29f05-c1e0-4fe5-82e8-62974c41bd76/ovn-acl-logging/0.log"
May 28 17:17:15.719911 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.719839    2556 generic.go:358] "Generic (PLEG): container finished" podID="9bd29f05-c1e0-4fe5-82e8-62974c41bd76" containerID="583a594953fb977ea4b215a1d1fd2349e0fbbc453587f43591e3a6a80fbb6699" exitCode=1
May 28 17:17:15.719911 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.719895    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb" event={"ID":"9bd29f05-c1e0-4fe5-82e8-62974c41bd76","Type":"ContainerStarted","Data":"c722c4c7951311013a53a500ccb42703b5ec988e357f5a831999f75c59753b73"}
May 28 17:17:15.719997 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.719918    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb" event={"ID":"9bd29f05-c1e0-4fe5-82e8-62974c41bd76","Type":"ContainerStarted","Data":"bbc565c4747050c1f5092cdf123a471d1edb53f2759236720577c962630ce604"}
May 28 17:17:15.719997 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.719931    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb" event={"ID":"9bd29f05-c1e0-4fe5-82e8-62974c41bd76","Type":"ContainerDied","Data":"583a594953fb977ea4b215a1d1fd2349e0fbbc453587f43591e3a6a80fbb6699"}
May 28 17:17:15.719997 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.719946    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb" event={"ID":"9bd29f05-c1e0-4fe5-82e8-62974c41bd76","Type":"ContainerStarted","Data":"d87c500b6b0821028ac56055026bf9b9bb7450f886ee3d8784b986d78b9abd36"}
May 28 17:17:15.721164 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.721144    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c8zvb" event={"ID":"30363fc7-9248-4a84-b318-49ac3fd22773","Type":"ContainerStarted","Data":"a5fe47e2db065a1e9ec3ee9d461674f3208ccd9bb0358c721b045e528921f7f0"}
May 28 17:17:15.722532 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.722512    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29" event={"ID":"7267ece4-c719-4d1b-8f1b-117e894dd45a","Type":"ContainerStarted","Data":"26b382dbf844fc1ea87c65f1973c4bddfee71954274a778a50b5f466060d24ce"}
May 28 17:17:15.723717 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.723696    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-4lf2r" event={"ID":"21807015-9b41-44d2-aae3-21e5e93a8986","Type":"ContainerStarted","Data":"840b37d5189d8cd6254d3a719fee1461013e22ddf4fcaa37b1c7d8e7cb7095d7"}
May 28 17:17:15.731253 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.731217    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-hhc9v" podStartSLOduration=4.013802527 podStartE2EDuration="21.731207991s" podCreationTimestamp="2026-05-28 17:16:54 +0000 UTC" firstStartedPulling="2026-05-28 17:16:57.392283812 +0000 UTC m=+3.368088148" lastFinishedPulling="2026-05-28 17:17:15.109689263 +0000 UTC m=+21.085493612" observedRunningTime="2026-05-28 17:17:15.730987313 +0000 UTC m=+21.706791669" watchObservedRunningTime="2026-05-28 17:17:15.731207991 +0000 UTC m=+21.707012346"
May 28 17:17:15.751026 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.750993    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2hs5x" podStartSLOduration=3.9935130599999997 podStartE2EDuration="21.750982777s" podCreationTimestamp="2026-05-28 17:16:54 +0000 UTC" firstStartedPulling="2026-05-28 17:16:57.38587597 +0000 UTC m=+3.361680304" lastFinishedPulling="2026-05-28 17:17:15.143345669 +0000 UTC m=+21.119150021" observedRunningTime="2026-05-28 17:17:15.750462566 +0000 UTC m=+21.726266922" watchObservedRunningTime="2026-05-28 17:17:15.750982777 +0000 UTC m=+21.726787133"
May 28 17:17:15.764932 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.764887    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9wdmt" podStartSLOduration=12.01022335 podStartE2EDuration="21.764877175s" podCreationTimestamp="2026-05-28 17:16:54 +0000 UTC" firstStartedPulling="2026-05-28 17:16:57.397149811 +0000 UTC m=+3.372954158" lastFinishedPulling="2026-05-28 17:17:07.151803632 +0000 UTC m=+13.127607983" observedRunningTime="2026-05-28 17:17:15.764844057 +0000 UTC m=+21.740648413" watchObservedRunningTime="2026-05-28 17:17:15.764877175 +0000 UTC m=+21.740681530"
May 28 17:17:15.780354 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.780293    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-4lf2r" podStartSLOduration=4.063989193 podStartE2EDuration="21.780279262s" podCreationTimestamp="2026-05-28 17:16:54 +0000 UTC" firstStartedPulling="2026-05-28 17:16:57.393529978 +0000 UTC m=+3.369334326" lastFinishedPulling="2026-05-28 17:17:15.10982006 +0000 UTC m=+21.085624395" observedRunningTime="2026-05-28 17:17:15.779669048 +0000 UTC m=+21.755473404" watchObservedRunningTime="2026-05-28 17:17:15.780279262 +0000 UTC m=+21.756083619"
May 28 17:17:15.831487 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.831439    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-c8zvb" podStartSLOduration=4.083468581 podStartE2EDuration="21.83142296s" podCreationTimestamp="2026-05-28 17:16:54 +0000 UTC" firstStartedPulling="2026-05-28 17:16:57.395823367 +0000 UTC m=+3.371627701" lastFinishedPulling="2026-05-28 17:17:15.143777746 +0000 UTC m=+21.119582080" observedRunningTime="2026-05-28 17:17:15.830985044 +0000 UTC m=+21.806789400" watchObservedRunningTime="2026-05-28 17:17:15.83142296 +0000 UTC m=+21.807227317"
May 28 17:17:15.984895 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:15.984820    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret\") pod \"global-pull-secret-syncer-h22jp\" (UID: \"9270f234-63b6-44fc-853c-45cf68ef063d\") " pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:15.985042 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:15.984929    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 17:17:15.985042 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:15.984996    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret podName:9270f234-63b6-44fc-853c-45cf68ef063d nodeName:}" failed. No retries permitted until 2026-05-28 17:17:19.984977933 +0000 UTC m=+25.960782269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret") pod "global-pull-secret-syncer-h22jp" (UID: "9270f234-63b6-44fc-853c-45cf68ef063d") : object "kube-system"/"original-pull-secret" not registered
May 28 17:17:16.554756 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:16.554734    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9wdmt"
May 28 17:17:16.555377 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:16.555361    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9wdmt"
May 28 17:17:16.574544 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:16.574519    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 28 17:17:16.584055 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:16.583986    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-28T17:17:16.574538867Z","UUID":"73beb933-7f18-48e6-bfa8-5bdaf509ebe1","Handler":null,"Name":"","Endpoint":""}
May 28 17:17:16.585276 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:16.585262    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 28 17:17:16.585357 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:16.585283    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 28 17:17:16.727397 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:16.727298    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29" event={"ID":"7267ece4-c719-4d1b-8f1b-117e894dd45a","Type":"ContainerStarted","Data":"51d320b06e94c1ee50a05bc5caf8cdda9027c1a0a4a09c5a03f61613d1654a41"}
May 28 17:17:16.730129 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:16.730109    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4lcb_9bd29f05-c1e0-4fe5-82e8-62974c41bd76/ovn-acl-logging/0.log"
May 28 17:17:16.730612 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:16.730585    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb" event={"ID":"9bd29f05-c1e0-4fe5-82e8-62974c41bd76","Type":"ContainerStarted","Data":"ea87b48f7fc0cc74edcbec624de83c9d057696761193acd7c6c208cf3cbfc3d6"}
May 28 17:17:16.730696 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:16.730622    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb" event={"ID":"9bd29f05-c1e0-4fe5-82e8-62974c41bd76","Type":"ContainerStarted","Data":"b25c196a3df266bdcfc0a299bf78522cf1340c4a9953b92e4c648fbe37721bfb"}
May 28 17:17:16.732049 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:16.732026    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-65gkm" event={"ID":"6cf25fc1-cd37-4ba5-8f18-f78847e3b4c5","Type":"ContainerStarted","Data":"fe664360eb291a6360a7fce300e162b2408db4f7c02131100274cdcb4fa65973"}
May 28 17:17:16.733096 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:16.733075    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9wdmt"
May 28 17:17:16.733562 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:16.733545    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9wdmt"
May 28 17:17:16.748022 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:16.747981    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-65gkm" podStartSLOduration=5.026082976 podStartE2EDuration="22.747965195s" podCreationTimestamp="2026-05-28 17:16:54 +0000 UTC" firstStartedPulling="2026-05-28 17:16:57.387802166 +0000 UTC m=+3.363606500" lastFinishedPulling="2026-05-28 17:17:15.109684385 +0000 UTC m=+21.085488719" observedRunningTime="2026-05-28 17:17:16.747532321 +0000 UTC m=+22.723336677" watchObservedRunningTime="2026-05-28 17:17:16.747965195 +0000 UTC m=+22.723769553"
May 28 17:17:17.627494 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:17.627467    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:17.627677 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:17.627503    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:17:17.627677 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:17.627472    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:17:17.627677 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:17.627574    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h22jp" podUID="9270f234-63b6-44fc-853c-45cf68ef063d"
May 28 17:17:17.627677 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:17.627648    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg777" podUID="dde1c12c-f6e7-4715-a1df-6bdb3f905c35"
May 28 17:17:17.627885 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:17.627750    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqgk7" podUID="a2131092-689a-4370-bea0-90a62c5af33a"
May 28 17:17:17.734966 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:17.734885    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29" event={"ID":"7267ece4-c719-4d1b-8f1b-117e894dd45a","Type":"ContainerStarted","Data":"88d44f2ac4f7897c058629bb4713c167a88186b906569a6cac83549373e75f5a"}
May 28 17:17:17.752914 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:17.752874    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kqv29" podStartSLOduration=2.695334154 podStartE2EDuration="22.752861068s" podCreationTimestamp="2026-05-28 17:16:55 +0000 UTC" firstStartedPulling="2026-05-28 17:16:57.39390915 +0000 UTC m=+3.369713498" lastFinishedPulling="2026-05-28 17:17:17.451436065 +0000 UTC m=+23.427240412" observedRunningTime="2026-05-28 17:17:17.752809076 +0000 UTC m=+23.728613434" watchObservedRunningTime="2026-05-28 17:17:17.752861068 +0000 UTC m=+23.728665425"
May 28 17:17:18.739140 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:18.738963    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4lcb_9bd29f05-c1e0-4fe5-82e8-62974c41bd76/ovn-acl-logging/0.log"
May 28 17:17:18.739534 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:18.739426    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb" event={"ID":"9bd29f05-c1e0-4fe5-82e8-62974c41bd76","Type":"ContainerStarted","Data":"29a9687de4aebfb09008e8be2040ff45eafcb0de4c2679d8bc725fdf25ba66f6"}
May 28 17:17:19.627079 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:19.627048    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:17:19.627292 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:19.627046    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:19.627292 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:19.627163    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqgk7" podUID="a2131092-689a-4370-bea0-90a62c5af33a"
May 28 17:17:19.627292 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:19.627046    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:17:19.627292 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:19.627238    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h22jp" podUID="9270f234-63b6-44fc-853c-45cf68ef063d"
May 28 17:17:19.627478 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:19.627325    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg777" podUID="dde1c12c-f6e7-4715-a1df-6bdb3f905c35"
May 28 17:17:20.015231 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:20.015147    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret\") pod \"global-pull-secret-syncer-h22jp\" (UID: \"9270f234-63b6-44fc-853c-45cf68ef063d\") " pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:20.015722 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:20.015275    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 17:17:20.015722 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:20.015352    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret podName:9270f234-63b6-44fc-853c-45cf68ef063d nodeName:}" failed. No retries permitted until 2026-05-28 17:17:28.015337195 +0000 UTC m=+33.991141533 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret") pod "global-pull-secret-syncer-h22jp" (UID: "9270f234-63b6-44fc-853c-45cf68ef063d") : object "kube-system"/"original-pull-secret" not registered
May 28 17:17:20.744714 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:20.744476    2556 generic.go:358] "Generic (PLEG): container finished" podID="6c0202c2-7ee3-45df-8026-eb1e9f10ff6b" containerID="7f977a4f3c86e0c55b259a3d49595ef184a734ba78623db16a196c1393041eb1" exitCode=0
May 28 17:17:20.744714 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:20.744558    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz2qt" event={"ID":"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b","Type":"ContainerDied","Data":"7f977a4f3c86e0c55b259a3d49595ef184a734ba78623db16a196c1393041eb1"}
May 28 17:17:20.747767 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:20.747751    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4lcb_9bd29f05-c1e0-4fe5-82e8-62974c41bd76/ovn-acl-logging/0.log"
May 28 17:17:20.748079 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:20.748056    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb" event={"ID":"9bd29f05-c1e0-4fe5-82e8-62974c41bd76","Type":"ContainerStarted","Data":"0c4d9825f5f3060c3fc66153d47738393eb369267560342d69576395f3be8675"}
May 28 17:17:20.748345 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:20.748324    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:17:20.748438 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:20.748354    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:17:20.748438 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:20.748366    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:17:20.748523 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:20.748508    2556 scope.go:117] "RemoveContainer" containerID="583a594953fb977ea4b215a1d1fd2349e0fbbc453587f43591e3a6a80fbb6699"
May 28 17:17:20.763943 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:20.763924    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:17:20.764012 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:20.764001    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:17:21.626596 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:21.626572    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:21.627155 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:21.626572    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:17:21.627155 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:21.626676    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h22jp" podUID="9270f234-63b6-44fc-853c-45cf68ef063d"
May 28 17:17:21.627155 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:21.626694    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:17:21.627155 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:21.626759    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg777" podUID="dde1c12c-f6e7-4715-a1df-6bdb3f905c35"
May 28 17:17:21.627155 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:21.626870    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqgk7" podUID="a2131092-689a-4370-bea0-90a62c5af33a"
May 28 17:17:21.751444 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:21.751413    2556 generic.go:358] "Generic (PLEG): container finished" podID="6c0202c2-7ee3-45df-8026-eb1e9f10ff6b" containerID="a940ff50a28f3fff43d34a25433c2c2f2757ac340cc01c1e8f3f9759d5fb116f" exitCode=0
May 28 17:17:21.751600 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:21.751492    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz2qt" event={"ID":"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b","Type":"ContainerDied","Data":"a940ff50a28f3fff43d34a25433c2c2f2757ac340cc01c1e8f3f9759d5fb116f"}
May 28 17:17:21.754978 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:21.754961    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4lcb_9bd29f05-c1e0-4fe5-82e8-62974c41bd76/ovn-acl-logging/0.log"
May 28 17:17:21.755322 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:21.755286    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb" event={"ID":"9bd29f05-c1e0-4fe5-82e8-62974c41bd76","Type":"ContainerStarted","Data":"7f1b3100e05972548f859a82493542c0950741b7ba84e5afc7f101015b6e1979"}
May 28 17:17:21.801242 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:21.801176    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb" podStartSLOduration=9.978893538 podStartE2EDuration="27.801163442s" podCreationTimestamp="2026-05-28 17:16:54 +0000 UTC" firstStartedPulling="2026-05-28 17:16:57.39078875 +0000 UTC m=+3.366593091" lastFinishedPulling="2026-05-28 17:17:15.213058659 +0000 UTC m=+21.188862995" observedRunningTime="2026-05-28 17:17:21.800797776 +0000 UTC m=+27.776602134" watchObservedRunningTime="2026-05-28 17:17:21.801163442 +0000 UTC m=+27.776967797"
May 28 17:17:22.394025 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:22.393656    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h22jp"]
May 28 17:17:22.394025 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:22.393761    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:22.394291 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:22.394258    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h22jp" podUID="9270f234-63b6-44fc-853c-45cf68ef063d"
May 28 17:17:22.396738 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:22.396386    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wg777"]
May 28 17:17:22.396738 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:22.396492    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:17:22.396738 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:22.396576    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg777" podUID="dde1c12c-f6e7-4715-a1df-6bdb3f905c35"
May 28 17:17:22.399220 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:22.399197    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jqgk7"]
May 28 17:17:22.399338 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:22.399286    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:17:22.399418 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:22.399397    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqgk7" podUID="a2131092-689a-4370-bea0-90a62c5af33a"
May 28 17:17:22.759625 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:22.759542    2556 generic.go:358] "Generic (PLEG): container finished" podID="6c0202c2-7ee3-45df-8026-eb1e9f10ff6b" containerID="6efa3a5402f65d229c7703112164bb7561ace77540e89f71642d856ba02096a5" exitCode=0
May 28 17:17:22.760010 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:22.759630    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz2qt" event={"ID":"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b","Type":"ContainerDied","Data":"6efa3a5402f65d229c7703112164bb7561ace77540e89f71642d856ba02096a5"}
May 28 17:17:23.626841 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:23.626809    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:23.627003 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:23.626934    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h22jp" podUID="9270f234-63b6-44fc-853c-45cf68ef063d"
May 28 17:17:24.630509 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:24.630472    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:17:24.630509 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:24.630490    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:17:24.630937 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:24.630585    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg777" podUID="dde1c12c-f6e7-4715-a1df-6bdb3f905c35"
May 28 17:17:24.630937 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:24.630683    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqgk7" podUID="a2131092-689a-4370-bea0-90a62c5af33a"
May 28 17:17:25.627091 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:25.626915    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:25.627255 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:25.627169    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h22jp" podUID="9270f234-63b6-44fc-853c-45cf68ef063d"
May 28 17:17:26.627517 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:26.627482    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:17:26.628098 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:26.627613    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-jqgk7" podUID="a2131092-689a-4370-bea0-90a62c5af33a"
May 28 17:17:26.628098 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:26.627660    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:17:26.628098 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:26.627770    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-wg777" podUID="dde1c12c-f6e7-4715-a1df-6bdb3f905c35"
May 28 17:17:27.627383 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:27.627347    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:27.627731 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:27.627485    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-h22jp" podUID="9270f234-63b6-44fc-853c-45cf68ef063d"
May 28 17:17:27.887342 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:27.887248    2556 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-133-205.ec2.internal" event="NodeReady"
May 28 17:17:27.887477 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:27.887399    2556 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 28 17:17:27.923184 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:27.923153    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7c59656557-t2h5w"]
May 28 17:17:27.966753 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:27.966715    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7c59656557-t2h5w"]
May 28 17:17:27.966925 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:27.966844    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mxnl2"]
May 28 17:17:27.966925 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:27.966879    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:27.969842 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:27.969809    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xv2ct\""
May 28 17:17:27.981618 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:27.981600    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-ldxgl"]
May 28 17:17:27.981763 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:27.981746    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mxnl2"
May 28 17:17:27.985613 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:27.985590    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 28 17:17:27.986872 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:27.986515    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 28 17:17:27.986872 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:27.986522    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sh6sk\""
May 28 17:17:27.986872 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:27.986560    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 28 17:17:27.986872 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:27.986603    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 28 17:17:27.990986 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:27.990968    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 28 17:17:27.996541 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:27.996524    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 28 17:17:27.999764 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:27.999747    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mxnl2"]
May 28 17:17:27.999854 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:27.999769    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ldxgl"]
May 28 17:17:27.999854 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:27.999847    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ldxgl"
May 28 17:17:28.002463 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.002445    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 28 17:17:28.003114 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.002733    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nznc5\""
May 28 17:17:28.003114 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.002997    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 28 17:17:28.003114 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.003029    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 28 17:17:28.079928 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.079894    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-bound-sa-token\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.080111 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.079961    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/db344c52-f4e9-4191-9b75-ce2a278c6841-image-registry-private-configuration\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.080111 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.079995    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.080111 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.080073    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db344c52-f4e9-4191-9b75-ce2a278c6841-ca-trust-extracted\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.080349 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.080158    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret\") pod \"global-pull-secret-syncer-h22jp\" (UID: \"9270f234-63b6-44fc-853c-45cf68ef063d\") " pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:28.080349 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.080196    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5d302957-1a7b-4109-92da-0c0d90325f4d-config-volume\") pod \"dns-default-mxnl2\" (UID: \"5d302957-1a7b-4109-92da-0c0d90325f4d\") " pod="openshift-dns/dns-default-mxnl2"
May 28 17:17:28.080349 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.080246    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db344c52-f4e9-4191-9b75-ce2a278c6841-installation-pull-secrets\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.080349 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.080276    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbp2m\" (UniqueName: \"kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-kube-api-access-wbp2m\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.080349 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.080302    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d302957-1a7b-4109-92da-0c0d90325f4d-tmp-dir\") pod \"dns-default-mxnl2\" (UID: \"5d302957-1a7b-4109-92da-0c0d90325f4d\") " pod="openshift-dns/dns-default-mxnl2"
May 28 17:17:28.080594 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.080365    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-certificates\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.080594 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.080369    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 28 17:17:28.080594 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.080429    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls\") pod \"dns-default-mxnl2\" (UID: \"5d302957-1a7b-4109-92da-0c0d90325f4d\") " pod="openshift-dns/dns-default-mxnl2"
May 28 17:17:28.080594 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.080462    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret podName:9270f234-63b6-44fc-853c-45cf68ef063d nodeName:}" failed. No retries permitted until 2026-05-28 17:17:44.080441573 +0000 UTC m=+50.056245910 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret") pod "global-pull-secret-syncer-h22jp" (UID: "9270f234-63b6-44fc-853c-45cf68ef063d") : object "kube-system"/"original-pull-secret" not registered
May 28 17:17:28.080594 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.080526    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4lnf\" (UniqueName: \"kubernetes.io/projected/5d302957-1a7b-4109-92da-0c0d90325f4d-kube-api-access-c4lnf\") pod \"dns-default-mxnl2\" (UID: \"5d302957-1a7b-4109-92da-0c0d90325f4d\") " pod="openshift-dns/dns-default-mxnl2"
May 28 17:17:28.080594 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.080557    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db344c52-f4e9-4191-9b75-ce2a278c6841-trusted-ca\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.181113 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.181031    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wbp2m\" (UniqueName: \"kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-kube-api-access-wbp2m\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.181113 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.181073    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d302957-1a7b-4109-92da-0c0d90325f4d-tmp-dir\") pod \"dns-default-mxnl2\" (UID: \"5d302957-1a7b-4109-92da-0c0d90325f4d\") " pod="openshift-dns/dns-default-mxnl2"
May 28 17:17:28.181113 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.181105    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-87jxt\" (UniqueName: \"kubernetes.io/projected/f3232f85-3d97-44a7-8d4c-42687b88d50f-kube-api-access-87jxt\") pod \"ingress-canary-ldxgl\" (UID: \"f3232f85-3d97-44a7-8d4c-42687b88d50f\") " pod="openshift-ingress-canary/ingress-canary-ldxgl"
May 28 17:17:28.181413 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.181138    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-certificates\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.181413 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.181171    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls\") pod \"dns-default-mxnl2\" (UID: \"5d302957-1a7b-4109-92da-0c0d90325f4d\") " pod="openshift-dns/dns-default-mxnl2"
May 28 17:17:28.181413 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.181205    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-c4lnf\" (UniqueName: \"kubernetes.io/projected/5d302957-1a7b-4109-92da-0c0d90325f4d-kube-api-access-c4lnf\") pod \"dns-default-mxnl2\" (UID: \"5d302957-1a7b-4109-92da-0c0d90325f4d\") " pod="openshift-dns/dns-default-mxnl2"
May 28 17:17:28.181413 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.181232    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db344c52-f4e9-4191-9b75-ce2a278c6841-trusted-ca\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.181413 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.181273    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-bound-sa-token\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.181650 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.181420    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:17:28.181650 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.181479    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls podName:5d302957-1a7b-4109-92da-0c0d90325f4d nodeName:}" failed. No retries permitted until 2026-05-28 17:17:28.681463602 +0000 UTC m=+34.657267948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls") pod "dns-default-mxnl2" (UID: "5d302957-1a7b-4109-92da-0c0d90325f4d") : secret "dns-default-metrics-tls" not found
May 28 17:17:28.181755 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.181644    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5d302957-1a7b-4109-92da-0c0d90325f4d-tmp-dir\") pod \"dns-default-mxnl2\" (UID: \"5d302957-1a7b-4109-92da-0c0d90325f4d\") " pod="openshift-dns/dns-default-mxnl2"
May 28 17:17:28.181755 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.181719    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert\") pod \"ingress-canary-ldxgl\" (UID: \"f3232f85-3d97-44a7-8d4c-42687b88d50f\") " pod="openshift-ingress-canary/ingress-canary-ldxgl"
May 28 17:17:28.181866 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.181808    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/db344c52-f4e9-4191-9b75-ce2a278c6841-image-registry-private-configuration\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.181866 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.181817    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-certificates\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.181966 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.181868    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.181966 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.181911    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db344c52-f4e9-4191-9b75-ce2a278c6841-ca-trust-extracted\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.182063 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.181969    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5d302957-1a7b-4109-92da-0c0d90325f4d-config-volume\") pod \"dns-default-mxnl2\" (UID: \"5d302957-1a7b-4109-92da-0c0d90325f4d\") " pod="openshift-dns/dns-default-mxnl2"
May 28 17:17:28.182063 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.181997    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 17:17:28.182063 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.182012    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c59656557-t2h5w: secret "image-registry-tls" not found
May 28 17:17:28.182063 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.182024    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db344c52-f4e9-4191-9b75-ce2a278c6841-installation-pull-secrets\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.182063 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.182046    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls podName:db344c52-f4e9-4191-9b75-ce2a278c6841 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:28.682035689 +0000 UTC m=+34.657840023 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls") pod "image-registry-7c59656557-t2h5w" (UID: "db344c52-f4e9-4191-9b75-ce2a278c6841") : secret "image-registry-tls" not found
May 28 17:17:28.182338 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.182303    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db344c52-f4e9-4191-9b75-ce2a278c6841-ca-trust-extracted\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.182724 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.182695    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5d302957-1a7b-4109-92da-0c0d90325f4d-config-volume\") pod \"dns-default-mxnl2\" (UID: \"5d302957-1a7b-4109-92da-0c0d90325f4d\") " pod="openshift-dns/dns-default-mxnl2"
May 28 17:17:28.182829 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.182699    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db344c52-f4e9-4191-9b75-ce2a278c6841-trusted-ca\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.186218 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.186201    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db344c52-f4e9-4191-9b75-ce2a278c6841-installation-pull-secrets\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.186218 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.186214    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/db344c52-f4e9-4191-9b75-ce2a278c6841-image-registry-private-configuration\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.189560 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.189542    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4lnf\" (UniqueName: \"kubernetes.io/projected/5d302957-1a7b-4109-92da-0c0d90325f4d-kube-api-access-c4lnf\") pod \"dns-default-mxnl2\" (UID: \"5d302957-1a7b-4109-92da-0c0d90325f4d\") " pod="openshift-dns/dns-default-mxnl2"
May 28 17:17:28.189937 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.189920    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-bound-sa-token\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.190009 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.189996    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbp2m\" (UniqueName: \"kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-kube-api-access-wbp2m\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.282849 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.282817    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert\") pod \"ingress-canary-ldxgl\" (UID: \"f3232f85-3d97-44a7-8d4c-42687b88d50f\") " pod="openshift-ingress-canary/ingress-canary-ldxgl"
May 28 17:17:28.283045 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.282966    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:17:28.283045 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.282988    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-87jxt\" (UniqueName: \"kubernetes.io/projected/f3232f85-3d97-44a7-8d4c-42687b88d50f-kube-api-access-87jxt\") pod \"ingress-canary-ldxgl\" (UID: \"f3232f85-3d97-44a7-8d4c-42687b88d50f\") " pod="openshift-ingress-canary/ingress-canary-ldxgl"
May 28 17:17:28.283045 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.283036    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert podName:f3232f85-3d97-44a7-8d4c-42687b88d50f nodeName:}" failed. No retries permitted until 2026-05-28 17:17:28.78301597 +0000 UTC m=+34.758820307 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert") pod "ingress-canary-ldxgl" (UID: "f3232f85-3d97-44a7-8d4c-42687b88d50f") : secret "canary-serving-cert" not found
May 28 17:17:28.293606 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.293584    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-87jxt\" (UniqueName: \"kubernetes.io/projected/f3232f85-3d97-44a7-8d4c-42687b88d50f-kube-api-access-87jxt\") pod \"ingress-canary-ldxgl\" (UID: \"f3232f85-3d97-44a7-8d4c-42687b88d50f\") " pod="openshift-ingress-canary/ingress-canary-ldxgl"
May 28 17:17:28.383842 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.383815    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs\") pod \"network-metrics-daemon-jqgk7\" (UID: \"a2131092-689a-4370-bea0-90a62c5af33a\") " pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:17:28.383995 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.383888    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m99gk\" (UniqueName: \"kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk\") pod \"network-check-target-wg777\" (UID: \"dde1c12c-f6e7-4715-a1df-6bdb3f905c35\") " pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:17:28.383995 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.383968    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:28.383995 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.383990    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 28 17:17:28.384094 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.384003    2556 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 28 17:17:28.384094 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.384016    2556 projected.go:194] Error preparing data for projected volume kube-api-access-m99gk for pod openshift-network-diagnostics/network-check-target-wg777: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:28.384094 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.384035    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs podName:a2131092-689a-4370-bea0-90a62c5af33a nodeName:}" failed. No retries permitted until 2026-05-28 17:18:00.384015801 +0000 UTC m=+66.359820142 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs") pod "network-metrics-daemon-jqgk7" (UID: "a2131092-689a-4370-bea0-90a62c5af33a") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 28 17:17:28.384094 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.384051    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk podName:dde1c12c-f6e7-4715-a1df-6bdb3f905c35 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:00.384041237 +0000 UTC m=+66.359845588 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-m99gk" (UniqueName: "kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk") pod "network-check-target-wg777" (UID: "dde1c12c-f6e7-4715-a1df-6bdb3f905c35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 28 17:17:28.629618 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.629593    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:17:28.630175 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.629593    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:17:28.633105 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.632948    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rjfcr\""
May 28 17:17:28.633666 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.633646    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 17:17:28.633765 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.633670    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 17:17:28.633765 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.633714    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 17:17:28.633765 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.633671    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-svsk4\""
May 28 17:17:28.685676 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.685646    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:28.685781 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.685754    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls\") pod \"dns-default-mxnl2\" (UID: \"5d302957-1a7b-4109-92da-0c0d90325f4d\") " pod="openshift-dns/dns-default-mxnl2"
May 28 17:17:28.685893 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.685876    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 17:17:28.685938 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.685895    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c59656557-t2h5w: secret "image-registry-tls" not found
May 28 17:17:28.685938 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.685909    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:17:28.686000 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.685960    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls podName:db344c52-f4e9-4191-9b75-ce2a278c6841 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:29.685940933 +0000 UTC m=+35.661745281 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls") pod "image-registry-7c59656557-t2h5w" (UID: "db344c52-f4e9-4191-9b75-ce2a278c6841") : secret "image-registry-tls" not found
May 28 17:17:28.686000 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.685974    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls podName:5d302957-1a7b-4109-92da-0c0d90325f4d nodeName:}" failed. No retries permitted until 2026-05-28 17:17:29.685968154 +0000 UTC m=+35.661772492 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls") pod "dns-default-mxnl2" (UID: "5d302957-1a7b-4109-92da-0c0d90325f4d") : secret "dns-default-metrics-tls" not found
May 28 17:17:28.776349 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.776325    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz2qt" event={"ID":"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b","Type":"ContainerStarted","Data":"029a647c64d94fcdd11b066d721ca2e26b663310b54b0bfb62791a9f53c8e28a"}
May 28 17:17:28.786581 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:28.786557    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert\") pod \"ingress-canary-ldxgl\" (UID: \"f3232f85-3d97-44a7-8d4c-42687b88d50f\") " pod="openshift-ingress-canary/ingress-canary-ldxgl"
May 28 17:17:28.786727 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.786709    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:17:28.786794 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:28.786781    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert podName:f3232f85-3d97-44a7-8d4c-42687b88d50f nodeName:}" failed. No retries permitted until 2026-05-28 17:17:29.786761651 +0000 UTC m=+35.762566001 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert") pod "ingress-canary-ldxgl" (UID: "f3232f85-3d97-44a7-8d4c-42687b88d50f") : secret "canary-serving-cert" not found
May 28 17:17:29.626587 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:29.626554    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:29.629108 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:29.629087    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 28 17:17:29.693767 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:29.693732    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:29.694109 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:29.693874    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 17:17:29.694109 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:29.693891    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c59656557-t2h5w: secret "image-registry-tls" not found
May 28 17:17:29.694109 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:29.693888    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls\") pod \"dns-default-mxnl2\" (UID: \"5d302957-1a7b-4109-92da-0c0d90325f4d\") " pod="openshift-dns/dns-default-mxnl2"
May 28 17:17:29.694109 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:29.693938    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls podName:db344c52-f4e9-4191-9b75-ce2a278c6841 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:31.693922583 +0000 UTC m=+37.669726917 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls") pod "image-registry-7c59656557-t2h5w" (UID: "db344c52-f4e9-4191-9b75-ce2a278c6841") : secret "image-registry-tls" not found
May 28 17:17:29.694109 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:29.694000    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:17:29.694109 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:29.694040    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls podName:5d302957-1a7b-4109-92da-0c0d90325f4d nodeName:}" failed. No retries permitted until 2026-05-28 17:17:31.694029453 +0000 UTC m=+37.669833787 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls") pod "dns-default-mxnl2" (UID: "5d302957-1a7b-4109-92da-0c0d90325f4d") : secret "dns-default-metrics-tls" not found
May 28 17:17:29.780415 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:29.780381    2556 generic.go:358] "Generic (PLEG): container finished" podID="6c0202c2-7ee3-45df-8026-eb1e9f10ff6b" containerID="029a647c64d94fcdd11b066d721ca2e26b663310b54b0bfb62791a9f53c8e28a" exitCode=0
May 28 17:17:29.780587 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:29.780442    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz2qt" event={"ID":"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b","Type":"ContainerDied","Data":"029a647c64d94fcdd11b066d721ca2e26b663310b54b0bfb62791a9f53c8e28a"}
May 28 17:17:29.794961 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:29.794938    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert\") pod \"ingress-canary-ldxgl\" (UID: \"f3232f85-3d97-44a7-8d4c-42687b88d50f\") " pod="openshift-ingress-canary/ingress-canary-ldxgl"
May 28 17:17:29.795086 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:29.795071    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:17:29.795133 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:29.795124    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert podName:f3232f85-3d97-44a7-8d4c-42687b88d50f nodeName:}" failed. No retries permitted until 2026-05-28 17:17:31.795109875 +0000 UTC m=+37.770914213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert") pod "ingress-canary-ldxgl" (UID: "f3232f85-3d97-44a7-8d4c-42687b88d50f") : secret "canary-serving-cert" not found
May 28 17:17:30.785331 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:30.785285    2556 generic.go:358] "Generic (PLEG): container finished" podID="6c0202c2-7ee3-45df-8026-eb1e9f10ff6b" containerID="9dcb1f3dd7738af29c8a4520bd46016ec834d16d3c3bf232d799d8fb2e58cb5b" exitCode=0
May 28 17:17:30.785713 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:30.785341    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz2qt" event={"ID":"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b","Type":"ContainerDied","Data":"9dcb1f3dd7738af29c8a4520bd46016ec834d16d3c3bf232d799d8fb2e58cb5b"}
May 28 17:17:31.709082 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:31.709045    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:31.709284 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:31.709135    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls\") pod \"dns-default-mxnl2\" (UID: \"5d302957-1a7b-4109-92da-0c0d90325f4d\") " pod="openshift-dns/dns-default-mxnl2"
May 28 17:17:31.709284 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:31.709188    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 17:17:31.709284 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:31.709208    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c59656557-t2h5w: secret "image-registry-tls" not found
May 28 17:17:31.709284 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:31.709265    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls podName:db344c52-f4e9-4191-9b75-ce2a278c6841 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:35.709249344 +0000 UTC m=+41.685053678 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls") pod "image-registry-7c59656557-t2h5w" (UID: "db344c52-f4e9-4191-9b75-ce2a278c6841") : secret "image-registry-tls" not found
May 28 17:17:31.709284 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:31.709269    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:17:31.709496 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:31.709338    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls podName:5d302957-1a7b-4109-92da-0c0d90325f4d nodeName:}" failed. No retries permitted until 2026-05-28 17:17:35.709322311 +0000 UTC m=+41.685126657 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls") pod "dns-default-mxnl2" (UID: "5d302957-1a7b-4109-92da-0c0d90325f4d") : secret "dns-default-metrics-tls" not found
May 28 17:17:31.790077 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:31.790045    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-zz2qt" event={"ID":"6c0202c2-7ee3-45df-8026-eb1e9f10ff6b","Type":"ContainerStarted","Data":"664db22c3f6bf69995be3a8650b34d6f1971c27f2185b3157689ab041c08dcae"}
May 28 17:17:31.809995 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:31.809964    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert\") pod \"ingress-canary-ldxgl\" (UID: \"f3232f85-3d97-44a7-8d4c-42687b88d50f\") " pod="openshift-ingress-canary/ingress-canary-ldxgl"
May 28 17:17:31.810137 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:31.810106    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:17:31.810183 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:31.810163    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert podName:f3232f85-3d97-44a7-8d4c-42687b88d50f nodeName:}" failed. No retries permitted until 2026-05-28 17:17:35.810148962 +0000 UTC m=+41.785953296 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert") pod "ingress-canary-ldxgl" (UID: "f3232f85-3d97-44a7-8d4c-42687b88d50f") : secret "canary-serving-cert" not found
May 28 17:17:31.813848 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:31.813807    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-zz2qt" podStartSLOduration=6.685099426 podStartE2EDuration="37.813795044s" podCreationTimestamp="2026-05-28 17:16:54 +0000 UTC" firstStartedPulling="2026-05-28 17:16:57.389228375 +0000 UTC m=+3.365032711" lastFinishedPulling="2026-05-28 17:17:28.517923987 +0000 UTC m=+34.493728329" observedRunningTime="2026-05-28 17:17:31.812404399 +0000 UTC m=+37.788208756" watchObservedRunningTime="2026-05-28 17:17:31.813795044 +0000 UTC m=+37.789599400"
May 28 17:17:35.742231 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:35.742193    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls\") pod \"dns-default-mxnl2\" (UID: \"5d302957-1a7b-4109-92da-0c0d90325f4d\") " pod="openshift-dns/dns-default-mxnl2"
May 28 17:17:35.742661 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:35.742267    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:35.742661 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:35.742367    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:17:35.742661 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:35.742386    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 17:17:35.742661 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:35.742398    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c59656557-t2h5w: secret "image-registry-tls" not found
May 28 17:17:35.742661 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:35.742431    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls podName:5d302957-1a7b-4109-92da-0c0d90325f4d nodeName:}" failed. No retries permitted until 2026-05-28 17:17:43.742416234 +0000 UTC m=+49.718220569 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls") pod "dns-default-mxnl2" (UID: "5d302957-1a7b-4109-92da-0c0d90325f4d") : secret "dns-default-metrics-tls" not found
May 28 17:17:35.742661 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:35.742445    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls podName:db344c52-f4e9-4191-9b75-ce2a278c6841 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:43.742439568 +0000 UTC m=+49.718243901 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls") pod "image-registry-7c59656557-t2h5w" (UID: "db344c52-f4e9-4191-9b75-ce2a278c6841") : secret "image-registry-tls" not found
May 28 17:17:35.843488 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:35.843457    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert\") pod \"ingress-canary-ldxgl\" (UID: \"f3232f85-3d97-44a7-8d4c-42687b88d50f\") " pod="openshift-ingress-canary/ingress-canary-ldxgl"
May 28 17:17:35.843629 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:35.843586    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:17:35.843671 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:35.843639    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert podName:f3232f85-3d97-44a7-8d4c-42687b88d50f nodeName:}" failed. No retries permitted until 2026-05-28 17:17:43.843624899 +0000 UTC m=+49.819429233 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert") pod "ingress-canary-ldxgl" (UID: "f3232f85-3d97-44a7-8d4c-42687b88d50f") : secret "canary-serving-cert" not found
May 28 17:17:43.801136 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:43.801095    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls\") pod \"dns-default-mxnl2\" (UID: \"5d302957-1a7b-4109-92da-0c0d90325f4d\") " pod="openshift-dns/dns-default-mxnl2"
May 28 17:17:43.801547 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:43.801193    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:43.801547 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:43.801231    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:17:43.801547 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:43.801326    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls podName:5d302957-1a7b-4109-92da-0c0d90325f4d nodeName:}" failed. No retries permitted until 2026-05-28 17:17:59.801296502 +0000 UTC m=+65.777100837 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls") pod "dns-default-mxnl2" (UID: "5d302957-1a7b-4109-92da-0c0d90325f4d") : secret "dns-default-metrics-tls" not found
May 28 17:17:43.801547 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:43.801361    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 17:17:43.801547 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:43.801376    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c59656557-t2h5w: secret "image-registry-tls" not found
May 28 17:17:43.801547 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:43.801430    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls podName:db344c52-f4e9-4191-9b75-ce2a278c6841 nodeName:}" failed. No retries permitted until 2026-05-28 17:17:59.80141763 +0000 UTC m=+65.777221970 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls") pod "image-registry-7c59656557-t2h5w" (UID: "db344c52-f4e9-4191-9b75-ce2a278c6841") : secret "image-registry-tls" not found
May 28 17:17:43.901928 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:43.901889    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert\") pod \"ingress-canary-ldxgl\" (UID: \"f3232f85-3d97-44a7-8d4c-42687b88d50f\") " pod="openshift-ingress-canary/ingress-canary-ldxgl"
May 28 17:17:43.902083 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:43.902046    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:17:43.902127 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:43.902120    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert podName:f3232f85-3d97-44a7-8d4c-42687b88d50f nodeName:}" failed. No retries permitted until 2026-05-28 17:17:59.902105003 +0000 UTC m=+65.877909336 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert") pod "ingress-canary-ldxgl" (UID: "f3232f85-3d97-44a7-8d4c-42687b88d50f") : secret "canary-serving-cert" not found
May 28 17:17:44.103460 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:44.103384    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret\") pod \"global-pull-secret-syncer-h22jp\" (UID: \"9270f234-63b6-44fc-853c-45cf68ef063d\") " pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:44.106431 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:44.106405    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9270f234-63b6-44fc-853c-45cf68ef063d-original-pull-secret\") pod \"global-pull-secret-syncer-h22jp\" (UID: \"9270f234-63b6-44fc-853c-45cf68ef063d\") " pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:44.334946 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:44.334912    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-h22jp"
May 28 17:17:44.500189 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:44.500162    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-h22jp"]
May 28 17:17:44.814079 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:44.814048    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h22jp" event={"ID":"9270f234-63b6-44fc-853c-45cf68ef063d","Type":"ContainerStarted","Data":"9aa10c4007534fdcb8ea51fc987333d36df544fba165789cfff7f3d796ac2a0d"}
May 28 17:17:49.824808 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:49.824774    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-h22jp" event={"ID":"9270f234-63b6-44fc-853c-45cf68ef063d","Type":"ContainerStarted","Data":"d5da8cf9d6a57518995e41d74215e158ef5fdf0d0d4f3ce53b74fffaaee7a516"}
May 28 17:17:49.842588 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:49.842515    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-h22jp" podStartSLOduration=33.495748884 podStartE2EDuration="37.842501233s" podCreationTimestamp="2026-05-28 17:17:12 +0000 UTC" firstStartedPulling="2026-05-28 17:17:44.504828925 +0000 UTC m=+50.480633262" lastFinishedPulling="2026-05-28 17:17:48.851581277 +0000 UTC m=+54.827385611" observedRunningTime="2026-05-28 17:17:49.841552755 +0000 UTC m=+55.817357124" watchObservedRunningTime="2026-05-28 17:17:49.842501233 +0000 UTC m=+55.818305589"
May 28 17:17:52.769817 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:52.769786    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-q4lcb"
May 28 17:17:59.822627 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:59.822588    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:17:59.823113 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:59.822647    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls\") pod \"dns-default-mxnl2\" (UID: \"5d302957-1a7b-4109-92da-0c0d90325f4d\") " pod="openshift-dns/dns-default-mxnl2"
May 28 17:17:59.823113 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:59.822763    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:17:59.823113 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:59.822763    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 17:17:59.823113 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:59.822785    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c59656557-t2h5w: secret "image-registry-tls" not found
May 28 17:17:59.823113 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:59.822818    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls podName:5d302957-1a7b-4109-92da-0c0d90325f4d nodeName:}" failed. No retries permitted until 2026-05-28 17:18:31.822803163 +0000 UTC m=+97.798607497 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls") pod "dns-default-mxnl2" (UID: "5d302957-1a7b-4109-92da-0c0d90325f4d") : secret "dns-default-metrics-tls" not found
May 28 17:17:59.823113 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:59.822830    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls podName:db344c52-f4e9-4191-9b75-ce2a278c6841 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:31.822824964 +0000 UTC m=+97.798629298 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls") pod "image-registry-7c59656557-t2h5w" (UID: "db344c52-f4e9-4191-9b75-ce2a278c6841") : secret "image-registry-tls" not found
May 28 17:17:59.923443 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:17:59.923402    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert\") pod \"ingress-canary-ldxgl\" (UID: \"f3232f85-3d97-44a7-8d4c-42687b88d50f\") " pod="openshift-ingress-canary/ingress-canary-ldxgl"
May 28 17:17:59.923605 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:59.923544    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:17:59.923651 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:17:59.923612    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert podName:f3232f85-3d97-44a7-8d4c-42687b88d50f nodeName:}" failed. No retries permitted until 2026-05-28 17:18:31.923596787 +0000 UTC m=+97.899401121 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert") pod "ingress-canary-ldxgl" (UID: "f3232f85-3d97-44a7-8d4c-42687b88d50f") : secret "canary-serving-cert" not found
May 28 17:18:00.427527 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:00.427491    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m99gk\" (UniqueName: \"kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk\") pod \"network-check-target-wg777\" (UID: \"dde1c12c-f6e7-4715-a1df-6bdb3f905c35\") " pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:18:00.427686 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:00.427554    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs\") pod \"network-metrics-daemon-jqgk7\" (UID: \"a2131092-689a-4370-bea0-90a62c5af33a\") " pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:18:00.430224 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:00.430207    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 28 17:18:00.430341 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:00.430303    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 28 17:18:00.438153 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:00.438121    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 28 17:18:00.438248 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:00.438200    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs podName:a2131092-689a-4370-bea0-90a62c5af33a nodeName:}" failed. No retries permitted until 2026-05-28 17:19:04.438178657 +0000 UTC m=+130.413982991 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs") pod "network-metrics-daemon-jqgk7" (UID: "a2131092-689a-4370-bea0-90a62c5af33a") : secret "metrics-daemon-secret" not found
May 28 17:18:00.440011 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:00.439997    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 28 17:18:00.450558 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:00.450537    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m99gk\" (UniqueName: \"kubernetes.io/projected/dde1c12c-f6e7-4715-a1df-6bdb3f905c35-kube-api-access-m99gk\") pod \"network-check-target-wg777\" (UID: \"dde1c12c-f6e7-4715-a1df-6bdb3f905c35\") " pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:18:00.742885 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:00.742787    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rjfcr\""
May 28 17:18:00.750324 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:00.750286    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:18:00.871578 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:00.871545    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-wg777"]
May 28 17:18:00.875022 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:18:00.874996    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddde1c12c_f6e7_4715_a1df_6bdb3f905c35.slice/crio-7420b1403f02a307e02683dc54fb44bafefe9a32eef2c06226782e74e8760bd6 WatchSource:0}: Error finding container 7420b1403f02a307e02683dc54fb44bafefe9a32eef2c06226782e74e8760bd6: Status 404 returned error can't find the container with id 7420b1403f02a307e02683dc54fb44bafefe9a32eef2c06226782e74e8760bd6
May 28 17:18:01.849884 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:01.849835    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wg777" event={"ID":"dde1c12c-f6e7-4715-a1df-6bdb3f905c35","Type":"ContainerStarted","Data":"7420b1403f02a307e02683dc54fb44bafefe9a32eef2c06226782e74e8760bd6"}
May 28 17:18:03.855121 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:03.855088    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-wg777" event={"ID":"dde1c12c-f6e7-4715-a1df-6bdb3f905c35","Type":"ContainerStarted","Data":"09460ed2a3d26714b926ab4438a22c5f32ed56761138496c20b8eecc33b98daa"}
May 28 17:18:03.855489 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:03.855275    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:18:03.874210 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:03.874168    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-wg777" podStartSLOduration=67.060102348 podStartE2EDuration="1m9.874154214s" podCreationTimestamp="2026-05-28 17:16:54 +0000 UTC" firstStartedPulling="2026-05-28 17:18:00.877048015 +0000 UTC m=+66.852852348" lastFinishedPulling="2026-05-28 17:18:03.691099866 +0000 UTC m=+69.666904214" observedRunningTime="2026-05-28 17:18:03.872913176 +0000 UTC m=+69.848717532" watchObservedRunningTime="2026-05-28 17:18:03.874154214 +0000 UTC m=+69.849958570"
May 28 17:18:25.861014 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:25.860985    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8"]
May 28 17:18:25.863231 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:25.863214    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8"
May 28 17:18:25.865887 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:25.865862    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 28 17:18:25.866008 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:25.865865    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 28 17:18:25.866739 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:25.866714    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cwlmn\""
May 28 17:18:25.866814 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:25.866780    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 28 17:18:25.867829 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:25.867811    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 28 17:18:25.873319 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:25.873285    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8"]
May 28 17:18:25.967194 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:25.967167    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-4hs87"]
May 28 17:18:25.968700 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:25.968685    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-4hs87"
May 28 17:18:25.970964 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:25.970942    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 28 17:18:25.970964 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:25.970943    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 28 17:18:25.971148 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:25.971083    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 28 17:18:25.971206 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:25.971193    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-chc2t\""
May 28 17:18:25.971297 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:25.971281    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 28 17:18:25.976976 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:25.976959    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 28 17:18:25.979182 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:25.979160    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-4hs87"]
May 28 17:18:26.010321 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.010283    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-p7nm8\" (UID: \"c1c60c5b-c157-4f36-b9fd-39d824c6bb11\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8"
May 28 17:18:26.010407 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.010376    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sjkgr\" (UniqueName: \"kubernetes.io/projected/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-kube-api-access-sjkgr\") pod \"cluster-monitoring-operator-6c75959455-p7nm8\" (UID: \"c1c60c5b-c157-4f36-b9fd-39d824c6bb11\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8"
May 28 17:18:26.010447 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.010433    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-p7nm8\" (UID: \"c1c60c5b-c157-4f36-b9fd-39d824c6bb11\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8"
May 28 17:18:26.111621 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.111575    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d9190bc-9f04-4ee4-a71d-3d44eda9abf9-service-ca-bundle\") pod \"insights-operator-78bdfb888c-4hs87\" (UID: \"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9\") " pod="openshift-insights/insights-operator-78bdfb888c-4hs87"
May 28 17:18:26.111621 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.111610    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8knlv\" (UniqueName: \"kubernetes.io/projected/9d9190bc-9f04-4ee4-a71d-3d44eda9abf9-kube-api-access-8knlv\") pod \"insights-operator-78bdfb888c-4hs87\" (UID: \"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9\") " pod="openshift-insights/insights-operator-78bdfb888c-4hs87"
May 28 17:18:26.111715 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.111639    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d9190bc-9f04-4ee4-a71d-3d44eda9abf9-serving-cert\") pod \"insights-operator-78bdfb888c-4hs87\" (UID: \"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9\") " pod="openshift-insights/insights-operator-78bdfb888c-4hs87"
May 28 17:18:26.111715 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.111678    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d9190bc-9f04-4ee4-a71d-3d44eda9abf9-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-4hs87\" (UID: \"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9\") " pod="openshift-insights/insights-operator-78bdfb888c-4hs87"
May 28 17:18:26.111715 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.111712    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d9190bc-9f04-4ee4-a71d-3d44eda9abf9-tmp\") pod \"insights-operator-78bdfb888c-4hs87\" (UID: \"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9\") " pod="openshift-insights/insights-operator-78bdfb888c-4hs87"
May 28 17:18:26.111809 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.111736    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sjkgr\" (UniqueName: \"kubernetes.io/projected/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-kube-api-access-sjkgr\") pod \"cluster-monitoring-operator-6c75959455-p7nm8\" (UID: \"c1c60c5b-c157-4f36-b9fd-39d824c6bb11\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8"
May 28 17:18:26.111809 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.111763    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-p7nm8\" (UID: \"c1c60c5b-c157-4f36-b9fd-39d824c6bb11\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8"
May 28 17:18:26.111809 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.111795    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-p7nm8\" (UID: \"c1c60c5b-c157-4f36-b9fd-39d824c6bb11\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8"
May 28 17:18:26.111923 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.111816    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9d9190bc-9f04-4ee4-a71d-3d44eda9abf9-snapshots\") pod \"insights-operator-78bdfb888c-4hs87\" (UID: \"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9\") " pod="openshift-insights/insights-operator-78bdfb888c-4hs87"
May 28 17:18:26.111923 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:26.111891    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 17:18:26.111987 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:26.111934    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls podName:c1c60c5b-c157-4f36-b9fd-39d824c6bb11 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:26.611920472 +0000 UTC m=+92.587724811 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-p7nm8" (UID: "c1c60c5b-c157-4f36-b9fd-39d824c6bb11") : secret "cluster-monitoring-operator-tls" not found
May 28 17:18:26.112400 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.112385    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-p7nm8\" (UID: \"c1c60c5b-c157-4f36-b9fd-39d824c6bb11\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8"
May 28 17:18:26.120632 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.120609    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sjkgr\" (UniqueName: \"kubernetes.io/projected/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-kube-api-access-sjkgr\") pod \"cluster-monitoring-operator-6c75959455-p7nm8\" (UID: \"c1c60c5b-c157-4f36-b9fd-39d824c6bb11\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8"
May 28 17:18:26.213086 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.213064    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9d9190bc-9f04-4ee4-a71d-3d44eda9abf9-snapshots\") pod \"insights-operator-78bdfb888c-4hs87\" (UID: \"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9\") " pod="openshift-insights/insights-operator-78bdfb888c-4hs87"
May 28 17:18:26.213167 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.213102    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d9190bc-9f04-4ee4-a71d-3d44eda9abf9-service-ca-bundle\") pod \"insights-operator-78bdfb888c-4hs87\" (UID: \"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9\") " pod="openshift-insights/insights-operator-78bdfb888c-4hs87"
May 28 17:18:26.213167 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.213129    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8knlv\" (UniqueName: \"kubernetes.io/projected/9d9190bc-9f04-4ee4-a71d-3d44eda9abf9-kube-api-access-8knlv\") pod \"insights-operator-78bdfb888c-4hs87\" (UID: \"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9\") " pod="openshift-insights/insights-operator-78bdfb888c-4hs87"
May 28 17:18:26.213167 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.213148    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d9190bc-9f04-4ee4-a71d-3d44eda9abf9-serving-cert\") pod \"insights-operator-78bdfb888c-4hs87\" (UID: \"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9\") " pod="openshift-insights/insights-operator-78bdfb888c-4hs87"
May 28 17:18:26.213167 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.213165    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d9190bc-9f04-4ee4-a71d-3d44eda9abf9-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-4hs87\" (UID: \"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9\") " pod="openshift-insights/insights-operator-78bdfb888c-4hs87"
May 28 17:18:26.213386 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.213200    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d9190bc-9f04-4ee4-a71d-3d44eda9abf9-tmp\") pod \"insights-operator-78bdfb888c-4hs87\" (UID: \"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9\") " pod="openshift-insights/insights-operator-78bdfb888c-4hs87"
May 28 17:18:26.213704 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.213683    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d9190bc-9f04-4ee4-a71d-3d44eda9abf9-service-ca-bundle\") pod \"insights-operator-78bdfb888c-4hs87\" (UID: \"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9\") " pod="openshift-insights/insights-operator-78bdfb888c-4hs87"
May 28 17:18:26.213763 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.213720    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9d9190bc-9f04-4ee4-a71d-3d44eda9abf9-tmp\") pod \"insights-operator-78bdfb888c-4hs87\" (UID: \"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9\") " pod="openshift-insights/insights-operator-78bdfb888c-4hs87"
May 28 17:18:26.213799 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.213767    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9d9190bc-9f04-4ee4-a71d-3d44eda9abf9-snapshots\") pod \"insights-operator-78bdfb888c-4hs87\" (UID: \"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9\") " pod="openshift-insights/insights-operator-78bdfb888c-4hs87"
May 28 17:18:26.214042 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.214026    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9d9190bc-9f04-4ee4-a71d-3d44eda9abf9-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-4hs87\" (UID: \"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9\") " pod="openshift-insights/insights-operator-78bdfb888c-4hs87"
May 28 17:18:26.215320 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.215286    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9d9190bc-9f04-4ee4-a71d-3d44eda9abf9-serving-cert\") pod \"insights-operator-78bdfb888c-4hs87\" (UID: \"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9\") " pod="openshift-insights/insights-operator-78bdfb888c-4hs87"
May 28 17:18:26.221352 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.221334    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8knlv\" (UniqueName: \"kubernetes.io/projected/9d9190bc-9f04-4ee4-a71d-3d44eda9abf9-kube-api-access-8knlv\") pod \"insights-operator-78bdfb888c-4hs87\" (UID: \"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9\") " pod="openshift-insights/insights-operator-78bdfb888c-4hs87"
May 28 17:18:26.277926 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.277905    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-4hs87"
May 28 17:18:26.397519 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.397451    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-4hs87"]
May 28 17:18:26.400714 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:18:26.400685    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d9190bc_9f04_4ee4_a71d_3d44eda9abf9.slice/crio-008909573b7ebc17c0644ccefc77771c10bcbfd5c92c9aa71999c65cbd35be71 WatchSource:0}: Error finding container 008909573b7ebc17c0644ccefc77771c10bcbfd5c92c9aa71999c65cbd35be71: Status 404 returned error can't find the container with id 008909573b7ebc17c0644ccefc77771c10bcbfd5c92c9aa71999c65cbd35be71
May 28 17:18:26.616585 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.616538    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-p7nm8\" (UID: \"c1c60c5b-c157-4f36-b9fd-39d824c6bb11\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8"
May 28 17:18:26.616769 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:26.616694    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 17:18:26.616819 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:26.616772    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls podName:c1c60c5b-c157-4f36-b9fd-39d824c6bb11 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:27.616756559 +0000 UTC m=+93.592560893 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-p7nm8" (UID: "c1c60c5b-c157-4f36-b9fd-39d824c6bb11") : secret "cluster-monitoring-operator-tls" not found
May 28 17:18:26.899785 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:26.899748    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-4hs87" event={"ID":"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9","Type":"ContainerStarted","Data":"008909573b7ebc17c0644ccefc77771c10bcbfd5c92c9aa71999c65cbd35be71"}
May 28 17:18:27.622865 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:27.622828    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-p7nm8\" (UID: \"c1c60c5b-c157-4f36-b9fd-39d824c6bb11\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8"
May 28 17:18:27.623020 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:27.623003    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 17:18:27.623108 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:27.623095    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls podName:c1c60c5b-c157-4f36-b9fd-39d824c6bb11 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:29.623072691 +0000 UTC m=+95.598877027 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-p7nm8" (UID: "c1c60c5b-c157-4f36-b9fd-39d824c6bb11") : secret "cluster-monitoring-operator-tls" not found
May 28 17:18:28.904643 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:28.904606    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-4hs87" event={"ID":"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9","Type":"ContainerStarted","Data":"b3cda4a83e6ebb837ef1230f891cdd32c3a9370b6e3b6c46ee9c94991391c5f8"}
May 28 17:18:28.923620 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:28.923575    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-4hs87" podStartSLOduration=1.825074051 podStartE2EDuration="3.923561954s" podCreationTimestamp="2026-05-28 17:18:25 +0000 UTC" firstStartedPulling="2026-05-28 17:18:26.40245723 +0000 UTC m=+92.378261564" lastFinishedPulling="2026-05-28 17:18:28.500945131 +0000 UTC m=+94.476749467" observedRunningTime="2026-05-28 17:18:28.922008992 +0000 UTC m=+94.897813353" watchObservedRunningTime="2026-05-28 17:18:28.923561954 +0000 UTC m=+94.899366310"
May 28 17:18:29.639943 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:29.639903    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-p7nm8\" (UID: \"c1c60c5b-c157-4f36-b9fd-39d824c6bb11\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8"
May 28 17:18:29.640142 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:29.640064    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 17:18:29.640217 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:29.640161    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls podName:c1c60c5b-c157-4f36-b9fd-39d824c6bb11 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:33.640139208 +0000 UTC m=+99.615943547 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-p7nm8" (UID: "c1c60c5b-c157-4f36-b9fd-39d824c6bb11") : secret "cluster-monitoring-operator-tls" not found
May 28 17:18:29.863470 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:29.863431    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-tp7ql"]
May 28 17:18:29.866626 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:29.866611    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tp7ql"
May 28 17:18:29.868982 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:29.868955    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
May 28 17:18:29.869098 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:29.868964    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
May 28 17:18:29.869098 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:29.868963    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
May 28 17:18:29.869098 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:29.869079    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-gw8s8\""
May 28 17:18:29.876031 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:29.876008    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-tp7ql"]
May 28 17:18:29.943246 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:29.943158    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tghvs\" (UniqueName: \"kubernetes.io/projected/f23cf658-52c4-45f6-96ee-071473af2d14-kube-api-access-tghvs\") pod \"cluster-samples-operator-697587599-tp7ql\" (UID: \"f23cf658-52c4-45f6-96ee-071473af2d14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tp7ql"
May 28 17:18:29.943246 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:29.943197    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f23cf658-52c4-45f6-96ee-071473af2d14-samples-operator-tls\") pod \"cluster-samples-operator-697587599-tp7ql\" (UID: \"f23cf658-52c4-45f6-96ee-071473af2d14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tp7ql"
May 28 17:18:30.044705 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:30.044663    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tghvs\" (UniqueName: \"kubernetes.io/projected/f23cf658-52c4-45f6-96ee-071473af2d14-kube-api-access-tghvs\") pod \"cluster-samples-operator-697587599-tp7ql\" (UID: \"f23cf658-52c4-45f6-96ee-071473af2d14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tp7ql"
May 28 17:18:30.044889 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:30.044731    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f23cf658-52c4-45f6-96ee-071473af2d14-samples-operator-tls\") pod \"cluster-samples-operator-697587599-tp7ql\" (UID: \"f23cf658-52c4-45f6-96ee-071473af2d14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tp7ql"
May 28 17:18:30.044967 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:30.044913    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 17:18:30.045028 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:30.044975    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f23cf658-52c4-45f6-96ee-071473af2d14-samples-operator-tls podName:f23cf658-52c4-45f6-96ee-071473af2d14 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:30.544956752 +0000 UTC m=+96.520761093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f23cf658-52c4-45f6-96ee-071473af2d14-samples-operator-tls") pod "cluster-samples-operator-697587599-tp7ql" (UID: "f23cf658-52c4-45f6-96ee-071473af2d14") : secret "samples-operator-tls" not found
May 28 17:18:30.054779 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:30.054750    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tghvs\" (UniqueName: \"kubernetes.io/projected/f23cf658-52c4-45f6-96ee-071473af2d14-kube-api-access-tghvs\") pod \"cluster-samples-operator-697587599-tp7ql\" (UID: \"f23cf658-52c4-45f6-96ee-071473af2d14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tp7ql"
May 28 17:18:30.548935 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:30.548902    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f23cf658-52c4-45f6-96ee-071473af2d14-samples-operator-tls\") pod \"cluster-samples-operator-697587599-tp7ql\" (UID: \"f23cf658-52c4-45f6-96ee-071473af2d14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tp7ql"
May 28 17:18:30.549099 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:30.549076    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 17:18:30.549166 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:30.549151    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f23cf658-52c4-45f6-96ee-071473af2d14-samples-operator-tls podName:f23cf658-52c4-45f6-96ee-071473af2d14 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:31.549135732 +0000 UTC m=+97.524940071 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f23cf658-52c4-45f6-96ee-071473af2d14-samples-operator-tls") pod "cluster-samples-operator-697587599-tp7ql" (UID: "f23cf658-52c4-45f6-96ee-071473af2d14") : secret "samples-operator-tls" not found
May 28 17:18:31.557576 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:31.557524    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f23cf658-52c4-45f6-96ee-071473af2d14-samples-operator-tls\") pod \"cluster-samples-operator-697587599-tp7ql\" (UID: \"f23cf658-52c4-45f6-96ee-071473af2d14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tp7ql"
May 28 17:18:31.558087 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:31.557688    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 17:18:31.558087 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:31.557754    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f23cf658-52c4-45f6-96ee-071473af2d14-samples-operator-tls podName:f23cf658-52c4-45f6-96ee-071473af2d14 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:33.557736716 +0000 UTC m=+99.533541066 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f23cf658-52c4-45f6-96ee-071473af2d14-samples-operator-tls") pod "cluster-samples-operator-697587599-tp7ql" (UID: "f23cf658-52c4-45f6-96ee-071473af2d14") : secret "samples-operator-tls" not found
May 28 17:18:31.859132 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:31.859058    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-qdkvs"]
May 28 17:18:31.860296 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:31.860273    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls\") pod \"image-registry-7c59656557-t2h5w\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") " pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:18:31.860446 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:31.860426    2556 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 28 17:18:31.860481 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:31.860451    2556 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7c59656557-t2h5w: secret "image-registry-tls" not found
May 28 17:18:31.860481 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:31.860461    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls\") pod \"dns-default-mxnl2\" (UID: \"5d302957-1a7b-4109-92da-0c0d90325f4d\") " pod="openshift-dns/dns-default-mxnl2"
May 28 17:18:31.860547 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:31.860504    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls podName:db344c52-f4e9-4191-9b75-ce2a278c6841 nodeName:}" failed. No retries permitted until 2026-05-28 17:19:35.860487448 +0000 UTC m=+161.836291782 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls") pod "image-registry-7c59656557-t2h5w" (UID: "db344c52-f4e9-4191-9b75-ce2a278c6841") : secret "image-registry-tls" not found
May 28 17:18:31.860586 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:31.860553    2556 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 28 17:18:31.860618 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:31.860595    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls podName:5d302957-1a7b-4109-92da-0c0d90325f4d nodeName:}" failed. No retries permitted until 2026-05-28 17:19:35.860583499 +0000 UTC m=+161.836387856 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls") pod "dns-default-mxnl2" (UID: "5d302957-1a7b-4109-92da-0c0d90325f4d") : secret "dns-default-metrics-tls" not found
May 28 17:18:31.861922 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:31.861898    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-qdkvs"
May 28 17:18:31.864179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:31.864150    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 28 17:18:31.864324 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:31.864208    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 28 17:18:31.865088 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:31.865068    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 28 17:18:31.865088 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:31.865072    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vh99t\""
May 28 17:18:31.865223 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:31.865116    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 28 17:18:31.869220 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:31.869205    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 28 17:18:31.873519 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:31.873499    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-qdkvs"]
May 28 17:18:31.961758 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:31.961717    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86dc3fc1-6d7c-4dec-b9b3-7197fa551e87-trusted-ca\") pod \"console-operator-76dff48d59-qdkvs\" (UID: \"86dc3fc1-6d7c-4dec-b9b3-7197fa551e87\") " pod="openshift-console-operator/console-operator-76dff48d59-qdkvs"
May 28 17:18:31.961758 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:31.961765    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/86dc3fc1-6d7c-4dec-b9b3-7197fa551e87-config\") pod \"console-operator-76dff48d59-qdkvs\" (UID: \"86dc3fc1-6d7c-4dec-b9b3-7197fa551e87\") " pod="openshift-console-operator/console-operator-76dff48d59-qdkvs"
May 28 17:18:31.961921 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:31.961869    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9c58\" (UniqueName: \"kubernetes.io/projected/86dc3fc1-6d7c-4dec-b9b3-7197fa551e87-kube-api-access-w9c58\") pod \"console-operator-76dff48d59-qdkvs\" (UID: \"86dc3fc1-6d7c-4dec-b9b3-7197fa551e87\") " pod="openshift-console-operator/console-operator-76dff48d59-qdkvs"
May 28 17:18:31.961921 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:31.961916    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert\") pod \"ingress-canary-ldxgl\" (UID: \"f3232f85-3d97-44a7-8d4c-42687b88d50f\") " pod="openshift-ingress-canary/ingress-canary-ldxgl"
May 28 17:18:31.961987 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:31.961941    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86dc3fc1-6d7c-4dec-b9b3-7197fa551e87-serving-cert\") pod \"console-operator-76dff48d59-qdkvs\" (UID: \"86dc3fc1-6d7c-4dec-b9b3-7197fa551e87\") " pod="openshift-console-operator/console-operator-76dff48d59-qdkvs"
May 28 17:18:31.962027 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:31.962013    2556 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 28 17:18:31.962074 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:31.962065    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert podName:f3232f85-3d97-44a7-8d4c-42687b88d50f nodeName:}" failed. No retries permitted until 2026-05-28 17:19:35.9620526 +0000 UTC m=+161.937856939 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert") pod "ingress-canary-ldxgl" (UID: "f3232f85-3d97-44a7-8d4c-42687b88d50f") : secret "canary-serving-cert" not found
May 28 17:18:32.063297 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:32.063246    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w9c58\" (UniqueName: \"kubernetes.io/projected/86dc3fc1-6d7c-4dec-b9b3-7197fa551e87-kube-api-access-w9c58\") pod \"console-operator-76dff48d59-qdkvs\" (UID: \"86dc3fc1-6d7c-4dec-b9b3-7197fa551e87\") " pod="openshift-console-operator/console-operator-76dff48d59-qdkvs"
May 28 17:18:32.063508 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:32.063351    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86dc3fc1-6d7c-4dec-b9b3-7197fa551e87-serving-cert\") pod \"console-operator-76dff48d59-qdkvs\" (UID: \"86dc3fc1-6d7c-4dec-b9b3-7197fa551e87\") " pod="openshift-console-operator/console-operator-76dff48d59-qdkvs"
May 28 17:18:32.063508 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:32.063409    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86dc3fc1-6d7c-4dec-b9b3-7197fa551e87-trusted-ca\") pod \"console-operator-76dff48d59-qdkvs\" (UID: \"86dc3fc1-6d7c-4dec-b9b3-7197fa551e87\") " pod="openshift-console-operator/console-operator-76dff48d59-qdkvs"
May 28 17:18:32.063508 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:32.063440    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/86dc3fc1-6d7c-4dec-b9b3-7197fa551e87-config\") pod \"console-operator-76dff48d59-qdkvs\" (UID: \"86dc3fc1-6d7c-4dec-b9b3-7197fa551e87\") " pod="openshift-console-operator/console-operator-76dff48d59-qdkvs"
May 28 17:18:32.064113 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:32.064089    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/86dc3fc1-6d7c-4dec-b9b3-7197fa551e87-config\") pod \"console-operator-76dff48d59-qdkvs\" (UID: \"86dc3fc1-6d7c-4dec-b9b3-7197fa551e87\") " pod="openshift-console-operator/console-operator-76dff48d59-qdkvs"
May 28 17:18:32.064438 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:32.064421    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/86dc3fc1-6d7c-4dec-b9b3-7197fa551e87-trusted-ca\") pod \"console-operator-76dff48d59-qdkvs\" (UID: \"86dc3fc1-6d7c-4dec-b9b3-7197fa551e87\") " pod="openshift-console-operator/console-operator-76dff48d59-qdkvs"
May 28 17:18:32.065673 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:32.065653    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/86dc3fc1-6d7c-4dec-b9b3-7197fa551e87-serving-cert\") pod \"console-operator-76dff48d59-qdkvs\" (UID: \"86dc3fc1-6d7c-4dec-b9b3-7197fa551e87\") " pod="openshift-console-operator/console-operator-76dff48d59-qdkvs"
May 28 17:18:32.071770 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:32.071748    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9c58\" (UniqueName: \"kubernetes.io/projected/86dc3fc1-6d7c-4dec-b9b3-7197fa551e87-kube-api-access-w9c58\") pod \"console-operator-76dff48d59-qdkvs\" (UID: \"86dc3fc1-6d7c-4dec-b9b3-7197fa551e87\") " pod="openshift-console-operator/console-operator-76dff48d59-qdkvs"
May 28 17:18:32.170764 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:32.170682    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-qdkvs"
May 28 17:18:32.290120 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:32.290072    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-qdkvs"]
May 28 17:18:32.293431 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:18:32.293403    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86dc3fc1_6d7c_4dec_b9b3_7197fa551e87.slice/crio-962c1ab9f9b91a6312adf8541ae1946533c5041e6864eaf986fbd6bbecbfc22c WatchSource:0}: Error finding container 962c1ab9f9b91a6312adf8541ae1946533c5041e6864eaf986fbd6bbecbfc22c: Status 404 returned error can't find the container with id 962c1ab9f9b91a6312adf8541ae1946533c5041e6864eaf986fbd6bbecbfc22c
May 28 17:18:32.489154 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:32.489083    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hhc9v_7044d69e-088f-4778-9f23-833010990847/dns-node-resolver/0.log"
May 28 17:18:32.913299 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:32.913256    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-qdkvs" event={"ID":"86dc3fc1-6d7c-4dec-b9b3-7197fa551e87","Type":"ContainerStarted","Data":"962c1ab9f9b91a6312adf8541ae1946533c5041e6864eaf986fbd6bbecbfc22c"}
May 28 17:18:33.085262 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:33.085234    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4lf2r_21807015-9b41-44d2-aae3-21e5e93a8986/node-ca/0.log"
May 28 17:18:33.576041 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:33.576005    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f23cf658-52c4-45f6-96ee-071473af2d14-samples-operator-tls\") pod \"cluster-samples-operator-697587599-tp7ql\" (UID: \"f23cf658-52c4-45f6-96ee-071473af2d14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tp7ql"
May 28 17:18:33.576223 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:33.576135    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 17:18:33.576223 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:33.576201    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f23cf658-52c4-45f6-96ee-071473af2d14-samples-operator-tls podName:f23cf658-52c4-45f6-96ee-071473af2d14 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:37.576180074 +0000 UTC m=+103.551984411 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f23cf658-52c4-45f6-96ee-071473af2d14-samples-operator-tls") pod "cluster-samples-operator-697587599-tp7ql" (UID: "f23cf658-52c4-45f6-96ee-071473af2d14") : secret "samples-operator-tls" not found
May 28 17:18:33.677287 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:33.677245    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-p7nm8\" (UID: \"c1c60c5b-c157-4f36-b9fd-39d824c6bb11\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8"
May 28 17:18:33.677485 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:33.677431    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 17:18:33.677550 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:33.677510    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls podName:c1c60c5b-c157-4f36-b9fd-39d824c6bb11 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:41.677489968 +0000 UTC m=+107.653294319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-p7nm8" (UID: "c1c60c5b-c157-4f36-b9fd-39d824c6bb11") : secret "cluster-monitoring-operator-tls" not found
May 28 17:18:33.916989 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:33.916951    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-qdkvs" event={"ID":"86dc3fc1-6d7c-4dec-b9b3-7197fa551e87","Type":"ContainerStarted","Data":"b874454a831a334d14896a43e0bd31abc83ebc80edaa66ec9584cc59329d4659"}
May 28 17:18:33.917384 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:33.917148    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-qdkvs"
May 28 17:18:33.918982 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:33.918662    2556 patch_prober.go:28] interesting pod/console-operator-76dff48d59-qdkvs container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.12:8443/readyz\": dial tcp 10.132.0.12:8443: connect: connection refused" start-of-body=
May 28 17:18:33.918982 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:33.918715    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-76dff48d59-qdkvs" podUID="86dc3fc1-6d7c-4dec-b9b3-7197fa551e87" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.12:8443/readyz\": dial tcp 10.132.0.12:8443: connect: connection refused"
May 28 17:18:33.935462 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:33.935406    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-qdkvs" podStartSLOduration=1.399860844 podStartE2EDuration="2.93538488s" podCreationTimestamp="2026-05-28 17:18:31 +0000 UTC" firstStartedPulling="2026-05-28 17:18:32.295508578 +0000 UTC m=+98.271312915" lastFinishedPulling="2026-05-28 17:18:33.831032603 +0000 UTC m=+99.806836951" observedRunningTime="2026-05-28 17:18:33.93383621 +0000 UTC m=+99.909640567" watchObservedRunningTime="2026-05-28 17:18:33.93538488 +0000 UTC m=+99.911189238"
May 28 17:18:34.858982 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:34.858954    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-wg777"
May 28 17:18:34.920384 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:34.920354    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/0.log"
May 28 17:18:34.920816 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:34.920393    2556 generic.go:358] "Generic (PLEG): container finished" podID="86dc3fc1-6d7c-4dec-b9b3-7197fa551e87" containerID="b874454a831a334d14896a43e0bd31abc83ebc80edaa66ec9584cc59329d4659" exitCode=255
May 28 17:18:34.920816 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:34.920452    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-qdkvs" event={"ID":"86dc3fc1-6d7c-4dec-b9b3-7197fa551e87","Type":"ContainerDied","Data":"b874454a831a334d14896a43e0bd31abc83ebc80edaa66ec9584cc59329d4659"}
May 28 17:18:34.920816 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:34.920694    2556 scope.go:117] "RemoveContainer" containerID="b874454a831a334d14896a43e0bd31abc83ebc80edaa66ec9584cc59329d4659"
May 28 17:18:35.853613 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.853585    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-7bknv"]
May 28 17:18:35.855432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.855416    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-7bknv"
May 28 17:18:35.857790 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.857766    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 28 17:18:35.857915 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.857775    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 28 17:18:35.857983 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.857903    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 28 17:18:35.858709 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.858670    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-pd8p8\""
May 28 17:18:35.858709 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.858679    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 28 17:18:35.866101 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.866081    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-7bknv"]
May 28 17:18:35.924087 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.924060    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/1.log"
May 28 17:18:35.924519 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.924470    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/0.log"
May 28 17:18:35.924519 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.924508    2556 generic.go:358] "Generic (PLEG): container finished" podID="86dc3fc1-6d7c-4dec-b9b3-7197fa551e87" containerID="a9f076c092f211bfe68c3b1956416f66d5ac9d1011dd9cf21c648c1f7e25ce1b" exitCode=255
May 28 17:18:35.924627 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.924565    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-qdkvs" event={"ID":"86dc3fc1-6d7c-4dec-b9b3-7197fa551e87","Type":"ContainerDied","Data":"a9f076c092f211bfe68c3b1956416f66d5ac9d1011dd9cf21c648c1f7e25ce1b"}
May 28 17:18:35.924627 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.924607    2556 scope.go:117] "RemoveContainer" containerID="b874454a831a334d14896a43e0bd31abc83ebc80edaa66ec9584cc59329d4659"
May 28 17:18:35.924778 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.924765    2556 scope.go:117] "RemoveContainer" containerID="a9f076c092f211bfe68c3b1956416f66d5ac9d1011dd9cf21c648c1f7e25ce1b"
May 28 17:18:35.924966 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:35.924949    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-qdkvs_openshift-console-operator(86dc3fc1-6d7c-4dec-b9b3-7197fa551e87)\"" pod="openshift-console-operator/console-operator-76dff48d59-qdkvs" podUID="86dc3fc1-6d7c-4dec-b9b3-7197fa551e87"
May 28 17:18:35.958144 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.958111    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-q85pl"]
May 28 17:18:35.960113 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.960098    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-q85pl"
May 28 17:18:35.962503 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.962475    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 28 17:18:35.962503 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.962480    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 28 17:18:35.962664 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.962498    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 28 17:18:35.962911 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.962897    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 28 17:18:35.962966 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.962932    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-9p8w8\""
May 28 17:18:35.968545 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.968525    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-q85pl"]
May 28 17:18:35.997112 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.997082    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/381b3abf-96fb-4c94-896f-a9bc249cb957-config\") pod \"kube-storage-version-migrator-operator-565644f49-7bknv\" (UID: \"381b3abf-96fb-4c94-896f-a9bc249cb957\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-7bknv"
May 28 17:18:35.997260 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.997128    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/381b3abf-96fb-4c94-896f-a9bc249cb957-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-7bknv\" (UID: \"381b3abf-96fb-4c94-896f-a9bc249cb957\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-7bknv"
May 28 17:18:35.997260 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:35.997218    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbt4h\" (UniqueName: \"kubernetes.io/projected/381b3abf-96fb-4c94-896f-a9bc249cb957-kube-api-access-pbt4h\") pod \"kube-storage-version-migrator-operator-565644f49-7bknv\" (UID: \"381b3abf-96fb-4c94-896f-a9bc249cb957\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-7bknv"
May 28 17:18:36.098414 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.098375    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pbt4h\" (UniqueName: \"kubernetes.io/projected/381b3abf-96fb-4c94-896f-a9bc249cb957-kube-api-access-pbt4h\") pod \"kube-storage-version-migrator-operator-565644f49-7bknv\" (UID: \"381b3abf-96fb-4c94-896f-a9bc249cb957\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-7bknv"
May 28 17:18:36.098610 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.098595    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7714f9b-7133-489f-86cb-eac71c7afdc6-serving-cert\") pod \"service-ca-operator-57b5b68b8-q85pl\" (UID: \"d7714f9b-7133-489f-86cb-eac71c7afdc6\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-q85pl"
May 28 17:18:36.098677 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.098656    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7714f9b-7133-489f-86cb-eac71c7afdc6-config\") pod \"service-ca-operator-57b5b68b8-q85pl\" (UID: \"d7714f9b-7133-489f-86cb-eac71c7afdc6\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-q85pl"
May 28 17:18:36.098790 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.098775    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/381b3abf-96fb-4c94-896f-a9bc249cb957-config\") pod \"kube-storage-version-migrator-operator-565644f49-7bknv\" (UID: \"381b3abf-96fb-4c94-896f-a9bc249cb957\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-7bknv"
May 28 17:18:36.098843 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.098824    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8rndw\" (UniqueName: \"kubernetes.io/projected/d7714f9b-7133-489f-86cb-eac71c7afdc6-kube-api-access-8rndw\") pod \"service-ca-operator-57b5b68b8-q85pl\" (UID: \"d7714f9b-7133-489f-86cb-eac71c7afdc6\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-q85pl"
May 28 17:18:36.098919 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.098878    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/381b3abf-96fb-4c94-896f-a9bc249cb957-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-7bknv\" (UID: \"381b3abf-96fb-4c94-896f-a9bc249cb957\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-7bknv"
May 28 17:18:36.099266 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.099246    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/381b3abf-96fb-4c94-896f-a9bc249cb957-config\") pod \"kube-storage-version-migrator-operator-565644f49-7bknv\" (UID: \"381b3abf-96fb-4c94-896f-a9bc249cb957\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-7bknv"
May 28 17:18:36.100987 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.100962    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/381b3abf-96fb-4c94-896f-a9bc249cb957-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-7bknv\" (UID: \"381b3abf-96fb-4c94-896f-a9bc249cb957\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-7bknv"
May 28 17:18:36.107678 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.107619    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbt4h\" (UniqueName: \"kubernetes.io/projected/381b3abf-96fb-4c94-896f-a9bc249cb957-kube-api-access-pbt4h\") pod \"kube-storage-version-migrator-operator-565644f49-7bknv\" (UID: \"381b3abf-96fb-4c94-896f-a9bc249cb957\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-7bknv"
May 28 17:18:36.163396 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.163357    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-7bknv"
May 28 17:18:36.199485 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.199449    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7714f9b-7133-489f-86cb-eac71c7afdc6-serving-cert\") pod \"service-ca-operator-57b5b68b8-q85pl\" (UID: \"d7714f9b-7133-489f-86cb-eac71c7afdc6\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-q85pl"
May 28 17:18:36.199675 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.199501    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7714f9b-7133-489f-86cb-eac71c7afdc6-config\") pod \"service-ca-operator-57b5b68b8-q85pl\" (UID: \"d7714f9b-7133-489f-86cb-eac71c7afdc6\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-q85pl"
May 28 17:18:36.199747 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.199694    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8rndw\" (UniqueName: \"kubernetes.io/projected/d7714f9b-7133-489f-86cb-eac71c7afdc6-kube-api-access-8rndw\") pod \"service-ca-operator-57b5b68b8-q85pl\" (UID: \"d7714f9b-7133-489f-86cb-eac71c7afdc6\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-q85pl"
May 28 17:18:36.200090 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.200064    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/d7714f9b-7133-489f-86cb-eac71c7afdc6-config\") pod \"service-ca-operator-57b5b68b8-q85pl\" (UID: \"d7714f9b-7133-489f-86cb-eac71c7afdc6\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-q85pl"
May 28 17:18:36.201718 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.201689    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d7714f9b-7133-489f-86cb-eac71c7afdc6-serving-cert\") pod \"service-ca-operator-57b5b68b8-q85pl\" (UID: \"d7714f9b-7133-489f-86cb-eac71c7afdc6\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-q85pl"
May 28 17:18:36.209964 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.209941    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8rndw\" (UniqueName: \"kubernetes.io/projected/d7714f9b-7133-489f-86cb-eac71c7afdc6-kube-api-access-8rndw\") pod \"service-ca-operator-57b5b68b8-q85pl\" (UID: \"d7714f9b-7133-489f-86cb-eac71c7afdc6\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-q85pl"
May 28 17:18:36.268606 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.268575    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-q85pl"
May 28 17:18:36.291191 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.288506    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-7bknv"]
May 28 17:18:36.295640 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:18:36.295596    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod381b3abf_96fb_4c94_896f_a9bc249cb957.slice/crio-f527fd33d0013b354b5a6e1774e85fe81fedcbe7da74c791617305d48e87666f WatchSource:0}: Error finding container f527fd33d0013b354b5a6e1774e85fe81fedcbe7da74c791617305d48e87666f: Status 404 returned error can't find the container with id f527fd33d0013b354b5a6e1774e85fe81fedcbe7da74c791617305d48e87666f
May 28 17:18:36.388074 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.387996    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-q85pl"]
May 28 17:18:36.391753 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:18:36.391717    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7714f9b_7133_489f_86cb_eac71c7afdc6.slice/crio-32071238a79ad792b574fb2010e5bf10df5e9d1b160a88a9d1535a4836278fae WatchSource:0}: Error finding container 32071238a79ad792b574fb2010e5bf10df5e9d1b160a88a9d1535a4836278fae: Status 404 returned error can't find the container with id 32071238a79ad792b574fb2010e5bf10df5e9d1b160a88a9d1535a4836278fae
May 28 17:18:36.928509 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.928474    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/1.log"
May 28 17:18:36.928962 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.928896    2556 scope.go:117] "RemoveContainer" containerID="a9f076c092f211bfe68c3b1956416f66d5ac9d1011dd9cf21c648c1f7e25ce1b"
May 28 17:18:36.929145 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:36.929114    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-qdkvs_openshift-console-operator(86dc3fc1-6d7c-4dec-b9b3-7197fa551e87)\"" pod="openshift-console-operator/console-operator-76dff48d59-qdkvs" podUID="86dc3fc1-6d7c-4dec-b9b3-7197fa551e87"
May 28 17:18:36.930043 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.929996    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-7bknv" event={"ID":"381b3abf-96fb-4c94-896f-a9bc249cb957","Type":"ContainerStarted","Data":"f527fd33d0013b354b5a6e1774e85fe81fedcbe7da74c791617305d48e87666f"}
May 28 17:18:36.931027 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:36.930991    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-q85pl" event={"ID":"d7714f9b-7133-489f-86cb-eac71c7afdc6","Type":"ContainerStarted","Data":"32071238a79ad792b574fb2010e5bf10df5e9d1b160a88a9d1535a4836278fae"}
May 28 17:18:37.613602 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:37.613565    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f23cf658-52c4-45f6-96ee-071473af2d14-samples-operator-tls\") pod \"cluster-samples-operator-697587599-tp7ql\" (UID: \"f23cf658-52c4-45f6-96ee-071473af2d14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tp7ql"
May 28 17:18:37.613773 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:37.613683    2556 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
May 28 17:18:37.613773 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:37.613737    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f23cf658-52c4-45f6-96ee-071473af2d14-samples-operator-tls podName:f23cf658-52c4-45f6-96ee-071473af2d14 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:45.613723111 +0000 UTC m=+111.589527444 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/f23cf658-52c4-45f6-96ee-071473af2d14-samples-operator-tls") pod "cluster-samples-operator-697587599-tp7ql" (UID: "f23cf658-52c4-45f6-96ee-071473af2d14") : secret "samples-operator-tls" not found
May 28 17:18:38.539035 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:38.538941    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-x8mrk"]
May 28 17:18:38.542622 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:38.542599    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x8mrk"
May 28 17:18:38.545040 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:38.545018    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qpgtj\""
May 28 17:18:38.554399 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:38.554377    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-x8mrk"]
May 28 17:18:38.723529 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:38.723498    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qn8pn\" (UniqueName: \"kubernetes.io/projected/c7a02f7e-c0ff-46b5-9725-f6e9fe667797-kube-api-access-qn8pn\") pod \"network-check-source-7f44b6dd87-x8mrk\" (UID: \"c7a02f7e-c0ff-46b5-9725-f6e9fe667797\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x8mrk"
May 28 17:18:38.824821 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:38.824794    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qn8pn\" (UniqueName: \"kubernetes.io/projected/c7a02f7e-c0ff-46b5-9725-f6e9fe667797-kube-api-access-qn8pn\") pod \"network-check-source-7f44b6dd87-x8mrk\" (UID: \"c7a02f7e-c0ff-46b5-9725-f6e9fe667797\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x8mrk"
May 28 17:18:38.833640 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:38.833617    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qn8pn\" (UniqueName: \"kubernetes.io/projected/c7a02f7e-c0ff-46b5-9725-f6e9fe667797-kube-api-access-qn8pn\") pod \"network-check-source-7f44b6dd87-x8mrk\" (UID: \"c7a02f7e-c0ff-46b5-9725-f6e9fe667797\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x8mrk"
May 28 17:18:38.852339 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:38.852301    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x8mrk"
May 28 17:18:38.937998 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:38.937963    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-7bknv" event={"ID":"381b3abf-96fb-4c94-896f-a9bc249cb957","Type":"ContainerStarted","Data":"fa9bd01046d5ed2de56161dbe991d83683f6c798ba04c20a53cf0adb8172ee74"}
May 28 17:18:38.939697 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:38.939672    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-q85pl" event={"ID":"d7714f9b-7133-489f-86cb-eac71c7afdc6","Type":"ContainerStarted","Data":"d98a3020803d347986f2985b5ca62934f5912b3d5dc190bc04ab182a4e8e613c"}
May 28 17:18:38.957897 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:38.957846    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-7bknv" podStartSLOduration=1.5147191119999999 podStartE2EDuration="3.957827542s" podCreationTimestamp="2026-05-28 17:18:35 +0000 UTC" firstStartedPulling="2026-05-28 17:18:36.297355442 +0000 UTC m=+102.273159776" lastFinishedPulling="2026-05-28 17:18:38.740463861 +0000 UTC m=+104.716268206" observedRunningTime="2026-05-28 17:18:38.955562976 +0000 UTC m=+104.931367335" watchObservedRunningTime="2026-05-28 17:18:38.957827542 +0000 UTC m=+104.933631903"
May 28 17:18:38.975207 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:38.975163    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-q85pl" podStartSLOduration=2.23760324 podStartE2EDuration="3.975149317s" podCreationTimestamp="2026-05-28 17:18:35 +0000 UTC" firstStartedPulling="2026-05-28 17:18:36.393461295 +0000 UTC m=+102.369265629" lastFinishedPulling="2026-05-28 17:18:38.131007356 +0000 UTC m=+104.106811706" observedRunningTime="2026-05-28 17:18:38.974516841 +0000 UTC m=+104.950321199" watchObservedRunningTime="2026-05-28 17:18:38.975149317 +0000 UTC m=+104.950953673"
May 28 17:18:38.977269 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:38.977238    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-x8mrk"]
May 28 17:18:38.980546 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:18:38.980520    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a02f7e_c0ff_46b5_9725_f6e9fe667797.slice/crio-0089c77515e4cfd746443526f53d6f24286d5d6e0076c976643522b2e8614d60 WatchSource:0}: Error finding container 0089c77515e4cfd746443526f53d6f24286d5d6e0076c976643522b2e8614d60: Status 404 returned error can't find the container with id 0089c77515e4cfd746443526f53d6f24286d5d6e0076c976643522b2e8614d60
May 28 17:18:39.943140 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:39.943105    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x8mrk" event={"ID":"c7a02f7e-c0ff-46b5-9725-f6e9fe667797","Type":"ContainerStarted","Data":"d7a6de1ea3938dd36a1e799486f60c86082891ea2d2ed9e0958936512e4ff49c"}
May 28 17:18:39.943140 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:39.943144    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x8mrk" event={"ID":"c7a02f7e-c0ff-46b5-9725-f6e9fe667797","Type":"ContainerStarted","Data":"0089c77515e4cfd746443526f53d6f24286d5d6e0076c976643522b2e8614d60"}
May 28 17:18:39.960865 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:39.960811    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-x8mrk" podStartSLOduration=1.9607938950000001 podStartE2EDuration="1.960793895s" podCreationTimestamp="2026-05-28 17:18:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:18:39.959772244 +0000 UTC m=+105.935576601" watchObservedRunningTime="2026-05-28 17:18:39.960793895 +0000 UTC m=+105.936598252"
May 28 17:18:40.365380 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:40.365343    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-v476b"]
May 28 17:18:40.368545 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:40.368524    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-v476b"
May 28 17:18:40.371186 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:40.371164    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-znmnx\""
May 28 17:18:40.371760 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:40.371738    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 28 17:18:40.371960 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:40.371948    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 28 17:18:40.381361 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:40.381339    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-v476b"]
May 28 17:18:40.439377 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:40.439344    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgzst\" (UniqueName: \"kubernetes.io/projected/f7696681-c38f-4d34-ace5-556a3c6c2486-kube-api-access-jgzst\") pod \"migrator-b985f5d89-v476b\" (UID: \"f7696681-c38f-4d34-ace5-556a3c6c2486\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-v476b"
May 28 17:18:40.540412 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:40.540381    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jgzst\" (UniqueName: \"kubernetes.io/projected/f7696681-c38f-4d34-ace5-556a3c6c2486-kube-api-access-jgzst\") pod \"migrator-b985f5d89-v476b\" (UID: \"f7696681-c38f-4d34-ace5-556a3c6c2486\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-v476b"
May 28 17:18:40.548743 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:40.548718    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgzst\" (UniqueName: \"kubernetes.io/projected/f7696681-c38f-4d34-ace5-556a3c6c2486-kube-api-access-jgzst\") pod \"migrator-b985f5d89-v476b\" (UID: \"f7696681-c38f-4d34-ace5-556a3c6c2486\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-v476b"
May 28 17:18:40.678437 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:40.678356    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-v476b"
May 28 17:18:40.801682 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:40.801650    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-v476b"]
May 28 17:18:40.805640 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:18:40.805607    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7696681_c38f_4d34_ace5_556a3c6c2486.slice/crio-572baa6671ee5e80d4fd26fbd9901b1388427ff4a605acbb1333f903b60eed95 WatchSource:0}: Error finding container 572baa6671ee5e80d4fd26fbd9901b1388427ff4a605acbb1333f903b60eed95: Status 404 returned error can't find the container with id 572baa6671ee5e80d4fd26fbd9901b1388427ff4a605acbb1333f903b60eed95
May 28 17:18:40.946518 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:40.946423    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-v476b" event={"ID":"f7696681-c38f-4d34-ace5-556a3c6c2486","Type":"ContainerStarted","Data":"572baa6671ee5e80d4fd26fbd9901b1388427ff4a605acbb1333f903b60eed95"}
May 28 17:18:41.751118 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:41.751083    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-p7nm8\" (UID: \"c1c60c5b-c157-4f36-b9fd-39d824c6bb11\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8"
May 28 17:18:41.751397 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:41.751234    2556 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 28 17:18:41.751397 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:41.751322    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls podName:c1c60c5b-c157-4f36-b9fd-39d824c6bb11 nodeName:}" failed. No retries permitted until 2026-05-28 17:18:57.751292342 +0000 UTC m=+123.727096676 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-p7nm8" (UID: "c1c60c5b-c157-4f36-b9fd-39d824c6bb11") : secret "cluster-monitoring-operator-tls" not found
May 28 17:18:42.170942 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:42.170914    2556 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-qdkvs"
May 28 17:18:42.171350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:42.171243    2556 scope.go:117] "RemoveContainer" containerID="a9f076c092f211bfe68c3b1956416f66d5ac9d1011dd9cf21c648c1f7e25ce1b"
May 28 17:18:42.171430 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:42.171411    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-qdkvs_openshift-console-operator(86dc3fc1-6d7c-4dec-b9b3-7197fa551e87)\"" pod="openshift-console-operator/console-operator-76dff48d59-qdkvs" podUID="86dc3fc1-6d7c-4dec-b9b3-7197fa551e87"
May 28 17:18:42.952558 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:42.952521    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-v476b" event={"ID":"f7696681-c38f-4d34-ace5-556a3c6c2486","Type":"ContainerStarted","Data":"6f1ea6d10c6cb2380de0cc7615f1dd010c8d35d9c5586507650373faa983d5f7"}
May 28 17:18:42.952558 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:42.952556    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-v476b" event={"ID":"f7696681-c38f-4d34-ace5-556a3c6c2486","Type":"ContainerStarted","Data":"14938acee65d5a606bd5c701d02cdae00e7e626e7086e77eae80c0e8a4fa8872"}
May 28 17:18:42.972278 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:42.972227    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-v476b" podStartSLOduration=1.767226414 podStartE2EDuration="2.972213559s" podCreationTimestamp="2026-05-28 17:18:40 +0000 UTC" firstStartedPulling="2026-05-28 17:18:40.808084289 +0000 UTC m=+106.783888626" lastFinishedPulling="2026-05-28 17:18:42.013071435 +0000 UTC m=+107.988875771" observedRunningTime="2026-05-28 17:18:42.972034446 +0000 UTC m=+108.947838803" watchObservedRunningTime="2026-05-28 17:18:42.972213559 +0000 UTC m=+108.948017915"
May 28 17:18:43.917389 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:43.917343    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-qdkvs"
May 28 17:18:43.917776 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:43.917713    2556 scope.go:117] "RemoveContainer" containerID="a9f076c092f211bfe68c3b1956416f66d5ac9d1011dd9cf21c648c1f7e25ce1b"
May 28 17:18:43.917893 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:18:43.917864    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-qdkvs_openshift-console-operator(86dc3fc1-6d7c-4dec-b9b3-7197fa551e87)\"" pod="openshift-console-operator/console-operator-76dff48d59-qdkvs" podUID="86dc3fc1-6d7c-4dec-b9b3-7197fa551e87"
May 28 17:18:45.681170 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:45.681116    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f23cf658-52c4-45f6-96ee-071473af2d14-samples-operator-tls\") pod \"cluster-samples-operator-697587599-tp7ql\" (UID: \"f23cf658-52c4-45f6-96ee-071473af2d14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tp7ql"
May 28 17:18:45.683464 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:45.683439    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/f23cf658-52c4-45f6-96ee-071473af2d14-samples-operator-tls\") pod \"cluster-samples-operator-697587599-tp7ql\" (UID: \"f23cf658-52c4-45f6-96ee-071473af2d14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tp7ql"
May 28 17:18:45.775492 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:45.775451    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tp7ql"
May 28 17:18:45.894132 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:45.894097    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-697587599-tp7ql"]
May 28 17:18:45.964954 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:45.964924    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tp7ql" event={"ID":"f23cf658-52c4-45f6-96ee-071473af2d14","Type":"ContainerStarted","Data":"60b93dd3ea28ec906c27c39b03aa408ed2f4c3c5f1a0ec2ce42530847c261b28"}
May 28 17:18:47.972446 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:47.972357    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tp7ql" event={"ID":"f23cf658-52c4-45f6-96ee-071473af2d14","Type":"ContainerStarted","Data":"cccb68f3e15f229612d78767d76b062e272ff4dbcba734e7a6b8c398079125b7"}
May 28 17:18:47.972446 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:47.972394    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tp7ql" event={"ID":"f23cf658-52c4-45f6-96ee-071473af2d14","Type":"ContainerStarted","Data":"fbf4fed6799015c4109444a85079637119f6ea1e6b5a61302d650099d1171e6d"}
May 28 17:18:47.992771 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:47.992714    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-697587599-tp7ql" podStartSLOduration=17.360064033 podStartE2EDuration="18.992699975s" podCreationTimestamp="2026-05-28 17:18:29 +0000 UTC" firstStartedPulling="2026-05-28 17:18:45.93259351 +0000 UTC m=+111.908397851" lastFinishedPulling="2026-05-28 17:18:47.565229455 +0000 UTC m=+113.541033793" observedRunningTime="2026-05-28 17:18:47.991905653 +0000 UTC m=+113.967710009" watchObservedRunningTime="2026-05-28 17:18:47.992699975 +0000 UTC m=+113.968504380"
May 28 17:18:54.629060 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:54.629020    2556 scope.go:117] "RemoveContainer" containerID="a9f076c092f211bfe68c3b1956416f66d5ac9d1011dd9cf21c648c1f7e25ce1b"
May 28 17:18:54.991615 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:54.991538    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/1.log"
May 28 17:18:54.991754 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:54.991622    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-qdkvs" event={"ID":"86dc3fc1-6d7c-4dec-b9b3-7197fa551e87","Type":"ContainerStarted","Data":"1a0ac0ec771a9059a3c085f71c27868b9c5bfa7617b0a074520da780ac5f5cb5"}
May 28 17:18:54.991879 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:54.991860    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-qdkvs"
May 28 17:18:55.054180 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:55.054149    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-qdkvs"
May 28 17:18:57.782860 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:57.782823    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-p7nm8\" (UID: \"c1c60c5b-c157-4f36-b9fd-39d824c6bb11\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8"
May 28 17:18:57.785101 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:57.785081    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/c1c60c5b-c157-4f36-b9fd-39d824c6bb11-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-p7nm8\" (UID: \"c1c60c5b-c157-4f36-b9fd-39d824c6bb11\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8"
May 28 17:18:57.974544 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:57.974513    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-cwlmn\""
May 28 17:18:57.981987 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:57.981962    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8"
May 28 17:18:58.101788 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:58.101759    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8"]
May 28 17:18:58.104499 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:18:58.104468    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1c60c5b_c157_4f36_b9fd_39d824c6bb11.slice/crio-a9ef096f12caeb2cf8ab87144d981e2b15d939b7700ecd2d1b0c522cba458b3d WatchSource:0}: Error finding container a9ef096f12caeb2cf8ab87144d981e2b15d939b7700ecd2d1b0c522cba458b3d: Status 404 returned error can't find the container with id a9ef096f12caeb2cf8ab87144d981e2b15d939b7700ecd2d1b0c522cba458b3d
May 28 17:18:59.004015 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:18:59.003969    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8" event={"ID":"c1c60c5b-c157-4f36-b9fd-39d824c6bb11","Type":"ContainerStarted","Data":"a9ef096f12caeb2cf8ab87144d981e2b15d939b7700ecd2d1b0c522cba458b3d"}
May 28 17:19:00.008404 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:00.008291    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8" event={"ID":"c1c60c5b-c157-4f36-b9fd-39d824c6bb11","Type":"ContainerStarted","Data":"6b6f7f3902003fbda567658ba5b7e206f9e0a0eeeaf61b9c65c4cfe3eece936c"}
May 28 17:19:00.025441 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:00.025384    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-p7nm8" podStartSLOduration=33.576497316 podStartE2EDuration="35.025365882s" podCreationTimestamp="2026-05-28 17:18:25 +0000 UTC" firstStartedPulling="2026-05-28 17:18:58.106208121 +0000 UTC m=+124.082012455" lastFinishedPulling="2026-05-28 17:18:59.555076684 +0000 UTC m=+125.530881021" observedRunningTime="2026-05-28 17:19:00.024596085 +0000 UTC m=+126.000400452" watchObservedRunningTime="2026-05-28 17:19:00.025365882 +0000 UTC m=+126.001170239"
May 28 17:19:04.531786 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.531749    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs\") pod \"network-metrics-daemon-jqgk7\" (UID: \"a2131092-689a-4370-bea0-90a62c5af33a\") " pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:19:04.533970 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.533950    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a2131092-689a-4370-bea0-90a62c5af33a-metrics-certs\") pod \"network-metrics-daemon-jqgk7\" (UID: \"a2131092-689a-4370-bea0-90a62c5af33a\") " pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:19:04.647272 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.647244    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-svsk4\""
May 28 17:19:04.654982 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.654961    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-jqgk7"
May 28 17:19:04.775495 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.775463    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-jqgk7"]
May 28 17:19:04.778671 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:19:04.778641    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2131092_689a_4370_bea0_90a62c5af33a.slice/crio-e0ecb735eaf2d6194768f376f20043c2b2ea1782b42fb2f9ae5d66a168010ba0 WatchSource:0}: Error finding container e0ecb735eaf2d6194768f376f20043c2b2ea1782b42fb2f9ae5d66a168010ba0: Status 404 returned error can't find the container with id e0ecb735eaf2d6194768f376f20043c2b2ea1782b42fb2f9ae5d66a168010ba0
May 28 17:19:04.814604 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.814575    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-2c87z"]
May 28 17:19:04.818926 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.818899    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2c87z"
May 28 17:19:04.821628 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.821602    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 28 17:19:04.821763 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.821722    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-97lmk\""
May 28 17:19:04.821903 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.821881    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 28 17:19:04.829532 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.829505    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-2c87z"]
May 28 17:19:04.914518 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.914484    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-nfvrf"]
May 28 17:19:04.917598 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.917574    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-nfvrf"
May 28 17:19:04.918043 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.918025    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sgqql"]
May 28 17:19:04.920876 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.920857    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sgqql"
May 28 17:19:04.921183 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.921168    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-56rwh\""
May 28 17:19:04.921518 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.921503    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 28 17:19:04.921606 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.921508    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 28 17:19:04.923091 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.923075    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 28 17:19:04.923186 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.923163    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-ntxrx\""
May 28 17:19:04.934622 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.934605    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/487e6598-8985-4498-853d-24e34f67fe62-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-2c87z\" (UID: \"487e6598-8985-4498-853d-24e34f67fe62\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2c87z"
May 28 17:19:04.934719 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.934634    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/487e6598-8985-4498-853d-24e34f67fe62-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-2c87z\" (UID: \"487e6598-8985-4498-853d-24e34f67fe62\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2c87z"
May 28 17:19:04.937363 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.937346    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-nfvrf"]
May 28 17:19:04.944407 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:04.944382    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sgqql"]
May 28 17:19:05.021451 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.021419    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jqgk7" event={"ID":"a2131092-689a-4370-bea0-90a62c5af33a","Type":"ContainerStarted","Data":"e0ecb735eaf2d6194768f376f20043c2b2ea1782b42fb2f9ae5d66a168010ba0"}
May 28 17:19:05.035937 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.035852    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chjqg\" (UniqueName: \"kubernetes.io/projected/e6f670a9-918f-444d-a959-7dde52b2434d-kube-api-access-chjqg\") pod \"downloads-57bd96b888-nfvrf\" (UID: \"e6f670a9-918f-444d-a959-7dde52b2434d\") " pod="openshift-console/downloads-57bd96b888-nfvrf"
May 28 17:19:05.035937 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.035901    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/487e6598-8985-4498-853d-24e34f67fe62-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-2c87z\" (UID: \"487e6598-8985-4498-853d-24e34f67fe62\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2c87z"
May 28 17:19:05.036122 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.035962    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/487e6598-8985-4498-853d-24e34f67fe62-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-2c87z\" (UID: \"487e6598-8985-4498-853d-24e34f67fe62\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2c87z"
May 28 17:19:05.036122 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.036017    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/813e895e-8474-4e96-8925-355c43cf1481-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-sgqql\" (UID: \"813e895e-8474-4e96-8925-355c43cf1481\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sgqql"
May 28 17:19:05.036589 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.036571    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/487e6598-8985-4498-853d-24e34f67fe62-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-2c87z\" (UID: \"487e6598-8985-4498-853d-24e34f67fe62\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2c87z"
May 28 17:19:05.038274 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.038246    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/487e6598-8985-4498-853d-24e34f67fe62-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-2c87z\" (UID: \"487e6598-8985-4498-853d-24e34f67fe62\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2c87z"
May 28 17:19:05.077814 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.077784    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hmwwc"]
May 28 17:19:05.081187 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.081168    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hmwwc"
May 28 17:19:05.084177 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.084153    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 28 17:19:05.084264 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.084223    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9mq7s\""
May 28 17:19:05.084913 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.084893    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 28 17:19:05.101746 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.101722    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hmwwc"]
May 28 17:19:05.130695 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.130670    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2c87z"
May 28 17:19:05.137166 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.137143    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/813e895e-8474-4e96-8925-355c43cf1481-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-sgqql\" (UID: \"813e895e-8474-4e96-8925-355c43cf1481\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sgqql"
May 28 17:19:05.137293 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.137182    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tcqr\" (UniqueName: \"kubernetes.io/projected/b4d17b1e-205b-4c9e-ac87-3e4f9004bda2-kube-api-access-5tcqr\") pod \"insights-runtime-extractor-hmwwc\" (UID: \"b4d17b1e-205b-4c9e-ac87-3e4f9004bda2\") " pod="openshift-insights/insights-runtime-extractor-hmwwc"
May 28 17:19:05.137293 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.137219    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b4d17b1e-205b-4c9e-ac87-3e4f9004bda2-crio-socket\") pod \"insights-runtime-extractor-hmwwc\" (UID: \"b4d17b1e-205b-4c9e-ac87-3e4f9004bda2\") " pod="openshift-insights/insights-runtime-extractor-hmwwc"
May 28 17:19:05.137293 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.137264    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4d17b1e-205b-4c9e-ac87-3e4f9004bda2-data-volume\") pod \"insights-runtime-extractor-hmwwc\" (UID: \"b4d17b1e-205b-4c9e-ac87-3e4f9004bda2\") " pod="openshift-insights/insights-runtime-extractor-hmwwc"
May 28 17:19:05.137293 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.137292    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b4d17b1e-205b-4c9e-ac87-3e4f9004bda2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hmwwc\" (UID: \"b4d17b1e-205b-4c9e-ac87-3e4f9004bda2\") " pod="openshift-insights/insights-runtime-extractor-hmwwc"
May 28 17:19:05.137941 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.137384    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b4d17b1e-205b-4c9e-ac87-3e4f9004bda2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hmwwc\" (UID: \"b4d17b1e-205b-4c9e-ac87-3e4f9004bda2\") " pod="openshift-insights/insights-runtime-extractor-hmwwc"
May 28 17:19:05.137941 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.137435    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-chjqg\" (UniqueName: \"kubernetes.io/projected/e6f670a9-918f-444d-a959-7dde52b2434d-kube-api-access-chjqg\") pod \"downloads-57bd96b888-nfvrf\" (UID: \"e6f670a9-918f-444d-a959-7dde52b2434d\") " pod="openshift-console/downloads-57bd96b888-nfvrf"
May 28 17:19:05.140083 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.140062    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/813e895e-8474-4e96-8925-355c43cf1481-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-sgqql\" (UID: \"813e895e-8474-4e96-8925-355c43cf1481\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sgqql"
May 28 17:19:05.148123 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.148104    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-chjqg\" (UniqueName: \"kubernetes.io/projected/e6f670a9-918f-444d-a959-7dde52b2434d-kube-api-access-chjqg\") pod \"downloads-57bd96b888-nfvrf\" (UID: \"e6f670a9-918f-444d-a959-7dde52b2434d\") " pod="openshift-console/downloads-57bd96b888-nfvrf"
May 28 17:19:05.229163 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.228710    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-nfvrf"
May 28 17:19:05.232877 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.231870    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sgqql"
May 28 17:19:05.239074 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.238209    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b4d17b1e-205b-4c9e-ac87-3e4f9004bda2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hmwwc\" (UID: \"b4d17b1e-205b-4c9e-ac87-3e4f9004bda2\") " pod="openshift-insights/insights-runtime-extractor-hmwwc"
May 28 17:19:05.239074 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.238256    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b4d17b1e-205b-4c9e-ac87-3e4f9004bda2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hmwwc\" (UID: \"b4d17b1e-205b-4c9e-ac87-3e4f9004bda2\") " pod="openshift-insights/insights-runtime-extractor-hmwwc"
May 28 17:19:05.239074 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.238373    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5tcqr\" (UniqueName: \"kubernetes.io/projected/b4d17b1e-205b-4c9e-ac87-3e4f9004bda2-kube-api-access-5tcqr\") pod \"insights-runtime-extractor-hmwwc\" (UID: \"b4d17b1e-205b-4c9e-ac87-3e4f9004bda2\") " pod="openshift-insights/insights-runtime-extractor-hmwwc"
May 28 17:19:05.239074 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.238413    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b4d17b1e-205b-4c9e-ac87-3e4f9004bda2-crio-socket\") pod \"insights-runtime-extractor-hmwwc\" (UID: \"b4d17b1e-205b-4c9e-ac87-3e4f9004bda2\") " pod="openshift-insights/insights-runtime-extractor-hmwwc"
May 28 17:19:05.239074 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.238456    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4d17b1e-205b-4c9e-ac87-3e4f9004bda2-data-volume\") pod \"insights-runtime-extractor-hmwwc\" (UID: \"b4d17b1e-205b-4c9e-ac87-3e4f9004bda2\") " pod="openshift-insights/insights-runtime-extractor-hmwwc"
May 28 17:19:05.239074 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.238697    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b4d17b1e-205b-4c9e-ac87-3e4f9004bda2-data-volume\") pod \"insights-runtime-extractor-hmwwc\" (UID: \"b4d17b1e-205b-4c9e-ac87-3e4f9004bda2\") " pod="openshift-insights/insights-runtime-extractor-hmwwc"
May 28 17:19:05.239074 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.238768    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b4d17b1e-205b-4c9e-ac87-3e4f9004bda2-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hmwwc\" (UID: \"b4d17b1e-205b-4c9e-ac87-3e4f9004bda2\") " pod="openshift-insights/insights-runtime-extractor-hmwwc"
May 28 17:19:05.239074 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.239021    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b4d17b1e-205b-4c9e-ac87-3e4f9004bda2-crio-socket\") pod \"insights-runtime-extractor-hmwwc\" (UID: \"b4d17b1e-205b-4c9e-ac87-3e4f9004bda2\") " pod="openshift-insights/insights-runtime-extractor-hmwwc"
May 28 17:19:05.241589 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.241564    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b4d17b1e-205b-4c9e-ac87-3e4f9004bda2-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hmwwc\" (UID: \"b4d17b1e-205b-4c9e-ac87-3e4f9004bda2\") " pod="openshift-insights/insights-runtime-extractor-hmwwc"
May 28 17:19:05.251747 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.251720    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tcqr\" (UniqueName: \"kubernetes.io/projected/b4d17b1e-205b-4c9e-ac87-3e4f9004bda2-kube-api-access-5tcqr\") pod \"insights-runtime-extractor-hmwwc\" (UID: \"b4d17b1e-205b-4c9e-ac87-3e4f9004bda2\") " pod="openshift-insights/insights-runtime-extractor-hmwwc"
May 28 17:19:05.276870 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.276832    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-2c87z"]
May 28 17:19:05.281355 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:19:05.280623    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod487e6598_8985_4498_853d_24e34f67fe62.slice/crio-8e21a76263f0126d36981e63b7ccd84107fa08d86fbcbd093d4f156376692185 WatchSource:0}: Error finding container 8e21a76263f0126d36981e63b7ccd84107fa08d86fbcbd093d4f156376692185: Status 404 returned error can't find the container with id 8e21a76263f0126d36981e63b7ccd84107fa08d86fbcbd093d4f156376692185
May 28 17:19:05.378611 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.378570    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sgqql"]
May 28 17:19:05.383134 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:19:05.383104    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod813e895e_8474_4e96_8925_355c43cf1481.slice/crio-65d28b40729bb0e49b18417e6275245247d49f9c0380763b231bcd0ab42d933d WatchSource:0}: Error finding container 65d28b40729bb0e49b18417e6275245247d49f9c0380763b231bcd0ab42d933d: Status 404 returned error can't find the container with id 65d28b40729bb0e49b18417e6275245247d49f9c0380763b231bcd0ab42d933d
May 28 17:19:05.389950 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.389921    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hmwwc"
May 28 17:19:05.405672 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.405649    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-nfvrf"]
May 28 17:19:05.408665 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:19:05.408632    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6f670a9_918f_444d_a959_7dde52b2434d.slice/crio-79cdc7ffd47044ad218a826e306de02a749463d2e7de41e83da5a6cb8679c848 WatchSource:0}: Error finding container 79cdc7ffd47044ad218a826e306de02a749463d2e7de41e83da5a6cb8679c848: Status 404 returned error can't find the container with id 79cdc7ffd47044ad218a826e306de02a749463d2e7de41e83da5a6cb8679c848
May 28 17:19:05.532302 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:05.532272    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hmwwc"]
May 28 17:19:05.702738 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:19:05.702669    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4d17b1e_205b_4c9e_ac87_3e4f9004bda2.slice/crio-8cfe2c9401b63884aa3a9e9ab9daa6650f3b80ce360094d564123b70f0807fb1 WatchSource:0}: Error finding container 8cfe2c9401b63884aa3a9e9ab9daa6650f3b80ce360094d564123b70f0807fb1: Status 404 returned error can't find the container with id 8cfe2c9401b63884aa3a9e9ab9daa6650f3b80ce360094d564123b70f0807fb1
May 28 17:19:06.029367 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:06.029327    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jqgk7" event={"ID":"a2131092-689a-4370-bea0-90a62c5af33a","Type":"ContainerStarted","Data":"3c6e6be309e92b03b39128aa2d511a0e8a08cbef8a2cb2b6e3386f438a186023"}
May 28 17:19:06.029558 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:06.029375    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-jqgk7" event={"ID":"a2131092-689a-4370-bea0-90a62c5af33a","Type":"ContainerStarted","Data":"1c5aaa35aa0a31225dd514e54a1f4a8d58212ec4b6fd1408384989932eb09f98"}
May 28 17:19:06.030964 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:06.030908    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hmwwc" event={"ID":"b4d17b1e-205b-4c9e-ac87-3e4f9004bda2","Type":"ContainerStarted","Data":"4e01ca5f1039ae56b4e2439ed08c3f3ce18437a15537bc9200add105212ad594"}
May 28 17:19:06.030964 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:06.030942    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hmwwc" event={"ID":"b4d17b1e-205b-4c9e-ac87-3e4f9004bda2","Type":"ContainerStarted","Data":"8cfe2c9401b63884aa3a9e9ab9daa6650f3b80ce360094d564123b70f0807fb1"}
May 28 17:19:06.033555 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:06.033525    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sgqql" event={"ID":"813e895e-8474-4e96-8925-355c43cf1481","Type":"ContainerStarted","Data":"65d28b40729bb0e49b18417e6275245247d49f9c0380763b231bcd0ab42d933d"}
May 28 17:19:06.035382 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:06.035356    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-nfvrf" event={"ID":"e6f670a9-918f-444d-a959-7dde52b2434d","Type":"ContainerStarted","Data":"79cdc7ffd47044ad218a826e306de02a749463d2e7de41e83da5a6cb8679c848"}
May 28 17:19:06.036628 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:06.036596    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2c87z" event={"ID":"487e6598-8985-4498-853d-24e34f67fe62","Type":"ContainerStarted","Data":"8e21a76263f0126d36981e63b7ccd84107fa08d86fbcbd093d4f156376692185"}
May 28 17:19:06.048777 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:06.047922    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-jqgk7" podStartSLOduration=131.08064936 podStartE2EDuration="2m12.047905283s" podCreationTimestamp="2026-05-28 17:16:54 +0000 UTC" firstStartedPulling="2026-05-28 17:19:04.780550988 +0000 UTC m=+130.756355322" lastFinishedPulling="2026-05-28 17:19:05.747806907 +0000 UTC m=+131.723611245" observedRunningTime="2026-05-28 17:19:06.046386468 +0000 UTC m=+132.022190844" watchObservedRunningTime="2026-05-28 17:19:06.047905283 +0000 UTC m=+132.023709641"
May 28 17:19:08.043561 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:08.043522    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hmwwc" event={"ID":"b4d17b1e-205b-4c9e-ac87-3e4f9004bda2","Type":"ContainerStarted","Data":"e88b5d5149526d1e46b2a4a93abf9bc0e146a1af523675ce6d79a090117f8392"}
May 28 17:19:08.044996 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:08.044964    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sgqql" event={"ID":"813e895e-8474-4e96-8925-355c43cf1481","Type":"ContainerStarted","Data":"7c3b5b3df138246cb0d997b5fc6c98901fe6d1622edabc83f1bb19e0265b8e6d"}
May 28 17:19:08.045215 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:08.045194    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sgqql"
May 28 17:19:08.046531 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:08.046493    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2c87z" event={"ID":"487e6598-8985-4498-853d-24e34f67fe62","Type":"ContainerStarted","Data":"7267e08b5ca793613ef4cd7c7871d4eda27651c2ce1328322da0a9d11b7b00ec"}
May 28 17:19:08.050859 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:08.050825    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sgqql"
May 28 17:19:08.064851 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:08.064797    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-sgqql" podStartSLOduration=2.457936153 podStartE2EDuration="4.064780502s" podCreationTimestamp="2026-05-28 17:19:04 +0000 UTC" firstStartedPulling="2026-05-28 17:19:05.385356537 +0000 UTC m=+131.361160874" lastFinishedPulling="2026-05-28 17:19:06.992200883 +0000 UTC m=+132.968005223" observedRunningTime="2026-05-28 17:19:08.063024292 +0000 UTC m=+134.038828646" watchObservedRunningTime="2026-05-28 17:19:08.064780502 +0000 UTC m=+134.040584863"
May 28 17:19:09.050898 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:09.050858    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hmwwc" event={"ID":"b4d17b1e-205b-4c9e-ac87-3e4f9004bda2","Type":"ContainerStarted","Data":"b19a3a6ab0305698f937cb3f0dd42b24d9ac16c6ece4f487b69df4f29e37859d"}
May 28 17:19:09.073629 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:09.073581    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hmwwc" podStartSLOduration=1.454135366 podStartE2EDuration="4.073567809s" podCreationTimestamp="2026-05-28 17:19:05 +0000 UTC" firstStartedPulling="2026-05-28 17:19:05.76070376 +0000 UTC m=+131.736508093" lastFinishedPulling="2026-05-28 17:19:08.380136202 +0000 UTC m=+134.355940536" observedRunningTime="2026-05-28 17:19:09.07329311 +0000 UTC m=+135.049097466" watchObservedRunningTime="2026-05-28 17:19:09.073567809 +0000 UTC m=+135.049372164"
May 28 17:19:09.073929 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:09.073895    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-2c87z" podStartSLOduration=3.366475606 podStartE2EDuration="5.073887459s" podCreationTimestamp="2026-05-28 17:19:04 +0000 UTC" firstStartedPulling="2026-05-28 17:19:05.282920211 +0000 UTC m=+131.258724545" lastFinishedPulling="2026-05-28 17:19:06.990332064 +0000 UTC m=+132.966136398" observedRunningTime="2026-05-28 17:19:08.099223594 +0000 UTC m=+134.075027952" watchObservedRunningTime="2026-05-28 17:19:09.073887459 +0000 UTC m=+135.049691814"
May 28 17:19:13.500367 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.500333    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"]
May 28 17:19:13.503393 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.503366    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"
May 28 17:19:13.507255 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.507095    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 28 17:19:13.507255 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.507115    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 28 17:19:13.507255 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.507114    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-v5rlk\""
May 28 17:19:13.507255 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.507095    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 28 17:19:13.507255 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.507210    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 28 17:19:13.514897 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.514864    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"]
May 28 17:19:13.516117 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.516096    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-l7f5w"]
May 28 17:19:13.518380 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.518361    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.520715 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.520657    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 28 17:19:13.520979 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.520812    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 28 17:19:13.521109 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.521088    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 28 17:19:13.521211 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.521151    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9sdlp\""
May 28 17:19:13.620432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.620392    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cabe30be-d521-4e9a-af4a-d1251082bad3-metrics-client-ca\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.620611 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.620445    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cabe30be-d521-4e9a-af4a-d1251082bad3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.620611 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.620484    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2e06019-bb4e-41c3-ba07-0a52efdc1236-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-bndt5\" (UID: \"f2e06019-bb4e-41c3-ba07-0a52efdc1236\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"
May 28 17:19:13.620611 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.620585    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f2e06019-bb4e-41c3-ba07-0a52efdc1236-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-bndt5\" (UID: \"f2e06019-bb4e-41c3-ba07-0a52efdc1236\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"
May 28 17:19:13.620766 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.620631    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cabe30be-d521-4e9a-af4a-d1251082bad3-sys\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.620766 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.620673    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cabe30be-d521-4e9a-af4a-d1251082bad3-node-exporter-accelerators-collector-config\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.620766 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.620702    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cabe30be-d521-4e9a-af4a-d1251082bad3-root\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.620911 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.620774    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlgcv\" (UniqueName: \"kubernetes.io/projected/cabe30be-d521-4e9a-af4a-d1251082bad3-kube-api-access-zlgcv\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.620911 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.620843    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2e06019-bb4e-41c3-ba07-0a52efdc1236-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-bndt5\" (UID: \"f2e06019-bb4e-41c3-ba07-0a52efdc1236\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"
May 28 17:19:13.620911 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.620870    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cabe30be-d521-4e9a-af4a-d1251082bad3-node-exporter-textfile\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.620911 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.620905    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhbwk\" (UniqueName: \"kubernetes.io/projected/f2e06019-bb4e-41c3-ba07-0a52efdc1236-kube-api-access-jhbwk\") pod \"kube-state-metrics-54fd6bc5c4-bndt5\" (UID: \"f2e06019-bb4e-41c3-ba07-0a52efdc1236\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"
May 28 17:19:13.621095 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.620938    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f2e06019-bb4e-41c3-ba07-0a52efdc1236-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-bndt5\" (UID: \"f2e06019-bb4e-41c3-ba07-0a52efdc1236\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"
May 28 17:19:13.621095 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.620969    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cabe30be-d521-4e9a-af4a-d1251082bad3-node-exporter-wtmp\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.621095 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.621033    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2e06019-bb4e-41c3-ba07-0a52efdc1236-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-bndt5\" (UID: \"f2e06019-bb4e-41c3-ba07-0a52efdc1236\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"
May 28 17:19:13.621095 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.621063    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cabe30be-d521-4e9a-af4a-d1251082bad3-node-exporter-tls\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.722080 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.722040    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cabe30be-d521-4e9a-af4a-d1251082bad3-node-exporter-accelerators-collector-config\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.722234 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.722096    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cabe30be-d521-4e9a-af4a-d1251082bad3-root\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.722234 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.722125    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zlgcv\" (UniqueName: \"kubernetes.io/projected/cabe30be-d521-4e9a-af4a-d1251082bad3-kube-api-access-zlgcv\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.722234 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.722170    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2e06019-bb4e-41c3-ba07-0a52efdc1236-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-bndt5\" (UID: \"f2e06019-bb4e-41c3-ba07-0a52efdc1236\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"
May 28 17:19:13.722234 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.722198    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cabe30be-d521-4e9a-af4a-d1251082bad3-node-exporter-textfile\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.722472 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.722226    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/cabe30be-d521-4e9a-af4a-d1251082bad3-root\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.722472 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.722234    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jhbwk\" (UniqueName: \"kubernetes.io/projected/f2e06019-bb4e-41c3-ba07-0a52efdc1236-kube-api-access-jhbwk\") pod \"kube-state-metrics-54fd6bc5c4-bndt5\" (UID: \"f2e06019-bb4e-41c3-ba07-0a52efdc1236\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"
May 28 17:19:13.722472 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.722432    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f2e06019-bb4e-41c3-ba07-0a52efdc1236-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-bndt5\" (UID: \"f2e06019-bb4e-41c3-ba07-0a52efdc1236\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"
May 28 17:19:13.722472 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.722468    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cabe30be-d521-4e9a-af4a-d1251082bad3-node-exporter-wtmp\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.722660 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.722524    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2e06019-bb4e-41c3-ba07-0a52efdc1236-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-bndt5\" (UID: \"f2e06019-bb4e-41c3-ba07-0a52efdc1236\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"
May 28 17:19:13.722660 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.722550    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cabe30be-d521-4e9a-af4a-d1251082bad3-node-exporter-tls\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.722660 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.722592    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cabe30be-d521-4e9a-af4a-d1251082bad3-metrics-client-ca\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.722660 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.722624    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cabe30be-d521-4e9a-af4a-d1251082bad3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.722859 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.722658    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2e06019-bb4e-41c3-ba07-0a52efdc1236-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-bndt5\" (UID: \"f2e06019-bb4e-41c3-ba07-0a52efdc1236\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"
May 28 17:19:13.722859 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.722720    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f2e06019-bb4e-41c3-ba07-0a52efdc1236-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-bndt5\" (UID: \"f2e06019-bb4e-41c3-ba07-0a52efdc1236\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"
May 28 17:19:13.722859 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.722734    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/cabe30be-d521-4e9a-af4a-d1251082bad3-node-exporter-accelerators-collector-config\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.722859 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.722782    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cabe30be-d521-4e9a-af4a-d1251082bad3-sys\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.723035 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.722900    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cabe30be-d521-4e9a-af4a-d1251082bad3-sys\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.723035 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.722980    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/cabe30be-d521-4e9a-af4a-d1251082bad3-node-exporter-textfile\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.723035 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.723023    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/cabe30be-d521-4e9a-af4a-d1251082bad3-node-exporter-wtmp\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.723806 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.723434    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/f2e06019-bb4e-41c3-ba07-0a52efdc1236-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-bndt5\" (UID: \"f2e06019-bb4e-41c3-ba07-0a52efdc1236\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"
May 28 17:19:13.723806 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.723690    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2e06019-bb4e-41c3-ba07-0a52efdc1236-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-bndt5\" (UID: \"f2e06019-bb4e-41c3-ba07-0a52efdc1236\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"
May 28 17:19:13.723958 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.723873    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cabe30be-d521-4e9a-af4a-d1251082bad3-metrics-client-ca\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.723958 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.723884    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/f2e06019-bb4e-41c3-ba07-0a52efdc1236-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-bndt5\" (UID: \"f2e06019-bb4e-41c3-ba07-0a52efdc1236\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"
May 28 17:19:13.725589 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.725563    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cabe30be-d521-4e9a-af4a-d1251082bad3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.725965 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.725921    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/cabe30be-d521-4e9a-af4a-d1251082bad3-node-exporter-tls\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.726193 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.726166    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f2e06019-bb4e-41c3-ba07-0a52efdc1236-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-bndt5\" (UID: \"f2e06019-bb4e-41c3-ba07-0a52efdc1236\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"
May 28 17:19:13.726982 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.726945    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2e06019-bb4e-41c3-ba07-0a52efdc1236-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-bndt5\" (UID: \"f2e06019-bb4e-41c3-ba07-0a52efdc1236\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"
May 28 17:19:13.732905 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.732885    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlgcv\" (UniqueName: \"kubernetes.io/projected/cabe30be-d521-4e9a-af4a-d1251082bad3-kube-api-access-zlgcv\") pod \"node-exporter-l7f5w\" (UID: \"cabe30be-d521-4e9a-af4a-d1251082bad3\") " pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.733192 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.733171    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhbwk\" (UniqueName: \"kubernetes.io/projected/f2e06019-bb4e-41c3-ba07-0a52efdc1236-kube-api-access-jhbwk\") pod \"kube-state-metrics-54fd6bc5c4-bndt5\" (UID: \"f2e06019-bb4e-41c3-ba07-0a52efdc1236\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"
May 28 17:19:13.813918 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.813881    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"
May 28 17:19:13.828964 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.828915    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-l7f5w"
May 28 17:19:13.840012 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:19:13.839978    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcabe30be_d521_4e9a_af4a_d1251082bad3.slice/crio-844135c2e13e925069142049a6c137aba503966bdfe51c68e68720fcde4d8e44 WatchSource:0}: Error finding container 844135c2e13e925069142049a6c137aba503966bdfe51c68e68720fcde4d8e44: Status 404 returned error can't find the container with id 844135c2e13e925069142049a6c137aba503966bdfe51c68e68720fcde4d8e44
May 28 17:19:13.960239 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:13.960209    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5"]
May 28 17:19:13.963225 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:19:13.963198    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2e06019_bb4e_41c3_ba07_0a52efdc1236.slice/crio-543e76999358596fe1ed075f76f65c5f85310dd021fc4ab0dd2f112aec676de1 WatchSource:0}: Error finding container 543e76999358596fe1ed075f76f65c5f85310dd021fc4ab0dd2f112aec676de1: Status 404 returned error can't find the container with id 543e76999358596fe1ed075f76f65c5f85310dd021fc4ab0dd2f112aec676de1
May 28 17:19:14.074949 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.074857    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5" event={"ID":"f2e06019-bb4e-41c3-ba07-0a52efdc1236","Type":"ContainerStarted","Data":"543e76999358596fe1ed075f76f65c5f85310dd021fc4ab0dd2f112aec676de1"}
May 28 17:19:14.076078 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.076047    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7f5w" event={"ID":"cabe30be-d521-4e9a-af4a-d1251082bad3","Type":"ContainerStarted","Data":"844135c2e13e925069142049a6c137aba503966bdfe51c68e68720fcde4d8e44"}
May 28 17:19:14.626995 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.626961    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:19:14.631694 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.631670    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.634292 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.634259    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 17:19:14.634670 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.634653    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 17:19:14.635713 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.635685    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 17:19:14.636666 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.636632    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 17:19:14.637074 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.637052    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 17:19:14.638065 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.637896    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 17:19:14.638715 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.638695    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 17:19:14.638867 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.638849    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 17:19:14.638953 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.638855    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pbfxr\""
May 28 17:19:14.639128 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.639108    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 17:19:14.661376 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.661345    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:19:14.733370 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.733328    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8be34e66-2c21-48c8-92ef-fce3af2a0d56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.733551 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.733444    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.733551 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.733510    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8be34e66-2c21-48c8-92ef-fce3af2a0d56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.733650 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.733572    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be34e66-2c21-48c8-92ef-fce3af2a0d56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.733650 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.733628    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.733749 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.733692    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8be34e66-2c21-48c8-92ef-fce3af2a0d56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.733749 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.733726    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-web-config\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.733842 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.733784    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd5p9\" (UniqueName: \"kubernetes.io/projected/8be34e66-2c21-48c8-92ef-fce3af2a0d56-kube-api-access-wd5p9\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.733894 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.733851    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.733953 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.733888    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.733953 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.733925    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-config-volume\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.734045 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.733962    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8be34e66-2c21-48c8-92ef-fce3af2a0d56-config-out\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.734045 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.733988    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.835336 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.835285    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8be34e66-2c21-48c8-92ef-fce3af2a0d56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.835557 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.835355    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be34e66-2c21-48c8-92ef-fce3af2a0d56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.835557 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.835401    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.835557 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.835437    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8be34e66-2c21-48c8-92ef-fce3af2a0d56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.835557 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.835467    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-web-config\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.835557 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.835526    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wd5p9\" (UniqueName: \"kubernetes.io/projected/8be34e66-2c21-48c8-92ef-fce3af2a0d56-kube-api-access-wd5p9\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.835828 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.835594    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.835828 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.835633    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.835828 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.835670    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-config-volume\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.835828 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.835701    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8be34e66-2c21-48c8-92ef-fce3af2a0d56-config-out\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.835828 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.835729    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.835828 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.835754    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8be34e66-2c21-48c8-92ef-fce3af2a0d56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.835828 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.835782    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.836594 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.836566    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be34e66-2c21-48c8-92ef-fce3af2a0d56-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.836865 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.836842    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8be34e66-2c21-48c8-92ef-fce3af2a0d56-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.838278 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.838252    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8be34e66-2c21-48c8-92ef-fce3af2a0d56-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.840801 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.840636    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.841257 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.841192    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-config-volume\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.841513 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.841470    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.842537 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.842512    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-web-config\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.843199 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.843167    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8be34e66-2c21-48c8-92ef-fce3af2a0d56-config-out\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.843626 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.843575    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8be34e66-2c21-48c8-92ef-fce3af2a0d56-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.844153 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.843805    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.844564 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.844527    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.846110 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.846082    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.848072 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.847977    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd5p9\" (UniqueName: \"kubernetes.io/projected/8be34e66-2c21-48c8-92ef-fce3af2a0d56-kube-api-access-wd5p9\") pod \"alertmanager-main-0\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:14.944126 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:14.944045    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 17:19:19.816068 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.816025    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 17:19:19.823379 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.823342    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.828512 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.828484    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 28 17:19:19.828653 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.828576    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 28 17:19:19.829631 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.829473    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9761qv8aad35r\""
May 28 17:19:19.829631 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.829523    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 28 17:19:19.829631 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.829548    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 28 17:19:19.829631 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.829562    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 17:19:19.829631 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.829608    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 28 17:19:19.829950 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.829867    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rlqn4\""
May 28 17:19:19.830016 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.830004    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 28 17:19:19.830658 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.830103    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 28 17:19:19.830658 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.830217    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 28 17:19:19.830658 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.830245    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 28 17:19:19.830846 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.830742    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 28 17:19:19.831998 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.831717    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 28 17:19:19.834641 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.834623    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 28 17:19:19.838168 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.838142    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 17:19:19.886138 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.886097    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.886320 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.886170    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.886320 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.886212    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-config\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.886320 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.886252    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec3c9510-50de-42e7-b5dd-519cb5d2768f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.886320 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.886273    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.886498 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.886356    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec3c9510-50de-42e7-b5dd-519cb5d2768f-config-out\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.886498 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.886392    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.886498 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.886417    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.886498 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.886451    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec3c9510-50de-42e7-b5dd-519cb5d2768f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.886498 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.886488    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2989\" (UniqueName: \"kubernetes.io/projected/ec3c9510-50de-42e7-b5dd-519cb5d2768f-kube-api-access-g2989\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.886683 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.886600    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.886683 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.886650    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.886683 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.886678    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.886792 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.886702    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.886792 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.886740    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.886792 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.886768    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-web-config\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.886916 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.886843    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.886916 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.886877    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.988039 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.988001    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec3c9510-50de-42e7-b5dd-519cb5d2768f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.988039 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.988051    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.988302 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.988097    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec3c9510-50de-42e7-b5dd-519cb5d2768f-config-out\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.988302 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.988122    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.988302 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.988149    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.988302 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.988183    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec3c9510-50de-42e7-b5dd-519cb5d2768f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.988302 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.988207    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-g2989\" (UniqueName: \"kubernetes.io/projected/ec3c9510-50de-42e7-b5dd-519cb5d2768f-kube-api-access-g2989\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.988302 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.988263    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.988647 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.988509    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.988647 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.988568    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.988647 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.988598    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.988647 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.988640    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.988843 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.988672    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-web-config\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.988843 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.988757    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.988843 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.988785    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.988843 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.988824    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.989041 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.988857    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.989473 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.989120    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-config\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.989473 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.989179    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec3c9510-50de-42e7-b5dd-519cb5d2768f-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.990414 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.990376    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.990551 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.990524    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.992047 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.991979    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.992717 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.992678    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec3c9510-50de-42e7-b5dd-519cb5d2768f-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.992717 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.992713    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.992913 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.992742    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.992913 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.992890    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.993710 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.993240    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-config\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.993710 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.993672    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.993885 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.993861    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec3c9510-50de-42e7-b5dd-519cb5d2768f-config-out\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.994739 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.994716    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-web-config\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.994829 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.994810    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.994939 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.994909    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.995107 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.995085    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.995498 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.995476    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:19.996541 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:19.996518    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:20.006047 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:20.006028    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2989\" (UniqueName: \"kubernetes.io/projected/ec3c9510-50de-42e7-b5dd-519cb5d2768f-kube-api-access-g2989\") pod \"prometheus-k8s-0\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:20.135081 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:20.134995    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:21.335021 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:21.334030    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 17:19:21.336242 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:19:21.336200    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec3c9510_50de_42e7_b5dd_519cb5d2768f.slice/crio-98d4238726929eee95cb593ea5c10b8ac5d5aee2abe8a07e8b936e414e371312 WatchSource:0}: Error finding container 98d4238726929eee95cb593ea5c10b8ac5d5aee2abe8a07e8b936e414e371312: Status 404 returned error can't find the container with id 98d4238726929eee95cb593ea5c10b8ac5d5aee2abe8a07e8b936e414e371312
May 28 17:19:21.351017 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:21.350968    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:19:21.353629 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:19:21.353600    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be34e66_2c21_48c8_92ef_fce3af2a0d56.slice/crio-0767d8a3e68cfffe873af05f1432a27aa2001953a6641e6efc4213b10aa2818b WatchSource:0}: Error finding container 0767d8a3e68cfffe873af05f1432a27aa2001953a6641e6efc4213b10aa2818b: Status 404 returned error can't find the container with id 0767d8a3e68cfffe873af05f1432a27aa2001953a6641e6efc4213b10aa2818b
May 28 17:19:22.109532 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:22.109491    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-nfvrf" event={"ID":"e6f670a9-918f-444d-a959-7dde52b2434d","Type":"ContainerStarted","Data":"1d65ac58e50668ecf52dbd6ac3866bde66796ed4330789d2bd0b6ece99a39e70"}
May 28 17:19:22.109738 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:22.109547    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-nfvrf"
May 28 17:19:22.111816 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:22.111762    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec3c9510-50de-42e7-b5dd-519cb5d2768f","Type":"ContainerStarted","Data":"98d4238726929eee95cb593ea5c10b8ac5d5aee2abe8a07e8b936e414e371312"}
May 28 17:19:22.113669 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:22.113629    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8be34e66-2c21-48c8-92ef-fce3af2a0d56","Type":"ContainerStarted","Data":"0767d8a3e68cfffe873af05f1432a27aa2001953a6641e6efc4213b10aa2818b"}
May 28 17:19:22.124435 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:22.124395    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-nfvrf"
May 28 17:19:22.133945 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:22.133532    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-nfvrf" podStartSLOduration=2.254883007 podStartE2EDuration="18.133515098s" podCreationTimestamp="2026-05-28 17:19:04 +0000 UTC" firstStartedPulling="2026-05-28 17:19:05.410725116 +0000 UTC m=+131.386529451" lastFinishedPulling="2026-05-28 17:19:21.289357188 +0000 UTC m=+147.265161542" observedRunningTime="2026-05-28 17:19:22.131862871 +0000 UTC m=+148.107667228" watchObservedRunningTime="2026-05-28 17:19:22.133515098 +0000 UTC m=+148.109319481"
May 28 17:19:23.121097 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:23.121038    2556 generic.go:358] "Generic (PLEG): container finished" podID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerID="e7e5ecf9c6680eabfaf484299114dadc26c09df9cfa0119893aadd8adca1860e" exitCode=0
May 28 17:19:23.121535 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:23.121189    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec3c9510-50de-42e7-b5dd-519cb5d2768f","Type":"ContainerDied","Data":"e7e5ecf9c6680eabfaf484299114dadc26c09df9cfa0119893aadd8adca1860e"}
May 28 17:19:23.127029 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:23.126890    2556 generic.go:358] "Generic (PLEG): container finished" podID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerID="1f31860b16a6e2b14f430600e556e4f467cdae6a0a688817991e8d03bf8d4636" exitCode=0
May 28 17:19:23.127029 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:23.126969    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8be34e66-2c21-48c8-92ef-fce3af2a0d56","Type":"ContainerDied","Data":"1f31860b16a6e2b14f430600e556e4f467cdae6a0a688817991e8d03bf8d4636"}
May 28 17:19:23.132191 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:23.131474    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7f5w" event={"ID":"cabe30be-d521-4e9a-af4a-d1251082bad3","Type":"ContainerStarted","Data":"e75f9f89b58a044a88ef027cceec7ec850dfe6cbd127b8ecaa437ecec4ccd97c"}
May 28 17:19:23.136668 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:23.134770    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5" event={"ID":"f2e06019-bb4e-41c3-ba07-0a52efdc1236","Type":"ContainerStarted","Data":"2510ea142db997e8f75de8f9dcd9fb3a3b93b88f54093731ad3ab83f890294b8"}
May 28 17:19:23.136668 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:23.134801    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5" event={"ID":"f2e06019-bb4e-41c3-ba07-0a52efdc1236","Type":"ContainerStarted","Data":"40561e0c4abc6d77f71603d442a1f5a57f23ad5e154ef8beedf20227e74dae34"}
May 28 17:19:24.142602 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:24.142515    2556 generic.go:358] "Generic (PLEG): container finished" podID="cabe30be-d521-4e9a-af4a-d1251082bad3" containerID="e75f9f89b58a044a88ef027cceec7ec850dfe6cbd127b8ecaa437ecec4ccd97c" exitCode=0
May 28 17:19:24.144082 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:24.142610    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7f5w" event={"ID":"cabe30be-d521-4e9a-af4a-d1251082bad3","Type":"ContainerDied","Data":"e75f9f89b58a044a88ef027cceec7ec850dfe6cbd127b8ecaa437ecec4ccd97c"}
May 28 17:19:24.144082 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:24.142633    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7f5w" event={"ID":"cabe30be-d521-4e9a-af4a-d1251082bad3","Type":"ContainerStarted","Data":"9fd8de0e7bed2ee99c8e28e07c2d786a239367aee77314b3b45313ca7d47fea5"}
May 28 17:19:24.144082 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:24.142643    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-l7f5w" event={"ID":"cabe30be-d521-4e9a-af4a-d1251082bad3","Type":"ContainerStarted","Data":"773d9f0998ba8ffa289ed1fe94dd2da6de4dceef0a1eda73b9eebf8b4e02efb7"}
May 28 17:19:24.145636 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:24.145610    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5" event={"ID":"f2e06019-bb4e-41c3-ba07-0a52efdc1236","Type":"ContainerStarted","Data":"e58f54444d7b26d17760861931f50aaa2b39d595cf80cbdc74982bf2835bfed7"}
May 28 17:19:24.167341 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:24.167150    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-l7f5w" podStartSLOduration=2.185675841 podStartE2EDuration="11.167132807s" podCreationTimestamp="2026-05-28 17:19:13 +0000 UTC" firstStartedPulling="2026-05-28 17:19:13.842389433 +0000 UTC m=+139.818193777" lastFinishedPulling="2026-05-28 17:19:22.823846405 +0000 UTC m=+148.799650743" observedRunningTime="2026-05-28 17:19:24.164675474 +0000 UTC m=+150.140479838" watchObservedRunningTime="2026-05-28 17:19:24.167132807 +0000 UTC m=+150.142937165"
May 28 17:19:24.187948 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:24.187817    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-bndt5" podStartSLOduration=2.329073293 podStartE2EDuration="11.187799601s" podCreationTimestamp="2026-05-28 17:19:13 +0000 UTC" firstStartedPulling="2026-05-28 17:19:13.965034857 +0000 UTC m=+139.940839195" lastFinishedPulling="2026-05-28 17:19:22.823761164 +0000 UTC m=+148.799565503" observedRunningTime="2026-05-28 17:19:24.185606466 +0000 UTC m=+150.161410822" watchObservedRunningTime="2026-05-28 17:19:24.187799601 +0000 UTC m=+150.163603958"
May 28 17:19:26.155011 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:26.154967    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8be34e66-2c21-48c8-92ef-fce3af2a0d56","Type":"ContainerStarted","Data":"9c359af5d6ffd280d95f3ff05f47544666ca12b3b7f493052cf3d3612947a0ef"}
May 28 17:19:26.697095 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:26.697062    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c59656557-t2h5w"]
May 28 17:19:26.697388 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:19:26.697359    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7c59656557-t2h5w" podUID="db344c52-f4e9-4191-9b75-ce2a278c6841"
May 28 17:19:27.160958 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.160749    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8be34e66-2c21-48c8-92ef-fce3af2a0d56","Type":"ContainerStarted","Data":"ffe2765fb80a96d344f3f389123abc918d39d6d2b1e02d0229fba6a369c2778f"}
May 28 17:19:27.161360 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.160975    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8be34e66-2c21-48c8-92ef-fce3af2a0d56","Type":"ContainerStarted","Data":"8c73ce24ffda6050380d0541c187a8c5edec20132d7b4ee5c1cf56581047cb67"}
May 28 17:19:27.161360 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.160992    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8be34e66-2c21-48c8-92ef-fce3af2a0d56","Type":"ContainerStarted","Data":"0900dd89e5c6469e4304b82fe2ec4cfb2897f2ab27e3c130cfc47cfc007678a9"}
May 28 17:19:27.162870 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.162823    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:19:27.162870 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.162832    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec3c9510-50de-42e7-b5dd-519cb5d2768f","Type":"ContainerStarted","Data":"8b0373949546e2ab010d9a5761ccaaa18e278ba23bd3c178727fa34e78c9358e"}
May 28 17:19:27.172538 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.172519    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:19:27.268252 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.268225    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-certificates\") pod \"db344c52-f4e9-4191-9b75-ce2a278c6841\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") "
May 28 17:19:27.268365 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.268268    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-bound-sa-token\") pod \"db344c52-f4e9-4191-9b75-ce2a278c6841\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") "
May 28 17:19:27.268365 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.268346    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db344c52-f4e9-4191-9b75-ce2a278c6841-ca-trust-extracted\") pod \"db344c52-f4e9-4191-9b75-ce2a278c6841\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") "
May 28 17:19:27.268476 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.268412    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db344c52-f4e9-4191-9b75-ce2a278c6841-trusted-ca\") pod \"db344c52-f4e9-4191-9b75-ce2a278c6841\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") "
May 28 17:19:27.268476 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.268449    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db344c52-f4e9-4191-9b75-ce2a278c6841-installation-pull-secrets\") pod \"db344c52-f4e9-4191-9b75-ce2a278c6841\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") "
May 28 17:19:27.268566 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.268504    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbp2m\" (UniqueName: \"kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-kube-api-access-wbp2m\") pod \"db344c52-f4e9-4191-9b75-ce2a278c6841\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") "
May 28 17:19:27.268566 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.268534    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/db344c52-f4e9-4191-9b75-ce2a278c6841-image-registry-private-configuration\") pod \"db344c52-f4e9-4191-9b75-ce2a278c6841\" (UID: \"db344c52-f4e9-4191-9b75-ce2a278c6841\") "
May 28 17:19:27.270490 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.270187    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "db344c52-f4e9-4191-9b75-ce2a278c6841" (UID: "db344c52-f4e9-4191-9b75-ce2a278c6841"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:19:27.270648 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.270625    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db344c52-f4e9-4191-9b75-ce2a278c6841-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "db344c52-f4e9-4191-9b75-ce2a278c6841" (UID: "db344c52-f4e9-4191-9b75-ce2a278c6841"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:19:27.270713 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.270689    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db344c52-f4e9-4191-9b75-ce2a278c6841-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "db344c52-f4e9-4191-9b75-ce2a278c6841" (UID: "db344c52-f4e9-4191-9b75-ce2a278c6841"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:19:27.272003 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.271974    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db344c52-f4e9-4191-9b75-ce2a278c6841-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "db344c52-f4e9-4191-9b75-ce2a278c6841" (UID: "db344c52-f4e9-4191-9b75-ce2a278c6841"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:19:27.272378 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.272353    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db344c52-f4e9-4191-9b75-ce2a278c6841-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "db344c52-f4e9-4191-9b75-ce2a278c6841" (UID: "db344c52-f4e9-4191-9b75-ce2a278c6841"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:19:27.275730 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.275687    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "db344c52-f4e9-4191-9b75-ce2a278c6841" (UID: "db344c52-f4e9-4191-9b75-ce2a278c6841"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:19:27.276681 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.276647    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-kube-api-access-wbp2m" (OuterVolumeSpecName: "kube-api-access-wbp2m") pod "db344c52-f4e9-4191-9b75-ce2a278c6841" (UID: "db344c52-f4e9-4191-9b75-ce2a278c6841"). InnerVolumeSpecName "kube-api-access-wbp2m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:19:27.370490 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.370447    2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-certificates\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:19:27.370490 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.370488    2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-bound-sa-token\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:19:27.370721 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.370504    2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/db344c52-f4e9-4191-9b75-ce2a278c6841-ca-trust-extracted\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:19:27.370721 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.370516    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/db344c52-f4e9-4191-9b75-ce2a278c6841-trusted-ca\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:19:27.370721 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.370531    2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/db344c52-f4e9-4191-9b75-ce2a278c6841-installation-pull-secrets\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:19:27.370721 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.370546    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbp2m\" (UniqueName: \"kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-kube-api-access-wbp2m\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:19:27.370721 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:27.370561    2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/db344c52-f4e9-4191-9b75-ce2a278c6841-image-registry-private-configuration\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:19:28.171290 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:28.171238    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec3c9510-50de-42e7-b5dd-519cb5d2768f","Type":"ContainerStarted","Data":"44b76923c335661ba0355b6da841740300ebb28c24e34634ab4b73042a25a25d"}
May 28 17:19:28.175707 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:28.175661    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8be34e66-2c21-48c8-92ef-fce3af2a0d56","Type":"ContainerStarted","Data":"c20e0bfad9c5e9c6f4cf81f5a8eb20d68cd003994ea443e5e86527ffc2b3a09e"}
May 28 17:19:28.175826 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:28.175704    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7c59656557-t2h5w"
May 28 17:19:28.216446 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:28.216401    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7c59656557-t2h5w"]
May 28 17:19:28.219755 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:28.219666    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7c59656557-t2h5w"]
May 28 17:19:28.379832 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:28.379797    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/db344c52-f4e9-4191-9b75-ce2a278c6841-registry-tls\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:19:28.632452 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:28.632413    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db344c52-f4e9-4191-9b75-ce2a278c6841" path="/var/lib/kubelet/pods/db344c52-f4e9-4191-9b75-ce2a278c6841/volumes"
May 28 17:19:30.185584 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:30.185556    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec3c9510-50de-42e7-b5dd-519cb5d2768f","Type":"ContainerStarted","Data":"a2fe932f45ceba4a04a4fc289d683a0a032229e96b8a0a3760df0c39be11ce34"}
May 28 17:19:30.185958 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:30.185596    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec3c9510-50de-42e7-b5dd-519cb5d2768f","Type":"ContainerStarted","Data":"7d75c204c385ab1eb5af1618eccbac5d474cbb3f422e61ee86b7353524ca8e36"}
May 28 17:19:30.189002 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:30.188976    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8be34e66-2c21-48c8-92ef-fce3af2a0d56","Type":"ContainerStarted","Data":"4f46f4cefc70b4a33fad456a7a788a16e7a20f6e46c2485e436713d394246f30"}
May 28 17:19:30.220140 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:30.219755    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=8.151687813 podStartE2EDuration="16.219739832s" podCreationTimestamp="2026-05-28 17:19:14 +0000 UTC" firstStartedPulling="2026-05-28 17:19:21.356095298 +0000 UTC m=+147.331899632" lastFinishedPulling="2026-05-28 17:19:29.424147296 +0000 UTC m=+155.399951651" observedRunningTime="2026-05-28 17:19:30.218265658 +0000 UTC m=+156.194070039" watchObservedRunningTime="2026-05-28 17:19:30.219739832 +0000 UTC m=+156.195544189"
May 28 17:19:30.990717 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:19:30.990676    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mxnl2" podUID="5d302957-1a7b-4109-92da-0c0d90325f4d"
May 28 17:19:31.008890 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:19:31.008863    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-ldxgl" podUID="f3232f85-3d97-44a7-8d4c-42687b88d50f"
May 28 17:19:31.196639 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:31.195221    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec3c9510-50de-42e7-b5dd-519cb5d2768f","Type":"ContainerStarted","Data":"a97eb2357055d3de85793963b9e8c282aadf203e0c6780af69280b1fbe166bda"}
May 28 17:19:31.196639 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:31.195264    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec3c9510-50de-42e7-b5dd-519cb5d2768f","Type":"ContainerStarted","Data":"46c8c5233ce90dd74c0a106c405e5ebc0b9c17f3f8554e1bae07d9728d00d9ec"}
May 28 17:19:31.197158 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:31.196716    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mxnl2"
May 28 17:19:31.236287 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:31.236224    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.71868109 podStartE2EDuration="12.23620695s" podCreationTimestamp="2026-05-28 17:19:19 +0000 UTC" firstStartedPulling="2026-05-28 17:19:21.33860897 +0000 UTC m=+147.314413308" lastFinishedPulling="2026-05-28 17:19:29.856134822 +0000 UTC m=+155.831939168" observedRunningTime="2026-05-28 17:19:31.233539875 +0000 UTC m=+157.209344231" watchObservedRunningTime="2026-05-28 17:19:31.23620695 +0000 UTC m=+157.212011308"
May 28 17:19:35.135134 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:35.135106    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:19:35.952173 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:35.952138    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls\") pod \"dns-default-mxnl2\" (UID: \"5d302957-1a7b-4109-92da-0c0d90325f4d\") " pod="openshift-dns/dns-default-mxnl2"
May 28 17:19:35.954415 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:35.954386    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5d302957-1a7b-4109-92da-0c0d90325f4d-metrics-tls\") pod \"dns-default-mxnl2\" (UID: \"5d302957-1a7b-4109-92da-0c0d90325f4d\") " pod="openshift-dns/dns-default-mxnl2"
May 28 17:19:35.999942 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:35.999919    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-sh6sk\""
May 28 17:19:36.007845 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:36.007823    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mxnl2"
May 28 17:19:36.053067 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:36.052670    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert\") pod \"ingress-canary-ldxgl\" (UID: \"f3232f85-3d97-44a7-8d4c-42687b88d50f\") " pod="openshift-ingress-canary/ingress-canary-ldxgl"
May 28 17:19:36.055768 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:36.055740    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f3232f85-3d97-44a7-8d4c-42687b88d50f-cert\") pod \"ingress-canary-ldxgl\" (UID: \"f3232f85-3d97-44a7-8d4c-42687b88d50f\") " pod="openshift-ingress-canary/ingress-canary-ldxgl"
May 28 17:19:36.134462 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:36.134438    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mxnl2"]
May 28 17:19:36.136922 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:19:36.136897    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d302957_1a7b_4109_92da_0c0d90325f4d.slice/crio-ec6111b5cda5f5cc660af8c8ff2d9707c5498ab794e79ab127f394aeb4c9ac9b WatchSource:0}: Error finding container ec6111b5cda5f5cc660af8c8ff2d9707c5498ab794e79ab127f394aeb4c9ac9b: Status 404 returned error can't find the container with id ec6111b5cda5f5cc660af8c8ff2d9707c5498ab794e79ab127f394aeb4c9ac9b
May 28 17:19:36.211664 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:36.211574    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mxnl2" event={"ID":"5d302957-1a7b-4109-92da-0c0d90325f4d","Type":"ContainerStarted","Data":"ec6111b5cda5f5cc660af8c8ff2d9707c5498ab794e79ab127f394aeb4c9ac9b"}
May 28 17:19:36.212979 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:36.212954    2556 generic.go:358] "Generic (PLEG): container finished" podID="9d9190bc-9f04-4ee4-a71d-3d44eda9abf9" containerID="b3cda4a83e6ebb837ef1230f891cdd32c3a9370b6e3b6c46ee9c94991391c5f8" exitCode=0
May 28 17:19:36.213105 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:36.212998    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-4hs87" event={"ID":"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9","Type":"ContainerDied","Data":"b3cda4a83e6ebb837ef1230f891cdd32c3a9370b6e3b6c46ee9c94991391c5f8"}
May 28 17:19:36.213376 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:36.213359    2556 scope.go:117] "RemoveContainer" containerID="b3cda4a83e6ebb837ef1230f891cdd32c3a9370b6e3b6c46ee9c94991391c5f8"
May 28 17:19:37.219748 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:37.219711    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-4hs87" event={"ID":"9d9190bc-9f04-4ee4-a71d-3d44eda9abf9","Type":"ContainerStarted","Data":"447ee887ef3008706e38fc461f0b51e2aa0af23fd7bc2ec3b2cb385aa63855db"}
May 28 17:19:38.223971 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:38.223938    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mxnl2" event={"ID":"5d302957-1a7b-4109-92da-0c0d90325f4d","Type":"ContainerStarted","Data":"1819f7e7552eb9759a6626e889e51cc271f4cf7b7522285dc87628b113561281"}
May 28 17:19:39.228774 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:39.228738    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mxnl2" event={"ID":"5d302957-1a7b-4109-92da-0c0d90325f4d","Type":"ContainerStarted","Data":"689671a5f2b0c789c79ecbd6df5430330bdb55afe82dc5b8ec7cadaecfdb7c08"}
May 28 17:19:39.229140 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:39.228855    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mxnl2"
May 28 17:19:39.248721 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:39.248681    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-mxnl2" podStartSLOduration=130.425726767 podStartE2EDuration="2m12.248669771s" podCreationTimestamp="2026-05-28 17:17:27 +0000 UTC" firstStartedPulling="2026-05-28 17:19:36.138759976 +0000 UTC m=+162.114564310" lastFinishedPulling="2026-05-28 17:19:37.961702977 +0000 UTC m=+163.937507314" observedRunningTime="2026-05-28 17:19:39.246506403 +0000 UTC m=+165.222310760" watchObservedRunningTime="2026-05-28 17:19:39.248669771 +0000 UTC m=+165.224474127"
May 28 17:19:42.627063 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:42.627027    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ldxgl"
May 28 17:19:42.629650 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:42.629620    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nznc5\""
May 28 17:19:42.637375 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:42.637356    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-ldxgl"
May 28 17:19:42.763865 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:42.763695    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-ldxgl"]
May 28 17:19:42.766659 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:19:42.766631    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3232f85_3d97_44a7_8d4c_42687b88d50f.slice/crio-aa14273b64b8298d4e4ca519f69080f8f1920476061916b25122385dcf95ba73 WatchSource:0}: Error finding container aa14273b64b8298d4e4ca519f69080f8f1920476061916b25122385dcf95ba73: Status 404 returned error can't find the container with id aa14273b64b8298d4e4ca519f69080f8f1920476061916b25122385dcf95ba73
May 28 17:19:43.252604 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:43.252567    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ldxgl" event={"ID":"f3232f85-3d97-44a7-8d4c-42687b88d50f","Type":"ContainerStarted","Data":"aa14273b64b8298d4e4ca519f69080f8f1920476061916b25122385dcf95ba73"}
May 28 17:19:45.260360 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:45.260256    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-ldxgl" event={"ID":"f3232f85-3d97-44a7-8d4c-42687b88d50f","Type":"ContainerStarted","Data":"a58314042f665dee7e8d13b2027a9ce5041906aac78af7fc6fd31e1f72d3c561"}
May 28 17:19:45.277013 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:45.276946    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-ldxgl" podStartSLOduration=136.205897621 podStartE2EDuration="2m18.276929552s" podCreationTimestamp="2026-05-28 17:17:27 +0000 UTC" firstStartedPulling="2026-05-28 17:19:42.768496468 +0000 UTC m=+168.744300802" lastFinishedPulling="2026-05-28 17:19:44.839528396 +0000 UTC m=+170.815332733" observedRunningTime="2026-05-28 17:19:45.276079538 +0000 UTC m=+171.251883904" watchObservedRunningTime="2026-05-28 17:19:45.276929552 +0000 UTC m=+171.252733910"
May 28 17:19:49.234528 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:49.234482    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mxnl2"
May 28 17:19:49.278753 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:49.277626    2556 generic.go:358] "Generic (PLEG): container finished" podID="d7714f9b-7133-489f-86cb-eac71c7afdc6" containerID="d98a3020803d347986f2985b5ca62934f5912b3d5dc190bc04ab182a4e8e613c" exitCode=0
May 28 17:19:49.278753 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:49.277769    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-q85pl" event={"ID":"d7714f9b-7133-489f-86cb-eac71c7afdc6","Type":"ContainerDied","Data":"d98a3020803d347986f2985b5ca62934f5912b3d5dc190bc04ab182a4e8e613c"}
May 28 17:19:49.278753 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:49.278192    2556 scope.go:117] "RemoveContainer" containerID="d98a3020803d347986f2985b5ca62934f5912b3d5dc190bc04ab182a4e8e613c"
May 28 17:19:50.283594 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:19:50.283562    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-q85pl" event={"ID":"d7714f9b-7133-489f-86cb-eac71c7afdc6","Type":"ContainerStarted","Data":"d519ef761b73fa32b172c7ec2127ba96882e98acc56b18e6ccdae69103a5afa3"}
May 28 17:20:05.330454 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:05.330419    2556 generic.go:358] "Generic (PLEG): container finished" podID="381b3abf-96fb-4c94-896f-a9bc249cb957" containerID="fa9bd01046d5ed2de56161dbe991d83683f6c798ba04c20a53cf0adb8172ee74" exitCode=0
May 28 17:20:05.330829 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:05.330495    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-7bknv" event={"ID":"381b3abf-96fb-4c94-896f-a9bc249cb957","Type":"ContainerDied","Data":"fa9bd01046d5ed2de56161dbe991d83683f6c798ba04c20a53cf0adb8172ee74"}
May 28 17:20:05.330829 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:05.330812    2556 scope.go:117] "RemoveContainer" containerID="fa9bd01046d5ed2de56161dbe991d83683f6c798ba04c20a53cf0adb8172ee74"
May 28 17:20:06.334793 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:06.334759    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-7bknv" event={"ID":"381b3abf-96fb-4c94-896f-a9bc249cb957","Type":"ContainerStarted","Data":"6d63e9f9ed24f8ef239d55318cd4e4a94eb1517c11e628036ebca4b1a7075bd3"}
May 28 17:20:20.135526 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:20.135487    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:20.158861 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:20.158835    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:20.388296 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:20.388226    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:33.850961 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:33.850926    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:20:33.851476 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:33.851445    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="alertmanager" containerID="cri-o://9c359af5d6ffd280d95f3ff05f47544666ca12b3b7f493052cf3d3612947a0ef" gracePeriod=120
May 28 17:20:33.851543 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:33.851511    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="kube-rbac-proxy" containerID="cri-o://ffe2765fb80a96d344f3f389123abc918d39d6d2b1e02d0229fba6a369c2778f" gracePeriod=120
May 28 17:20:33.851595 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:33.851504    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="kube-rbac-proxy-metric" containerID="cri-o://c20e0bfad9c5e9c6f4cf81f5a8eb20d68cd003994ea443e5e86527ffc2b3a09e" gracePeriod=120
May 28 17:20:33.851595 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:33.851545    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="config-reloader" containerID="cri-o://0900dd89e5c6469e4304b82fe2ec4cfb2897f2ab27e3c130cfc47cfc007678a9" gracePeriod=120
May 28 17:20:33.851690 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:33.851573    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="prom-label-proxy" containerID="cri-o://4f46f4cefc70b4a33fad456a7a788a16e7a20f6e46c2485e436713d394246f30" gracePeriod=120
May 28 17:20:33.851690 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:33.851520    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="kube-rbac-proxy-web" containerID="cri-o://8c73ce24ffda6050380d0541c187a8c5edec20132d7b4ee5c1cf56581047cb67" gracePeriod=120
May 28 17:20:34.427510 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:34.427477    2556 generic.go:358] "Generic (PLEG): container finished" podID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerID="4f46f4cefc70b4a33fad456a7a788a16e7a20f6e46c2485e436713d394246f30" exitCode=0
May 28 17:20:34.427510 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:34.427504    2556 generic.go:358] "Generic (PLEG): container finished" podID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerID="ffe2765fb80a96d344f3f389123abc918d39d6d2b1e02d0229fba6a369c2778f" exitCode=0
May 28 17:20:34.427510 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:34.427510    2556 generic.go:358] "Generic (PLEG): container finished" podID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerID="0900dd89e5c6469e4304b82fe2ec4cfb2897f2ab27e3c130cfc47cfc007678a9" exitCode=0
May 28 17:20:34.427510 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:34.427515    2556 generic.go:358] "Generic (PLEG): container finished" podID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerID="9c359af5d6ffd280d95f3ff05f47544666ca12b3b7f493052cf3d3612947a0ef" exitCode=0
May 28 17:20:34.427780 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:34.427547    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8be34e66-2c21-48c8-92ef-fce3af2a0d56","Type":"ContainerDied","Data":"4f46f4cefc70b4a33fad456a7a788a16e7a20f6e46c2485e436713d394246f30"}
May 28 17:20:34.427780 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:34.427581    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8be34e66-2c21-48c8-92ef-fce3af2a0d56","Type":"ContainerDied","Data":"ffe2765fb80a96d344f3f389123abc918d39d6d2b1e02d0229fba6a369c2778f"}
May 28 17:20:34.427780 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:34.427592    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8be34e66-2c21-48c8-92ef-fce3af2a0d56","Type":"ContainerDied","Data":"0900dd89e5c6469e4304b82fe2ec4cfb2897f2ab27e3c130cfc47cfc007678a9"}
May 28 17:20:34.427780 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:34.427601    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8be34e66-2c21-48c8-92ef-fce3af2a0d56","Type":"ContainerDied","Data":"9c359af5d6ffd280d95f3ff05f47544666ca12b3b7f493052cf3d3612947a0ef"}
May 28 17:20:35.096359 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.096335    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.161360 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.161332    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8be34e66-2c21-48c8-92ef-fce3af2a0d56-metrics-client-ca\") pod \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") "
May 28 17:20:35.161498 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.161388    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-config-volume\") pod \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") "
May 28 17:20:35.161498 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.161408    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-cluster-tls-config\") pod \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") "
May 28 17:20:35.161498 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.161428    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8be34e66-2c21-48c8-92ef-fce3af2a0d56-config-out\") pod \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") "
May 28 17:20:35.161498 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.161449    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-web-config\") pod \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") "
May 28 17:20:35.161498 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.161473    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") "
May 28 17:20:35.161800 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.161770    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8be34e66-2c21-48c8-92ef-fce3af2a0d56-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8be34e66-2c21-48c8-92ef-fce3af2a0d56" (UID: "8be34e66-2c21-48c8-92ef-fce3af2a0d56"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:20:35.161800 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.161795    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wd5p9\" (UniqueName: \"kubernetes.io/projected/8be34e66-2c21-48c8-92ef-fce3af2a0d56-kube-api-access-wd5p9\") pod \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") "
May 28 17:20:35.161932 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.161834    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-kube-rbac-proxy\") pod \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") "
May 28 17:20:35.161995 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.161939    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-kube-rbac-proxy-web\") pod \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") "
May 28 17:20:35.161995 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.161966    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8be34e66-2c21-48c8-92ef-fce3af2a0d56-tls-assets\") pod \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") "
May 28 17:20:35.162108 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.161996    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8be34e66-2c21-48c8-92ef-fce3af2a0d56-alertmanager-main-db\") pod \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") "
May 28 17:20:35.162108 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.162032    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-main-tls\") pod \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") "
May 28 17:20:35.162108 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.162062    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be34e66-2c21-48c8-92ef-fce3af2a0d56-alertmanager-trusted-ca-bundle\") pod \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\" (UID: \"8be34e66-2c21-48c8-92ef-fce3af2a0d56\") "
May 28 17:20:35.162398 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.162379    2556 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8be34e66-2c21-48c8-92ef-fce3af2a0d56-metrics-client-ca\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:35.162940 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.162918    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8be34e66-2c21-48c8-92ef-fce3af2a0d56-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8be34e66-2c21-48c8-92ef-fce3af2a0d56" (UID: "8be34e66-2c21-48c8-92ef-fce3af2a0d56"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:20:35.164743 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.164707    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8be34e66-2c21-48c8-92ef-fce3af2a0d56" (UID: "8be34e66-2c21-48c8-92ef-fce3af2a0d56"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:35.164844 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.164795    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8be34e66-2c21-48c8-92ef-fce3af2a0d56-config-out" (OuterVolumeSpecName: "config-out") pod "8be34e66-2c21-48c8-92ef-fce3af2a0d56" (UID: "8be34e66-2c21-48c8-92ef-fce3af2a0d56"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:20:35.165348 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.165131    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8be34e66-2c21-48c8-92ef-fce3af2a0d56-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8be34e66-2c21-48c8-92ef-fce3af2a0d56" (UID: "8be34e66-2c21-48c8-92ef-fce3af2a0d56"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:20:35.165348 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.165217    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-config-volume" (OuterVolumeSpecName: "config-volume") pod "8be34e66-2c21-48c8-92ef-fce3af2a0d56" (UID: "8be34e66-2c21-48c8-92ef-fce3af2a0d56"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:35.166334 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.166275    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8be34e66-2c21-48c8-92ef-fce3af2a0d56" (UID: "8be34e66-2c21-48c8-92ef-fce3af2a0d56"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:35.166454 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.166414    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8be34e66-2c21-48c8-92ef-fce3af2a0d56-kube-api-access-wd5p9" (OuterVolumeSpecName: "kube-api-access-wd5p9") pod "8be34e66-2c21-48c8-92ef-fce3af2a0d56" (UID: "8be34e66-2c21-48c8-92ef-fce3af2a0d56"). InnerVolumeSpecName "kube-api-access-wd5p9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:20:35.167459 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.167423    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8be34e66-2c21-48c8-92ef-fce3af2a0d56-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8be34e66-2c21-48c8-92ef-fce3af2a0d56" (UID: "8be34e66-2c21-48c8-92ef-fce3af2a0d56"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:20:35.167605 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.167585    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8be34e66-2c21-48c8-92ef-fce3af2a0d56" (UID: "8be34e66-2c21-48c8-92ef-fce3af2a0d56"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:35.167776 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.167756    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8be34e66-2c21-48c8-92ef-fce3af2a0d56" (UID: "8be34e66-2c21-48c8-92ef-fce3af2a0d56"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:35.172906 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.172880    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8be34e66-2c21-48c8-92ef-fce3af2a0d56" (UID: "8be34e66-2c21-48c8-92ef-fce3af2a0d56"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:35.179024 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.178977    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-web-config" (OuterVolumeSpecName: "web-config") pod "8be34e66-2c21-48c8-92ef-fce3af2a0d56" (UID: "8be34e66-2c21-48c8-92ef-fce3af2a0d56"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:35.262881 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.262848    2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8be34e66-2c21-48c8-92ef-fce3af2a0d56-config-out\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:35.263039 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.262896    2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-web-config\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:35.263039 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.262908    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:35.263039 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.262919    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wd5p9\" (UniqueName: \"kubernetes.io/projected/8be34e66-2c21-48c8-92ef-fce3af2a0d56-kube-api-access-wd5p9\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:35.263039 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.262929    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:35.263039 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.262940    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:35.263039 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.262949    2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8be34e66-2c21-48c8-92ef-fce3af2a0d56-tls-assets\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:35.263039 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.262957    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8be34e66-2c21-48c8-92ef-fce3af2a0d56-alertmanager-main-db\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:35.263039 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.262966    2556 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-secret-alertmanager-main-tls\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:35.263039 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.262976    2556 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8be34e66-2c21-48c8-92ef-fce3af2a0d56-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:35.263039 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.262984    2556 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-config-volume\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:35.263039 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.262992    2556 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8be34e66-2c21-48c8-92ef-fce3af2a0d56-cluster-tls-config\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:35.432596 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.432516    2556 generic.go:358] "Generic (PLEG): container finished" podID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerID="c20e0bfad9c5e9c6f4cf81f5a8eb20d68cd003994ea443e5e86527ffc2b3a09e" exitCode=0
May 28 17:20:35.432596 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.432544    2556 generic.go:358] "Generic (PLEG): container finished" podID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerID="8c73ce24ffda6050380d0541c187a8c5edec20132d7b4ee5c1cf56581047cb67" exitCode=0
May 28 17:20:35.432756 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.432592    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8be34e66-2c21-48c8-92ef-fce3af2a0d56","Type":"ContainerDied","Data":"c20e0bfad9c5e9c6f4cf81f5a8eb20d68cd003994ea443e5e86527ffc2b3a09e"}
May 28 17:20:35.432756 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.432638    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.432756 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.432650    2556 scope.go:117] "RemoveContainer" containerID="4f46f4cefc70b4a33fad456a7a788a16e7a20f6e46c2485e436713d394246f30"
May 28 17:20:35.432756 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.432638    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8be34e66-2c21-48c8-92ef-fce3af2a0d56","Type":"ContainerDied","Data":"8c73ce24ffda6050380d0541c187a8c5edec20132d7b4ee5c1cf56581047cb67"}
May 28 17:20:35.432904 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.432770    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8be34e66-2c21-48c8-92ef-fce3af2a0d56","Type":"ContainerDied","Data":"0767d8a3e68cfffe873af05f1432a27aa2001953a6641e6efc4213b10aa2818b"}
May 28 17:20:35.441936 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.441872    2556 scope.go:117] "RemoveContainer" containerID="c20e0bfad9c5e9c6f4cf81f5a8eb20d68cd003994ea443e5e86527ffc2b3a09e"
May 28 17:20:35.448629 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.448612    2556 scope.go:117] "RemoveContainer" containerID="ffe2765fb80a96d344f3f389123abc918d39d6d2b1e02d0229fba6a369c2778f"
May 28 17:20:35.454702 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.454683    2556 scope.go:117] "RemoveContainer" containerID="8c73ce24ffda6050380d0541c187a8c5edec20132d7b4ee5c1cf56581047cb67"
May 28 17:20:35.457856 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.457837    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:20:35.462769 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.462746    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:20:35.463085 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.463071    2556 scope.go:117] "RemoveContainer" containerID="0900dd89e5c6469e4304b82fe2ec4cfb2897f2ab27e3c130cfc47cfc007678a9"
May 28 17:20:35.469522 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.469508    2556 scope.go:117] "RemoveContainer" containerID="9c359af5d6ffd280d95f3ff05f47544666ca12b3b7f493052cf3d3612947a0ef"
May 28 17:20:35.476474 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.476459    2556 scope.go:117] "RemoveContainer" containerID="1f31860b16a6e2b14f430600e556e4f467cdae6a0a688817991e8d03bf8d4636"
May 28 17:20:35.483156 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.483142    2556 scope.go:117] "RemoveContainer" containerID="4f46f4cefc70b4a33fad456a7a788a16e7a20f6e46c2485e436713d394246f30"
May 28 17:20:35.483425 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:20:35.483403    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f46f4cefc70b4a33fad456a7a788a16e7a20f6e46c2485e436713d394246f30\": container with ID starting with 4f46f4cefc70b4a33fad456a7a788a16e7a20f6e46c2485e436713d394246f30 not found: ID does not exist" containerID="4f46f4cefc70b4a33fad456a7a788a16e7a20f6e46c2485e436713d394246f30"
May 28 17:20:35.483472 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.483434    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f46f4cefc70b4a33fad456a7a788a16e7a20f6e46c2485e436713d394246f30"} err="failed to get container status \"4f46f4cefc70b4a33fad456a7a788a16e7a20f6e46c2485e436713d394246f30\": rpc error: code = NotFound desc = could not find container \"4f46f4cefc70b4a33fad456a7a788a16e7a20f6e46c2485e436713d394246f30\": container with ID starting with 4f46f4cefc70b4a33fad456a7a788a16e7a20f6e46c2485e436713d394246f30 not found: ID does not exist"
May 28 17:20:35.483472 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.483468    2556 scope.go:117] "RemoveContainer" containerID="c20e0bfad9c5e9c6f4cf81f5a8eb20d68cd003994ea443e5e86527ffc2b3a09e"
May 28 17:20:35.483679 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:20:35.483659    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c20e0bfad9c5e9c6f4cf81f5a8eb20d68cd003994ea443e5e86527ffc2b3a09e\": container with ID starting with c20e0bfad9c5e9c6f4cf81f5a8eb20d68cd003994ea443e5e86527ffc2b3a09e not found: ID does not exist" containerID="c20e0bfad9c5e9c6f4cf81f5a8eb20d68cd003994ea443e5e86527ffc2b3a09e"
May 28 17:20:35.483719 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.483688    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c20e0bfad9c5e9c6f4cf81f5a8eb20d68cd003994ea443e5e86527ffc2b3a09e"} err="failed to get container status \"c20e0bfad9c5e9c6f4cf81f5a8eb20d68cd003994ea443e5e86527ffc2b3a09e\": rpc error: code = NotFound desc = could not find container \"c20e0bfad9c5e9c6f4cf81f5a8eb20d68cd003994ea443e5e86527ffc2b3a09e\": container with ID starting with c20e0bfad9c5e9c6f4cf81f5a8eb20d68cd003994ea443e5e86527ffc2b3a09e not found: ID does not exist"
May 28 17:20:35.483719 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.483703    2556 scope.go:117] "RemoveContainer" containerID="ffe2765fb80a96d344f3f389123abc918d39d6d2b1e02d0229fba6a369c2778f"
May 28 17:20:35.483912 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:20:35.483897    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ffe2765fb80a96d344f3f389123abc918d39d6d2b1e02d0229fba6a369c2778f\": container with ID starting with ffe2765fb80a96d344f3f389123abc918d39d6d2b1e02d0229fba6a369c2778f not found: ID does not exist" containerID="ffe2765fb80a96d344f3f389123abc918d39d6d2b1e02d0229fba6a369c2778f"
May 28 17:20:35.483958 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.483916    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe2765fb80a96d344f3f389123abc918d39d6d2b1e02d0229fba6a369c2778f"} err="failed to get container status \"ffe2765fb80a96d344f3f389123abc918d39d6d2b1e02d0229fba6a369c2778f\": rpc error: code = NotFound desc = could not find container \"ffe2765fb80a96d344f3f389123abc918d39d6d2b1e02d0229fba6a369c2778f\": container with ID starting with ffe2765fb80a96d344f3f389123abc918d39d6d2b1e02d0229fba6a369c2778f not found: ID does not exist"
May 28 17:20:35.483958 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.483929    2556 scope.go:117] "RemoveContainer" containerID="8c73ce24ffda6050380d0541c187a8c5edec20132d7b4ee5c1cf56581047cb67"
May 28 17:20:35.484146 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:20:35.484130    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c73ce24ffda6050380d0541c187a8c5edec20132d7b4ee5c1cf56581047cb67\": container with ID starting with 8c73ce24ffda6050380d0541c187a8c5edec20132d7b4ee5c1cf56581047cb67 not found: ID does not exist" containerID="8c73ce24ffda6050380d0541c187a8c5edec20132d7b4ee5c1cf56581047cb67"
May 28 17:20:35.484189 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.484149    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c73ce24ffda6050380d0541c187a8c5edec20132d7b4ee5c1cf56581047cb67"} err="failed to get container status \"8c73ce24ffda6050380d0541c187a8c5edec20132d7b4ee5c1cf56581047cb67\": rpc error: code = NotFound desc = could not find container \"8c73ce24ffda6050380d0541c187a8c5edec20132d7b4ee5c1cf56581047cb67\": container with ID starting with 8c73ce24ffda6050380d0541c187a8c5edec20132d7b4ee5c1cf56581047cb67 not found: ID does not exist"
May 28 17:20:35.484189 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.484160    2556 scope.go:117] "RemoveContainer" containerID="0900dd89e5c6469e4304b82fe2ec4cfb2897f2ab27e3c130cfc47cfc007678a9"
May 28 17:20:35.484369 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:20:35.484347    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0900dd89e5c6469e4304b82fe2ec4cfb2897f2ab27e3c130cfc47cfc007678a9\": container with ID starting with 0900dd89e5c6469e4304b82fe2ec4cfb2897f2ab27e3c130cfc47cfc007678a9 not found: ID does not exist" containerID="0900dd89e5c6469e4304b82fe2ec4cfb2897f2ab27e3c130cfc47cfc007678a9"
May 28 17:20:35.484448 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.484372    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0900dd89e5c6469e4304b82fe2ec4cfb2897f2ab27e3c130cfc47cfc007678a9"} err="failed to get container status \"0900dd89e5c6469e4304b82fe2ec4cfb2897f2ab27e3c130cfc47cfc007678a9\": rpc error: code = NotFound desc = could not find container \"0900dd89e5c6469e4304b82fe2ec4cfb2897f2ab27e3c130cfc47cfc007678a9\": container with ID starting with 0900dd89e5c6469e4304b82fe2ec4cfb2897f2ab27e3c130cfc47cfc007678a9 not found: ID does not exist"
May 28 17:20:35.484448 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.484387    2556 scope.go:117] "RemoveContainer" containerID="9c359af5d6ffd280d95f3ff05f47544666ca12b3b7f493052cf3d3612947a0ef"
May 28 17:20:35.484577 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:20:35.484564    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c359af5d6ffd280d95f3ff05f47544666ca12b3b7f493052cf3d3612947a0ef\": container with ID starting with 9c359af5d6ffd280d95f3ff05f47544666ca12b3b7f493052cf3d3612947a0ef not found: ID does not exist" containerID="9c359af5d6ffd280d95f3ff05f47544666ca12b3b7f493052cf3d3612947a0ef"
May 28 17:20:35.484616 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.484583    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c359af5d6ffd280d95f3ff05f47544666ca12b3b7f493052cf3d3612947a0ef"} err="failed to get container status \"9c359af5d6ffd280d95f3ff05f47544666ca12b3b7f493052cf3d3612947a0ef\": rpc error: code = NotFound desc = could not find container \"9c359af5d6ffd280d95f3ff05f47544666ca12b3b7f493052cf3d3612947a0ef\": container with ID starting with 9c359af5d6ffd280d95f3ff05f47544666ca12b3b7f493052cf3d3612947a0ef not found: ID does not exist"
May 28 17:20:35.484616 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.484599    2556 scope.go:117] "RemoveContainer" containerID="1f31860b16a6e2b14f430600e556e4f467cdae6a0a688817991e8d03bf8d4636"
May 28 17:20:35.484807 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:20:35.484790    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f31860b16a6e2b14f430600e556e4f467cdae6a0a688817991e8d03bf8d4636\": container with ID starting with 1f31860b16a6e2b14f430600e556e4f467cdae6a0a688817991e8d03bf8d4636 not found: ID does not exist" containerID="1f31860b16a6e2b14f430600e556e4f467cdae6a0a688817991e8d03bf8d4636"
May 28 17:20:35.484855 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.484810    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f31860b16a6e2b14f430600e556e4f467cdae6a0a688817991e8d03bf8d4636"} err="failed to get container status \"1f31860b16a6e2b14f430600e556e4f467cdae6a0a688817991e8d03bf8d4636\": rpc error: code = NotFound desc = could not find container \"1f31860b16a6e2b14f430600e556e4f467cdae6a0a688817991e8d03bf8d4636\": container with ID starting with 1f31860b16a6e2b14f430600e556e4f467cdae6a0a688817991e8d03bf8d4636 not found: ID does not exist"
May 28 17:20:35.484855 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.484823    2556 scope.go:117] "RemoveContainer" containerID="4f46f4cefc70b4a33fad456a7a788a16e7a20f6e46c2485e436713d394246f30"
May 28 17:20:35.485007 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.484986    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f46f4cefc70b4a33fad456a7a788a16e7a20f6e46c2485e436713d394246f30"} err="failed to get container status \"4f46f4cefc70b4a33fad456a7a788a16e7a20f6e46c2485e436713d394246f30\": rpc error: code = NotFound desc = could not find container \"4f46f4cefc70b4a33fad456a7a788a16e7a20f6e46c2485e436713d394246f30\": container with ID starting with 4f46f4cefc70b4a33fad456a7a788a16e7a20f6e46c2485e436713d394246f30 not found: ID does not exist"
May 28 17:20:35.485085 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.485008    2556 scope.go:117] "RemoveContainer" containerID="c20e0bfad9c5e9c6f4cf81f5a8eb20d68cd003994ea443e5e86527ffc2b3a09e"
May 28 17:20:35.485288 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.485265    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c20e0bfad9c5e9c6f4cf81f5a8eb20d68cd003994ea443e5e86527ffc2b3a09e"} err="failed to get container status \"c20e0bfad9c5e9c6f4cf81f5a8eb20d68cd003994ea443e5e86527ffc2b3a09e\": rpc error: code = NotFound desc = could not find container \"c20e0bfad9c5e9c6f4cf81f5a8eb20d68cd003994ea443e5e86527ffc2b3a09e\": container with ID starting with c20e0bfad9c5e9c6f4cf81f5a8eb20d68cd003994ea443e5e86527ffc2b3a09e not found: ID does not exist"
May 28 17:20:35.485522 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.485289    2556 scope.go:117] "RemoveContainer" containerID="ffe2765fb80a96d344f3f389123abc918d39d6d2b1e02d0229fba6a369c2778f"
May 28 17:20:35.485762 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.485666    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ffe2765fb80a96d344f3f389123abc918d39d6d2b1e02d0229fba6a369c2778f"} err="failed to get container status \"ffe2765fb80a96d344f3f389123abc918d39d6d2b1e02d0229fba6a369c2778f\": rpc error: code = NotFound desc = could not find container \"ffe2765fb80a96d344f3f389123abc918d39d6d2b1e02d0229fba6a369c2778f\": container with ID starting with ffe2765fb80a96d344f3f389123abc918d39d6d2b1e02d0229fba6a369c2778f not found: ID does not exist"
May 28 17:20:35.485762 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.485692    2556 scope.go:117] "RemoveContainer" containerID="8c73ce24ffda6050380d0541c187a8c5edec20132d7b4ee5c1cf56581047cb67"
May 28 17:20:35.486177 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.486071    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c73ce24ffda6050380d0541c187a8c5edec20132d7b4ee5c1cf56581047cb67"} err="failed to get container status \"8c73ce24ffda6050380d0541c187a8c5edec20132d7b4ee5c1cf56581047cb67\": rpc error: code = NotFound desc = could not find container \"8c73ce24ffda6050380d0541c187a8c5edec20132d7b4ee5c1cf56581047cb67\": container with ID starting with 8c73ce24ffda6050380d0541c187a8c5edec20132d7b4ee5c1cf56581047cb67 not found: ID does not exist"
May 28 17:20:35.486177 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.486099    2556 scope.go:117] "RemoveContainer" containerID="0900dd89e5c6469e4304b82fe2ec4cfb2897f2ab27e3c130cfc47cfc007678a9"
May 28 17:20:35.486485 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.486460    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0900dd89e5c6469e4304b82fe2ec4cfb2897f2ab27e3c130cfc47cfc007678a9"} err="failed to get container status \"0900dd89e5c6469e4304b82fe2ec4cfb2897f2ab27e3c130cfc47cfc007678a9\": rpc error: code = NotFound desc = could not find container \"0900dd89e5c6469e4304b82fe2ec4cfb2897f2ab27e3c130cfc47cfc007678a9\": container with ID starting with 0900dd89e5c6469e4304b82fe2ec4cfb2897f2ab27e3c130cfc47cfc007678a9 not found: ID does not exist"
May 28 17:20:35.486554 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.486487    2556 scope.go:117] "RemoveContainer" containerID="9c359af5d6ffd280d95f3ff05f47544666ca12b3b7f493052cf3d3612947a0ef"
May 28 17:20:35.486722 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.486703    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c359af5d6ffd280d95f3ff05f47544666ca12b3b7f493052cf3d3612947a0ef"} err="failed to get container status \"9c359af5d6ffd280d95f3ff05f47544666ca12b3b7f493052cf3d3612947a0ef\": rpc error: code = NotFound desc = could not find container \"9c359af5d6ffd280d95f3ff05f47544666ca12b3b7f493052cf3d3612947a0ef\": container with ID starting with 9c359af5d6ffd280d95f3ff05f47544666ca12b3b7f493052cf3d3612947a0ef not found: ID does not exist"
May 28 17:20:35.486799 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.486725    2556 scope.go:117] "RemoveContainer" containerID="1f31860b16a6e2b14f430600e556e4f467cdae6a0a688817991e8d03bf8d4636"
May 28 17:20:35.486939 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.486920    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f31860b16a6e2b14f430600e556e4f467cdae6a0a688817991e8d03bf8d4636"} err="failed to get container status \"1f31860b16a6e2b14f430600e556e4f467cdae6a0a688817991e8d03bf8d4636\": rpc error: code = NotFound desc = could not find container \"1f31860b16a6e2b14f430600e556e4f467cdae6a0a688817991e8d03bf8d4636\": container with ID starting with 1f31860b16a6e2b14f430600e556e4f467cdae6a0a688817991e8d03bf8d4636 not found: ID does not exist"
May 28 17:20:35.487457 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.487439    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:20:35.487821 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.487807    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="prom-label-proxy"
May 28 17:20:35.487853 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.487827    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="prom-label-proxy"
May 28 17:20:35.487853 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.487842    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="kube-rbac-proxy-web"
May 28 17:20:35.487853 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.487848    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="kube-rbac-proxy-web"
May 28 17:20:35.487943 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.487856    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="init-config-reloader"
May 28 17:20:35.487943 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.487862    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="init-config-reloader"
May 28 17:20:35.487943 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.487873    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="config-reloader"
May 28 17:20:35.487943 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.487878    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="config-reloader"
May 28 17:20:35.487943 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.487883    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="kube-rbac-proxy-metric"
May 28 17:20:35.487943 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.487888    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="kube-rbac-proxy-metric"
May 28 17:20:35.487943 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.487898    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="alertmanager"
May 28 17:20:35.487943 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.487906    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="alertmanager"
May 28 17:20:35.487943 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.487919    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="kube-rbac-proxy"
May 28 17:20:35.487943 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.487924    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="kube-rbac-proxy"
May 28 17:20:35.488222 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.487973    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="kube-rbac-proxy-metric"
May 28 17:20:35.488222 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.487989    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="prom-label-proxy"
May 28 17:20:35.488222 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.487997    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="alertmanager"
May 28 17:20:35.488222 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.488003    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="config-reloader"
May 28 17:20:35.488222 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.488010    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="kube-rbac-proxy"
May 28 17:20:35.488222 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.488017    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" containerName="kube-rbac-proxy-web"
May 28 17:20:35.493269 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.493253    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.495709 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.495691    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
May 28 17:20:35.495808 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.495727    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
May 28 17:20:35.496118 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.496101    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
May 28 17:20:35.496208 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.496143    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
May 28 17:20:35.496208 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.496181    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
May 28 17:20:35.496208 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.496201    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
May 28 17:20:35.496379 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.496219    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
May 28 17:20:35.496558 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.496543    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-pbfxr\""
May 28 17:20:35.496734 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.496720    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
May 28 17:20:35.502179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.502148    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
May 28 17:20:35.503717 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.503697    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:20:35.564673 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.564637    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.564819 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.564702    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm2q9\" (UniqueName: \"kubernetes.io/projected/9fdf0802-a55e-4642-85db-7a95787f66d0-kube-api-access-fm2q9\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.564819 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.564729    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.564819 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.564755    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.564819 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.564775    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9fdf0802-a55e-4642-85db-7a95787f66d0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.564962 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.564831    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fdf0802-a55e-4642-85db-7a95787f66d0-config-out\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.564962 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.564867    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fdf0802-a55e-4642-85db-7a95787f66d0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.564962 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.564894    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-web-config\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.564962 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.564917    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.564962 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.564934    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fdf0802-a55e-4642-85db-7a95787f66d0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.564962 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.564958    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fdf0802-a55e-4642-85db-7a95787f66d0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.565136 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.564978    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.565136 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.565000    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-config-volume\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.665897 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.665864    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.666060 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.665908    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fm2q9\" (UniqueName: \"kubernetes.io/projected/9fdf0802-a55e-4642-85db-7a95787f66d0-kube-api-access-fm2q9\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.666060 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.665941    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.666060 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.665978    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.666060 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.666018    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9fdf0802-a55e-4642-85db-7a95787f66d0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.666060 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.666045    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fdf0802-a55e-4642-85db-7a95787f66d0-config-out\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.666345 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.666076    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fdf0802-a55e-4642-85db-7a95787f66d0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.666345 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.666104    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-web-config\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.666498 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.666470    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.666558 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.666518    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fdf0802-a55e-4642-85db-7a95787f66d0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.666558 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.666545    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9fdf0802-a55e-4642-85db-7a95787f66d0-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.666660 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.666562    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fdf0802-a55e-4642-85db-7a95787f66d0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.666660 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.666610    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.666660 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.666651    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-config-volume\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.667270 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.667218    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9fdf0802-a55e-4642-85db-7a95787f66d0-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.668195 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.668168    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9fdf0802-a55e-4642-85db-7a95787f66d0-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.668821 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.668797    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9fdf0802-a55e-4642-85db-7a95787f66d0-config-out\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.669107 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.669084    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.669196 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.669177    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.669273 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.669243    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9fdf0802-a55e-4642-85db-7a95787f66d0-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.669481 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.669463    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-web-config\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.669783 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.669763    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-config-volume\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.669921 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.669899    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.670090 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.670070    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.670720 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.670704    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9fdf0802-a55e-4642-85db-7a95787f66d0-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.673775 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.673753    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm2q9\" (UniqueName: \"kubernetes.io/projected/9fdf0802-a55e-4642-85db-7a95787f66d0-kube-api-access-fm2q9\") pod \"alertmanager-main-0\" (UID: \"9fdf0802-a55e-4642-85db-7a95787f66d0\") " pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.804325 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.804280    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
May 28 17:20:35.938774 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:35.938750    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
May 28 17:20:35.940911 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:20:35.940861    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fdf0802_a55e_4642_85db_7a95787f66d0.slice/crio-4142137e51bda8f87f56c1a7f7640df8e1a77180bbc67b60e2ee1a1253cede53 WatchSource:0}: Error finding container 4142137e51bda8f87f56c1a7f7640df8e1a77180bbc67b60e2ee1a1253cede53: Status 404 returned error can't find the container with id 4142137e51bda8f87f56c1a7f7640df8e1a77180bbc67b60e2ee1a1253cede53
May 28 17:20:36.437065 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:36.437031    2556 generic.go:358] "Generic (PLEG): container finished" podID="9fdf0802-a55e-4642-85db-7a95787f66d0" containerID="6a65eee9490df374dcf824d835dbdf70fc291221aabb2add285909e4a44c8b96" exitCode=0
May 28 17:20:36.437533 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:36.437123    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fdf0802-a55e-4642-85db-7a95787f66d0","Type":"ContainerDied","Data":"6a65eee9490df374dcf824d835dbdf70fc291221aabb2add285909e4a44c8b96"}
May 28 17:20:36.437533 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:36.437163    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fdf0802-a55e-4642-85db-7a95787f66d0","Type":"ContainerStarted","Data":"4142137e51bda8f87f56c1a7f7640df8e1a77180bbc67b60e2ee1a1253cede53"}
May 28 17:20:36.633988 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:36.633943    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8be34e66-2c21-48c8-92ef-fce3af2a0d56" path="/var/lib/kubelet/pods/8be34e66-2c21-48c8-92ef-fce3af2a0d56/volumes"
May 28 17:20:37.444125 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.444083    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fdf0802-a55e-4642-85db-7a95787f66d0","Type":"ContainerStarted","Data":"ea2494436d038a8b1c43e2e686f8e77779d2bb1b05f908eb6e28482650b37746"}
May 28 17:20:37.444125 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.444128    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fdf0802-a55e-4642-85db-7a95787f66d0","Type":"ContainerStarted","Data":"170922048d64938d434b3a8709a6f96efae8f35da5786baf70345133aa977c4d"}
May 28 17:20:37.444553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.444139    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fdf0802-a55e-4642-85db-7a95787f66d0","Type":"ContainerStarted","Data":"a79cf64023aa36bc7a347b7b534b73c78876cbd64d0bea9ca2e570e384c96994"}
May 28 17:20:37.444553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.444147    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fdf0802-a55e-4642-85db-7a95787f66d0","Type":"ContainerStarted","Data":"8dd9b90a42b6762939d0a1000898247e79d3915b6233937af49e429a23560b6f"}
May 28 17:20:37.444553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.444156    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fdf0802-a55e-4642-85db-7a95787f66d0","Type":"ContainerStarted","Data":"a654e0e68ae6cece67ae5ae3c9ecc8cff3134d7331bd42810543c70e3ed7e953"}
May 28 17:20:37.444553 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.444163    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9fdf0802-a55e-4642-85db-7a95787f66d0","Type":"ContainerStarted","Data":"c8e0a64f8458617ffbb9180141ca2415ffd30cd19c5e00d85c479a77ccbb6fb8"}
May 28 17:20:37.471364 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.471274    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.471255642 podStartE2EDuration="2.471255642s" podCreationTimestamp="2026-05-28 17:20:35 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:20:37.470100436 +0000 UTC m=+223.445904792" watchObservedRunningTime="2026-05-28 17:20:37.471255642 +0000 UTC m=+223.447060001"
May 28 17:20:37.871911 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.871871    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-566c55d94c-w8f82"]
May 28 17:20:37.875765 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.875740    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:37.877944 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.877920    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-sd5r4\""
May 28 17:20:37.878168 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.878152    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
May 28 17:20:37.878441 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.878422    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
May 28 17:20:37.878682 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.878665    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
May 28 17:20:37.878731 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.878701    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
May 28 17:20:37.878777 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.878703    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
May 28 17:20:37.884226 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.884206    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
May 28 17:20:37.888219 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.888198    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-566c55d94c-w8f82"]
May 28 17:20:37.989116 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.989077    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4ztq\" (UniqueName: \"kubernetes.io/projected/f5beaac8-a4d5-44e5-b342-186c86145375-kube-api-access-l4ztq\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:37.989289 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.989145    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5beaac8-a4d5-44e5-b342-186c86145375-serving-certs-ca-bundle\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:37.989289 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.989178    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5beaac8-a4d5-44e5-b342-186c86145375-metrics-client-ca\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:37.989289 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.989197    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5beaac8-a4d5-44e5-b342-186c86145375-telemeter-trusted-ca-bundle\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:37.989289 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.989234    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f5beaac8-a4d5-44e5-b342-186c86145375-federate-client-tls\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:37.989460 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.989287    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5beaac8-a4d5-44e5-b342-186c86145375-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:37.989460 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.989362    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f5beaac8-a4d5-44e5-b342-186c86145375-telemeter-client-tls\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:37.989460 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:37.989388    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f5beaac8-a4d5-44e5-b342-186c86145375-secret-telemeter-client\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:38.090586 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.090554    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4ztq\" (UniqueName: \"kubernetes.io/projected/f5beaac8-a4d5-44e5-b342-186c86145375-kube-api-access-l4ztq\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:38.090715 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.090592    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5beaac8-a4d5-44e5-b342-186c86145375-serving-certs-ca-bundle\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:38.090715 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.090610    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5beaac8-a4d5-44e5-b342-186c86145375-metrics-client-ca\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:38.090715 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.090638    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5beaac8-a4d5-44e5-b342-186c86145375-telemeter-trusted-ca-bundle\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:38.090715 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.090675    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f5beaac8-a4d5-44e5-b342-186c86145375-federate-client-tls\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:38.090982 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.090734    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5beaac8-a4d5-44e5-b342-186c86145375-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:38.090982 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.090813    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f5beaac8-a4d5-44e5-b342-186c86145375-telemeter-client-tls\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:38.090982 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.090846    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f5beaac8-a4d5-44e5-b342-186c86145375-secret-telemeter-client\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:38.091437 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.091408    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5beaac8-a4d5-44e5-b342-186c86145375-serving-certs-ca-bundle\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:38.091437 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.091430    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5beaac8-a4d5-44e5-b342-186c86145375-metrics-client-ca\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:38.092016 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.091991    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f5beaac8-a4d5-44e5-b342-186c86145375-telemeter-trusted-ca-bundle\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:38.093114 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.093086    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5beaac8-a4d5-44e5-b342-186c86145375-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:38.093342 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.093323    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/f5beaac8-a4d5-44e5-b342-186c86145375-telemeter-client-tls\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:38.093450 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.093430    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/f5beaac8-a4d5-44e5-b342-186c86145375-secret-telemeter-client\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:38.093494 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.093469    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/f5beaac8-a4d5-44e5-b342-186c86145375-federate-client-tls\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:38.098818 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.098802    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4ztq\" (UniqueName: \"kubernetes.io/projected/f5beaac8-a4d5-44e5-b342-186c86145375-kube-api-access-l4ztq\") pod \"telemeter-client-566c55d94c-w8f82\" (UID: \"f5beaac8-a4d5-44e5-b342-186c86145375\") " pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:38.186681 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.186591    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82"
May 28 17:20:38.245634 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.245605    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 17:20:38.246225 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.246051    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="prometheus" containerID="cri-o://8b0373949546e2ab010d9a5761ccaaa18e278ba23bd3c178727fa34e78c9358e" gracePeriod=600
May 28 17:20:38.246225 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.246079    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="thanos-sidecar" containerID="cri-o://7d75c204c385ab1eb5af1618eccbac5d474cbb3f422e61ee86b7353524ca8e36" gracePeriod=600
May 28 17:20:38.246225 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.246109    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="kube-rbac-proxy-web" containerID="cri-o://a2fe932f45ceba4a04a4fc289d683a0a032229e96b8a0a3760df0c39be11ce34" gracePeriod=600
May 28 17:20:38.246225 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.246126    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a97eb2357055d3de85793963b9e8c282aadf203e0c6780af69280b1fbe166bda" gracePeriod=600
May 28 17:20:38.246225 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.246144    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="config-reloader" containerID="cri-o://44b76923c335661ba0355b6da841740300ebb28c24e34634ab4b73042a25a25d" gracePeriod=600
May 28 17:20:38.246225 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.246075    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="kube-rbac-proxy" containerID="cri-o://46c8c5233ce90dd74c0a106c405e5ebc0b9c17f3f8554e1bae07d9728d00d9ec" gracePeriod=600
May 28 17:20:38.330791 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.330765    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-566c55d94c-w8f82"]
May 28 17:20:38.351185 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:20:38.351152    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5beaac8_a4d5_44e5_b342_186c86145375.slice/crio-8b5d79e6d43e9c740efcc979d0e6f127c73f68c94a1048361939b78f35812791 WatchSource:0}: Error finding container 8b5d79e6d43e9c740efcc979d0e6f127c73f68c94a1048361939b78f35812791: Status 404 returned error can't find the container with id 8b5d79e6d43e9c740efcc979d0e6f127c73f68c94a1048361939b78f35812791
May 28 17:20:38.450697 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.450615    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82" event={"ID":"f5beaac8-a4d5-44e5-b342-186c86145375","Type":"ContainerStarted","Data":"8b5d79e6d43e9c740efcc979d0e6f127c73f68c94a1048361939b78f35812791"}
May 28 17:20:38.453788 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.453762    2556 generic.go:358] "Generic (PLEG): container finished" podID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerID="a97eb2357055d3de85793963b9e8c282aadf203e0c6780af69280b1fbe166bda" exitCode=0
May 28 17:20:38.453788 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.453786    2556 generic.go:358] "Generic (PLEG): container finished" podID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerID="46c8c5233ce90dd74c0a106c405e5ebc0b9c17f3f8554e1bae07d9728d00d9ec" exitCode=0
May 28 17:20:38.453964 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.453795    2556 generic.go:358] "Generic (PLEG): container finished" podID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerID="a2fe932f45ceba4a04a4fc289d683a0a032229e96b8a0a3760df0c39be11ce34" exitCode=0
May 28 17:20:38.453964 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.453804    2556 generic.go:358] "Generic (PLEG): container finished" podID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerID="7d75c204c385ab1eb5af1618eccbac5d474cbb3f422e61ee86b7353524ca8e36" exitCode=0
May 28 17:20:38.453964 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.453811    2556 generic.go:358] "Generic (PLEG): container finished" podID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerID="44b76923c335661ba0355b6da841740300ebb28c24e34634ab4b73042a25a25d" exitCode=0
May 28 17:20:38.453964 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.453820    2556 generic.go:358] "Generic (PLEG): container finished" podID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerID="8b0373949546e2ab010d9a5761ccaaa18e278ba23bd3c178727fa34e78c9358e" exitCode=0
May 28 17:20:38.453964 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.453829    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec3c9510-50de-42e7-b5dd-519cb5d2768f","Type":"ContainerDied","Data":"a97eb2357055d3de85793963b9e8c282aadf203e0c6780af69280b1fbe166bda"}
May 28 17:20:38.453964 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.453873    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec3c9510-50de-42e7-b5dd-519cb5d2768f","Type":"ContainerDied","Data":"46c8c5233ce90dd74c0a106c405e5ebc0b9c17f3f8554e1bae07d9728d00d9ec"}
May 28 17:20:38.453964 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.453891    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec3c9510-50de-42e7-b5dd-519cb5d2768f","Type":"ContainerDied","Data":"a2fe932f45ceba4a04a4fc289d683a0a032229e96b8a0a3760df0c39be11ce34"}
May 28 17:20:38.453964 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.453904    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec3c9510-50de-42e7-b5dd-519cb5d2768f","Type":"ContainerDied","Data":"7d75c204c385ab1eb5af1618eccbac5d474cbb3f422e61ee86b7353524ca8e36"}
May 28 17:20:38.453964 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.453918    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec3c9510-50de-42e7-b5dd-519cb5d2768f","Type":"ContainerDied","Data":"44b76923c335661ba0355b6da841740300ebb28c24e34634ab4b73042a25a25d"}
May 28 17:20:38.453964 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.453930    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec3c9510-50de-42e7-b5dd-519cb5d2768f","Type":"ContainerDied","Data":"8b0373949546e2ab010d9a5761ccaaa18e278ba23bd3c178727fa34e78c9358e"}
May 28 17:20:38.484094 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.484072    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:38.594760 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.594725    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-configmap-metrics-client-ca\") pod \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") "
May 28 17:20:38.594941 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.594776    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") "
May 28 17:20:38.594941 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.594795    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-thanos-prometheus-http-client-file\") pod \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") "
May 28 17:20:38.594941 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.594813    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-prometheus-k8s-rulefiles-0\") pod \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") "
May 28 17:20:38.594941 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.594829    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-kube-rbac-proxy\") pod \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") "
May 28 17:20:38.594941 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.594878    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-configmap-kubelet-serving-ca-bundle\") pod \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") "
May 28 17:20:38.594941 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.594901    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-prometheus-trusted-ca-bundle\") pod \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") "
May 28 17:20:38.594941 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.594932    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g2989\" (UniqueName: \"kubernetes.io/projected/ec3c9510-50de-42e7-b5dd-519cb5d2768f-kube-api-access-g2989\") pod \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") "
May 28 17:20:38.595284 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.594957    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-configmap-serving-certs-ca-bundle\") pod \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") "
May 28 17:20:38.595284 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.594984    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-web-config\") pod \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") "
May 28 17:20:38.595284 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.595014    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec3c9510-50de-42e7-b5dd-519cb5d2768f-tls-assets\") pod \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") "
May 28 17:20:38.595284 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.595050    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-config\") pod \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") "
May 28 17:20:38.595284 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.595081    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec3c9510-50de-42e7-b5dd-519cb5d2768f-prometheus-k8s-db\") pod \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") "
May 28 17:20:38.595284 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.595111    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-metrics-client-certs\") pod \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") "
May 28 17:20:38.595284 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.595158    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-prometheus-k8s-tls\") pod \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") "
May 28 17:20:38.595284 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.595181    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-grpc-tls\") pod \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") "
May 28 17:20:38.595284 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.595219    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") "
May 28 17:20:38.595284 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.595254    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec3c9510-50de-42e7-b5dd-519cb5d2768f-config-out\") pod \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\" (UID: \"ec3c9510-50de-42e7-b5dd-519cb5d2768f\") "
May 28 17:20:38.595800 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.595293    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ec3c9510-50de-42e7-b5dd-519cb5d2768f" (UID: "ec3c9510-50de-42e7-b5dd-519cb5d2768f"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:20:38.595800 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.595385    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ec3c9510-50de-42e7-b5dd-519cb5d2768f" (UID: "ec3c9510-50de-42e7-b5dd-519cb5d2768f"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:20:38.595800 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.595684    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ec3c9510-50de-42e7-b5dd-519cb5d2768f" (UID: "ec3c9510-50de-42e7-b5dd-519cb5d2768f"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:20:38.595948 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.595902    2556 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:38.595948 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.595927    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-prometheus-trusted-ca-bundle\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:38.595948 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.595944    2556 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-configmap-metrics-client-ca\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:38.596718 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.596683    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ec3c9510-50de-42e7-b5dd-519cb5d2768f" (UID: "ec3c9510-50de-42e7-b5dd-519cb5d2768f"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:20:38.597346 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.597319    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ec3c9510-50de-42e7-b5dd-519cb5d2768f" (UID: "ec3c9510-50de-42e7-b5dd-519cb5d2768f"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 28 17:20:38.597742 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.597690    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ec3c9510-50de-42e7-b5dd-519cb5d2768f" (UID: "ec3c9510-50de-42e7-b5dd-519cb5d2768f"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:38.598713 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.598666    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec3c9510-50de-42e7-b5dd-519cb5d2768f-config-out" (OuterVolumeSpecName: "config-out") pod "ec3c9510-50de-42e7-b5dd-519cb5d2768f" (UID: "ec3c9510-50de-42e7-b5dd-519cb5d2768f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:20:38.598713 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.598677    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ec3c9510-50de-42e7-b5dd-519cb5d2768f" (UID: "ec3c9510-50de-42e7-b5dd-519cb5d2768f"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:38.599016 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.598991    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec3c9510-50de-42e7-b5dd-519cb5d2768f-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ec3c9510-50de-42e7-b5dd-519cb5d2768f" (UID: "ec3c9510-50de-42e7-b5dd-519cb5d2768f"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 28 17:20:38.599410 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.599380    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ec3c9510-50de-42e7-b5dd-519cb5d2768f" (UID: "ec3c9510-50de-42e7-b5dd-519cb5d2768f"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:38.599495 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.599408    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ec3c9510-50de-42e7-b5dd-519cb5d2768f" (UID: "ec3c9510-50de-42e7-b5dd-519cb5d2768f"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:38.599605 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.599585    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec3c9510-50de-42e7-b5dd-519cb5d2768f-kube-api-access-g2989" (OuterVolumeSpecName: "kube-api-access-g2989") pod "ec3c9510-50de-42e7-b5dd-519cb5d2768f" (UID: "ec3c9510-50de-42e7-b5dd-519cb5d2768f"). InnerVolumeSpecName "kube-api-access-g2989". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:20:38.599751 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.599736    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-config" (OuterVolumeSpecName: "config") pod "ec3c9510-50de-42e7-b5dd-519cb5d2768f" (UID: "ec3c9510-50de-42e7-b5dd-519cb5d2768f"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:38.599901 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.599874    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ec3c9510-50de-42e7-b5dd-519cb5d2768f" (UID: "ec3c9510-50de-42e7-b5dd-519cb5d2768f"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:38.600038 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.600023    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec3c9510-50de-42e7-b5dd-519cb5d2768f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ec3c9510-50de-42e7-b5dd-519cb5d2768f" (UID: "ec3c9510-50de-42e7-b5dd-519cb5d2768f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:20:38.600440 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.600426    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ec3c9510-50de-42e7-b5dd-519cb5d2768f" (UID: "ec3c9510-50de-42e7-b5dd-519cb5d2768f"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:38.600560 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.600540    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ec3c9510-50de-42e7-b5dd-519cb5d2768f" (UID: "ec3c9510-50de-42e7-b5dd-519cb5d2768f"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:38.611137 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.611114    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-web-config" (OuterVolumeSpecName: "web-config") pod "ec3c9510-50de-42e7-b5dd-519cb5d2768f" (UID: "ec3c9510-50de-42e7-b5dd-519cb5d2768f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:20:38.696433 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.696398    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ec3c9510-50de-42e7-b5dd-519cb5d2768f-prometheus-k8s-db\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:38.696433 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.696432    2556 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-metrics-client-certs\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:38.696660 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.696446    2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-prometheus-k8s-tls\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:38.696660 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.696460    2556 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-grpc-tls\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:38.696660 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.696473    2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:38.696660 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.696485    2556 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec3c9510-50de-42e7-b5dd-519cb5d2768f-config-out\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:38.696660 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.696497    2556 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:38.696660 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.696509    2556 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-thanos-prometheus-http-client-file\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:38.696660 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.696522    2556 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:38.696660 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.696534    2556 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-secret-kube-rbac-proxy\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:38.696660 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.696548    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g2989\" (UniqueName: \"kubernetes.io/projected/ec3c9510-50de-42e7-b5dd-519cb5d2768f-kube-api-access-g2989\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:38.696660 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.696562    2556 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec3c9510-50de-42e7-b5dd-519cb5d2768f-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:38.696660 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.696575    2556 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-web-config\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:38.696660 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.696587    2556 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec3c9510-50de-42e7-b5dd-519cb5d2768f-tls-assets\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:38.696660 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:38.696598    2556 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ec3c9510-50de-42e7-b5dd-519cb5d2768f-config\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:20:39.460731 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.460638    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ec3c9510-50de-42e7-b5dd-519cb5d2768f","Type":"ContainerDied","Data":"98d4238726929eee95cb593ea5c10b8ac5d5aee2abe8a07e8b936e414e371312"}
May 28 17:20:39.460731 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.460696    2556 scope.go:117] "RemoveContainer" containerID="a97eb2357055d3de85793963b9e8c282aadf203e0c6780af69280b1fbe166bda"
May 28 17:20:39.461213 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.460730    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.470293 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.470266    2556 scope.go:117] "RemoveContainer" containerID="46c8c5233ce90dd74c0a106c405e5ebc0b9c17f3f8554e1bae07d9728d00d9ec"
May 28 17:20:39.482663 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.482636    2556 scope.go:117] "RemoveContainer" containerID="a2fe932f45ceba4a04a4fc289d683a0a032229e96b8a0a3760df0c39be11ce34"
May 28 17:20:39.489353 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.489324    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 17:20:39.494054 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.494031    2556 scope.go:117] "RemoveContainer" containerID="7d75c204c385ab1eb5af1618eccbac5d474cbb3f422e61ee86b7353524ca8e36"
May 28 17:20:39.494844 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.494819    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 17:20:39.502130 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.502100    2556 scope.go:117] "RemoveContainer" containerID="44b76923c335661ba0355b6da841740300ebb28c24e34634ab4b73042a25a25d"
May 28 17:20:39.508780 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.508765    2556 scope.go:117] "RemoveContainer" containerID="8b0373949546e2ab010d9a5761ccaaa18e278ba23bd3c178727fa34e78c9358e"
May 28 17:20:39.515890 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.515868    2556 scope.go:117] "RemoveContainer" containerID="e7e5ecf9c6680eabfaf484299114dadc26c09df9cfa0119893aadd8adca1860e"
May 28 17:20:39.521270 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521251    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 17:20:39.521613 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521599    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="init-config-reloader"
May 28 17:20:39.521655 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521614    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="init-config-reloader"
May 28 17:20:39.521655 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521621    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="kube-rbac-proxy-web"
May 28 17:20:39.521655 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521626    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="kube-rbac-proxy-web"
May 28 17:20:39.521655 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521635    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="kube-rbac-proxy"
May 28 17:20:39.521655 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521641    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="kube-rbac-proxy"
May 28 17:20:39.521655 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521651    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="thanos-sidecar"
May 28 17:20:39.521655 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521656    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="thanos-sidecar"
May 28 17:20:39.521874 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521669    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="config-reloader"
May 28 17:20:39.521874 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521675    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="config-reloader"
May 28 17:20:39.521874 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521683    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="prometheus"
May 28 17:20:39.521874 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521689    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="prometheus"
May 28 17:20:39.521874 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521695    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="kube-rbac-proxy-thanos"
May 28 17:20:39.521874 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521700    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="kube-rbac-proxy-thanos"
May 28 17:20:39.521874 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521764    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="kube-rbac-proxy-thanos"
May 28 17:20:39.521874 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521779    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="kube-rbac-proxy-web"
May 28 17:20:39.521874 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521793    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="config-reloader"
May 28 17:20:39.521874 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521803    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="prometheus"
May 28 17:20:39.521874 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521816    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="thanos-sidecar"
May 28 17:20:39.521874 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.521826    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" containerName="kube-rbac-proxy"
May 28 17:20:39.527488 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.527471    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.530273 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.530250    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 28 17:20:39.530369 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.530254    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 28 17:20:39.530609 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.530511    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 28 17:20:39.530745 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.530603    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 28 17:20:39.530745 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.530674    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-rlqn4\""
May 28 17:20:39.530745 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.530702    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-9761qv8aad35r\""
May 28 17:20:39.531001 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.530769    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 28 17:20:39.531124 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.531105    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 28 17:20:39.531558 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.531541    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 28 17:20:39.531655 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.531586    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 28 17:20:39.531655 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.531620    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 28 17:20:39.531876 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.531830    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 28 17:20:39.531979 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.531919    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 28 17:20:39.534800 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.534614    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 28 17:20:39.538346 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.538266    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 28 17:20:39.540062 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.540042    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 17:20:39.604192 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.604159    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.604192 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.604195    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.604420 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.604236    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.604420 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.604271    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mmjp\" (UniqueName: \"kubernetes.io/projected/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-kube-api-access-2mmjp\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.604420 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.604329    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.604420 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.604347    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.604420 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.604368    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-config\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.604420 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.604384    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.604701 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.604466    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.604701 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.604525    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.604701 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.604556    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.604701 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.604587    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.604701 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.604614    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.604701 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.604653    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-config-out\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.604701 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.604692    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-web-config\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.604955 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.604724    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.604955 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.604757    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.604955 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.604789    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.705994 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.705959    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.706178 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.706025    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.706178 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.706055    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.706178 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.706076    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.706178 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.706100    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.706178 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.706137    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-config-out\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.706178 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.706158    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-web-config\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.706791 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.706360    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.706791 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.706410    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.706791 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.706448    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.706791 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.706486    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.706791 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.706512    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.706791 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.706541    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.706791 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.706579    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2mmjp\" (UniqueName: \"kubernetes.io/projected/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-kube-api-access-2mmjp\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.706791 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.706588    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.706791 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.706605    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.706791 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.706657    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.706791 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.706702    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-config\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.706791 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.706730    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.707419 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.706910    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.707419 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.706988    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.708776 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.707841    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.708776 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.708471    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.709945 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.709658    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.709945 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.709754    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.709945 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.709765    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.710179 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.710120    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-web-config\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.710241 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.710192    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.710607 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.710562    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.710812 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.710742    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.712207 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.712178    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.712604 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.712578    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-config\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.712735 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.712717    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.712881 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.712860    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-config-out\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.713283 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.713257    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.720019 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.719995    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mmjp\" (UniqueName: \"kubernetes.io/projected/52efc007-02e6-48d5-8cc3-bde9ea1d86e2-kube-api-access-2mmjp\") pod \"prometheus-k8s-0\" (UID: \"52efc007-02e6-48d5-8cc3-bde9ea1d86e2\") " pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:39.838107 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:39.838069    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:20:40.186064 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:40.186019    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 28 17:20:40.187875 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:20:40.187845    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52efc007_02e6_48d5_8cc3_bde9ea1d86e2.slice/crio-1944f2579ca3fb7c6b5d3ac4df8b6abfd3236511499d0f9adb8e28b668bb7a4a WatchSource:0}: Error finding container 1944f2579ca3fb7c6b5d3ac4df8b6abfd3236511499d0f9adb8e28b668bb7a4a: Status 404 returned error can't find the container with id 1944f2579ca3fb7c6b5d3ac4df8b6abfd3236511499d0f9adb8e28b668bb7a4a
May 28 17:20:40.467912 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:40.467841    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82" event={"ID":"f5beaac8-a4d5-44e5-b342-186c86145375","Type":"ContainerStarted","Data":"e9f3b3b723e836955e68cb9fdea68069491c3429f201744a4051e9469646ea44"}
May 28 17:20:40.467912 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:40.467878    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82" event={"ID":"f5beaac8-a4d5-44e5-b342-186c86145375","Type":"ContainerStarted","Data":"84c2e214a1d714e003759d55a49187f5c799841332bc7449cdfec806a965b4f1"}
May 28 17:20:40.467912 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:40.467888    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82" event={"ID":"f5beaac8-a4d5-44e5-b342-186c86145375","Type":"ContainerStarted","Data":"c385d6f2e5d64d6416554ee717ea5cb97abb8925db944c88b10623377ea60263"}
May 28 17:20:40.469351 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:40.469291    2556 generic.go:358] "Generic (PLEG): container finished" podID="52efc007-02e6-48d5-8cc3-bde9ea1d86e2" containerID="e5959bea32b5bc689593566ac94d6713d0546400dccd0df93411d6861c4c6b3b" exitCode=0
May 28 17:20:40.469487 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:40.469350    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52efc007-02e6-48d5-8cc3-bde9ea1d86e2","Type":"ContainerDied","Data":"e5959bea32b5bc689593566ac94d6713d0546400dccd0df93411d6861c4c6b3b"}
May 28 17:20:40.469487 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:40.469383    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52efc007-02e6-48d5-8cc3-bde9ea1d86e2","Type":"ContainerStarted","Data":"1944f2579ca3fb7c6b5d3ac4df8b6abfd3236511499d0f9adb8e28b668bb7a4a"}
May 28 17:20:40.491578 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:40.491533    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-566c55d94c-w8f82" podStartSLOduration=1.758303258 podStartE2EDuration="3.491520254s" podCreationTimestamp="2026-05-28 17:20:37 +0000 UTC" firstStartedPulling="2026-05-28 17:20:38.354605592 +0000 UTC m=+224.330409956" lastFinishedPulling="2026-05-28 17:20:40.087822597 +0000 UTC m=+226.063626952" observedRunningTime="2026-05-28 17:20:40.489489578 +0000 UTC m=+226.465293972" watchObservedRunningTime="2026-05-28 17:20:40.491520254 +0000 UTC m=+226.467324610"
May 28 17:20:40.633664 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:40.633634    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec3c9510-50de-42e7-b5dd-519cb5d2768f" path="/var/lib/kubelet/pods/ec3c9510-50de-42e7-b5dd-519cb5d2768f/volumes"
May 28 17:20:41.477398 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:41.477292    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52efc007-02e6-48d5-8cc3-bde9ea1d86e2","Type":"ContainerStarted","Data":"438486cdb582afb9844a8827026e4c32b5aad367fac7545f9c8d337f266823ab"}
May 28 17:20:41.477398 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:41.477359    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52efc007-02e6-48d5-8cc3-bde9ea1d86e2","Type":"ContainerStarted","Data":"50680673da5d40e7e34d5dd6f30bd10e40139eb933bc877f3954162d7569d24d"}
May 28 17:20:41.477398 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:41.477376    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52efc007-02e6-48d5-8cc3-bde9ea1d86e2","Type":"ContainerStarted","Data":"0ef18c4745cb12ee0d18040ec2e98461d5a5b9771f510eea157400d7b84499fb"}
May 28 17:20:41.477398 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:41.477386    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52efc007-02e6-48d5-8cc3-bde9ea1d86e2","Type":"ContainerStarted","Data":"1375f9dd626c2aee5350aae8674f7ca42afa8610e206f9d568bf75e7056e3586"}
May 28 17:20:41.477398 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:41.477398    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52efc007-02e6-48d5-8cc3-bde9ea1d86e2","Type":"ContainerStarted","Data":"db7e761757165cd617eed0507b0fd02292cf9f3bdb0d3f4fd9063edf828ca63a"}
May 28 17:20:41.477879 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:41.477410    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"52efc007-02e6-48d5-8cc3-bde9ea1d86e2","Type":"ContainerStarted","Data":"71189ccad4e8cd4087f8f5680fb6efc56cf9cc2b3ef88f3d3f7ed6d982b7d238"}
May 28 17:20:41.507896 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:41.507845    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.507830096 podStartE2EDuration="2.507830096s" podCreationTimestamp="2026-05-28 17:20:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:20:41.505269639 +0000 UTC m=+227.481074009" watchObservedRunningTime="2026-05-28 17:20:41.507830096 +0000 UTC m=+227.483634452"
May 28 17:20:44.838508 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:20:44.838453    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:21:39.838794 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:21:39.838762    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:21:39.854118 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:21:39.854091    2556 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:21:40.665673 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:21:40.665642    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 28 17:21:54.525757 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:21:54.525725    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/1.log"
May 28 17:21:54.526184 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:21:54.526028    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/1.log"
May 28 17:21:54.530876 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:21:54.530850    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4lcb_9bd29f05-c1e0-4fe5-82e8-62974c41bd76/ovn-acl-logging/0.log"
May 28 17:21:54.531004 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:21:54.530895    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4lcb_9bd29f05-c1e0-4fe5-82e8-62974c41bd76/ovn-acl-logging/0.log"
May 28 17:21:54.542833 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:21:54.542814    2556 kubelet.go:1628] "Image garbage collection succeeded"
May 28 17:24:06.973257 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:06.973176    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6795fd7c67-dnsq6"]
May 28 17:24:06.976605 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:06.976587    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-dnsq6"
May 28 17:24:06.983244 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:06.983218    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 28 17:24:06.983378 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:06.983283    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 28 17:24:06.983378 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:06.983338    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 28 17:24:06.983669 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:06.983650    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 28 17:24:06.984099 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:06.984084    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kmhgz\""
May 28 17:24:07.007880 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:07.007853    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6795fd7c67-dnsq6"]
May 28 17:24:07.032323 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:07.032283    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bbea426-07aa-421b-85a6-5e91ebb306d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-6795fd7c67-dnsq6\" (UID: \"1bbea426-07aa-421b-85a6-5e91ebb306d1\") " pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-dnsq6"
May 28 17:24:07.032483 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:07.032412    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t46rc\" (UniqueName: \"kubernetes.io/projected/1bbea426-07aa-421b-85a6-5e91ebb306d1-kube-api-access-t46rc\") pod \"opendatahub-operator-controller-manager-6795fd7c67-dnsq6\" (UID: \"1bbea426-07aa-421b-85a6-5e91ebb306d1\") " pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-dnsq6"
May 28 17:24:07.032483 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:07.032462    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1bbea426-07aa-421b-85a6-5e91ebb306d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6795fd7c67-dnsq6\" (UID: \"1bbea426-07aa-421b-85a6-5e91ebb306d1\") " pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-dnsq6"
May 28 17:24:07.133513 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:07.133487    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t46rc\" (UniqueName: \"kubernetes.io/projected/1bbea426-07aa-421b-85a6-5e91ebb306d1-kube-api-access-t46rc\") pod \"opendatahub-operator-controller-manager-6795fd7c67-dnsq6\" (UID: \"1bbea426-07aa-421b-85a6-5e91ebb306d1\") " pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-dnsq6"
May 28 17:24:07.133651 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:07.133526    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1bbea426-07aa-421b-85a6-5e91ebb306d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6795fd7c67-dnsq6\" (UID: \"1bbea426-07aa-421b-85a6-5e91ebb306d1\") " pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-dnsq6"
May 28 17:24:07.133651 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:07.133575    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bbea426-07aa-421b-85a6-5e91ebb306d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-6795fd7c67-dnsq6\" (UID: \"1bbea426-07aa-421b-85a6-5e91ebb306d1\") " pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-dnsq6"
May 28 17:24:07.135870 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:07.135842    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1bbea426-07aa-421b-85a6-5e91ebb306d1-webhook-cert\") pod \"opendatahub-operator-controller-manager-6795fd7c67-dnsq6\" (UID: \"1bbea426-07aa-421b-85a6-5e91ebb306d1\") " pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-dnsq6"
May 28 17:24:07.135974 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:07.135899    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/1bbea426-07aa-421b-85a6-5e91ebb306d1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6795fd7c67-dnsq6\" (UID: \"1bbea426-07aa-421b-85a6-5e91ebb306d1\") " pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-dnsq6"
May 28 17:24:07.142863 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:07.142840    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t46rc\" (UniqueName: \"kubernetes.io/projected/1bbea426-07aa-421b-85a6-5e91ebb306d1-kube-api-access-t46rc\") pod \"opendatahub-operator-controller-manager-6795fd7c67-dnsq6\" (UID: \"1bbea426-07aa-421b-85a6-5e91ebb306d1\") " pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-dnsq6"
May 28 17:24:07.286466 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:07.286405    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-dnsq6"
May 28 17:24:07.417672 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:07.417638    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6795fd7c67-dnsq6"]
May 28 17:24:07.421297 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:24:07.421269    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bbea426_07aa_421b_85a6_5e91ebb306d1.slice/crio-fe3b8fec508cbf71579200f55f07458f58dd7ebf26f9df0872cfdaed4631083a WatchSource:0}: Error finding container fe3b8fec508cbf71579200f55f07458f58dd7ebf26f9df0872cfdaed4631083a: Status 404 returned error can't find the container with id fe3b8fec508cbf71579200f55f07458f58dd7ebf26f9df0872cfdaed4631083a
May 28 17:24:07.423533 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:07.423516    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 17:24:08.095527 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:08.095483    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-dnsq6" event={"ID":"1bbea426-07aa-421b-85a6-5e91ebb306d1","Type":"ContainerStarted","Data":"fe3b8fec508cbf71579200f55f07458f58dd7ebf26f9df0872cfdaed4631083a"}
May 28 17:24:10.103667 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:10.103635    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-dnsq6" event={"ID":"1bbea426-07aa-421b-85a6-5e91ebb306d1","Type":"ContainerStarted","Data":"722ba57457d937fa39e5681fba0a9ee69b180409d861713f7dd4dff799a8f5cc"}
May 28 17:24:10.104046 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:10.103704    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-dnsq6"
May 28 17:24:11.127222 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.127165    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-dnsq6" podStartSLOduration=2.590919243 podStartE2EDuration="5.127148392s" podCreationTimestamp="2026-05-28 17:24:06 +0000 UTC" firstStartedPulling="2026-05-28 17:24:07.42363524 +0000 UTC m=+433.399439574" lastFinishedPulling="2026-05-28 17:24:09.959864386 +0000 UTC m=+435.935668723" observedRunningTime="2026-05-28 17:24:10.142171587 +0000 UTC m=+436.117975942" watchObservedRunningTime="2026-05-28 17:24:11.127148392 +0000 UTC m=+437.102952748"
May 28 17:24:11.128428 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.128409    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq"]
May 28 17:24:11.131743 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.131729    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq"
May 28 17:24:11.138600 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.138583    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 28 17:24:11.139497 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.139479    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 28 17:24:11.140056 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.140040    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 28 17:24:11.140216 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.140200    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 28 17:24:11.140439 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.140424    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-n98lm\""
May 28 17:24:11.140491 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.140477    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 28 17:24:11.169684 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.169652    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/433c08cf-affa-4cd7-a40b-d490cc24aff4-cert\") pod \"lws-controller-manager-7954d66c6b-672nq\" (UID: \"433c08cf-affa-4cd7-a40b-d490cc24aff4\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq"
May 28 17:24:11.169804 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.169688    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/433c08cf-affa-4cd7-a40b-d490cc24aff4-metrics-cert\") pod \"lws-controller-manager-7954d66c6b-672nq\" (UID: \"433c08cf-affa-4cd7-a40b-d490cc24aff4\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq"
May 28 17:24:11.169804 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.169716    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/433c08cf-affa-4cd7-a40b-d490cc24aff4-manager-config\") pod \"lws-controller-manager-7954d66c6b-672nq\" (UID: \"433c08cf-affa-4cd7-a40b-d490cc24aff4\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq"
May 28 17:24:11.169804 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.169781    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltc47\" (UniqueName: \"kubernetes.io/projected/433c08cf-affa-4cd7-a40b-d490cc24aff4-kube-api-access-ltc47\") pod \"lws-controller-manager-7954d66c6b-672nq\" (UID: \"433c08cf-affa-4cd7-a40b-d490cc24aff4\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq"
May 28 17:24:11.172000 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.171977    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq"]
May 28 17:24:11.271107 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.271076    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ltc47\" (UniqueName: \"kubernetes.io/projected/433c08cf-affa-4cd7-a40b-d490cc24aff4-kube-api-access-ltc47\") pod \"lws-controller-manager-7954d66c6b-672nq\" (UID: \"433c08cf-affa-4cd7-a40b-d490cc24aff4\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq"
May 28 17:24:11.271271 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.271157    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/433c08cf-affa-4cd7-a40b-d490cc24aff4-cert\") pod \"lws-controller-manager-7954d66c6b-672nq\" (UID: \"433c08cf-affa-4cd7-a40b-d490cc24aff4\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq"
May 28 17:24:11.271271 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.271186    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/433c08cf-affa-4cd7-a40b-d490cc24aff4-metrics-cert\") pod \"lws-controller-manager-7954d66c6b-672nq\" (UID: \"433c08cf-affa-4cd7-a40b-d490cc24aff4\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq"
May 28 17:24:11.271271 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.271212    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/433c08cf-affa-4cd7-a40b-d490cc24aff4-manager-config\") pod \"lws-controller-manager-7954d66c6b-672nq\" (UID: \"433c08cf-affa-4cd7-a40b-d490cc24aff4\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq"
May 28 17:24:11.271896 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.271865    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/433c08cf-affa-4cd7-a40b-d490cc24aff4-manager-config\") pod \"lws-controller-manager-7954d66c6b-672nq\" (UID: \"433c08cf-affa-4cd7-a40b-d490cc24aff4\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq"
May 28 17:24:11.273608 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.273589    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/433c08cf-affa-4cd7-a40b-d490cc24aff4-cert\") pod \"lws-controller-manager-7954d66c6b-672nq\" (UID: \"433c08cf-affa-4cd7-a40b-d490cc24aff4\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq"
May 28 17:24:11.273691 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.273649    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/433c08cf-affa-4cd7-a40b-d490cc24aff4-metrics-cert\") pod \"lws-controller-manager-7954d66c6b-672nq\" (UID: \"433c08cf-affa-4cd7-a40b-d490cc24aff4\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq"
May 28 17:24:11.301196 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.301174    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltc47\" (UniqueName: \"kubernetes.io/projected/433c08cf-affa-4cd7-a40b-d490cc24aff4-kube-api-access-ltc47\") pod \"lws-controller-manager-7954d66c6b-672nq\" (UID: \"433c08cf-affa-4cd7-a40b-d490cc24aff4\") " pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq"
May 28 17:24:11.440385 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.440297    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq"
May 28 17:24:11.583186 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:24:11.583150    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod433c08cf_affa_4cd7_a40b_d490cc24aff4.slice/crio-4768da97e7f049abc166088162fce2526d0f1dee2517f8550b7cc17fdbf1e92d WatchSource:0}: Error finding container 4768da97e7f049abc166088162fce2526d0f1dee2517f8550b7cc17fdbf1e92d: Status 404 returned error can't find the container with id 4768da97e7f049abc166088162fce2526d0f1dee2517f8550b7cc17fdbf1e92d
May 28 17:24:11.583959 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:11.583935    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq"]
May 28 17:24:12.113578 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:12.113542    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq" event={"ID":"433c08cf-affa-4cd7-a40b-d490cc24aff4","Type":"ContainerStarted","Data":"4768da97e7f049abc166088162fce2526d0f1dee2517f8550b7cc17fdbf1e92d"}
May 28 17:24:15.130798 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:15.130759    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq" event={"ID":"433c08cf-affa-4cd7-a40b-d490cc24aff4","Type":"ContainerStarted","Data":"ba1327a428090569f19673d663eee4941442bdd4d7febc036a737ba9cdfdff06"}
May 28 17:24:15.131220 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:15.130818    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq"
May 28 17:24:15.149433 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:15.149389    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq" podStartSLOduration=1.421331541 podStartE2EDuration="4.149374277s" podCreationTimestamp="2026-05-28 17:24:11 +0000 UTC" firstStartedPulling="2026-05-28 17:24:11.584936073 +0000 UTC m=+437.560740408" lastFinishedPulling="2026-05-28 17:24:14.31297881 +0000 UTC m=+440.288783144" observedRunningTime="2026-05-28 17:24:15.148248151 +0000 UTC m=+441.124052506" watchObservedRunningTime="2026-05-28 17:24:15.149374277 +0000 UTC m=+441.125178634"
May 28 17:24:21.112139 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:21.112106    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6795fd7c67-dnsq6"
May 28 17:24:24.267059 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:24.267019    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5454695dcd-rm6m9"]
May 28 17:24:24.270830 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:24.270805    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5454695dcd-rm6m9"
May 28 17:24:24.273474 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:24.273451    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 28 17:24:24.273596 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:24.273478    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 28 17:24:24.274350 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:24.274331    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 28 17:24:24.274463 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:24.274446    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 28 17:24:24.274516 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:24.274464    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zgknt\""
May 28 17:24:24.279037 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:24.279013    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5454695dcd-rm6m9"]
May 28 17:24:24.396504 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:24.396467    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e5d09ae-83e3-4507-ad43-8320b4e29155-tls-certs\") pod \"kube-auth-proxy-5454695dcd-rm6m9\" (UID: \"6e5d09ae-83e3-4507-ad43-8320b4e29155\") " pod="openshift-ingress/kube-auth-proxy-5454695dcd-rm6m9"
May 28 17:24:24.396691 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:24.396607    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4h92g\" (UniqueName: \"kubernetes.io/projected/6e5d09ae-83e3-4507-ad43-8320b4e29155-kube-api-access-4h92g\") pod \"kube-auth-proxy-5454695dcd-rm6m9\" (UID: \"6e5d09ae-83e3-4507-ad43-8320b4e29155\") " pod="openshift-ingress/kube-auth-proxy-5454695dcd-rm6m9"
May 28 17:24:24.396691 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:24.396669    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e5d09ae-83e3-4507-ad43-8320b4e29155-tmp\") pod \"kube-auth-proxy-5454695dcd-rm6m9\" (UID: \"6e5d09ae-83e3-4507-ad43-8320b4e29155\") " pod="openshift-ingress/kube-auth-proxy-5454695dcd-rm6m9"
May 28 17:24:24.497380 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:24.497335    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4h92g\" (UniqueName: \"kubernetes.io/projected/6e5d09ae-83e3-4507-ad43-8320b4e29155-kube-api-access-4h92g\") pod \"kube-auth-proxy-5454695dcd-rm6m9\" (UID: \"6e5d09ae-83e3-4507-ad43-8320b4e29155\") " pod="openshift-ingress/kube-auth-proxy-5454695dcd-rm6m9"
May 28 17:24:24.497580 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:24.497398    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e5d09ae-83e3-4507-ad43-8320b4e29155-tmp\") pod \"kube-auth-proxy-5454695dcd-rm6m9\" (UID: \"6e5d09ae-83e3-4507-ad43-8320b4e29155\") " pod="openshift-ingress/kube-auth-proxy-5454695dcd-rm6m9"
May 28 17:24:24.497580 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:24.497453    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e5d09ae-83e3-4507-ad43-8320b4e29155-tls-certs\") pod \"kube-auth-proxy-5454695dcd-rm6m9\" (UID: \"6e5d09ae-83e3-4507-ad43-8320b4e29155\") " pod="openshift-ingress/kube-auth-proxy-5454695dcd-rm6m9"
May 28 17:24:24.499816 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:24.499775    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e5d09ae-83e3-4507-ad43-8320b4e29155-tmp\") pod \"kube-auth-proxy-5454695dcd-rm6m9\" (UID: \"6e5d09ae-83e3-4507-ad43-8320b4e29155\") " pod="openshift-ingress/kube-auth-proxy-5454695dcd-rm6m9"
May 28 17:24:24.499922 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:24.499903    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e5d09ae-83e3-4507-ad43-8320b4e29155-tls-certs\") pod \"kube-auth-proxy-5454695dcd-rm6m9\" (UID: \"6e5d09ae-83e3-4507-ad43-8320b4e29155\") " pod="openshift-ingress/kube-auth-proxy-5454695dcd-rm6m9"
May 28 17:24:24.505538 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:24.505513    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4h92g\" (UniqueName: \"kubernetes.io/projected/6e5d09ae-83e3-4507-ad43-8320b4e29155-kube-api-access-4h92g\") pod \"kube-auth-proxy-5454695dcd-rm6m9\" (UID: \"6e5d09ae-83e3-4507-ad43-8320b4e29155\") " pod="openshift-ingress/kube-auth-proxy-5454695dcd-rm6m9"
May 28 17:24:24.581524 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:24.581489    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5454695dcd-rm6m9"
May 28 17:24:24.713751 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:24.713727    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5454695dcd-rm6m9"]
May 28 17:24:24.716180 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:24:24.716154    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5d09ae_83e3_4507_ad43_8320b4e29155.slice/crio-2ff7bd688737938e7c23c0cc95be51188f87679100f8e57bc9d0686326ab695d WatchSource:0}: Error finding container 2ff7bd688737938e7c23c0cc95be51188f87679100f8e57bc9d0686326ab695d: Status 404 returned error can't find the container with id 2ff7bd688737938e7c23c0cc95be51188f87679100f8e57bc9d0686326ab695d
May 28 17:24:25.164509 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:25.164470    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5454695dcd-rm6m9" event={"ID":"6e5d09ae-83e3-4507-ad43-8320b4e29155","Type":"ContainerStarted","Data":"2ff7bd688737938e7c23c0cc95be51188f87679100f8e57bc9d0686326ab695d"}
May 28 17:24:26.136772 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:26.136663    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7954d66c6b-672nq"
May 28 17:24:28.178249 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:28.178212    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5454695dcd-rm6m9" event={"ID":"6e5d09ae-83e3-4507-ad43-8320b4e29155","Type":"ContainerStarted","Data":"64f047bb4fccb08d7ceb41689ec97f571a4591cd9b163caabc3ecde7187d3fbc"}
May 28 17:24:28.196143 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:24:28.196101    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5454695dcd-rm6m9" podStartSLOduration=1.655422276 podStartE2EDuration="4.196088637s" podCreationTimestamp="2026-05-28 17:24:24 +0000 UTC" firstStartedPulling="2026-05-28 17:24:24.718300735 +0000 UTC m=+450.694105076" lastFinishedPulling="2026-05-28 17:24:27.258967101 +0000 UTC m=+453.234771437" observedRunningTime="2026-05-28 17:24:28.194366987 +0000 UTC m=+454.170171350" watchObservedRunningTime="2026-05-28 17:24:28.196088637 +0000 UTC m=+454.171893035"
May 28 17:26:08.236413 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:08.236372    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz"]
May 28 17:26:08.239571 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:08.239552    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz"
May 28 17:26:08.242056 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:08.242035    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 28 17:26:08.242140 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:08.242124    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 28 17:26:08.242885 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:08.242860    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-6r6gz\""
May 28 17:26:08.249126 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:08.249108    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz"]
May 28 17:26:08.389512 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:08.389481    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cpjbw\" (UniqueName: \"kubernetes.io/projected/a0636a1a-d129-4593-bd9c-2bb3c2baa71a-kube-api-access-cpjbw\") pod \"limitador-operator-controller-manager-85c4996f8c-rqtnz\" (UID: \"a0636a1a-d129-4593-bd9c-2bb3c2baa71a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz"
May 28 17:26:08.489889 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:08.489825    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cpjbw\" (UniqueName: \"kubernetes.io/projected/a0636a1a-d129-4593-bd9c-2bb3c2baa71a-kube-api-access-cpjbw\") pod \"limitador-operator-controller-manager-85c4996f8c-rqtnz\" (UID: \"a0636a1a-d129-4593-bd9c-2bb3c2baa71a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz"
May 28 17:26:08.500390 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:08.500363    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cpjbw\" (UniqueName: \"kubernetes.io/projected/a0636a1a-d129-4593-bd9c-2bb3c2baa71a-kube-api-access-cpjbw\") pod \"limitador-operator-controller-manager-85c4996f8c-rqtnz\" (UID: \"a0636a1a-d129-4593-bd9c-2bb3c2baa71a\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz"
May 28 17:26:08.550272 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:08.550238    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz"
May 28 17:26:08.674892 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:08.674805    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz"]
May 28 17:26:08.677573 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:26:08.677539    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0636a1a_d129_4593_bd9c_2bb3c2baa71a.slice/crio-e3d5c9ecd9a4d5f49a2e219140b6383005e180f2b457746f5172e87ce35be081 WatchSource:0}: Error finding container e3d5c9ecd9a4d5f49a2e219140b6383005e180f2b457746f5172e87ce35be081: Status 404 returned error can't find the container with id e3d5c9ecd9a4d5f49a2e219140b6383005e180f2b457746f5172e87ce35be081
May 28 17:26:09.515608 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:09.515575    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz" event={"ID":"a0636a1a-d129-4593-bd9c-2bb3c2baa71a","Type":"ContainerStarted","Data":"e3d5c9ecd9a4d5f49a2e219140b6383005e180f2b457746f5172e87ce35be081"}
May 28 17:26:10.520524 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:10.520485    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz" event={"ID":"a0636a1a-d129-4593-bd9c-2bb3c2baa71a","Type":"ContainerStarted","Data":"f49608cd14053567139967ba46d53d12f749751e6d6cf04b866091e5a01bc57e"}
May 28 17:26:10.520886 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:10.520604    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz"
May 28 17:26:10.537773 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:10.537728    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz" podStartSLOduration=0.87568097 podStartE2EDuration="2.5377165s" podCreationTimestamp="2026-05-28 17:26:08 +0000 UTC" firstStartedPulling="2026-05-28 17:26:08.679446701 +0000 UTC m=+554.655251038" lastFinishedPulling="2026-05-28 17:26:10.341482219 +0000 UTC m=+556.317286568" observedRunningTime="2026-05-28 17:26:10.53694425 +0000 UTC m=+556.512748620" watchObservedRunningTime="2026-05-28 17:26:10.5377165 +0000 UTC m=+556.513520856"
May 28 17:26:19.704176 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:19.704140    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz"]
May 28 17:26:19.704577 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:19.704380    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz" podUID="a0636a1a-d129-4593-bd9c-2bb3c2baa71a" containerName="manager" containerID="cri-o://f49608cd14053567139967ba46d53d12f749751e6d6cf04b866091e5a01bc57e" gracePeriod=2
May 28 17:26:19.706130 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:19.706106    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz"
May 28 17:26:19.714919 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:19.714892    2556 status_manager.go:895] "Failed to get status for pod" podUID="a0636a1a-d129-4593-bd9c-2bb3c2baa71a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz" err="pods \"limitador-operator-controller-manager-85c4996f8c-rqtnz\" is forbidden: User \"system:node:ip-10-0-133-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-205.ec2.internal' and this object"
May 28 17:26:19.717359 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:19.717333    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz"]
May 28 17:26:19.727521 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:19.727498    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzghb"]
May 28 17:26:19.727871 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:19.727853    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0636a1a-d129-4593-bd9c-2bb3c2baa71a" containerName="manager"
May 28 17:26:19.727969 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:19.727896    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0636a1a-d129-4593-bd9c-2bb3c2baa71a" containerName="manager"
May 28 17:26:19.728050 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:19.728037    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="a0636a1a-d129-4593-bd9c-2bb3c2baa71a" containerName="manager"
May 28 17:26:19.730935 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:19.730916    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzghb"
May 28 17:26:19.733775 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:19.733752    2556 status_manager.go:895] "Failed to get status for pod" podUID="a0636a1a-d129-4593-bd9c-2bb3c2baa71a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz" err="pods \"limitador-operator-controller-manager-85c4996f8c-rqtnz\" is forbidden: User \"system:node:ip-10-0-133-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-205.ec2.internal' and this object"
May 28 17:26:19.746597 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:19.746575    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzghb"]
May 28 17:26:19.889754 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:19.889727    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jgv7\" (UniqueName: \"kubernetes.io/projected/7d1a0b5e-2a6d-4c16-a686-c24232b7fb97-kube-api-access-9jgv7\") pod \"limitador-operator-controller-manager-85c4996f8c-nzghb\" (UID: \"7d1a0b5e-2a6d-4c16-a686-c24232b7fb97\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzghb"
May 28 17:26:19.932341 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:19.932295    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz"
May 28 17:26:19.934863 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:19.934835    2556 status_manager.go:895] "Failed to get status for pod" podUID="a0636a1a-d129-4593-bd9c-2bb3c2baa71a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz" err="pods \"limitador-operator-controller-manager-85c4996f8c-rqtnz\" is forbidden: User \"system:node:ip-10-0-133-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-205.ec2.internal' and this object"
May 28 17:26:19.990608 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:19.990550    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9jgv7\" (UniqueName: \"kubernetes.io/projected/7d1a0b5e-2a6d-4c16-a686-c24232b7fb97-kube-api-access-9jgv7\") pod \"limitador-operator-controller-manager-85c4996f8c-nzghb\" (UID: \"7d1a0b5e-2a6d-4c16-a686-c24232b7fb97\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzghb"
May 28 17:26:20.010072 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:20.010050    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jgv7\" (UniqueName: \"kubernetes.io/projected/7d1a0b5e-2a6d-4c16-a686-c24232b7fb97-kube-api-access-9jgv7\") pod \"limitador-operator-controller-manager-85c4996f8c-nzghb\" (UID: \"7d1a0b5e-2a6d-4c16-a686-c24232b7fb97\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzghb"
May 28 17:26:20.090894 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:20.090864    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzghb"
May 28 17:26:20.091025 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:20.091007    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cpjbw\" (UniqueName: \"kubernetes.io/projected/a0636a1a-d129-4593-bd9c-2bb3c2baa71a-kube-api-access-cpjbw\") pod \"a0636a1a-d129-4593-bd9c-2bb3c2baa71a\" (UID: \"a0636a1a-d129-4593-bd9c-2bb3c2baa71a\") "
May 28 17:26:20.093136 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:20.093111    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0636a1a-d129-4593-bd9c-2bb3c2baa71a-kube-api-access-cpjbw" (OuterVolumeSpecName: "kube-api-access-cpjbw") pod "a0636a1a-d129-4593-bd9c-2bb3c2baa71a" (UID: "a0636a1a-d129-4593-bd9c-2bb3c2baa71a"). InnerVolumeSpecName "kube-api-access-cpjbw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:26:20.192125 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:20.192082    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cpjbw\" (UniqueName: \"kubernetes.io/projected/a0636a1a-d129-4593-bd9c-2bb3c2baa71a-kube-api-access-cpjbw\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:26:20.215795 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:20.215766    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzghb"]
May 28 17:26:20.218344 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:26:20.218320    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d1a0b5e_2a6d_4c16_a686_c24232b7fb97.slice/crio-6cc5df9248df216372134939a7403ca9c59449e7f0f196feb21ea11209cc8009 WatchSource:0}: Error finding container 6cc5df9248df216372134939a7403ca9c59449e7f0f196feb21ea11209cc8009: Status 404 returned error can't find the container with id 6cc5df9248df216372134939a7403ca9c59449e7f0f196feb21ea11209cc8009
May 28 17:26:20.554609 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:20.554571    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzghb" event={"ID":"7d1a0b5e-2a6d-4c16-a686-c24232b7fb97","Type":"ContainerStarted","Data":"e3b76517b0c19f6553fdb5282bce379a03dbbb7f485914b6ae4336d550751019"}
May 28 17:26:20.554758 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:20.554614    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzghb" event={"ID":"7d1a0b5e-2a6d-4c16-a686-c24232b7fb97","Type":"ContainerStarted","Data":"6cc5df9248df216372134939a7403ca9c59449e7f0f196feb21ea11209cc8009"}
May 28 17:26:20.554758 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:20.554711    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzghb"
May 28 17:26:20.555597 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:20.555574    2556 generic.go:358] "Generic (PLEG): container finished" podID="a0636a1a-d129-4593-bd9c-2bb3c2baa71a" containerID="f49608cd14053567139967ba46d53d12f749751e6d6cf04b866091e5a01bc57e" exitCode=0
May 28 17:26:20.555677 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:20.555609    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz"
May 28 17:26:20.555677 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:20.555660    2556 scope.go:117] "RemoveContainer" containerID="f49608cd14053567139967ba46d53d12f749751e6d6cf04b866091e5a01bc57e"
May 28 17:26:20.556974 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:20.556952    2556 status_manager.go:895] "Failed to get status for pod" podUID="a0636a1a-d129-4593-bd9c-2bb3c2baa71a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz" err="pods \"limitador-operator-controller-manager-85c4996f8c-rqtnz\" is forbidden: User \"system:node:ip-10-0-133-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-205.ec2.internal' and this object"
May 28 17:26:20.564161 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:20.564147    2556 scope.go:117] "RemoveContainer" containerID="f49608cd14053567139967ba46d53d12f749751e6d6cf04b866091e5a01bc57e"
May 28 17:26:20.564411 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:26:20.564390    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f49608cd14053567139967ba46d53d12f749751e6d6cf04b866091e5a01bc57e\": container with ID starting with f49608cd14053567139967ba46d53d12f749751e6d6cf04b866091e5a01bc57e not found: ID does not exist" containerID="f49608cd14053567139967ba46d53d12f749751e6d6cf04b866091e5a01bc57e"
May 28 17:26:20.564485 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:20.564418    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f49608cd14053567139967ba46d53d12f749751e6d6cf04b866091e5a01bc57e"} err="failed to get container status \"f49608cd14053567139967ba46d53d12f749751e6d6cf04b866091e5a01bc57e\": rpc error: code = NotFound desc = could not find container \"f49608cd14053567139967ba46d53d12f749751e6d6cf04b866091e5a01bc57e\": container with ID starting with f49608cd14053567139967ba46d53d12f749751e6d6cf04b866091e5a01bc57e not found: ID does not exist"
May 28 17:26:20.579959 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:20.579916    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzghb" podStartSLOduration=1.5799064779999998 podStartE2EDuration="1.579906478s" podCreationTimestamp="2026-05-28 17:26:19 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:26:20.578130783 +0000 UTC m=+566.553935139" watchObservedRunningTime="2026-05-28 17:26:20.579906478 +0000 UTC m=+566.555710833"
May 28 17:26:20.580175 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:20.580156    2556 status_manager.go:895] "Failed to get status for pod" podUID="a0636a1a-d129-4593-bd9c-2bb3c2baa71a" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-rqtnz" err="pods \"limitador-operator-controller-manager-85c4996f8c-rqtnz\" is forbidden: User \"system:node:ip-10-0-133-205.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-133-205.ec2.internal' and this object"
May 28 17:26:20.631503 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:20.631479    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0636a1a-d129-4593-bd9c-2bb3c2baa71a" path="/var/lib/kubelet/pods/a0636a1a-d129-4593-bd9c-2bb3c2baa71a/volumes"
May 28 17:26:31.562434 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:31.562400    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-nzghb"
May 28 17:26:54.564510 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:54.564482    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/1.log"
May 28 17:26:54.565612 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:54.565590    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/1.log"
May 28 17:26:54.570227 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:54.569890    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4lcb_9bd29f05-c1e0-4fe5-82e8-62974c41bd76/ovn-acl-logging/0.log"
May 28 17:26:54.570974 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:26:54.570956    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4lcb_9bd29f05-c1e0-4fe5-82e8-62974c41bd76/ovn-acl-logging/0.log"
May 28 17:27:07.795937 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:07.795863    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xgtmd"]
May 28 17:27:07.799244 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:07.799218    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-xgtmd"
May 28 17:27:07.801520 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:07.801498    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-hl225\""
May 28 17:27:07.805723 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:07.805698    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xgtmd"]
May 28 17:27:07.910340 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:07.910282    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8654c\" (UniqueName: \"kubernetes.io/projected/2f5bfc9b-4f06-4953-9e79-515c35bc0efd-kube-api-access-8654c\") pod \"authorino-f99f4b5cd-xgtmd\" (UID: \"2f5bfc9b-4f06-4953-9e79-515c35bc0efd\") " pod="kuadrant-system/authorino-f99f4b5cd-xgtmd"
May 28 17:27:07.993295 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:07.993261    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-5mscv"]
May 28 17:27:07.996655 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:07.996636    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-5mscv"
May 28 17:27:08.003812 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:08.003778    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-5mscv"]
May 28 17:27:08.010808 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:08.010784    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8654c\" (UniqueName: \"kubernetes.io/projected/2f5bfc9b-4f06-4953-9e79-515c35bc0efd-kube-api-access-8654c\") pod \"authorino-f99f4b5cd-xgtmd\" (UID: \"2f5bfc9b-4f06-4953-9e79-515c35bc0efd\") " pod="kuadrant-system/authorino-f99f4b5cd-xgtmd"
May 28 17:27:08.018493 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:08.018469    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8654c\" (UniqueName: \"kubernetes.io/projected/2f5bfc9b-4f06-4953-9e79-515c35bc0efd-kube-api-access-8654c\") pod \"authorino-f99f4b5cd-xgtmd\" (UID: \"2f5bfc9b-4f06-4953-9e79-515c35bc0efd\") " pod="kuadrant-system/authorino-f99f4b5cd-xgtmd"
May 28 17:27:08.111522 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:08.111422    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b448f\" (UniqueName: \"kubernetes.io/projected/b6af0104-c181-48fa-805e-389326b8c23b-kube-api-access-b448f\") pod \"authorino-7498df8756-5mscv\" (UID: \"b6af0104-c181-48fa-805e-389326b8c23b\") " pod="kuadrant-system/authorino-7498df8756-5mscv"
May 28 17:27:08.116195 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:08.116163    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-xgtmd"
May 28 17:27:08.212286 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:08.212198    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b448f\" (UniqueName: \"kubernetes.io/projected/b6af0104-c181-48fa-805e-389326b8c23b-kube-api-access-b448f\") pod \"authorino-7498df8756-5mscv\" (UID: \"b6af0104-c181-48fa-805e-389326b8c23b\") " pod="kuadrant-system/authorino-7498df8756-5mscv"
May 28 17:27:08.222279 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:08.222254    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b448f\" (UniqueName: \"kubernetes.io/projected/b6af0104-c181-48fa-805e-389326b8c23b-kube-api-access-b448f\") pod \"authorino-7498df8756-5mscv\" (UID: \"b6af0104-c181-48fa-805e-389326b8c23b\") " pod="kuadrant-system/authorino-7498df8756-5mscv"
May 28 17:27:08.241337 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:08.241240    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xgtmd"]
May 28 17:27:08.243499 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:27:08.243476    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2f5bfc9b_4f06_4953_9e79_515c35bc0efd.slice/crio-5f83c3aa6c978292f9390a6429a0c5481163a1c0a075eb1a6f4b84201b4994a1 WatchSource:0}: Error finding container 5f83c3aa6c978292f9390a6429a0c5481163a1c0a075eb1a6f4b84201b4994a1: Status 404 returned error can't find the container with id 5f83c3aa6c978292f9390a6429a0c5481163a1c0a075eb1a6f4b84201b4994a1
May 28 17:27:08.306293 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:08.306259    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-5mscv"
May 28 17:27:08.432332 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:08.432296    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-5mscv"]
May 28 17:27:08.434270 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:27:08.434241    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb6af0104_c181_48fa_805e_389326b8c23b.slice/crio-dad65cc7f41ae28fce8c79608b0331cccab9d12ae61e2fe26d142bd8476d47cf WatchSource:0}: Error finding container dad65cc7f41ae28fce8c79608b0331cccab9d12ae61e2fe26d142bd8476d47cf: Status 404 returned error can't find the container with id dad65cc7f41ae28fce8c79608b0331cccab9d12ae61e2fe26d142bd8476d47cf
May 28 17:27:08.723914 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:08.723832    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-5mscv" event={"ID":"b6af0104-c181-48fa-805e-389326b8c23b","Type":"ContainerStarted","Data":"dad65cc7f41ae28fce8c79608b0331cccab9d12ae61e2fe26d142bd8476d47cf"}
May 28 17:27:08.724951 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:08.724921    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-xgtmd" event={"ID":"2f5bfc9b-4f06-4953-9e79-515c35bc0efd","Type":"ContainerStarted","Data":"5f83c3aa6c978292f9390a6429a0c5481163a1c0a075eb1a6f4b84201b4994a1"}
May 28 17:27:11.744982 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:11.744939    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-5mscv" event={"ID":"b6af0104-c181-48fa-805e-389326b8c23b","Type":"ContainerStarted","Data":"ac3ae0f9e7b949c0a3718e939fe54a610226f7b68b374b6fc4b87217f0d27682"}
May 28 17:27:11.746327 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:11.746290    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-xgtmd" event={"ID":"2f5bfc9b-4f06-4953-9e79-515c35bc0efd","Type":"ContainerStarted","Data":"a62f169c52fb54db96a413fe52e3fd259519d823ce51969ebda59be605f11944"}
May 28 17:27:11.761074 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:11.761014    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-5mscv" podStartSLOduration=1.5276405450000001 podStartE2EDuration="4.7609959s" podCreationTimestamp="2026-05-28 17:27:07 +0000 UTC" firstStartedPulling="2026-05-28 17:27:08.435538947 +0000 UTC m=+614.411343280" lastFinishedPulling="2026-05-28 17:27:11.668894293 +0000 UTC m=+617.644698635" observedRunningTime="2026-05-28 17:27:11.759924514 +0000 UTC m=+617.735728868" watchObservedRunningTime="2026-05-28 17:27:11.7609959 +0000 UTC m=+617.736800258"
May 28 17:27:11.775504 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:11.775454    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-xgtmd" podStartSLOduration=1.3621523039999999 podStartE2EDuration="4.775438938s" podCreationTimestamp="2026-05-28 17:27:07 +0000 UTC" firstStartedPulling="2026-05-28 17:27:08.244689359 +0000 UTC m=+614.220493693" lastFinishedPulling="2026-05-28 17:27:11.657975993 +0000 UTC m=+617.633780327" observedRunningTime="2026-05-28 17:27:11.773995175 +0000 UTC m=+617.749799528" watchObservedRunningTime="2026-05-28 17:27:11.775438938 +0000 UTC m=+617.751243294"
May 28 17:27:11.803714 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:11.803682    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xgtmd"]
May 28 17:27:13.752904 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:13.752865    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-xgtmd" podUID="2f5bfc9b-4f06-4953-9e79-515c35bc0efd" containerName="authorino" containerID="cri-o://a62f169c52fb54db96a413fe52e3fd259519d823ce51969ebda59be605f11944" gracePeriod=30
May 28 17:27:13.991708 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:13.991682    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-xgtmd"
May 28 17:27:14.060895 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:14.060869    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8654c\" (UniqueName: \"kubernetes.io/projected/2f5bfc9b-4f06-4953-9e79-515c35bc0efd-kube-api-access-8654c\") pod \"2f5bfc9b-4f06-4953-9e79-515c35bc0efd\" (UID: \"2f5bfc9b-4f06-4953-9e79-515c35bc0efd\") "
May 28 17:27:14.062895 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:14.062872    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2f5bfc9b-4f06-4953-9e79-515c35bc0efd-kube-api-access-8654c" (OuterVolumeSpecName: "kube-api-access-8654c") pod "2f5bfc9b-4f06-4953-9e79-515c35bc0efd" (UID: "2f5bfc9b-4f06-4953-9e79-515c35bc0efd"). InnerVolumeSpecName "kube-api-access-8654c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:27:14.162142 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:14.162103    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8654c\" (UniqueName: \"kubernetes.io/projected/2f5bfc9b-4f06-4953-9e79-515c35bc0efd-kube-api-access-8654c\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:27:14.756911 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:14.756873    2556 generic.go:358] "Generic (PLEG): container finished" podID="2f5bfc9b-4f06-4953-9e79-515c35bc0efd" containerID="a62f169c52fb54db96a413fe52e3fd259519d823ce51969ebda59be605f11944" exitCode=0
May 28 17:27:14.757360 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:14.756917    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-xgtmd" event={"ID":"2f5bfc9b-4f06-4953-9e79-515c35bc0efd","Type":"ContainerDied","Data":"a62f169c52fb54db96a413fe52e3fd259519d823ce51969ebda59be605f11944"}
May 28 17:27:14.757360 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:14.756934    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-xgtmd"
May 28 17:27:14.757360 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:14.756944    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-xgtmd" event={"ID":"2f5bfc9b-4f06-4953-9e79-515c35bc0efd","Type":"ContainerDied","Data":"5f83c3aa6c978292f9390a6429a0c5481163a1c0a075eb1a6f4b84201b4994a1"}
May 28 17:27:14.757360 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:14.756964    2556 scope.go:117] "RemoveContainer" containerID="a62f169c52fb54db96a413fe52e3fd259519d823ce51969ebda59be605f11944"
May 28 17:27:14.764901 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:14.764879    2556 scope.go:117] "RemoveContainer" containerID="a62f169c52fb54db96a413fe52e3fd259519d823ce51969ebda59be605f11944"
May 28 17:27:14.765123 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:27:14.765102    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a62f169c52fb54db96a413fe52e3fd259519d823ce51969ebda59be605f11944\": container with ID starting with a62f169c52fb54db96a413fe52e3fd259519d823ce51969ebda59be605f11944 not found: ID does not exist" containerID="a62f169c52fb54db96a413fe52e3fd259519d823ce51969ebda59be605f11944"
May 28 17:27:14.765195 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:14.765130    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a62f169c52fb54db96a413fe52e3fd259519d823ce51969ebda59be605f11944"} err="failed to get container status \"a62f169c52fb54db96a413fe52e3fd259519d823ce51969ebda59be605f11944\": rpc error: code = NotFound desc = could not find container \"a62f169c52fb54db96a413fe52e3fd259519d823ce51969ebda59be605f11944\": container with ID starting with a62f169c52fb54db96a413fe52e3fd259519d823ce51969ebda59be605f11944 not found: ID does not exist"
May 28 17:27:14.777137 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:14.777110    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xgtmd"]
May 28 17:27:14.781900 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:14.781879    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-xgtmd"]
May 28 17:27:16.631020 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:16.630985    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2f5bfc9b-4f06-4953-9e79-515c35bc0efd" path="/var/lib/kubelet/pods/2f5bfc9b-4f06-4953-9e79-515c35bc0efd/volumes"
May 28 17:27:38.694017 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:38.693965    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8v6w5"]
May 28 17:27:38.695257 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:38.694374    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f5bfc9b-4f06-4953-9e79-515c35bc0efd" containerName="authorino"
May 28 17:27:38.695257 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:38.694386    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f5bfc9b-4f06-4953-9e79-515c35bc0efd" containerName="authorino"
May 28 17:27:38.695257 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:38.694448    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="2f5bfc9b-4f06-4953-9e79-515c35bc0efd" containerName="authorino"
May 28 17:27:38.696023 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:38.696007    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-8v6w5"
May 28 17:27:38.704248 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:38.704225    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8v6w5"]
May 28 17:27:38.772840 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:38.772813    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2br5\" (UniqueName: \"kubernetes.io/projected/4012d005-8fd8-41c1-ad7b-d850b5830c88-kube-api-access-h2br5\") pod \"authorino-8b475cf9f-8v6w5\" (UID: \"4012d005-8fd8-41c1-ad7b-d850b5830c88\") " pod="kuadrant-system/authorino-8b475cf9f-8v6w5"
May 28 17:27:38.873740 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:38.873714    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h2br5\" (UniqueName: \"kubernetes.io/projected/4012d005-8fd8-41c1-ad7b-d850b5830c88-kube-api-access-h2br5\") pod \"authorino-8b475cf9f-8v6w5\" (UID: \"4012d005-8fd8-41c1-ad7b-d850b5830c88\") " pod="kuadrant-system/authorino-8b475cf9f-8v6w5"
May 28 17:27:38.884499 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:38.884470    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8v6w5"]
May 28 17:27:38.884721 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:27:38.884702    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-h2br5], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-8b475cf9f-8v6w5" podUID="4012d005-8fd8-41c1-ad7b-d850b5830c88"
May 28 17:27:38.885720 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:38.885697    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2br5\" (UniqueName: \"kubernetes.io/projected/4012d005-8fd8-41c1-ad7b-d850b5830c88-kube-api-access-h2br5\") pod \"authorino-8b475cf9f-8v6w5\" (UID: \"4012d005-8fd8-41c1-ad7b-d850b5830c88\") " pod="kuadrant-system/authorino-8b475cf9f-8v6w5"
May 28 17:27:38.914890 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:38.914868    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56fdd757f5-hs5rx"]
May 28 17:27:38.917247 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:38.917232    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-hs5rx"
May 28 17:27:38.922832 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:38.922815    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 28 17:27:38.929056 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:38.929035    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-hs5rx"]
May 28 17:27:38.958050 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:38.957995    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-hs5rx"]
May 28 17:27:38.958224 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:27:38.958207    2556 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-85lkr tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-85lkr tls-cert]: context canceled" pod="kuadrant-system/authorino-56fdd757f5-hs5rx" podUID="9a18fec1-3a2c-46fd-9dfa-6836cd04f855"
May 28 17:27:38.993024 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:38.992996    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-548d46dfc9-vncqm"]
May 28 17:27:38.995069 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:38.995050    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-548d46dfc9-vncqm"
May 28 17:27:39.003944 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.003923    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-548d46dfc9-vncqm"]
May 28 17:27:39.075460 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.075433    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbwjw\" (UniqueName: \"kubernetes.io/projected/0465e600-144b-4a7e-9304-6dbdac222d49-kube-api-access-nbwjw\") pod \"authorino-548d46dfc9-vncqm\" (UID: \"0465e600-144b-4a7e-9304-6dbdac222d49\") " pod="kuadrant-system/authorino-548d46dfc9-vncqm"
May 28 17:27:39.075575 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.075485    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9a18fec1-3a2c-46fd-9dfa-6836cd04f855-tls-cert\") pod \"authorino-56fdd757f5-hs5rx\" (UID: \"9a18fec1-3a2c-46fd-9dfa-6836cd04f855\") " pod="kuadrant-system/authorino-56fdd757f5-hs5rx"
May 28 17:27:39.075575 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.075526    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85lkr\" (UniqueName: \"kubernetes.io/projected/9a18fec1-3a2c-46fd-9dfa-6836cd04f855-kube-api-access-85lkr\") pod \"authorino-56fdd757f5-hs5rx\" (UID: \"9a18fec1-3a2c-46fd-9dfa-6836cd04f855\") " pod="kuadrant-system/authorino-56fdd757f5-hs5rx"
May 28 17:27:39.075662 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.075578    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0465e600-144b-4a7e-9304-6dbdac222d49-tls-cert\") pod \"authorino-548d46dfc9-vncqm\" (UID: \"0465e600-144b-4a7e-9304-6dbdac222d49\") " pod="kuadrant-system/authorino-548d46dfc9-vncqm"
May 28 17:27:39.176850 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.176819    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nbwjw\" (UniqueName: \"kubernetes.io/projected/0465e600-144b-4a7e-9304-6dbdac222d49-kube-api-access-nbwjw\") pod \"authorino-548d46dfc9-vncqm\" (UID: \"0465e600-144b-4a7e-9304-6dbdac222d49\") " pod="kuadrant-system/authorino-548d46dfc9-vncqm"
May 28 17:27:39.176984 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.176886    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9a18fec1-3a2c-46fd-9dfa-6836cd04f855-tls-cert\") pod \"authorino-56fdd757f5-hs5rx\" (UID: \"9a18fec1-3a2c-46fd-9dfa-6836cd04f855\") " pod="kuadrant-system/authorino-56fdd757f5-hs5rx"
May 28 17:27:39.176984 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.176906    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-85lkr\" (UniqueName: \"kubernetes.io/projected/9a18fec1-3a2c-46fd-9dfa-6836cd04f855-kube-api-access-85lkr\") pod \"authorino-56fdd757f5-hs5rx\" (UID: \"9a18fec1-3a2c-46fd-9dfa-6836cd04f855\") " pod="kuadrant-system/authorino-56fdd757f5-hs5rx"
May 28 17:27:39.176984 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.176939    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0465e600-144b-4a7e-9304-6dbdac222d49-tls-cert\") pod \"authorino-548d46dfc9-vncqm\" (UID: \"0465e600-144b-4a7e-9304-6dbdac222d49\") " pod="kuadrant-system/authorino-548d46dfc9-vncqm"
May 28 17:27:39.179351 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.179324    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9a18fec1-3a2c-46fd-9dfa-6836cd04f855-tls-cert\") pod \"authorino-56fdd757f5-hs5rx\" (UID: \"9a18fec1-3a2c-46fd-9dfa-6836cd04f855\") " pod="kuadrant-system/authorino-56fdd757f5-hs5rx"
May 28 17:27:39.179448 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.179406    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0465e600-144b-4a7e-9304-6dbdac222d49-tls-cert\") pod \"authorino-548d46dfc9-vncqm\" (UID: \"0465e600-144b-4a7e-9304-6dbdac222d49\") " pod="kuadrant-system/authorino-548d46dfc9-vncqm"
May 28 17:27:39.184927 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.184909    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbwjw\" (UniqueName: \"kubernetes.io/projected/0465e600-144b-4a7e-9304-6dbdac222d49-kube-api-access-nbwjw\") pod \"authorino-548d46dfc9-vncqm\" (UID: \"0465e600-144b-4a7e-9304-6dbdac222d49\") " pod="kuadrant-system/authorino-548d46dfc9-vncqm"
May 28 17:27:39.185208 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.185189    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85lkr\" (UniqueName: \"kubernetes.io/projected/9a18fec1-3a2c-46fd-9dfa-6836cd04f855-kube-api-access-85lkr\") pod \"authorino-56fdd757f5-hs5rx\" (UID: \"9a18fec1-3a2c-46fd-9dfa-6836cd04f855\") " pod="kuadrant-system/authorino-56fdd757f5-hs5rx"
May 28 17:27:39.304254 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.304227    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-548d46dfc9-vncqm"
May 28 17:27:39.431161 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.431137    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-548d46dfc9-vncqm"]
May 28 17:27:39.433510 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:27:39.433480    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0465e600_144b_4a7e_9304_6dbdac222d49.slice/crio-a4a83edebea44de09b11cef9396307d8145562b4018c95f00bcaa9886a8b49b5 WatchSource:0}: Error finding container a4a83edebea44de09b11cef9396307d8145562b4018c95f00bcaa9886a8b49b5: Status 404 returned error can't find the container with id a4a83edebea44de09b11cef9396307d8145562b4018c95f00bcaa9886a8b49b5
May 28 17:27:39.840998 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.840968    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-548d46dfc9-vncqm" event={"ID":"0465e600-144b-4a7e-9304-6dbdac222d49","Type":"ContainerStarted","Data":"a4a83edebea44de09b11cef9396307d8145562b4018c95f00bcaa9886a8b49b5"}
May 28 17:27:39.841395 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.841001    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-hs5rx"
May 28 17:27:39.841395 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.841152    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-8v6w5"
May 28 17:27:39.847033 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.847007    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-hs5rx"
May 28 17:27:39.851243 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.851223    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-8v6w5"
May 28 17:27:39.984619 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.984588    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2br5\" (UniqueName: \"kubernetes.io/projected/4012d005-8fd8-41c1-ad7b-d850b5830c88-kube-api-access-h2br5\") pod \"4012d005-8fd8-41c1-ad7b-d850b5830c88\" (UID: \"4012d005-8fd8-41c1-ad7b-d850b5830c88\") "
May 28 17:27:39.984778 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.984636    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85lkr\" (UniqueName: \"kubernetes.io/projected/9a18fec1-3a2c-46fd-9dfa-6836cd04f855-kube-api-access-85lkr\") pod \"9a18fec1-3a2c-46fd-9dfa-6836cd04f855\" (UID: \"9a18fec1-3a2c-46fd-9dfa-6836cd04f855\") "
May 28 17:27:39.984778 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.984764    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9a18fec1-3a2c-46fd-9dfa-6836cd04f855-tls-cert\") pod \"9a18fec1-3a2c-46fd-9dfa-6836cd04f855\" (UID: \"9a18fec1-3a2c-46fd-9dfa-6836cd04f855\") "
May 28 17:27:39.986975 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.986946    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a18fec1-3a2c-46fd-9dfa-6836cd04f855-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9a18fec1-3a2c-46fd-9dfa-6836cd04f855" (UID: "9a18fec1-3a2c-46fd-9dfa-6836cd04f855"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:27:39.987171 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.987145    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a18fec1-3a2c-46fd-9dfa-6836cd04f855-kube-api-access-85lkr" (OuterVolumeSpecName: "kube-api-access-85lkr") pod "9a18fec1-3a2c-46fd-9dfa-6836cd04f855" (UID: "9a18fec1-3a2c-46fd-9dfa-6836cd04f855"). InnerVolumeSpecName "kube-api-access-85lkr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:27:39.987247 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:39.987187    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4012d005-8fd8-41c1-ad7b-d850b5830c88-kube-api-access-h2br5" (OuterVolumeSpecName: "kube-api-access-h2br5") pod "4012d005-8fd8-41c1-ad7b-d850b5830c88" (UID: "4012d005-8fd8-41c1-ad7b-d850b5830c88"). InnerVolumeSpecName "kube-api-access-h2br5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:27:40.085599 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:40.085520    2556 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9a18fec1-3a2c-46fd-9dfa-6836cd04f855-tls-cert\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:27:40.085599 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:40.085549    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2br5\" (UniqueName: \"kubernetes.io/projected/4012d005-8fd8-41c1-ad7b-d850b5830c88-kube-api-access-h2br5\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:27:40.085599 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:40.085564    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85lkr\" (UniqueName: \"kubernetes.io/projected/9a18fec1-3a2c-46fd-9dfa-6836cd04f855-kube-api-access-85lkr\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:27:40.846062 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:40.846020    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-548d46dfc9-vncqm" event={"ID":"0465e600-144b-4a7e-9304-6dbdac222d49","Type":"ContainerStarted","Data":"b7f63e6fa800598c06ba3edd604fe1471a5cad523e77adadd44b2a052dfd3bf2"}
May 28 17:27:40.846547 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:40.846134    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-8v6w5"
May 28 17:27:40.846547 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:40.846248    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56fdd757f5-hs5rx"
May 28 17:27:40.864649 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:40.864605    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-548d46dfc9-vncqm" podStartSLOduration=2.468843214 podStartE2EDuration="2.864592988s" podCreationTimestamp="2026-05-28 17:27:38 +0000 UTC" firstStartedPulling="2026-05-28 17:27:39.434703672 +0000 UTC m=+645.410508006" lastFinishedPulling="2026-05-28 17:27:39.830453443 +0000 UTC m=+645.806257780" observedRunningTime="2026-05-28 17:27:40.862879356 +0000 UTC m=+646.838683712" watchObservedRunningTime="2026-05-28 17:27:40.864592988 +0000 UTC m=+646.840397345"
May 28 17:27:40.885053 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:40.885025    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8v6w5"]
May 28 17:27:40.891132 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:40.891063    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-5mscv"]
May 28 17:27:40.891324 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:40.891286    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-5mscv" podUID="b6af0104-c181-48fa-805e-389326b8c23b" containerName="authorino" containerID="cri-o://ac3ae0f9e7b949c0a3718e939fe54a610226f7b68b374b6fc4b87217f0d27682" gracePeriod=30
May 28 17:27:40.894006 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:40.893982    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-8v6w5"]
May 28 17:27:40.918250 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:40.918220    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-hs5rx"]
May 28 17:27:40.924895 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:40.924866    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56fdd757f5-hs5rx"]
May 28 17:27:41.133132 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:41.133112    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-5mscv"
May 28 17:27:41.295624 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:41.295589    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b448f\" (UniqueName: \"kubernetes.io/projected/b6af0104-c181-48fa-805e-389326b8c23b-kube-api-access-b448f\") pod \"b6af0104-c181-48fa-805e-389326b8c23b\" (UID: \"b6af0104-c181-48fa-805e-389326b8c23b\") "
May 28 17:27:41.297574 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:41.297543    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6af0104-c181-48fa-805e-389326b8c23b-kube-api-access-b448f" (OuterVolumeSpecName: "kube-api-access-b448f") pod "b6af0104-c181-48fa-805e-389326b8c23b" (UID: "b6af0104-c181-48fa-805e-389326b8c23b"). InnerVolumeSpecName "kube-api-access-b448f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:27:41.396168 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:41.396140    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b448f\" (UniqueName: \"kubernetes.io/projected/b6af0104-c181-48fa-805e-389326b8c23b-kube-api-access-b448f\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:27:41.850191 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:41.850164    2556 generic.go:358] "Generic (PLEG): container finished" podID="b6af0104-c181-48fa-805e-389326b8c23b" containerID="ac3ae0f9e7b949c0a3718e939fe54a610226f7b68b374b6fc4b87217f0d27682" exitCode=0
May 28 17:27:41.850579 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:41.850214    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-5mscv"
May 28 17:27:41.850579 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:41.850256    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-5mscv" event={"ID":"b6af0104-c181-48fa-805e-389326b8c23b","Type":"ContainerDied","Data":"ac3ae0f9e7b949c0a3718e939fe54a610226f7b68b374b6fc4b87217f0d27682"}
May 28 17:27:41.850579 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:41.850295    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-5mscv" event={"ID":"b6af0104-c181-48fa-805e-389326b8c23b","Type":"ContainerDied","Data":"dad65cc7f41ae28fce8c79608b0331cccab9d12ae61e2fe26d142bd8476d47cf"}
May 28 17:27:41.850579 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:41.850333    2556 scope.go:117] "RemoveContainer" containerID="ac3ae0f9e7b949c0a3718e939fe54a610226f7b68b374b6fc4b87217f0d27682"
May 28 17:27:41.858776 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:41.858759    2556 scope.go:117] "RemoveContainer" containerID="ac3ae0f9e7b949c0a3718e939fe54a610226f7b68b374b6fc4b87217f0d27682"
May 28 17:27:41.859014 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:27:41.858997    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac3ae0f9e7b949c0a3718e939fe54a610226f7b68b374b6fc4b87217f0d27682\": container with ID starting with ac3ae0f9e7b949c0a3718e939fe54a610226f7b68b374b6fc4b87217f0d27682 not found: ID does not exist" containerID="ac3ae0f9e7b949c0a3718e939fe54a610226f7b68b374b6fc4b87217f0d27682"
May 28 17:27:41.859064 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:41.859023    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac3ae0f9e7b949c0a3718e939fe54a610226f7b68b374b6fc4b87217f0d27682"} err="failed to get container status \"ac3ae0f9e7b949c0a3718e939fe54a610226f7b68b374b6fc4b87217f0d27682\": rpc error: code = NotFound desc = could not find container \"ac3ae0f9e7b949c0a3718e939fe54a610226f7b68b374b6fc4b87217f0d27682\": container with ID starting with ac3ae0f9e7b949c0a3718e939fe54a610226f7b68b374b6fc4b87217f0d27682 not found: ID does not exist"
May 28 17:27:41.870397 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:41.870373    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-5mscv"]
May 28 17:27:41.876165 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:41.876145    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-5mscv"]
May 28 17:27:42.631683 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:42.631651    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4012d005-8fd8-41c1-ad7b-d850b5830c88" path="/var/lib/kubelet/pods/4012d005-8fd8-41c1-ad7b-d850b5830c88/volumes"
May 28 17:27:42.631920 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:42.631908    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a18fec1-3a2c-46fd-9dfa-6836cd04f855" path="/var/lib/kubelet/pods/9a18fec1-3a2c-46fd-9dfa-6836cd04f855/volumes"
May 28 17:27:42.632102 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:27:42.632092    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6af0104-c181-48fa-805e-389326b8c23b" path="/var/lib/kubelet/pods/b6af0104-c181-48fa-805e-389326b8c23b/volumes"
May 28 17:28:31.551983 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.551944    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"]
May 28 17:28:31.552501 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.552360    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6af0104-c181-48fa-805e-389326b8c23b" containerName="authorino"
May 28 17:28:31.552501 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.552373    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6af0104-c181-48fa-805e-389326b8c23b" containerName="authorino"
May 28 17:28:31.552501 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.552449    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="b6af0104-c181-48fa-805e-389326b8c23b" containerName="authorino"
May 28 17:28:31.554407 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.554390    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:31.556982 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.556961    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 28 17:28:31.558053 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.558034    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
May 28 17:28:31.558155 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.558075    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 28 17:28:31.558155 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.558117    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pmsz5\""
May 28 17:28:31.564881 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.564858    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"]
May 28 17:28:31.631489 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.631457    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9938415a-7ed9-40d9-abfd-006c29e3663e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl\" (UID: \"9938415a-7ed9-40d9-abfd-006c29e3663e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:31.631645 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.631496    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9938415a-7ed9-40d9-abfd-006c29e3663e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl\" (UID: \"9938415a-7ed9-40d9-abfd-006c29e3663e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:31.631645 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.631527    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9938415a-7ed9-40d9-abfd-006c29e3663e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl\" (UID: \"9938415a-7ed9-40d9-abfd-006c29e3663e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:31.631645 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.631610    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9938415a-7ed9-40d9-abfd-006c29e3663e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl\" (UID: \"9938415a-7ed9-40d9-abfd-006c29e3663e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:31.631802 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.631672    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9938415a-7ed9-40d9-abfd-006c29e3663e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl\" (UID: \"9938415a-7ed9-40d9-abfd-006c29e3663e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:31.631802 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.631718    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nsjh6\" (UniqueName: \"kubernetes.io/projected/9938415a-7ed9-40d9-abfd-006c29e3663e-kube-api-access-nsjh6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl\" (UID: \"9938415a-7ed9-40d9-abfd-006c29e3663e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:31.732782 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.732746    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9938415a-7ed9-40d9-abfd-006c29e3663e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl\" (UID: \"9938415a-7ed9-40d9-abfd-006c29e3663e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:31.732944 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.732789    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9938415a-7ed9-40d9-abfd-006c29e3663e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl\" (UID: \"9938415a-7ed9-40d9-abfd-006c29e3663e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:31.732944 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.732824    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9938415a-7ed9-40d9-abfd-006c29e3663e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl\" (UID: \"9938415a-7ed9-40d9-abfd-006c29e3663e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:31.732944 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.732858    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nsjh6\" (UniqueName: \"kubernetes.io/projected/9938415a-7ed9-40d9-abfd-006c29e3663e-kube-api-access-nsjh6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl\" (UID: \"9938415a-7ed9-40d9-abfd-006c29e3663e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:31.733069 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.732941    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9938415a-7ed9-40d9-abfd-006c29e3663e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl\" (UID: \"9938415a-7ed9-40d9-abfd-006c29e3663e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:31.733069 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.732970    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9938415a-7ed9-40d9-abfd-006c29e3663e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl\" (UID: \"9938415a-7ed9-40d9-abfd-006c29e3663e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:31.733174 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.733139    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9938415a-7ed9-40d9-abfd-006c29e3663e-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl\" (UID: \"9938415a-7ed9-40d9-abfd-006c29e3663e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:31.733290 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.733269    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9938415a-7ed9-40d9-abfd-006c29e3663e-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl\" (UID: \"9938415a-7ed9-40d9-abfd-006c29e3663e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:31.733290 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.733282    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/9938415a-7ed9-40d9-abfd-006c29e3663e-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl\" (UID: \"9938415a-7ed9-40d9-abfd-006c29e3663e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:31.734998 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.734975    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9938415a-7ed9-40d9-abfd-006c29e3663e-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl\" (UID: \"9938415a-7ed9-40d9-abfd-006c29e3663e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:31.735290 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.735272    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9938415a-7ed9-40d9-abfd-006c29e3663e-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl\" (UID: \"9938415a-7ed9-40d9-abfd-006c29e3663e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:31.741052 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.741020    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nsjh6\" (UniqueName: \"kubernetes.io/projected/9938415a-7ed9-40d9-abfd-006c29e3663e-kube-api-access-nsjh6\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl\" (UID: \"9938415a-7ed9-40d9-abfd-006c29e3663e\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:31.865368 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.865269    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:31.994561 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:31.994537    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"]
May 28 17:28:31.996622 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:28:31.996592    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9938415a_7ed9_40d9_abfd_006c29e3663e.slice/crio-17e15d5164f1e542cf740c0ae00a6c7487e9a937422cba8592cf694abbb0a9b4 WatchSource:0}: Error finding container 17e15d5164f1e542cf740c0ae00a6c7487e9a937422cba8592cf694abbb0a9b4: Status 404 returned error can't find the container with id 17e15d5164f1e542cf740c0ae00a6c7487e9a937422cba8592cf694abbb0a9b4
May 28 17:28:32.018628 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:32.018601    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl" event={"ID":"9938415a-7ed9-40d9-abfd-006c29e3663e","Type":"ContainerStarted","Data":"17e15d5164f1e542cf740c0ae00a6c7487e9a937422cba8592cf694abbb0a9b4"}
May 28 17:28:39.049393 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:39.049353    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl" event={"ID":"9938415a-7ed9-40d9-abfd-006c29e3663e","Type":"ContainerStarted","Data":"90f9c705b7bffa21fc30facb3c4adb03d024b884732810abd3553471cd4e4600"}
May 28 17:28:44.070915 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:44.070881    2556 generic.go:358] "Generic (PLEG): container finished" podID="9938415a-7ed9-40d9-abfd-006c29e3663e" containerID="90f9c705b7bffa21fc30facb3c4adb03d024b884732810abd3553471cd4e4600" exitCode=0
May 28 17:28:44.071278 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:44.070926    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl" event={"ID":"9938415a-7ed9-40d9-abfd-006c29e3663e","Type":"ContainerDied","Data":"90f9c705b7bffa21fc30facb3c4adb03d024b884732810abd3553471cd4e4600"}
May 28 17:28:46.079767 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:46.079731    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl" event={"ID":"9938415a-7ed9-40d9-abfd-006c29e3663e","Type":"ContainerStarted","Data":"5f1cde0bf05419876e58d0671b9fb6b342d1f7c5f6059adf81be7ed904621f0b"}
May 28 17:28:46.080140 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:46.079943    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:28:46.101235 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:46.101187    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl" podStartSLOduration=1.963336193 podStartE2EDuration="15.101172193s" podCreationTimestamp="2026-05-28 17:28:31 +0000 UTC" firstStartedPulling="2026-05-28 17:28:31.998256341 +0000 UTC m=+697.974060689" lastFinishedPulling="2026-05-28 17:28:45.13609234 +0000 UTC m=+711.111896689" observedRunningTime="2026-05-28 17:28:46.099975537 +0000 UTC m=+712.075779926" watchObservedRunningTime="2026-05-28 17:28:46.101172193 +0000 UTC m=+712.076976551"
May 28 17:28:57.095600 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:28:57.095570    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl"
May 28 17:29:03.858040 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:03.858004    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"]
May 28 17:29:03.889326 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:03.889279    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"]
May 28 17:29:03.889469 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:03.889387    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:03.892121 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:03.892098    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 28 17:29:03.920278 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:03.920258    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec7ad64e-d160-4db3-96c0-065da85f2af3-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5\" (UID: \"ec7ad64e-d160-4db3-96c0-065da85f2af3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:03.920406 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:03.920285    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec7ad64e-d160-4db3-96c0-065da85f2af3-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5\" (UID: \"ec7ad64e-d160-4db3-96c0-065da85f2af3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:03.920406 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:03.920351    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec7ad64e-d160-4db3-96c0-065da85f2af3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5\" (UID: \"ec7ad64e-d160-4db3-96c0-065da85f2af3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:03.920483 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:03.920440    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmt7l\" (UniqueName: \"kubernetes.io/projected/ec7ad64e-d160-4db3-96c0-065da85f2af3-kube-api-access-gmt7l\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5\" (UID: \"ec7ad64e-d160-4db3-96c0-065da85f2af3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:03.920483 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:03.920466    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec7ad64e-d160-4db3-96c0-065da85f2af3-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5\" (UID: \"ec7ad64e-d160-4db3-96c0-065da85f2af3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:03.920558 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:03.920496    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ec7ad64e-d160-4db3-96c0-065da85f2af3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5\" (UID: \"ec7ad64e-d160-4db3-96c0-065da85f2af3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:04.021071 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:04.021040    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmt7l\" (UniqueName: \"kubernetes.io/projected/ec7ad64e-d160-4db3-96c0-065da85f2af3-kube-api-access-gmt7l\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5\" (UID: \"ec7ad64e-d160-4db3-96c0-065da85f2af3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:04.021071 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:04.021075    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec7ad64e-d160-4db3-96c0-065da85f2af3-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5\" (UID: \"ec7ad64e-d160-4db3-96c0-065da85f2af3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:04.021227 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:04.021100    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ec7ad64e-d160-4db3-96c0-065da85f2af3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5\" (UID: \"ec7ad64e-d160-4db3-96c0-065da85f2af3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:04.021227 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:04.021138    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec7ad64e-d160-4db3-96c0-065da85f2af3-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5\" (UID: \"ec7ad64e-d160-4db3-96c0-065da85f2af3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:04.021227 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:04.021154    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec7ad64e-d160-4db3-96c0-065da85f2af3-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5\" (UID: \"ec7ad64e-d160-4db3-96c0-065da85f2af3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:04.021227 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:04.021179    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec7ad64e-d160-4db3-96c0-065da85f2af3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5\" (UID: \"ec7ad64e-d160-4db3-96c0-065da85f2af3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:04.021583 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:04.021542    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec7ad64e-d160-4db3-96c0-065da85f2af3-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5\" (UID: \"ec7ad64e-d160-4db3-96c0-065da85f2af3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:04.021583 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:04.021562    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ec7ad64e-d160-4db3-96c0-065da85f2af3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5\" (UID: \"ec7ad64e-d160-4db3-96c0-065da85f2af3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:04.021722 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:04.021653    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec7ad64e-d160-4db3-96c0-065da85f2af3-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5\" (UID: \"ec7ad64e-d160-4db3-96c0-065da85f2af3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:04.023391 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:04.023367    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec7ad64e-d160-4db3-96c0-065da85f2af3-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5\" (UID: \"ec7ad64e-d160-4db3-96c0-065da85f2af3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:04.023646 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:04.023626    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec7ad64e-d160-4db3-96c0-065da85f2af3-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5\" (UID: \"ec7ad64e-d160-4db3-96c0-065da85f2af3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:04.029162 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:04.029141    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmt7l\" (UniqueName: \"kubernetes.io/projected/ec7ad64e-d160-4db3-96c0-065da85f2af3-kube-api-access-gmt7l\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5\" (UID: \"ec7ad64e-d160-4db3-96c0-065da85f2af3\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:04.199366 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:04.199276    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:04.329091 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:04.329068    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"]
May 28 17:29:04.331030 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:29:04.331000    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec7ad64e_d160_4db3_96c0_065da85f2af3.slice/crio-16f5ae99df62269c892a28907c94ce63ef4f9f10024a050a777fb409ea012a89 WatchSource:0}: Error finding container 16f5ae99df62269c892a28907c94ce63ef4f9f10024a050a777fb409ea012a89: Status 404 returned error can't find the container with id 16f5ae99df62269c892a28907c94ce63ef4f9f10024a050a777fb409ea012a89
May 28 17:29:05.145427 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:05.145386    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5" event={"ID":"ec7ad64e-d160-4db3-96c0-065da85f2af3","Type":"ContainerStarted","Data":"803de1faf527e3e3222264ed9d639513054e963fff2cb175c5291938fb4aa4fa"}
May 28 17:29:05.145427 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:05.145430    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5" event={"ID":"ec7ad64e-d160-4db3-96c0-065da85f2af3","Type":"ContainerStarted","Data":"16f5ae99df62269c892a28907c94ce63ef4f9f10024a050a777fb409ea012a89"}
May 28 17:29:08.745191 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.745151    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"]
May 28 17:29:08.748711 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.748688    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:08.751160 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.751133    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 28 17:29:08.761212 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.761194    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"]
May 28 17:29:08.861375 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.861341    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5d4abbe-e810-4343-a538-4b1927680f0b-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx\" (UID: \"e5d4abbe-e810-4343-a538-4b1927680f0b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:08.861543 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.861404    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99dfn\" (UniqueName: \"kubernetes.io/projected/e5d4abbe-e810-4343-a538-4b1927680f0b-kube-api-access-99dfn\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx\" (UID: \"e5d4abbe-e810-4343-a538-4b1927680f0b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:08.861543 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.861442    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5d4abbe-e810-4343-a538-4b1927680f0b-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx\" (UID: \"e5d4abbe-e810-4343-a538-4b1927680f0b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:08.861543 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.861461    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5d4abbe-e810-4343-a538-4b1927680f0b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx\" (UID: \"e5d4abbe-e810-4343-a538-4b1927680f0b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:08.861543 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.861531    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5d4abbe-e810-4343-a538-4b1927680f0b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx\" (UID: \"e5d4abbe-e810-4343-a538-4b1927680f0b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:08.861759 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.861559    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e5d4abbe-e810-4343-a538-4b1927680f0b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx\" (UID: \"e5d4abbe-e810-4343-a538-4b1927680f0b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:08.962259 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.962225    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5d4abbe-e810-4343-a538-4b1927680f0b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx\" (UID: \"e5d4abbe-e810-4343-a538-4b1927680f0b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:08.962539 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.962268    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5d4abbe-e810-4343-a538-4b1927680f0b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx\" (UID: \"e5d4abbe-e810-4343-a538-4b1927680f0b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:08.962539 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.962289    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e5d4abbe-e810-4343-a538-4b1927680f0b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx\" (UID: \"e5d4abbe-e810-4343-a538-4b1927680f0b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:08.962539 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.962381    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5d4abbe-e810-4343-a538-4b1927680f0b-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx\" (UID: \"e5d4abbe-e810-4343-a538-4b1927680f0b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:08.962539 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.962463    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-99dfn\" (UniqueName: \"kubernetes.io/projected/e5d4abbe-e810-4343-a538-4b1927680f0b-kube-api-access-99dfn\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx\" (UID: \"e5d4abbe-e810-4343-a538-4b1927680f0b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:08.962539 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.962513    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5d4abbe-e810-4343-a538-4b1927680f0b-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx\" (UID: \"e5d4abbe-e810-4343-a538-4b1927680f0b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:08.962797 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.962653    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e5d4abbe-e810-4343-a538-4b1927680f0b-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx\" (UID: \"e5d4abbe-e810-4343-a538-4b1927680f0b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:08.962797 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.962714    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e5d4abbe-e810-4343-a538-4b1927680f0b-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx\" (UID: \"e5d4abbe-e810-4343-a538-4b1927680f0b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:08.962797 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.962754    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e5d4abbe-e810-4343-a538-4b1927680f0b-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx\" (UID: \"e5d4abbe-e810-4343-a538-4b1927680f0b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:08.964611 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.964583    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e5d4abbe-e810-4343-a538-4b1927680f0b-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx\" (UID: \"e5d4abbe-e810-4343-a538-4b1927680f0b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:08.964752 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.964736    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e5d4abbe-e810-4343-a538-4b1927680f0b-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx\" (UID: \"e5d4abbe-e810-4343-a538-4b1927680f0b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:08.971140 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:08.971117    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99dfn\" (UniqueName: \"kubernetes.io/projected/e5d4abbe-e810-4343-a538-4b1927680f0b-kube-api-access-99dfn\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx\" (UID: \"e5d4abbe-e810-4343-a538-4b1927680f0b\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:09.059695 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:09.059666    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:09.192821 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:09.192797    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"]
May 28 17:29:09.194730 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:29:09.194702    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5d4abbe_e810_4343_a538_4b1927680f0b.slice/crio-ebdf5f4a9810f13c861eeea4aeb263526943339c35afa5f06dd02bdb78bb7f60 WatchSource:0}: Error finding container ebdf5f4a9810f13c861eeea4aeb263526943339c35afa5f06dd02bdb78bb7f60: Status 404 returned error can't find the container with id ebdf5f4a9810f13c861eeea4aeb263526943339c35afa5f06dd02bdb78bb7f60
May 28 17:29:09.196441 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:09.196423    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 17:29:10.164963 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:10.164923    2556 generic.go:358] "Generic (PLEG): container finished" podID="ec7ad64e-d160-4db3-96c0-065da85f2af3" containerID="803de1faf527e3e3222264ed9d639513054e963fff2cb175c5291938fb4aa4fa" exitCode=0
May 28 17:29:10.165407 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:10.164993    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5" event={"ID":"ec7ad64e-d160-4db3-96c0-065da85f2af3","Type":"ContainerDied","Data":"803de1faf527e3e3222264ed9d639513054e963fff2cb175c5291938fb4aa4fa"}
May 28 17:29:10.166610 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:10.166583    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx" event={"ID":"e5d4abbe-e810-4343-a538-4b1927680f0b","Type":"ContainerStarted","Data":"54c6c2dfd013bda7e5da1c2f289bd56d48ee3e907846280cf3db561cd00a528c"}
May 28 17:29:10.166691 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:10.166620    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx" event={"ID":"e5d4abbe-e810-4343-a538-4b1927680f0b","Type":"ContainerStarted","Data":"ebdf5f4a9810f13c861eeea4aeb263526943339c35afa5f06dd02bdb78bb7f60"}
May 28 17:29:11.172302 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:11.172267    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5" event={"ID":"ec7ad64e-d160-4db3-96c0-065da85f2af3","Type":"ContainerStarted","Data":"0a45893e5d9b1e2ac12e678334314a440c86af35ef171ed180217e2daba1cd88"}
May 28 17:29:11.172702 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:11.172515    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:11.196608 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:11.196562    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5" podStartSLOduration=7.942025276 podStartE2EDuration="8.196547881s" podCreationTimestamp="2026-05-28 17:29:03 +0000 UTC" firstStartedPulling="2026-05-28 17:29:10.165909525 +0000 UTC m=+736.141713873" lastFinishedPulling="2026-05-28 17:29:10.420432142 +0000 UTC m=+736.396236478" observedRunningTime="2026-05-28 17:29:11.194970647 +0000 UTC m=+737.170775004" watchObservedRunningTime="2026-05-28 17:29:11.196547881 +0000 UTC m=+737.172352236"
May 28 17:29:15.190126 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:15.190089    2556 generic.go:358] "Generic (PLEG): container finished" podID="e5d4abbe-e810-4343-a538-4b1927680f0b" containerID="54c6c2dfd013bda7e5da1c2f289bd56d48ee3e907846280cf3db561cd00a528c" exitCode=0
May 28 17:29:15.190476 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:15.190150    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx" event={"ID":"e5d4abbe-e810-4343-a538-4b1927680f0b","Type":"ContainerDied","Data":"54c6c2dfd013bda7e5da1c2f289bd56d48ee3e907846280cf3db561cd00a528c"}
May 28 17:29:16.194799 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:16.194764    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx" event={"ID":"e5d4abbe-e810-4343-a538-4b1927680f0b","Type":"ContainerStarted","Data":"057d611d48ca7b483f770b63872ef05484b8e55dede5cafc116677c255f0e186"}
May 28 17:29:16.195154 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:16.194971    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:16.215828 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:16.215785    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx" podStartSLOduration=7.9835885730000005 podStartE2EDuration="8.21577272s" podCreationTimestamp="2026-05-28 17:29:08 +0000 UTC" firstStartedPulling="2026-05-28 17:29:15.190702245 +0000 UTC m=+741.166506579" lastFinishedPulling="2026-05-28 17:29:15.422886392 +0000 UTC m=+741.398690726" observedRunningTime="2026-05-28 17:29:16.213969776 +0000 UTC m=+742.189774133" watchObservedRunningTime="2026-05-28 17:29:16.21577272 +0000 UTC m=+742.191577076"
May 28 17:29:18.647928 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.647897    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"]
May 28 17:29:18.651525 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.651506    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:18.653731 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.653709    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 28 17:29:18.660226 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.660202    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"]
May 28 17:29:18.748435 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.748406    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8f4062d-898a-4806-81ad-0c1c6dcd5a4b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t\" (UID: \"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:18.748572 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.748461    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8f4062d-898a-4806-81ad-0c1c6dcd5a4b-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t\" (UID: \"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:18.748572 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.748551    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8f4062d-898a-4806-81ad-0c1c6dcd5a4b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t\" (UID: \"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:18.748649 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.748593    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e8f4062d-898a-4806-81ad-0c1c6dcd5a4b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t\" (UID: \"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:18.748649 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.748617    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7nxf\" (UniqueName: \"kubernetes.io/projected/e8f4062d-898a-4806-81ad-0c1c6dcd5a4b-kube-api-access-f7nxf\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t\" (UID: \"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:18.748713 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.748648    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8f4062d-898a-4806-81ad-0c1c6dcd5a4b-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t\" (UID: \"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:18.849615 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.849586    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8f4062d-898a-4806-81ad-0c1c6dcd5a4b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t\" (UID: \"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:18.849727 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.849632    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8f4062d-898a-4806-81ad-0c1c6dcd5a4b-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t\" (UID: \"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:18.849727 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.849662    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8f4062d-898a-4806-81ad-0c1c6dcd5a4b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t\" (UID: \"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:18.849727 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.849679    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e8f4062d-898a-4806-81ad-0c1c6dcd5a4b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t\" (UID: \"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:18.849727 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.849696    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f7nxf\" (UniqueName: \"kubernetes.io/projected/e8f4062d-898a-4806-81ad-0c1c6dcd5a4b-kube-api-access-f7nxf\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t\" (UID: \"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:18.849727 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.849713    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8f4062d-898a-4806-81ad-0c1c6dcd5a4b-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t\" (UID: \"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:18.850029 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.850005    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e8f4062d-898a-4806-81ad-0c1c6dcd5a4b-home\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t\" (UID: \"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:18.850100 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.850026    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e8f4062d-898a-4806-81ad-0c1c6dcd5a4b-model-cache\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t\" (UID: \"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:18.850100 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.850072    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e8f4062d-898a-4806-81ad-0c1c6dcd5a4b-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t\" (UID: \"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:18.851808 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.851792    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e8f4062d-898a-4806-81ad-0c1c6dcd5a4b-dshm\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t\" (UID: \"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:18.852163 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.852147    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e8f4062d-898a-4806-81ad-0c1c6dcd5a4b-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t\" (UID: \"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:18.859057 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.859034    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7nxf\" (UniqueName: \"kubernetes.io/projected/e8f4062d-898a-4806-81ad-0c1c6dcd5a4b-kube-api-access-f7nxf\") pod \"premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t\" (UID: \"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b\") " pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:18.967368 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:18.967288    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:19.098706 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.098677    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"]
May 28 17:29:19.100369 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:29:19.100344    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8f4062d_898a_4806_81ad_0c1c6dcd5a4b.slice/crio-7b1f838484167ac78bef0ff16a0c8be864b94ecd16954ecedfec0882dd2835b4 WatchSource:0}: Error finding container 7b1f838484167ac78bef0ff16a0c8be864b94ecd16954ecedfec0882dd2835b4: Status 404 returned error can't find the container with id 7b1f838484167ac78bef0ff16a0c8be864b94ecd16954ecedfec0882dd2835b4
May 28 17:29:19.206408 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.206374    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t" event={"ID":"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b","Type":"ContainerStarted","Data":"1b01f6aacde350cce63ed8474114b33e4889ebd1ef41df58daee7211830859ac"}
May 28 17:29:19.206572 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.206415    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t" event={"ID":"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b","Type":"ContainerStarted","Data":"7b1f838484167ac78bef0ff16a0c8be864b94ecd16954ecedfec0882dd2835b4"}
May 28 17:29:19.752428 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.752391    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"]
May 28 17:29:19.757735 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.757705    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:19.760251 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.760230    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 28 17:29:19.765791 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.765732    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"]
May 28 17:29:19.858389 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.858353    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs\" (UID: \"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:19.858389 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.858400    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs\" (UID: \"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:19.858632 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.858479    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs\" (UID: \"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:19.858632 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.858545    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdc78\" (UniqueName: \"kubernetes.io/projected/e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1-kube-api-access-qdc78\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs\" (UID: \"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:19.858632 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.858606    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs\" (UID: \"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:19.858796 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.858632    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs\" (UID: \"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:19.959446 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.959407    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs\" (UID: \"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:19.959616 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.959550    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs\" (UID: \"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:19.959616 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.959572    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs\" (UID: \"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:19.959616 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.959604    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs\" (UID: \"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:19.959798 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.959661    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qdc78\" (UniqueName: \"kubernetes.io/projected/e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1-kube-api-access-qdc78\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs\" (UID: \"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:19.959798 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.959714    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs\" (UID: \"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:19.959907 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.959836    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs\" (UID: \"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:19.959991 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.959962    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs\" (UID: \"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:19.960139 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.960122    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs\" (UID: \"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:19.961938 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.961915    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs\" (UID: \"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:19.962280 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.962258    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs\" (UID: \"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:19.967823 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:19.967800    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdc78\" (UniqueName: \"kubernetes.io/projected/e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1-kube-api-access-qdc78\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs\" (UID: \"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:20.070409 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:20.070369    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:20.221754 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:20.221726    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"]
May 28 17:29:20.222083 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:29:20.222059    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6f6411a_2d73_447e_a9fe_d03ab4d5e5d1.slice/crio-d06b1c6b01d5ae6b4e3a8e072a2b53f2cf6d19c7fe73f81541ecedd88663a245 WatchSource:0}: Error finding container d06b1c6b01d5ae6b4e3a8e072a2b53f2cf6d19c7fe73f81541ecedd88663a245: Status 404 returned error can't find the container with id d06b1c6b01d5ae6b4e3a8e072a2b53f2cf6d19c7fe73f81541ecedd88663a245
May 28 17:29:21.216524 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:21.216483    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs" event={"ID":"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1","Type":"ContainerStarted","Data":"81c50142814fc6009a559bc2a770afde235c98742818a381751136ec1ce81797"}
May 28 17:29:21.216893 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:21.216530    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs" event={"ID":"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1","Type":"ContainerStarted","Data":"d06b1c6b01d5ae6b4e3a8e072a2b53f2cf6d19c7fe73f81541ecedd88663a245"}
May 28 17:29:22.192714 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:22.192683    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5"
May 28 17:29:26.241693 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:26.241659    2556 generic.go:358] "Generic (PLEG): container finished" podID="e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1" containerID="81c50142814fc6009a559bc2a770afde235c98742818a381751136ec1ce81797" exitCode=0
May 28 17:29:26.242072 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:26.241730    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs" event={"ID":"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1","Type":"ContainerDied","Data":"81c50142814fc6009a559bc2a770afde235c98742818a381751136ec1ce81797"}
May 28 17:29:27.211147 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:27.211067    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx"
May 28 17:29:27.246432 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:27.246401    2556 generic.go:358] "Generic (PLEG): container finished" podID="e8f4062d-898a-4806-81ad-0c1c6dcd5a4b" containerID="1b01f6aacde350cce63ed8474114b33e4889ebd1ef41df58daee7211830859ac" exitCode=0
May 28 17:29:27.246820 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:27.246468    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t" event={"ID":"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b","Type":"ContainerDied","Data":"1b01f6aacde350cce63ed8474114b33e4889ebd1ef41df58daee7211830859ac"}
May 28 17:29:27.248170 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:27.248147    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs" event={"ID":"e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1","Type":"ContainerStarted","Data":"5076fe2e93fe0e95e6199ee1273980a05a56cd1c59c17d943286c2e789b844f2"}
May 28 17:29:27.248385 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:27.248368    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:29:27.305860 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:27.305808    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs" podStartSLOduration=8.016629681 podStartE2EDuration="8.305791449s" podCreationTimestamp="2026-05-28 17:29:19 +0000 UTC" firstStartedPulling="2026-05-28 17:29:26.242383081 +0000 UTC m=+752.218187416" lastFinishedPulling="2026-05-28 17:29:26.53154485 +0000 UTC m=+752.507349184" observedRunningTime="2026-05-28 17:29:27.305338086 +0000 UTC m=+753.281142442" watchObservedRunningTime="2026-05-28 17:29:27.305791449 +0000 UTC m=+753.281595807"
May 28 17:29:28.253106 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:28.253071    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t" event={"ID":"e8f4062d-898a-4806-81ad-0c1c6dcd5a4b","Type":"ContainerStarted","Data":"e9f92dae8da399dd8fde59b7b69b25c6e1d12478218b3cf72c369717337aea9d"}
May 28 17:29:28.272681 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:28.272626    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t" podStartSLOduration=9.940430255999999 podStartE2EDuration="10.272608901s" podCreationTimestamp="2026-05-28 17:29:18 +0000 UTC" firstStartedPulling="2026-05-28 17:29:27.247121737 +0000 UTC m=+753.222926071" lastFinishedPulling="2026-05-28 17:29:27.57930036 +0000 UTC m=+753.555104716" observedRunningTime="2026-05-28 17:29:28.271720779 +0000 UTC m=+754.247525136" watchObservedRunningTime="2026-05-28 17:29:28.272608901 +0000 UTC m=+754.248413259"
May 28 17:29:38.253802 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:38.253768    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:38.272343 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:38.272292    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t"
May 28 17:29:38.273084 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:29:38.273062    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs"
May 28 17:30:11.382125 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:11.382037    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-67d65448cd-wps7c"]
May 28 17:30:11.384500 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:11.384477    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67d65448cd-wps7c"
May 28 17:30:11.394235 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:11.394212    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67d65448cd-wps7c"]
May 28 17:30:11.535061 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:11.535027    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4n8gq\" (UniqueName: \"kubernetes.io/projected/ab5bb489-27ab-4662-95ab-1e2e3cfff7fa-kube-api-access-4n8gq\") pod \"authorino-67d65448cd-wps7c\" (UID: \"ab5bb489-27ab-4662-95ab-1e2e3cfff7fa\") " pod="kuadrant-system/authorino-67d65448cd-wps7c"
May 28 17:30:11.535211 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:11.535155    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ab5bb489-27ab-4662-95ab-1e2e3cfff7fa-tls-cert\") pod \"authorino-67d65448cd-wps7c\" (UID: \"ab5bb489-27ab-4662-95ab-1e2e3cfff7fa\") " pod="kuadrant-system/authorino-67d65448cd-wps7c"
May 28 17:30:11.636716 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:11.636628    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ab5bb489-27ab-4662-95ab-1e2e3cfff7fa-tls-cert\") pod \"authorino-67d65448cd-wps7c\" (UID: \"ab5bb489-27ab-4662-95ab-1e2e3cfff7fa\") " pod="kuadrant-system/authorino-67d65448cd-wps7c"
May 28 17:30:11.636716 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:11.636687    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4n8gq\" (UniqueName: \"kubernetes.io/projected/ab5bb489-27ab-4662-95ab-1e2e3cfff7fa-kube-api-access-4n8gq\") pod \"authorino-67d65448cd-wps7c\" (UID: \"ab5bb489-27ab-4662-95ab-1e2e3cfff7fa\") " pod="kuadrant-system/authorino-67d65448cd-wps7c"
May 28 17:30:11.639241 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:11.639213    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ab5bb489-27ab-4662-95ab-1e2e3cfff7fa-tls-cert\") pod \"authorino-67d65448cd-wps7c\" (UID: \"ab5bb489-27ab-4662-95ab-1e2e3cfff7fa\") " pod="kuadrant-system/authorino-67d65448cd-wps7c"
May 28 17:30:11.646913 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:11.646886    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4n8gq\" (UniqueName: \"kubernetes.io/projected/ab5bb489-27ab-4662-95ab-1e2e3cfff7fa-kube-api-access-4n8gq\") pod \"authorino-67d65448cd-wps7c\" (UID: \"ab5bb489-27ab-4662-95ab-1e2e3cfff7fa\") " pod="kuadrant-system/authorino-67d65448cd-wps7c"
May 28 17:30:11.693694 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:11.693673    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-67d65448cd-wps7c"
May 28 17:30:11.827651 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:11.827624    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-67d65448cd-wps7c"]
May 28 17:30:11.829788 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:30:11.829763    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab5bb489_27ab_4662_95ab_1e2e3cfff7fa.slice/crio-aba55cd1a7c99bd4c902dc07e6db3558b3ffb36a8021487397036113d596f7ce WatchSource:0}: Error finding container aba55cd1a7c99bd4c902dc07e6db3558b3ffb36a8021487397036113d596f7ce: Status 404 returned error can't find the container with id aba55cd1a7c99bd4c902dc07e6db3558b3ffb36a8021487397036113d596f7ce
May 28 17:30:12.408211 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:12.408178    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67d65448cd-wps7c" event={"ID":"ab5bb489-27ab-4662-95ab-1e2e3cfff7fa","Type":"ContainerStarted","Data":"aba55cd1a7c99bd4c902dc07e6db3558b3ffb36a8021487397036113d596f7ce"}
May 28 17:30:13.414082 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:13.414040    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-67d65448cd-wps7c" event={"ID":"ab5bb489-27ab-4662-95ab-1e2e3cfff7fa","Type":"ContainerStarted","Data":"8c36a19381f5d107ce3abe0dd639d705669bb46505a4b78ae80248d637306eae"}
May 28 17:30:13.429556 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:13.429503    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-67d65448cd-wps7c" podStartSLOduration=1.767924002 podStartE2EDuration="2.429487356s" podCreationTimestamp="2026-05-28 17:30:11 +0000 UTC" firstStartedPulling="2026-05-28 17:30:11.831187445 +0000 UTC m=+797.806991797" lastFinishedPulling="2026-05-28 17:30:12.4927508 +0000 UTC m=+798.468555151" observedRunningTime="2026-05-28 17:30:13.429141493 +0000 UTC m=+799.404945848" watchObservedRunningTime="2026-05-28 17:30:13.429487356 +0000 UTC m=+799.405291712"
May 28 17:30:13.462007 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:13.461965    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-548d46dfc9-vncqm"]
May 28 17:30:13.462251 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:13.462225    2556 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-548d46dfc9-vncqm" podUID="0465e600-144b-4a7e-9304-6dbdac222d49" containerName="authorino" containerID="cri-o://b7f63e6fa800598c06ba3edd604fe1471a5cad523e77adadd44b2a052dfd3bf2" gracePeriod=30
May 28 17:30:13.703203 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:13.703179    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-548d46dfc9-vncqm"
May 28 17:30:13.858763 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:13.858723    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0465e600-144b-4a7e-9304-6dbdac222d49-tls-cert\") pod \"0465e600-144b-4a7e-9304-6dbdac222d49\" (UID: \"0465e600-144b-4a7e-9304-6dbdac222d49\") "
May 28 17:30:13.858935 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:13.858819    2556 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbwjw\" (UniqueName: \"kubernetes.io/projected/0465e600-144b-4a7e-9304-6dbdac222d49-kube-api-access-nbwjw\") pod \"0465e600-144b-4a7e-9304-6dbdac222d49\" (UID: \"0465e600-144b-4a7e-9304-6dbdac222d49\") "
May 28 17:30:13.860755 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:13.860721    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0465e600-144b-4a7e-9304-6dbdac222d49-kube-api-access-nbwjw" (OuterVolumeSpecName: "kube-api-access-nbwjw") pod "0465e600-144b-4a7e-9304-6dbdac222d49" (UID: "0465e600-144b-4a7e-9304-6dbdac222d49"). InnerVolumeSpecName "kube-api-access-nbwjw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 28 17:30:13.869098 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:13.869076    2556 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0465e600-144b-4a7e-9304-6dbdac222d49-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "0465e600-144b-4a7e-9304-6dbdac222d49" (UID: "0465e600-144b-4a7e-9304-6dbdac222d49"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 28 17:30:13.960132 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:13.960061    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbwjw\" (UniqueName: \"kubernetes.io/projected/0465e600-144b-4a7e-9304-6dbdac222d49-kube-api-access-nbwjw\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:30:13.960132 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:13.960089    2556 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0465e600-144b-4a7e-9304-6dbdac222d49-tls-cert\") on node \"ip-10-0-133-205.ec2.internal\" DevicePath \"\""
May 28 17:30:14.418369 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:14.418334    2556 generic.go:358] "Generic (PLEG): container finished" podID="0465e600-144b-4a7e-9304-6dbdac222d49" containerID="b7f63e6fa800598c06ba3edd604fe1471a5cad523e77adadd44b2a052dfd3bf2" exitCode=0
May 28 17:30:14.418804 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:14.418406    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-548d46dfc9-vncqm" event={"ID":"0465e600-144b-4a7e-9304-6dbdac222d49","Type":"ContainerDied","Data":"b7f63e6fa800598c06ba3edd604fe1471a5cad523e77adadd44b2a052dfd3bf2"}
May 28 17:30:14.418804 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:14.418428    2556 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-548d46dfc9-vncqm"
May 28 17:30:14.418804 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:14.418443    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-548d46dfc9-vncqm" event={"ID":"0465e600-144b-4a7e-9304-6dbdac222d49","Type":"ContainerDied","Data":"a4a83edebea44de09b11cef9396307d8145562b4018c95f00bcaa9886a8b49b5"}
May 28 17:30:14.418804 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:14.418454    2556 scope.go:117] "RemoveContainer" containerID="b7f63e6fa800598c06ba3edd604fe1471a5cad523e77adadd44b2a052dfd3bf2"
May 28 17:30:14.427219 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:14.427204    2556 scope.go:117] "RemoveContainer" containerID="b7f63e6fa800598c06ba3edd604fe1471a5cad523e77adadd44b2a052dfd3bf2"
May 28 17:30:14.427465 ip-10-0-133-205 kubenswrapper[2556]: E0528 17:30:14.427445    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7f63e6fa800598c06ba3edd604fe1471a5cad523e77adadd44b2a052dfd3bf2\": container with ID starting with b7f63e6fa800598c06ba3edd604fe1471a5cad523e77adadd44b2a052dfd3bf2 not found: ID does not exist" containerID="b7f63e6fa800598c06ba3edd604fe1471a5cad523e77adadd44b2a052dfd3bf2"
May 28 17:30:14.427532 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:14.427476    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7f63e6fa800598c06ba3edd604fe1471a5cad523e77adadd44b2a052dfd3bf2"} err="failed to get container status \"b7f63e6fa800598c06ba3edd604fe1471a5cad523e77adadd44b2a052dfd3bf2\": rpc error: code = NotFound desc = could not find container \"b7f63e6fa800598c06ba3edd604fe1471a5cad523e77adadd44b2a052dfd3bf2\": container with ID starting with b7f63e6fa800598c06ba3edd604fe1471a5cad523e77adadd44b2a052dfd3bf2 not found: ID does not exist"
May 28 17:30:14.439915 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:14.439896    2556 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-548d46dfc9-vncqm"]
May 28 17:30:14.443917 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:14.443898    2556 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-548d46dfc9-vncqm"]
May 28 17:30:14.632614 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:30:14.632579    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0465e600-144b-4a7e-9304-6dbdac222d49" path="/var/lib/kubelet/pods/0465e600-144b-4a7e-9304-6dbdac222d49/volumes"
May 28 17:31:54.594144 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:31:54.594116    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/1.log"
May 28 17:31:54.596610 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:31:54.596587    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/1.log"
May 28 17:31:54.598391 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:31:54.598372    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4lcb_9bd29f05-c1e0-4fe5-82e8-62974c41bd76/ovn-acl-logging/0.log"
May 28 17:31:54.600806 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:31:54.600791    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4lcb_9bd29f05-c1e0-4fe5-82e8-62974c41bd76/ovn-acl-logging/0.log"
May 28 17:36:54.623369 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:36:54.623341    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/1.log"
May 28 17:36:54.628174 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:36:54.628149    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/1.log"
May 28 17:36:54.631448 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:36:54.631423    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4lcb_9bd29f05-c1e0-4fe5-82e8-62974c41bd76/ovn-acl-logging/0.log"
May 28 17:36:54.633294 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:36:54.633271    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4lcb_9bd29f05-c1e0-4fe5-82e8-62974c41bd76/ovn-acl-logging/0.log"
May 28 17:41:54.655371 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:41:54.655345    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/1.log"
May 28 17:41:54.657908 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:41:54.657528    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/1.log"
May 28 17:41:54.659696 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:41:54.659675    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4lcb_9bd29f05-c1e0-4fe5-82e8-62974c41bd76/ovn-acl-logging/0.log"
May 28 17:41:54.661885 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:41:54.661866    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4lcb_9bd29f05-c1e0-4fe5-82e8-62974c41bd76/ovn-acl-logging/0.log"
May 28 17:46:54.690458 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:46:54.690343    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/1.log"
May 28 17:46:54.698221 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:46:54.693030    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/1.log"
May 28 17:46:54.698221 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:46:54.694512    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4lcb_9bd29f05-c1e0-4fe5-82e8-62974c41bd76/ovn-acl-logging/0.log"
May 28 17:46:54.698221 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:46:54.697627    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4lcb_9bd29f05-c1e0-4fe5-82e8-62974c41bd76/ovn-acl-logging/0.log"
May 28 17:51:54.721248 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:51:54.721138    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/1.log"
May 28 17:51:54.725375 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:51:54.722741    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/1.log"
May 28 17:51:54.725769 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:51:54.725750    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4lcb_9bd29f05-c1e0-4fe5-82e8-62974c41bd76/ovn-acl-logging/0.log"
May 28 17:51:54.727269 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:51:54.727250    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-q4lcb_9bd29f05-c1e0-4fe5-82e8-62974c41bd76/ovn-acl-logging/0.log"
May 28 17:52:58.146163 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:52:58.146077    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67d65448cd-wps7c_ab5bb489-27ab-4662-95ab-1e2e3cfff7fa/authorino/0.log"
May 28 17:53:03.619371 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:03.619339    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6795fd7c67-dnsq6_1bbea426-07aa-421b-85a6-5e91ebb306d1/manager/0.log"
May 28 17:53:05.131951 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:05.131839    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67d65448cd-wps7c_ab5bb489-27ab-4662-95ab-1e2e3cfff7fa/authorino/0.log"
May 28 17:53:05.916476 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:05.916438    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-nzghb_7d1a0b5e-2a6d-4c16-a686-c24232b7fb97/manager/0.log"
May 28 17:53:06.605854 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:06.605824    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5454695dcd-rm6m9_6e5d09ae-83e3-4507-ad43-8320b4e29155/kube-auth-proxy/0.log"
May 28 17:53:07.299424 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:07.299387    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs_e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1/storage-initializer/0.log"
May 28 17:53:07.307608 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:07.307586    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-6h2gs_e6f6411a-2d73-447e-a9fe-d03ab4d5e5d1/main/0.log"
May 28 17:53:07.412784 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:07.412748    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5_ec7ad64e-d160-4db3-96c0-065da85f2af3/storage-initializer/0.log"
May 28 17:53:07.421393 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:07.421369    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-d5np5_ec7ad64e-d160-4db3-96c0-065da85f2af3/main/0.log"
May 28 17:53:07.648676 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:07.648586    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl_9938415a-7ed9-40d9-abfd-006c29e3663e/storage-initializer/0.log"
May 28 17:53:07.656501 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:07.656476    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-75cdccxjcrl_9938415a-7ed9-40d9-abfd-006c29e3663e/main/0.log"
May 28 17:53:07.768778 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:07.768742    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx_e5d4abbe-e810-4343-a538-4b1927680f0b/storage-initializer/0.log"
May 28 17:53:07.778983 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:07.778957    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-dq6mx_e5d4abbe-e810-4343-a538-4b1927680f0b/main/0.log"
May 28 17:53:07.883539 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:07.883513    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t_e8f4062d-898a-4806-81ad-0c1c6dcd5a4b/storage-initializer/0.log"
May 28 17:53:07.891089 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:07.891068    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-6b97b89985-bgt4t_e8f4062d-898a-4806-81ad-0c1c6dcd5a4b/main/0.log"
May 28 17:53:14.975967 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:14.975940    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-h22jp_9270f234-63b6-44fc-853c-45cf68ef063d/global-pull-secret-syncer/0.log"
May 28 17:53:15.147651 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:15.147622    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9wdmt_58dae7ec-c6ea-43d6-9666-96ff58564769/konnectivity-agent/0.log"
May 28 17:53:15.320872 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:15.320842    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-133-205.ec2.internal_09c2e9e5d3d1eb649c292303ae36692a/haproxy/0.log"
May 28 17:53:20.182247 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:20.182214    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-67d65448cd-wps7c_ab5bb489-27ab-4662-95ab-1e2e3cfff7fa/authorino/0.log"
May 28 17:53:20.815535 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:20.815500    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-nzghb_7d1a0b5e-2a6d-4c16-a686-c24232b7fb97/manager/0.log"
May 28 17:53:22.463964 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:22.463878    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fdf0802-a55e-4642-85db-7a95787f66d0/alertmanager/0.log"
May 28 17:53:22.504440 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:22.504410    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fdf0802-a55e-4642-85db-7a95787f66d0/config-reloader/0.log"
May 28 17:53:22.542502 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:22.542470    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fdf0802-a55e-4642-85db-7a95787f66d0/kube-rbac-proxy-web/0.log"
May 28 17:53:22.613681 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:22.613647    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fdf0802-a55e-4642-85db-7a95787f66d0/kube-rbac-proxy/0.log"
May 28 17:53:22.660551 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:22.660524    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fdf0802-a55e-4642-85db-7a95787f66d0/kube-rbac-proxy-metric/0.log"
May 28 17:53:22.691781 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:22.691755    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fdf0802-a55e-4642-85db-7a95787f66d0/prom-label-proxy/0.log"
May 28 17:53:22.724201 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:22.724096    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9fdf0802-a55e-4642-85db-7a95787f66d0/init-config-reloader/0.log"
May 28 17:53:22.777635 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:22.777608    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-p7nm8_c1c60c5b-c157-4f36-b9fd-39d824c6bb11/cluster-monitoring-operator/0.log"
May 28 17:53:22.822556 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:22.822528    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-bndt5_f2e06019-bb4e-41c3-ba07-0a52efdc1236/kube-state-metrics/0.log"
May 28 17:53:22.866990 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:22.866952    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-bndt5_f2e06019-bb4e-41c3-ba07-0a52efdc1236/kube-rbac-proxy-main/0.log"
May 28 17:53:22.903392 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:22.903362    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-bndt5_f2e06019-bb4e-41c3-ba07-0a52efdc1236/kube-rbac-proxy-self/0.log"
May 28 17:53:23.084976 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.084948    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l7f5w_cabe30be-d521-4e9a-af4a-d1251082bad3/node-exporter/0.log"
May 28 17:53:23.111510 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.111483    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l7f5w_cabe30be-d521-4e9a-af4a-d1251082bad3/kube-rbac-proxy/0.log"
May 28 17:53:23.134899 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.134876    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-l7f5w_cabe30be-d521-4e9a-af4a-d1251082bad3/init-textfile/0.log"
May 28 17:53:23.347050 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.346951    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_52efc007-02e6-48d5-8cc3-bde9ea1d86e2/prometheus/0.log"
May 28 17:53:23.370322 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.370285    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_52efc007-02e6-48d5-8cc3-bde9ea1d86e2/config-reloader/0.log"
May 28 17:53:23.395279 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.395252    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_52efc007-02e6-48d5-8cc3-bde9ea1d86e2/thanos-sidecar/0.log"
May 28 17:53:23.418707 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.418681    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_52efc007-02e6-48d5-8cc3-bde9ea1d86e2/kube-rbac-proxy-web/0.log"
May 28 17:53:23.450326 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.450289    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_52efc007-02e6-48d5-8cc3-bde9ea1d86e2/kube-rbac-proxy/0.log"
May 28 17:53:23.473533 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.473504    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_52efc007-02e6-48d5-8cc3-bde9ea1d86e2/kube-rbac-proxy-thanos/0.log"
May 28 17:53:23.499563 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.499530    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_52efc007-02e6-48d5-8cc3-bde9ea1d86e2/init-config-reloader/0.log"
May 28 17:53:23.592211 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.592181    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-sgqql_813e895e-8474-4e96-8925-355c43cf1481/prometheus-operator-admission-webhook/0.log"
May 28 17:53:23.626112 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.625997    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-566c55d94c-w8f82_f5beaac8-a4d5-44e5-b342-186c86145375/telemeter-client/0.log"
May 28 17:53:23.653080 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.653047    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-566c55d94c-w8f82_f5beaac8-a4d5-44e5-b342-186c86145375/reload/0.log"
May 28 17:53:23.674069 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.674038    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-566c55d94c-w8f82_f5beaac8-a4d5-44e5-b342-186c86145375/kube-rbac-proxy/0.log"
May 28 17:53:23.769480 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.769447    2556 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"]
May 28 17:53:23.769910 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.769895    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0465e600-144b-4a7e-9304-6dbdac222d49" containerName="authorino"
May 28 17:53:23.769954 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.769911    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0465e600-144b-4a7e-9304-6dbdac222d49" containerName="authorino"
May 28 17:53:23.770011 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.770001    2556 memory_manager.go:356] "RemoveStaleState removing state" podUID="0465e600-144b-4a7e-9304-6dbdac222d49" containerName="authorino"
May 28 17:53:23.772160 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.772145    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"
May 28 17:53:23.774480 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.774447    2556 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-7hsz9\"/\"default-dockercfg-dlls8\""
May 28 17:53:23.775293 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.775275    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7hsz9\"/\"kube-root-ca.crt\""
May 28 17:53:23.775419 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.775275    2556 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-7hsz9\"/\"openshift-service-ca.crt\""
May 28 17:53:23.782496 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.782469    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"]
May 28 17:53:23.904415 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.904301    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b-lib-modules\") pod \"perf-node-gather-daemonset-5z5dj\" (UID: \"7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"
May 28 17:53:23.904571 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.904429    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b-sys\") pod \"perf-node-gather-daemonset-5z5dj\" (UID: \"7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"
May 28 17:53:23.904571 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.904483    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b-proc\") pod \"perf-node-gather-daemonset-5z5dj\" (UID: \"7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"
May 28 17:53:23.904571 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.904522    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bb97\" (UniqueName: \"kubernetes.io/projected/7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b-kube-api-access-7bb97\") pod \"perf-node-gather-daemonset-5z5dj\" (UID: \"7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"
May 28 17:53:23.904677 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:23.904615    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b-podres\") pod \"perf-node-gather-daemonset-5z5dj\" (UID: \"7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"
May 28 17:53:24.005913 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:24.005866    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b-sys\") pod \"perf-node-gather-daemonset-5z5dj\" (UID: \"7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"
May 28 17:53:24.006061 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:24.005939    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b-proc\") pod \"perf-node-gather-daemonset-5z5dj\" (UID: \"7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"
May 28 17:53:24.006061 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:24.005992    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7bb97\" (UniqueName: \"kubernetes.io/projected/7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b-kube-api-access-7bb97\") pod \"perf-node-gather-daemonset-5z5dj\" (UID: \"7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"
May 28 17:53:24.006061 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:24.005998    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b-sys\") pod \"perf-node-gather-daemonset-5z5dj\" (UID: \"7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"
May 28 17:53:24.006162 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:24.006058    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b-podres\") pod \"perf-node-gather-daemonset-5z5dj\" (UID: \"7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"
May 28 17:53:24.006162 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:24.006064    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b-proc\") pod \"perf-node-gather-daemonset-5z5dj\" (UID: \"7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"
May 28 17:53:24.006162 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:24.006143    2556 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b-lib-modules\") pod \"perf-node-gather-daemonset-5z5dj\" (UID: \"7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"
May 28 17:53:24.006258 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:24.006184    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b-podres\") pod \"perf-node-gather-daemonset-5z5dj\" (UID: \"7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"
May 28 17:53:24.006332 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:24.006291    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b-lib-modules\") pod \"perf-node-gather-daemonset-5z5dj\" (UID: \"7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"
May 28 17:53:24.014709 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:24.014674    2556 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bb97\" (UniqueName: \"kubernetes.io/projected/7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b-kube-api-access-7bb97\") pod \"perf-node-gather-daemonset-5z5dj\" (UID: \"7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b\") " pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"
May 28 17:53:24.082997 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:24.082965    2556 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"
May 28 17:53:24.216253 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:24.216227    2556 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"]
May 28 17:53:24.218982 ip-10-0-133-205 kubenswrapper[2556]: W0528 17:53:24.218952    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod7fae35b2_4ab8_4a2c_b4db_86dcf1a29b6b.slice/crio-9716305b13302ab35609a9e1afd07d7adaef8aa060d048199bed4c9b79750d81 WatchSource:0}: Error finding container 9716305b13302ab35609a9e1afd07d7adaef8aa060d048199bed4c9b79750d81: Status 404 returned error can't find the container with id 9716305b13302ab35609a9e1afd07d7adaef8aa060d048199bed4c9b79750d81
May 28 17:53:24.220649 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:24.220633    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 28 17:53:24.345221 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:24.345181    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj" event={"ID":"7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b","Type":"ContainerStarted","Data":"9716305b13302ab35609a9e1afd07d7adaef8aa060d048199bed4c9b79750d81"}
May 28 17:53:24.948602 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:24.948570    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-2c87z_487e6598-8985-4498-853d-24e34f67fe62/networking-console-plugin/0.log"
May 28 17:53:25.351154 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:25.351117    2556 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj" event={"ID":"7fae35b2-4ab8-4a2c-b4db-86dcf1a29b6b","Type":"ContainerStarted","Data":"ab164a0640059c8a5350c3a03fea0ed02691fef7982256e93cf1fca5c3c57ea6"}
May 28 17:53:25.351359 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:25.351205    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"
May 28 17:53:25.378402 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:25.378335    2556 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj" podStartSLOduration=2.378288773 podStartE2EDuration="2.378288773s" podCreationTimestamp="2026-05-28 17:53:23 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-28 17:53:25.375543395 +0000 UTC m=+2191.351347751" watchObservedRunningTime="2026-05-28 17:53:25.378288773 +0000 UTC m=+2191.354093130"
May 28 17:53:25.544933 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:25.544900    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/1.log"
May 28 17:53:25.552829 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:25.552804    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-qdkvs_86dc3fc1-6d7c-4dec-b9b3-7197fa551e87/console-operator/2.log"
May 28 17:53:26.133046 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:26.133006    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-nfvrf_e6f670a9-918f-444d-a959-7dde52b2434d/download-server/0.log"
May 28 17:53:27.625957 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:27.625931    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mxnl2_5d302957-1a7b-4109-92da-0c0d90325f4d/dns/0.log"
May 28 17:53:27.648282 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:27.648255    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mxnl2_5d302957-1a7b-4109-92da-0c0d90325f4d/kube-rbac-proxy/0.log"
May 28 17:53:27.702726 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:27.702694    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hhc9v_7044d69e-088f-4778-9f23-833010990847/dns-node-resolver/0.log"
May 28 17:53:28.274445 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:28.274415    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-4lf2r_21807015-9b41-44d2-aae3-21e5e93a8986/node-ca/0.log"
May 28 17:53:29.560414 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:29.560382    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5454695dcd-rm6m9_6e5d09ae-83e3-4507-ad43-8320b4e29155/kube-auth-proxy/0.log"
May 28 17:53:30.417508 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:30.417481    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-ldxgl_f3232f85-3d97-44a7-8d4c-42687b88d50f/serve-healthcheck-canary/0.log"
May 28 17:53:30.977453 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:30.977418    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-4hs87_9d9190bc-9f04-4ee4-a71d-3d44eda9abf9/insights-operator/0.log"
May 28 17:53:30.978835 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:30.978807    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-4hs87_9d9190bc-9f04-4ee4-a71d-3d44eda9abf9/insights-operator/1.log"
May 28 17:53:31.123237 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:31.123209    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hmwwc_b4d17b1e-205b-4c9e-ac87-3e4f9004bda2/kube-rbac-proxy/0.log"
May 28 17:53:31.158817 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:31.158785    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hmwwc_b4d17b1e-205b-4c9e-ac87-3e4f9004bda2/exporter/0.log"
May 28 17:53:31.198301 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:31.198271    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hmwwc_b4d17b1e-205b-4c9e-ac87-3e4f9004bda2/extractor/0.log"
May 28 17:53:31.365752 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:31.365726    2556 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-7hsz9/perf-node-gather-daemonset-5z5dj"
May 28 17:53:33.993344 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:33.993289    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6795fd7c67-dnsq6_1bbea426-07aa-421b-85a6-5e91ebb306d1/manager/0.log"
May 28 17:53:35.493362 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:35.493326    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7954d66c6b-672nq_433c08cf-affa-4cd7-a40b-d490cc24aff4/manager/0.log"
May 28 17:53:40.358480 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:40.358448    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-v476b_f7696681-c38f-4d34-ace5-556a3c6c2486/migrator/0.log"
May 28 17:53:40.382076 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:40.382000    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-v476b_f7696681-c38f-4d34-ace5-556a3c6c2486/graceful-termination/0.log"
May 28 17:53:40.819973 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:40.819946    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-7bknv_381b3abf-96fb-4c94-896f-a9bc249cb957/kube-storage-version-migrator-operator/1.log"
May 28 17:53:40.821487 ip-10-0-133-205 kubenswrapper[2556]: I0528 17:53:40.821456    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-7bknv_381b3abf-96fb-4c94-896f-a9bc249cb957/kube-storage-version-migrator-operator/0.log"