May 21 01:47:37.454030 ip-10-0-129-167 systemd[1]: Starting Kubernetes Kubelet...
May 21 01:47:37.966600 ip-10-0-129-167 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 01:47:37.966600 ip-10-0-129-167 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 21 01:47:37.966600 ip-10-0-129-167 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 01:47:37.966600 ip-10-0-129-167 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 21 01:47:37.966600 ip-10-0-129-167 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 21 01:47:37.967784 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.967684    2582 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 21 01:47:37.973051 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973034    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 01:47:37.973051 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973051    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 01:47:37.973122 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973055    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 01:47:37.973122 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973058    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 01:47:37.973122 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973062    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 01:47:37.973122 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973065    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 01:47:37.973122 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973068    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 01:47:37.973122 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973071    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 01:47:37.973122 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973074    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 01:47:37.973122 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973077    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 01:47:37.973122 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973079    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 01:47:37.973122 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973082    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 01:47:37.973122 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973085    2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 01:47:37.973122 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973087    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 01:47:37.973122 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973090    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 01:47:37.973122 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973094    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 01:47:37.973122 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973096    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 01:47:37.973122 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973099    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 01:47:37.973122 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973101    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 01:47:37.973122 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973104    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 01:47:37.973122 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973106    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 01:47:37.973578 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973109    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 01:47:37.973578 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973112    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 01:47:37.973578 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973115    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 01:47:37.973578 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973119    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 01:47:37.973578 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973121    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 01:47:37.973578 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973124    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 01:47:37.973578 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973126    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 01:47:37.973578 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973129    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 01:47:37.973578 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973132    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 01:47:37.973578 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973135    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 01:47:37.973578 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973138    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 01:47:37.973578 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973140    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 01:47:37.973578 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973143    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 01:47:37.973578 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973145    2582 feature_gate.go:328] unrecognized feature gate: Example
May 21 01:47:37.973578 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973148    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 01:47:37.973578 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973151    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 01:47:37.973578 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973153    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 01:47:37.973578 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973155    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 01:47:37.973578 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973160    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 01:47:37.974091 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973164    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 01:47:37.974091 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973167    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 01:47:37.974091 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973170    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 01:47:37.974091 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973173    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 01:47:37.974091 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973175    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 01:47:37.974091 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973178    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 01:47:37.974091 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973180    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 01:47:37.974091 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973183    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 01:47:37.974091 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973185    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 01:47:37.974091 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973188    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 01:47:37.974091 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973190    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 01:47:37.974091 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973193    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 01:47:37.974091 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973195    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 01:47:37.974091 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973198    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 01:47:37.974091 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973201    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 01:47:37.974091 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973204    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 01:47:37.974091 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973206    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 01:47:37.974091 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973209    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 01:47:37.974091 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973211    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 01:47:37.974091 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973214    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 01:47:37.974577 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973216    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 01:47:37.974577 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973218    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 01:47:37.974577 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973221    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 01:47:37.974577 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973223    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 01:47:37.974577 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973226    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 01:47:37.974577 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973228    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 01:47:37.974577 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973231    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 01:47:37.974577 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973233    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 01:47:37.974577 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973236    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 01:47:37.974577 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973238    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 01:47:37.974577 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973241    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 01:47:37.974577 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973243    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 01:47:37.974577 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973246    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 01:47:37.974577 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973248    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 01:47:37.974577 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973252    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 01:47:37.974577 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973255    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 01:47:37.974577 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973257    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 01:47:37.974577 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973260    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 01:47:37.974577 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973264    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 01:47:37.975042 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973268    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 01:47:37.975042 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973270    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 01:47:37.975042 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973273    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 01:47:37.975042 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973275    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 01:47:37.975042 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973278    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 01:47:37.975042 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973281    2582 feature_gate.go:328] unrecognized feature gate: Example2
May 21 01:47:37.975042 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.973283    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 01:47:37.975597 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975584    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 01:47:37.975597 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975597    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 01:47:37.975680 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975600    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 01:47:37.975680 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975603    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 01:47:37.975680 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975606    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 01:47:37.975680 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975609    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 01:47:37.975680 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975612    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 01:47:37.975680 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975615    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 01:47:37.975680 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975618    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 01:47:37.975680 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975620    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 01:47:37.975680 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975623    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 01:47:37.975680 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975625    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 01:47:37.975680 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975629    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 01:47:37.975680 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975648    2582 feature_gate.go:328] unrecognized feature gate: Example2
May 21 01:47:37.975680 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975651    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 01:47:37.975680 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975654    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 01:47:37.975680 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975657    2582 feature_gate.go:328] unrecognized feature gate: Example
May 21 01:47:37.975680 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975660    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 01:47:37.975680 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975663    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 01:47:37.975680 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975665    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 01:47:37.975680 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975669    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 01:47:37.975680 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975672    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 01:47:37.976192 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975674    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 01:47:37.976192 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975677    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 01:47:37.976192 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975680    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 01:47:37.976192 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975682    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 01:47:37.976192 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975685    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 01:47:37.976192 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975688    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 01:47:37.976192 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975691    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 01:47:37.976192 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975695    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 01:47:37.976192 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975697    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 01:47:37.976192 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975700    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 01:47:37.976192 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975703    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 01:47:37.976192 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975705    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 01:47:37.976192 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975707    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 01:47:37.976192 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975711    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 01:47:37.976192 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975714    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 01:47:37.976192 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975717    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 01:47:37.976192 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975720    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 01:47:37.976192 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975723    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 01:47:37.976192 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975725    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 01:47:37.976722 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975728    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 01:47:37.976722 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975731    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 01:47:37.976722 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975735    2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 01:47:37.976722 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975738    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 01:47:37.976722 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975740    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 01:47:37.976722 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975742    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 01:47:37.976722 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975745    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 01:47:37.976722 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975747    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 01:47:37.976722 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975750    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 01:47:37.976722 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975752    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 01:47:37.976722 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975754    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 01:47:37.976722 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975757    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 01:47:37.976722 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975759    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 01:47:37.976722 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975762    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 01:47:37.976722 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975766    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 01:47:37.976722 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975768    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 01:47:37.976722 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975771    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 01:47:37.976722 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975773    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 01:47:37.976722 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975776    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 01:47:37.977187 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975778    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 01:47:37.977187 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975781    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 01:47:37.977187 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975783    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 01:47:37.977187 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975786    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 01:47:37.977187 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975788    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 01:47:37.977187 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975790    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 01:47:37.977187 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975793    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 01:47:37.977187 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975795    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 01:47:37.977187 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975797    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 01:47:37.977187 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975800    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 01:47:37.977187 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975802    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 01:47:37.977187 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975805    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 01:47:37.977187 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975807    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 01:47:37.977187 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975810    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 01:47:37.977187 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975813    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 01:47:37.977187 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975815    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 01:47:37.977187 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975818    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 01:47:37.977187 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975820    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 01:47:37.977187 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975822    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 01:47:37.977187 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975825    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975827    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975830    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975833    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975837    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975840    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.975842    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975920    2582 flags.go:64] FLAG: --address="0.0.0.0"
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975929    2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975936    2582 flags.go:64] FLAG: --anonymous-auth="true"
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975940    2582 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975945    2582 flags.go:64] FLAG: --authentication-token-webhook="false"
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975948    2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975952    2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975957    2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975960    2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975963    2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975967    2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975971    2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975974    2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975977    2582 flags.go:64] FLAG: --cgroup-root=""
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975980    2582 flags.go:64] FLAG: --cgroups-per-qos="true"
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975983    2582 flags.go:64] FLAG: --client-ca-file=""
May 21 01:47:37.977688 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975985    2582 flags.go:64] FLAG: --cloud-config=""
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975988    2582 flags.go:64] FLAG: --cloud-provider="external"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975991    2582 flags.go:64] FLAG: --cluster-dns="[]"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975996    2582 flags.go:64] FLAG: --cluster-domain=""
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.975999    2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976002    2582 flags.go:64] FLAG: --config-dir=""
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976005    2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976008    2582 flags.go:64] FLAG: --container-log-max-files="5"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976012    2582 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976016    2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976020    2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976023    2582 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976026    2582 flags.go:64] FLAG: --contention-profiling="false"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976029    2582 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976032    2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976035    2582 flags.go:64] FLAG: --cpu-manager-policy="none"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976038    2582 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976043    2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976046    2582 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976049    2582 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976052    2582 flags.go:64] FLAG: --enable-load-reader="false"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976055    2582 flags.go:64] FLAG: --enable-server="true"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976058    2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976063    2582 flags.go:64] FLAG: --event-burst="100"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976066    2582 flags.go:64] FLAG: --event-qps="50"
May 21 01:47:37.978250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976069    2582 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976072    2582 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976075    2582 flags.go:64] FLAG: --eviction-hard=""
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976078    2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976081    2582 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976084    2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976087    2582 flags.go:64] FLAG: --eviction-soft=""
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976090    2582 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976093    2582 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976096    2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976099    2582 flags.go:64] FLAG: --experimental-mounter-path=""
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976102    2582 flags.go:64] FLAG: --fail-cgroupv1="false"
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976105    2582 flags.go:64] FLAG: --fail-swap-on="true"
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976108    2582 flags.go:64] FLAG: --feature-gates=""
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976112    2582 flags.go:64] FLAG: --file-check-frequency="20s"
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976115    2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976118    2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976121    2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976124    2582 flags.go:64] FLAG: --healthz-port="10248"
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976127    2582 flags.go:64] FLAG: --help="false"
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976130    2582 flags.go:64] FLAG: --hostname-override="ip-10-0-129-167.ec2.internal"
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976133    2582 flags.go:64] FLAG: --housekeeping-interval="10s"
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976136    2582 flags.go:64] FLAG: --http-check-frequency="20s"
May 21 01:47:37.978865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976139    2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976142    2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976147    2582 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976150    2582 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976153    2582 flags.go:64] FLAG: --image-service-endpoint=""
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976155    2582 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976158    2582 flags.go:64] FLAG: --kube-api-burst="100"
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976161    2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976164    2582 flags.go:64] FLAG: --kube-api-qps="50"
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976167    2582 flags.go:64] FLAG: --kube-reserved=""
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976170    2582 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976172    2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976175    2582 flags.go:64] FLAG: --kubelet-cgroups=""
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976178    2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976181    2582 flags.go:64] FLAG: --lock-file=""
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976184    2582 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976186    2582 flags.go:64] FLAG: --log-flush-frequency="5s"
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976189    2582 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976195    2582 flags.go:64] FLAG: --log-json-split-stream="false"
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976198    2582 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976201    2582 flags.go:64] FLAG: --log-text-split-stream="false"
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976204    2582 flags.go:64] FLAG: --logging-format="text"
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976207    2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976210    2582 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 21 01:47:37.979432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976213    2582 flags.go:64] FLAG: --manifest-url=""
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976216    2582 flags.go:64] FLAG: --manifest-url-header=""
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976220    2582 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976223    2582 flags.go:64] FLAG: --max-open-files="1000000"
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976227    2582 flags.go:64] FLAG: --max-pods="110"
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976230    2582 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976233    2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976236    2582 flags.go:64] FLAG: --memory-manager-policy="None"
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976239    2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976242    2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976245    2582 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976249    2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976256    2582 flags.go:64] FLAG: --node-status-max-images="50"
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976259    2582 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976262    2582 flags.go:64] FLAG: --oom-score-adj="-999"
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976265    2582 flags.go:64] FLAG: --pod-cidr=""
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976268    2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976274    2582 flags.go:64] FLAG: --pod-manifest-path=""
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976277    2582 flags.go:64] FLAG: --pod-max-pids="-1"
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976280    2582 flags.go:64] FLAG: --pods-per-core="0"
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976283    2582 flags.go:64] FLAG: --port="10250"
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976286    2582 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976289    2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0eb15ee78bead58a1"
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976293    2582 flags.go:64] FLAG: --qos-reserved=""
May 21 01:47:37.980039 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976295    2582 flags.go:64] FLAG: --read-only-port="10255"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976299    2582 flags.go:64] FLAG: --register-node="true"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976302    2582 flags.go:64] FLAG: --register-schedulable="true"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976304    2582 flags.go:64] FLAG: --register-with-taints=""
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976308    2582 flags.go:64] FLAG: --registry-burst="10"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976311    2582 flags.go:64] FLAG: --registry-qps="5"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976314    2582 flags.go:64] FLAG: --reserved-cpus=""
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976317    2582 flags.go:64] FLAG: --reserved-memory=""
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976321    2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976324    2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976327    2582 flags.go:64] FLAG: --rotate-certificates="false"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976329    2582 flags.go:64] FLAG: --rotate-server-certificates="false"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976332    2582 flags.go:64] FLAG: --runonce="false"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976335    2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976338    2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976341    2582 flags.go:64] FLAG: --seccomp-default="false"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976344    2582 flags.go:64] FLAG: --serialize-image-pulls="true"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976348    2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976351    2582 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976353    2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976357    2582 flags.go:64] FLAG: --storage-driver-password="root"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976360    2582 flags.go:64] FLAG: --storage-driver-secure="false"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976363    2582 flags.go:64] FLAG: --storage-driver-table="stats"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976366    2582 flags.go:64] FLAG: --storage-driver-user="root"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976369    2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976372    2582 flags.go:64] FLAG: --sync-frequency="1m0s"
May 21 01:47:37.980614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976374    2582 flags.go:64] FLAG: --system-cgroups=""
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976377    2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976382    2582 flags.go:64] FLAG: --system-reserved-cgroup=""
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976385    2582 flags.go:64] FLAG: --tls-cert-file=""
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976388    2582 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976392    2582 flags.go:64] FLAG: --tls-min-version=""
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976396    2582 flags.go:64] FLAG: --tls-private-key-file=""
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976399    2582 flags.go:64] FLAG: --topology-manager-policy="none"
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976401    2582 flags.go:64] FLAG: --topology-manager-policy-options=""
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976404    2582 flags.go:64] FLAG: --topology-manager-scope="container"
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976407    2582 flags.go:64] FLAG: --v="2"
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976411    2582 flags.go:64] FLAG: --version="false"
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976419    2582 flags.go:64] FLAG: --vmodule=""
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976423    2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.976426    2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976527    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976531    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976534    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976537    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976540    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976543    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976546    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976549    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 01:47:37.981256 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976552    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 01:47:37.981817 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976555    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 01:47:37.981817 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976557    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 01:47:37.981817 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976560    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 01:47:37.981817 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976564    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 01:47:37.981817 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976567    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 01:47:37.981817 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976569    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 01:47:37.981817 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976572    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 01:47:37.981817 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976574    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 01:47:37.981817 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976577    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 01:47:37.981817 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976580    2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 01:47:37.981817 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976583    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 01:47:37.981817 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976585    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 01:47:37.981817 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976587    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 01:47:37.981817 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976592    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 01:47:37.981817 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976595    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 01:47:37.981817 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976598    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 01:47:37.981817 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976600    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 01:47:37.981817 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976603    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 01:47:37.981817 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976605    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 01:47:37.981817 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976608    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 01:47:37.982443 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976611    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 01:47:37.982443 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976614    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 01:47:37.982443 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976616    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 01:47:37.982443 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976618    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 01:47:37.982443 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976621    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 01:47:37.982443 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976623    2582 feature_gate.go:328] unrecognized feature gate: Example2
May 21 01:47:37.982443 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976626    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 01:47:37.982443 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976629    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 01:47:37.982443 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976650    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 01:47:37.982443 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976654    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 01:47:37.982443 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976659    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 01:47:37.982443 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976661    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 01:47:37.982443 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976664    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 01:47:37.982443 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976666    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 01:47:37.982443 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976669    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 01:47:37.982443 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976672    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 01:47:37.982443 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976679    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 01:47:37.982443 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976682    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 01:47:37.982443 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976685    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 01:47:37.982939 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976689    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 01:47:37.982939 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976693    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 01:47:37.982939 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976695    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 01:47:37.982939 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976698    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 01:47:37.982939 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976701    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 01:47:37.982939 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976704    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 01:47:37.982939 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976708    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 01:47:37.982939 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976711    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 01:47:37.982939 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976713    2582 feature_gate.go:328] unrecognized feature gate: Example
May 21 01:47:37.982939 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976716    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 01:47:37.982939 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976718    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 01:47:37.982939 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976721    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 01:47:37.982939 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976723    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 01:47:37.982939 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976726    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 01:47:37.982939 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976729    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 01:47:37.982939 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976732    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 01:47:37.982939 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976734    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 01:47:37.982939 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976737    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 01:47:37.982939 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976739    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 01:47:37.983435 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976741    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 01:47:37.983435 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976744    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 01:47:37.983435 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976747    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 01:47:37.983435 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976749    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 01:47:37.983435 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976753    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 01:47:37.983435 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976756    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 01:47:37.983435 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976758    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 01:47:37.983435 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976761    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 01:47:37.983435 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976763    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 01:47:37.983435 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976765    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 01:47:37.983435 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976768    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 01:47:37.983435 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976771    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 01:47:37.983435 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976773    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 01:47:37.983435 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976776    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 01:47:37.983435 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976778    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 01:47:37.983435 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976781    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 01:47:37.983435 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976783    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 01:47:37.983435 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976786    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 01:47:37.983435 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.976788    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 01:47:37.983920 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.977526    2582 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 01:47:37.985658 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.985620    2582 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 21 01:47:37.985658 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.985656    2582 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 21 01:47:37.985726 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985713    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 01:47:37.985726 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985720    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 01:47:37.985726 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985723    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 01:47:37.985726 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985726    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 01:47:37.985828 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985729    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 01:47:37.985828 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985732    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 01:47:37.985828 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985735    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 01:47:37.985828 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985738    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 01:47:37.985828 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985741    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 01:47:37.985828 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985743    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 01:47:37.985828 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985746    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 01:47:37.985828 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985748    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 01:47:37.985828 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985751    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 01:47:37.985828 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985754    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 01:47:37.985828 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985756    2582 feature_gate.go:328] unrecognized feature gate: Example
May 21 01:47:37.985828 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985759    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 01:47:37.985828 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985761    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 01:47:37.985828 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985764    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 01:47:37.985828 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985766    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 01:47:37.985828 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985769    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 01:47:37.985828 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985771    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 01:47:37.985828 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985775    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 01:47:37.985828 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985778    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 01:47:37.985828 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985781    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 01:47:37.986329 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985783    2582 feature_gate.go:328] unrecognized feature gate: Example2
May 21 01:47:37.986329 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985786    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 01:47:37.986329 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985788    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 01:47:37.986329 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985791    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 01:47:37.986329 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985794    2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 01:47:37.986329 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985796    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 01:47:37.986329 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985799    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 01:47:37.986329 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985802    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 01:47:37.986329 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985804    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 01:47:37.986329 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985807    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 01:47:37.986329 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985810    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 01:47:37.986329 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985812    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 01:47:37.986329 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985814    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 01:47:37.986329 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985818    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 01:47:37.986329 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985821    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 01:47:37.986329 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985824    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 01:47:37.986329 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985827    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 01:47:37.986329 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985829    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 01:47:37.986329 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985832    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 01:47:37.986329 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985835    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 01:47:37.986855 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985837    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 01:47:37.986855 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985840    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 01:47:37.986855 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985843    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 01:47:37.986855 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985845    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 01:47:37.986855 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985849    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 01:47:37.986855 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985853    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 01:47:37.986855 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985856    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 01:47:37.986855 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985860    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 01:47:37.986855 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985863    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 01:47:37.986855 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985865    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 01:47:37.986855 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985869    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 01:47:37.986855 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985872    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 01:47:37.986855 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985875    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 01:47:37.986855 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985878    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 01:47:37.986855 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985881    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 01:47:37.986855 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985883    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 01:47:37.986855 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985886    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 01:47:37.986855 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985888    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 01:47:37.986855 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985891    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 01:47:37.986855 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985893    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 01:47:37.987359 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985896    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 01:47:37.987359 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985899    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 01:47:37.987359 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985901    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 01:47:37.987359 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985904    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 01:47:37.987359 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985906    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 01:47:37.987359 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985910    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 01:47:37.987359 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985913    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 01:47:37.987359 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985916    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 01:47:37.987359 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985919    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 01:47:37.987359 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985921    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 01:47:37.987359 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985925    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 01:47:37.987359 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985928    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 01:47:37.987359 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985931    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 01:47:37.987359 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985933    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 01:47:37.987359 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985936    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 01:47:37.987359 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985939    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 01:47:37.987359 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985941    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 01:47:37.987359 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985943    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 01:47:37.987359 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985946    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 01:47:37.987852 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985948    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 01:47:37.987852 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985951    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 01:47:37.987852 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.985953    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 01:47:37.987852 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.985959    2582 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 01:47:37.987852 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986059    2582 feature_gate.go:328] unrecognized feature gate: NewOLM
May 21 01:47:37.987852 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986065    2582 feature_gate.go:328] unrecognized feature gate: DualReplica
May 21 01:47:37.987852 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986068    2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 21 01:47:37.987852 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986071    2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 21 01:47:37.987852 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986074    2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 21 01:47:37.987852 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986077    2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 21 01:47:37.987852 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986080    2582 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 21 01:47:37.987852 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986083    2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 21 01:47:37.987852 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986085    2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 21 01:47:37.987852 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986088    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 21 01:47:37.987852 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986091    2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 21 01:47:37.987852 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986094    2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 21 01:47:37.988249 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986096    2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 21 01:47:37.988249 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986098    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 21 01:47:37.988249 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986101    2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 21 01:47:37.988249 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986104    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 21 01:47:37.988249 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986107    2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 21 01:47:37.988249 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986110    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 21 01:47:37.988249 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986112    2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 21 01:47:37.988249 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986115    2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 21 01:47:37.988249 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986117    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 21 01:47:37.988249 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986119    2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 21 01:47:37.988249 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986122    2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 21 01:47:37.988249 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986124    2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 21 01:47:37.988249 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986127    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 21 01:47:37.988249 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986129    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 21 01:47:37.988249 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986132    2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 21 01:47:37.988249 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986134    2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 21 01:47:37.988249 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986137    2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 21 01:47:37.988249 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986140    2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 21 01:47:37.988249 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986142    2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 21 01:47:37.988744 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986145    2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 21 01:47:37.988744 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986147    2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 21 01:47:37.988744 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986150    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 21 01:47:37.988744 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986153    2582 feature_gate.go:328] unrecognized feature gate: Example2
May 21 01:47:37.988744 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986155    2582 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 21 01:47:37.988744 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986158    2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 21 01:47:37.988744 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986161    2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 21 01:47:37.988744 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986164    2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 21 01:47:37.988744 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986167    2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 21 01:47:37.988744 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986170    2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 21 01:47:37.988744 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986173    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 21 01:47:37.988744 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986175    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 21 01:47:37.988744 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986178    2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 21 01:47:37.988744 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986180    2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 21 01:47:37.988744 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986183    2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 21 01:47:37.988744 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986186    2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 21 01:47:37.988744 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986196    2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 21 01:47:37.988744 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986199    2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 21 01:47:37.988744 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986202    2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 21 01:47:37.988744 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986204    2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 21 01:47:37.989253 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986207    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 21 01:47:37.989253 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986209    2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 21 01:47:37.989253 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986212    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 21 01:47:37.989253 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986214    2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 21 01:47:37.989253 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986217    2582 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 21 01:47:37.989253 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986220    2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 21 01:47:37.989253 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986222    2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 21 01:47:37.989253 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986224    2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 21 01:47:37.989253 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986227    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 21 01:47:37.989253 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986229    2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 21 01:47:37.989253 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986232    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 21 01:47:37.989253 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986236    2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 21 01:47:37.989253 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986240    2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 21 01:47:37.989253 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986243    2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 21 01:47:37.989253 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986246    2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 21 01:47:37.989253 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986249    2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 21 01:47:37.989253 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986252    2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 21 01:47:37.989253 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986254    2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 21 01:47:37.989253 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986257    2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 21 01:47:37.989819 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986260    2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 21 01:47:37.989819 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986262    2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 21 01:47:37.989819 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986265    2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 21 01:47:37.989819 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986267    2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 21 01:47:37.989819 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986270    2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 21 01:47:37.989819 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986272    2582 feature_gate.go:328] unrecognized feature gate: Example
May 21 01:47:37.989819 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986274    2582 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 21 01:47:37.989819 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986277    2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 21 01:47:37.989819 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986280    2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 21 01:47:37.989819 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986282    2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 21 01:47:37.989819 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986285    2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 21 01:47:37.989819 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986287    2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 21 01:47:37.989819 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986290    2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 21 01:47:37.989819 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986292    2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 21 01:47:37.989819 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986295    2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 21 01:47:37.989819 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:37.986297    2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 21 01:47:37.990204 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.986302    2582 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 21 01:47:37.990204 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.986425    2582 server.go:962] "Client rotation is on, will bootstrap in background"
May 21 01:47:37.990204 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.988787    2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 21 01:47:37.990204 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.989959    2582 server.go:1019] "Starting client certificate rotation"
May 21 01:47:37.990204 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.990059    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 01:47:37.990204 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:37.990099    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 21 01:47:38.020083 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.020059    2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 01:47:38.021923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.021885    2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 21 01:47:38.037304 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.036984    2582 log.go:25] "Validated CRI v1 runtime API"
May 21 01:47:38.044405 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.044386    2582 log.go:25] "Validated CRI v1 image API"
May 21 01:47:38.045844 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.045832    2582 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 21 01:47:38.048763 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.048738    2582 fs.go:135] Filesystem UUIDs: map[6dcd020a-0006-4503-8b5c-e41615e39baa:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9e3b5225-2a69-4016-b634-6e764f466bb9:/dev/nvme0n1p3]
May 21 01:47:38.048763 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.048758    2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 21 01:47:38.051817 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.051799    2582 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 01:47:38.053367 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.053192    2582 manager.go:217] Machine: {Timestamp:2026-05-21 01:47:38.052622229 +0000 UTC m=+0.466141601 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097130 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c481f7ae6de9641a2f84d986857b5 SystemUUID:ec2c481f-7ae6-de96-41a2-f84d986857b5 BootID:8aca71ec-06f8-48be-a9e4-4d7614042796 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:99:44:fb:0a:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:99:44:fb:0a:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:c5:04:28:cb:e5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 21 01:47:38.053439 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.053371    2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 21 01:47:38.053475 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.053463    2582 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 21 01:47:38.057611 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.057575    2582 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 21 01:47:38.057782 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.057614    2582 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-167.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 21 01:47:38.057826 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.057793    2582 topology_manager.go:138] "Creating topology manager with none policy"
May 21 01:47:38.057826 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.057801    2582 container_manager_linux.go:306] "Creating device plugin manager"
May 21 01:47:38.057826 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.057809    2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 01:47:38.057826 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.057826    2582 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 21 01:47:38.060032 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.060020    2582 state_mem.go:36] "Initialized new in-memory state store"
May 21 01:47:38.060152 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.060143    2582 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 21 01:47:38.063269 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.063259    2582 kubelet.go:491] "Attempting to sync node with API server"
May 21 01:47:38.063313 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.063274    2582 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 21 01:47:38.063313 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.063288    2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 21 01:47:38.063313 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.063297    2582 kubelet.go:397] "Adding apiserver pod source"
May 21 01:47:38.063313 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.063305    2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 21 01:47:38.064492 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.064479    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 01:47:38.064541 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.064499    2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 21 01:47:38.067481 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.067464    2582 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 21 01:47:38.069609 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.069595    2582 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 21 01:47:38.070177 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.070158    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mgmcb"
May 21 01:47:38.071599 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.071584    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 21 01:47:38.071666 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.071609    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 21 01:47:38.071666 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.071663    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 21 01:47:38.071729 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.071675    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 21 01:47:38.071729 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.071687    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 21 01:47:38.071729 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.071696    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 21 01:47:38.071729 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.071705    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 21 01:47:38.071729 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.071714    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 21 01:47:38.071729 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.071723    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 21 01:47:38.071882 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.071744    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 21 01:47:38.071882 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.071763    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 21 01:47:38.071882 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.071773    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 21 01:47:38.071882 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.071806    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 21 01:47:38.071882 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.071814    2582 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 21 01:47:38.075941 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.075922    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-mgmcb"
May 21 01:47:38.076419 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.076375    2582 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-167.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 21 01:47:38.076542 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:38.076420    2582 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-167.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 21 01:47:38.076542 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:38.076448    2582 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 21 01:47:38.077331 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.077315    2582 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 21 01:47:38.077417 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.077360    2582 server.go:1295] "Started kubelet"
May 21 01:47:38.077470 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.077398    2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 21 01:47:38.077470 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.077440    2582 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 21 01:47:38.077553 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.077491    2582 server_v1.go:47] "podresources" method="list" useActivePods=true
May 21 01:47:38.078367 ip-10-0-129-167 systemd[1]: Started Kubernetes Kubelet.
May 21 01:47:38.080248 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.080233    2582 server.go:317] "Adding debug handlers to kubelet server"
May 21 01:47:38.081289 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.081272    2582 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 21 01:47:38.086860 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:38.086841    2582 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 21 01:47:38.088253 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.088229    2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 21 01:47:38.088965 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.088949    2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 21 01:47:38.089138 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.089118    2582 volume_manager.go:295] "The desired_state_of_world populator starts"
May 21 01:47:38.089138 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.089138    2582 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 21 01:47:38.089282 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.089192    2582 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 21 01:47:38.089282 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.089277    2582 reconstruct.go:97] "Volume reconstruction finished"
May 21 01:47:38.089434 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.089286    2582 reconciler.go:26] "Reconciler: start to sync state"
May 21 01:47:38.089651 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.089621    2582 factory.go:55] Registering systemd factory
May 21 01:47:38.089711 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.089659    2582 factory.go:223] Registration of the systemd container factory successfully
May 21 01:47:38.089916 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.089900    2582 factory.go:153] Registering CRI-O factory
May 21 01:47:38.089987 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.089919    2582 factory.go:223] Registration of the crio container factory successfully
May 21 01:47:38.089987 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.089965    2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 21 01:47:38.089987 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.089985    2582 factory.go:103] Registering Raw factory
May 21 01:47:38.090101 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.090000    2582 manager.go:1196] Started watching for new ooms in manager
May 21 01:47:38.090101 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:38.090025    2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
May 21 01:47:38.090458 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.090447    2582 manager.go:319] Starting recovery of all containers
May 21 01:47:38.091703 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.091683    2582 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 01:47:38.093180 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:38.093147    2582 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-129-167.ec2.internal\" not found" node="ip-10-0-129-167.ec2.internal"
May 21 01:47:38.100936 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.100767    2582 manager.go:324] Recovery completed
May 21 01:47:38.105681 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.105667    2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 01:47:38.107606 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.107592    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientMemory"
May 21 01:47:38.107678 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.107622    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasNoDiskPressure"
May 21 01:47:38.107678 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.107655    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientPID"
May 21 01:47:38.108113 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.108099    2582 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 21 01:47:38.108185 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.108112    2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 21 01:47:38.108185 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.108132    2582 state_mem.go:36] "Initialized new in-memory state store"
May 21 01:47:38.112022 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.112008    2582 policy_none.go:49] "None policy: Start"
May 21 01:47:38.112094 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.112028    2582 memory_manager.go:186] "Starting memorymanager" policy="None"
May 21 01:47:38.112094 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.112041    2582 state_mem.go:35] "Initializing new in-memory state store"
May 21 01:47:38.154275 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.154255    2582 manager.go:341] "Starting Device Plugin manager"
May 21 01:47:38.174259 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:38.154307    2582 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 21 01:47:38.174259 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.154321    2582 server.go:85] "Starting device plugin registration server"
May 21 01:47:38.174259 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.154563    2582 eviction_manager.go:189] "Eviction manager: starting control loop"
May 21 01:47:38.174259 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.154575    2582 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 21 01:47:38.174259 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.154686    2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 21 01:47:38.174259 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.154762    2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 21 01:47:38.174259 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.154769    2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 21 01:47:38.174259 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:38.155333    2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 21 01:47:38.174259 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:38.155374    2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-167.ec2.internal\" not found"
May 21 01:47:38.230117 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.230042    2582 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 21 01:47:38.231417 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.231398    2582 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 21 01:47:38.231470 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.231435    2582 status_manager.go:230] "Starting to sync pod status with apiserver"
May 21 01:47:38.231470 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.231463    2582 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 21 01:47:38.231544 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.231472    2582 kubelet.go:2451] "Starting kubelet main sync loop"
May 21 01:47:38.231544 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:38.231517    2582 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 21 01:47:38.233462 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.233443    2582 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 01:47:38.255566 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.255549    2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 01:47:38.256541 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.256526    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientMemory"
May 21 01:47:38.256604 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.256556    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasNoDiskPressure"
May 21 01:47:38.256604 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.256568    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientPID"
May 21 01:47:38.256604 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.256591    2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-167.ec2.internal"
May 21 01:47:38.267399 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.267384    2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-167.ec2.internal"
May 21 01:47:38.267445 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:38.267409    2582 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-167.ec2.internal\": node \"ip-10-0-129-167.ec2.internal\" not found"
May 21 01:47:38.281429 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:38.281405    2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
May 21 01:47:38.331799 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.331757    2582 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal"]
May 21 01:47:38.331900 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.331852    2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 01:47:38.336064 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.336049    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientMemory"
May 21 01:47:38.336146 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.336076    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasNoDiskPressure"
May 21 01:47:38.336146 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.336087    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientPID"
May 21 01:47:38.338355 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.338343    2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 01:47:38.338512 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.338498    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal"
May 21 01:47:38.338550 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.338530    2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 01:47:38.339182 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.339165    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientMemory"
May 21 01:47:38.339228 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.339169    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientMemory"
May 21 01:47:38.339276 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.339229    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasNoDiskPressure"
May 21 01:47:38.339276 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.339242    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientPID"
May 21 01:47:38.339276 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.339203    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasNoDiskPressure"
May 21 01:47:38.339276 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.339272    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientPID"
May 21 01:47:38.341403 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.341385    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal"
May 21 01:47:38.341493 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.341411    2582 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 21 01:47:38.342085 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.342070    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientMemory"
May 21 01:47:38.342182 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.342097    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasNoDiskPressure"
May 21 01:47:38.342182 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.342107    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeHasSufficientPID"
May 21 01:47:38.356203 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:38.356181    2582 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-167.ec2.internal\" not found" node="ip-10-0-129-167.ec2.internal"
May 21 01:47:38.359645 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:38.359615    2582 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-167.ec2.internal\" not found" node="ip-10-0-129-167.ec2.internal"
May 21 01:47:38.382073 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:38.382052    2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
May 21 01:47:38.391337 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.391312    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/39d5ec9834fb2fe3b4915cc23fe476be-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal\" (UID: \"39d5ec9834fb2fe3b4915cc23fe476be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal"
May 21 01:47:38.391442 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.391340    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39d5ec9834fb2fe3b4915cc23fe476be-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal\" (UID: \"39d5ec9834fb2fe3b4915cc23fe476be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal"
May 21 01:47:38.391442 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.391359    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c3a868fe1e79d317fac062e00f67b49-config\") pod \"kube-apiserver-proxy-ip-10-0-129-167.ec2.internal\" (UID: \"6c3a868fe1e79d317fac062e00f67b49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal"
May 21 01:47:38.482779 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:38.482694    2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
May 21 01:47:38.492073 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.492049    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c3a868fe1e79d317fac062e00f67b49-config\") pod \"kube-apiserver-proxy-ip-10-0-129-167.ec2.internal\" (UID: \"6c3a868fe1e79d317fac062e00f67b49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal"
May 21 01:47:38.492132 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.492079    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/39d5ec9834fb2fe3b4915cc23fe476be-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal\" (UID: \"39d5ec9834fb2fe3b4915cc23fe476be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal"
May 21 01:47:38.492132 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.492096    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39d5ec9834fb2fe3b4915cc23fe476be-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal\" (UID: \"39d5ec9834fb2fe3b4915cc23fe476be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal"
May 21 01:47:38.492196 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.492132    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39d5ec9834fb2fe3b4915cc23fe476be-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal\" (UID: \"39d5ec9834fb2fe3b4915cc23fe476be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal"
May 21 01:47:38.492196 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.492141    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6c3a868fe1e79d317fac062e00f67b49-config\") pod \"kube-apiserver-proxy-ip-10-0-129-167.ec2.internal\" (UID: \"6c3a868fe1e79d317fac062e00f67b49\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal"
May 21 01:47:38.492196 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.492174    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/39d5ec9834fb2fe3b4915cc23fe476be-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal\" (UID: \"39d5ec9834fb2fe3b4915cc23fe476be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal"
May 21 01:47:38.583484 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:38.583446    2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
May 21 01:47:38.659949 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.659911    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal"
May 21 01:47:38.662520 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.662503    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal"
May 21 01:47:38.684142 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:38.684101    2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
May 21 01:47:38.784689 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:38.784593    2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
May 21 01:47:38.885127 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:38.885089    2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
May 21 01:47:38.985650 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:38.985600    2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
May 21 01:47:38.989788 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.989772    2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 21 01:47:38.989928 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.989913    2582 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 01:47:38.989968 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:38.989923    2582 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 21 01:47:39.078139 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:39.078096    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-20 01:42:38 +0000 UTC" deadline="2027-10-31 14:25:44.063802049 +0000 UTC"
May 21 01:47:39.078139 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:39.078132    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12684h38m4.985674824s"
May 21 01:47:39.086034 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:39.086010    2582 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-129-167.ec2.internal\" not found"
May 21 01:47:39.088727 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:39.088702    2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 21 01:47:39.102224 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:39.102199    2582 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 21 01:47:39.118127 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:39.118107    2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tjkmg"
May 21 01:47:39.125523 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:39.125500    2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tjkmg"
May 21 01:47:39.131076 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:39.131053    2582 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 01:47:39.141240 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:39.141222    2582 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 01:47:39.189661 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:39.189622    2582 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal"
May 21 01:47:39.194702 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:39.194625    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39d5ec9834fb2fe3b4915cc23fe476be.slice/crio-6e6b220dfd827b4dc42440dc7d20cf8325915a652d683450dda4d4cc8cb1ce49 WatchSource:0}: Error finding container 6e6b220dfd827b4dc42440dc7d20cf8325915a652d683450dda4d4cc8cb1ce49: Status 404 returned error can't find the container with id 6e6b220dfd827b4dc42440dc7d20cf8325915a652d683450dda4d4cc8cb1ce49
May 21 01:47:39.197085 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:39.197054    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c3a868fe1e79d317fac062e00f67b49.slice/crio-290ce85b61b57949bd7e5f1b89c21cad0ecc489afad605b68a11481e94ec450e WatchSource:0}: Error finding container 290ce85b61b57949bd7e5f1b89c21cad0ecc489afad605b68a11481e94ec450e: Status 404 returned error can't find the container with id 290ce85b61b57949bd7e5f1b89c21cad0ecc489afad605b68a11481e94ec450e
May 21 01:47:39.200527 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:39.200512    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 01:47:39.201305 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:39.201283    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 01:47:39.202229 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:39.202212    2582 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal"
May 21 01:47:39.209790 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:39.209775    2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 21 01:47:39.234787 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:39.234738    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal" event={"ID":"39d5ec9834fb2fe3b4915cc23fe476be","Type":"ContainerStarted","Data":"6e6b220dfd827b4dc42440dc7d20cf8325915a652d683450dda4d4cc8cb1ce49"}
May 21 01:47:39.235658 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:39.235617    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal" event={"ID":"6c3a868fe1e79d317fac062e00f67b49","Type":"ContainerStarted","Data":"290ce85b61b57949bd7e5f1b89c21cad0ecc489afad605b68a11481e94ec450e"}
May 21 01:47:39.803441 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:39.803414    2582 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 01:47:40.033318 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.033285    2582 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 21 01:47:40.064671 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.064576    2582 apiserver.go:52] "Watching apiserver"
May 21 01:47:40.074229 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.074203    2582 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 21 01:47:40.074618 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.074593    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-l52ds","openshift-multus/network-metrics-daemon-2dkkl","openshift-network-diagnostics/network-check-target-q5jgp","openshift-network-operator/iptables-alerter-snxsq","openshift-ovn-kubernetes/ovnkube-node-5ttwc","kube-system/konnectivity-agent-kl7mq","kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal","openshift-dns/node-resolver-v9n7p","openshift-image-registry/node-ca-r5gk9","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal","openshift-multus/multus-additional-cni-plugins-7gzt5","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5","openshift-cluster-node-tuning-operator/tuned-9sznz"]
May 21 01:47:40.078463 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.077773    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.080023 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.079914    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:47:40.080023 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:40.079988    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkkl" podUID="4b0e871e-0753-4434-9ea6-2d139f7766c8"
May 21 01:47:40.080197 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.080151    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 21 01:47:40.080279 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.080261    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-mdkkf\""
May 21 01:47:40.080429 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.080406    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 21 01:47:40.080556 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.080535    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 21 01:47:40.082198 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.082171    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:47:40.082317 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:40.082259    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5jgp" podUID="e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e"
May 21 01:47:40.084473 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.084452    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-snxsq"
May 21 01:47:40.087491 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.087103    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 21 01:47:40.087491 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.087130    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 21 01:47:40.087491 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.087168    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 21 01:47:40.087491 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.087189    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.087491 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.087102    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dxvp2\""
May 21 01:47:40.090243 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.090034    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kl7mq"
May 21 01:47:40.092144 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.092123    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-sxmmq\""
May 21 01:47:40.092401 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.092385    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 21 01:47:40.092622 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.092607    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 21 01:47:40.092995 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.092871    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 21 01:47:40.093074 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.092995    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 21 01:47:40.093182 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.093165    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 21 01:47:40.093317 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.093299    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 21 01:47:40.093388 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.093355    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-z68sv\""
May 21 01:47:40.093441 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.093402    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 21 01:47:40.093511 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.093495    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 21 01:47:40.094871 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.094852    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l52ds"
May 21 01:47:40.097353 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.097331    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 21 01:47:40.097458 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.097392    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 21 01:47:40.097698 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.097682    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 21 01:47:40.097773 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.097698    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rhdzl\""
May 21 01:47:40.097993 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.097976    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 21 01:47:40.100568 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.100060    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v9n7p"
May 21 01:47:40.100568 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.100192    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r5gk9"
May 21 01:47:40.100871 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.100740    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-cni-netd\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.100871 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.100761    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvgsl\" (UniqueName: \"kubernetes.io/projected/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-kube-api-access-qvgsl\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.100871 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.100778    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szhg4\" (UniqueName: \"kubernetes.io/projected/a845f37d-9eee-4e51-9334-f91b085d92a9-kube-api-access-szhg4\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.100871 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.100801    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bc9c0ad2-90b8-4733-9d0a-353df57696f3-iptables-alerter-script\") pod \"iptables-alerter-snxsq\" (UID: \"bc9c0ad2-90b8-4733-9d0a-353df57696f3\") " pod="openshift-network-operator/iptables-alerter-snxsq"
May 21 01:47:40.100871 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.100823    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc9c0ad2-90b8-4733-9d0a-353df57696f3-host-slash\") pod \"iptables-alerter-snxsq\" (UID: \"bc9c0ad2-90b8-4733-9d0a-353df57696f3\") " pod="openshift-network-operator/iptables-alerter-snxsq"
May 21 01:47:40.100871 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.100845    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-run-netns\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.100871 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.100860    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-node-log\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.100871 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.100874    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-ovnkube-script-lib\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.101235 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.100896    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a845f37d-9eee-4e51-9334-f91b085d92a9-device-dir\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.101235 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.100918    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a845f37d-9eee-4e51-9334-f91b085d92a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.101235 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.100942    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs\") pod \"network-metrics-daemon-2dkkl\" (UID: \"4b0e871e-0753-4434-9ea6-2d139f7766c8\") " pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:47:40.101235 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.100969    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.101235 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.100997    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-ovnkube-config\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.101235 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101024    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-kubelet\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.101235 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101047    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-slash\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.101235 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101070    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-etc-openvswitch\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.101235 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101096    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-run-openvswitch\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.101235 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101131    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-systemd-units\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.101235 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101193    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-env-overrides\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.101235 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0e6bc807-e178-4d74-b81f-03d96b556cd6-agent-certs\") pod \"konnectivity-agent-kl7mq\" (UID: \"0e6bc807-e178-4d74-b81f-03d96b556cd6\") " pod="kube-system/konnectivity-agent-kl7mq"
May 21 01:47:40.101235 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101225    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a845f37d-9eee-4e51-9334-f91b085d92a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.101846 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101264    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-run-systemd\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.101846 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101299    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-var-lib-openvswitch\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.101846 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101353    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-ovn-node-metrics-cert\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.101846 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101389    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a845f37d-9eee-4e51-9334-f91b085d92a9-socket-dir\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.101846 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101425    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a845f37d-9eee-4e51-9334-f91b085d92a9-sys-fs\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.101846 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101464    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xqhck\" (UniqueName: \"kubernetes.io/projected/bc9c0ad2-90b8-4733-9d0a-353df57696f3-kube-api-access-xqhck\") pod \"iptables-alerter-snxsq\" (UID: \"bc9c0ad2-90b8-4733-9d0a-353df57696f3\") " pod="openshift-network-operator/iptables-alerter-snxsq"
May 21 01:47:40.101846 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101505    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-log-socket\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.101846 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101528    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0e6bc807-e178-4d74-b81f-03d96b556cd6-konnectivity-ca\") pod \"konnectivity-agent-kl7mq\" (UID: \"0e6bc807-e178-4d74-b81f-03d96b556cd6\") " pod="kube-system/konnectivity-agent-kl7mq"
May 21 01:47:40.101846 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101547    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl7kp\" (UniqueName: \"kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp\") pod \"network-check-target-q5jgp\" (UID: \"e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e\") " pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:47:40.101846 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101576    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a845f37d-9eee-4e51-9334-f91b085d92a9-registration-dir\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.101846 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101591    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-run-ovn\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.101846 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101606    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-cni-bin\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.101846 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101620    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nn7wb\" (UniqueName: \"kubernetes.io/projected/4b0e871e-0753-4434-9ea6-2d139f7766c8-kube-api-access-nn7wb\") pod \"network-metrics-daemon-2dkkl\" (UID: \"4b0e871e-0753-4434-9ea6-2d139f7766c8\") " pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:47:40.101846 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.101653    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-run-ovn-kubernetes\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.102605 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.102583    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xk5qj\""
May 21 01:47:40.102795 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.102778    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gnnmk\""
May 21 01:47:40.102866 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.102800    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 21 01:47:40.103019 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.103006    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 21 01:47:40.103145 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.103083    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 21 01:47:40.103145 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.103109    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 21 01:47:40.103428 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.103173    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 21 01:47:40.105310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.104895    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.105310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.104950    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.107237 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.107213    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 21 01:47:40.107467 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.107450    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 21 01:47:40.107669 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.107568    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 21 01:47:40.107876 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.107859    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-kfshk\""
May 21 01:47:40.108103 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.108089    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 21 01:47:40.108297 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.108282    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hrjsj\""
May 21 01:47:40.126540 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.126509    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 01:42:39 +0000 UTC" deadline="2028-01-09 14:34:01.580726034 +0000 UTC"
May 21 01:47:40.126540 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.126539    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14364h46m21.454189723s"
May 21 01:47:40.190543 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.190508    2582 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 21 01:47:40.205923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.202392    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68604f4f-7500-4121-8b89-95705dc8444e-etc-tuned\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.205923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.202457    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-run-netns\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.205923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.202477    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-ovnkube-script-lib\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.205923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.202498    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a845f37d-9eee-4e51-9334-f91b085d92a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.205923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.202519    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs\") pod \"network-metrics-daemon-2dkkl\" (UID: \"4b0e871e-0753-4434-9ea6-2d139f7766c8\") " pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:47:40.205923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.202542    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-etc-kubernetes\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.205923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.202545    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-run-netns\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.205923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.202563    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-etc-modprobe-d\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.205923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.202614    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6cdb6843-4726-44d1-a4e2-a85ff70dd595-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.205923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.202683    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-host-run-netns\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.205923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.202724    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a845f37d-9eee-4e51-9334-f91b085d92a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.205923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.202740    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.205923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.202776    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-ovnkube-config\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.205923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.202804    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-kubelet\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.205923 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:40.202848    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:40.205923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.202900    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.205923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203024    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-system-cni-dir\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.206892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203058    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmhkx\" (UniqueName: \"kubernetes.io/projected/55dff604-dfbc-40e7-8bfc-2a63dc376b02-kube-api-access-fmhkx\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.206892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203095    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6cdb6843-4726-44d1-a4e2-a85ff70dd595-cnibin\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.206892 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:40.203153    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs podName:4b0e871e-0753-4434-9ea6-2d139f7766c8 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:40.703108073 +0000 UTC m=+3.116627457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs") pod "network-metrics-daemon-2dkkl" (UID: "4b0e871e-0753-4434-9ea6-2d139f7766c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:40.206892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203183    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-systemd-units\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.206892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203241    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a845f37d-9eee-4e51-9334-f91b085d92a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.206892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203281    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx92k\" (UniqueName: \"kubernetes.io/projected/80d874e6-8977-4487-8559-364f023d087c-kube-api-access-qx92k\") pod \"node-resolver-v9n7p\" (UID: \"80d874e6-8977-4487-8559-364f023d087c\") " pod="openshift-dns/node-resolver-v9n7p"
May 21 01:47:40.206892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203333    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv5ss\" (UniqueName: \"kubernetes.io/projected/77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1-kube-api-access-gv5ss\") pod \"node-ca-r5gk9\" (UID: \"77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1\") " pod="openshift-image-registry/node-ca-r5gk9"
May 21 01:47:40.206892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203374    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-host-var-lib-cni-bin\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.206892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203439    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-kubelet\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.206892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203457    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a845f37d-9eee-4e51-9334-f91b085d92a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.206892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203470    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6cdb6843-4726-44d1-a4e2-a85ff70dd595-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.206892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203353    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-ovnkube-script-lib\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.206892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203518    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-run-systemd\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.206892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203476    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-ovnkube-config\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.206892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203567    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-run-systemd\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.206892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203567    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-var-lib-openvswitch\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.207587 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203532    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-systemd-units\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.207587 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203623    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a845f37d-9eee-4e51-9334-f91b085d92a9-sys-fs\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.207587 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203696    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a845f37d-9eee-4e51-9334-f91b085d92a9-sys-fs\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.207587 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203710    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80d874e6-8977-4487-8559-364f023d087c-tmp-dir\") pod \"node-resolver-v9n7p\" (UID: \"80d874e6-8977-4487-8559-364f023d087c\") " pod="openshift-dns/node-resolver-v9n7p"
May 21 01:47:40.207587 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203726    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-var-lib-openvswitch\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.207587 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203752    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-host-var-lib-kubelet\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.207587 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203774    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-etc-kubernetes\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.207587 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203806    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6cdb6843-4726-44d1-a4e2-a85ff70dd595-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.207587 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203866    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-log-socket\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.207587 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203897    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0e6bc807-e178-4d74-b81f-03d96b556cd6-konnectivity-ca\") pod \"konnectivity-agent-kl7mq\" (UID: \"0e6bc807-e178-4d74-b81f-03d96b556cd6\") " pod="kube-system/konnectivity-agent-kl7mq"
May 21 01:47:40.207587 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.203923    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55dff604-dfbc-40e7-8bfc-2a63dc376b02-cni-binary-copy\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.207587 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204314    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0e6bc807-e178-4d74-b81f-03d96b556cd6-konnectivity-ca\") pod \"konnectivity-agent-kl7mq\" (UID: \"0e6bc807-e178-4d74-b81f-03d96b556cd6\") " pod="kube-system/konnectivity-agent-kl7mq"
May 21 01:47:40.207587 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204359    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-log-socket\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.207587 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204387    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-host-var-lib-cni-multus\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.207587 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204406    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-hostroot\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.207587 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204426    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-etc-sysctl-conf\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.207587 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204446    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-run\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.208300 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204467    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4g5s2\" (UniqueName: \"kubernetes.io/projected/68604f4f-7500-4121-8b89-95705dc8444e-kube-api-access-4g5s2\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.208300 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204488    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-run-ovn\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.208300 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204505    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-cni-bin\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.208300 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204533    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nn7wb\" (UniqueName: \"kubernetes.io/projected/4b0e871e-0753-4434-9ea6-2d139f7766c8-kube-api-access-nn7wb\") pod \"network-metrics-daemon-2dkkl\" (UID: \"4b0e871e-0753-4434-9ea6-2d139f7766c8\") " pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:47:40.208300 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204554    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-host-run-multus-certs\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.208300 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204574    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-host\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.208300 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204595    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-run-ovn-kubernetes\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.208300 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204613    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/80d874e6-8977-4487-8559-364f023d087c-hosts-file\") pod \"node-resolver-v9n7p\" (UID: \"80d874e6-8977-4487-8559-364f023d087c\") " pod="openshift-dns/node-resolver-v9n7p"
May 21 01:47:40.208300 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204657    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flrtt\" (UniqueName: \"kubernetes.io/projected/6cdb6843-4726-44d1-a4e2-a85ff70dd595-kube-api-access-flrtt\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.208300 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204696    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-cni-netd\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.208300 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204725    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qvgsl\" (UniqueName: \"kubernetes.io/projected/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-kube-api-access-qvgsl\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.208300 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204758    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bc9c0ad2-90b8-4733-9d0a-353df57696f3-iptables-alerter-script\") pod \"iptables-alerter-snxsq\" (UID: \"bc9c0ad2-90b8-4733-9d0a-353df57696f3\") " pod="openshift-network-operator/iptables-alerter-snxsq"
May 21 01:47:40.208300 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204792    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-multus-socket-dir-parent\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.208300 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204823    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cdb6843-4726-44d1-a4e2-a85ff70dd595-system-cni-dir\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.208300 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204854    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-node-log\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.208300 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204885    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a845f37d-9eee-4e51-9334-f91b085d92a9-device-dir\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.208300 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204916    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-slash\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.208952 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204947    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-etc-openvswitch\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.208952 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.204977    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-run-openvswitch\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.208952 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205005    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-lib-modules\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.208952 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205035    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-var-lib-kubelet\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.208952 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205067    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-env-overrides\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.208952 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205097    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0e6bc807-e178-4d74-b81f-03d96b556cd6-agent-certs\") pod \"konnectivity-agent-kl7mq\" (UID: \"0e6bc807-e178-4d74-b81f-03d96b556cd6\") " pod="kube-system/konnectivity-agent-kl7mq"
May 21 01:47:40.208952 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205127    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-os-release\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.208952 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205152    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-host-run-k8s-cni-cncf-io\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.208952 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205181    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-sys\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.208952 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205211    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-ovn-node-metrics-cert\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.208952 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205242    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a845f37d-9eee-4e51-9334-f91b085d92a9-socket-dir\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.208952 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205277    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xqhck\" (UniqueName: \"kubernetes.io/projected/bc9c0ad2-90b8-4733-9d0a-353df57696f3-kube-api-access-xqhck\") pod \"iptables-alerter-snxsq\" (UID: \"bc9c0ad2-90b8-4733-9d0a-353df57696f3\") " pod="openshift-network-operator/iptables-alerter-snxsq"
May 21 01:47:40.208952 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205305    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68604f4f-7500-4121-8b89-95705dc8444e-tmp\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.208952 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205341    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7kp\" (UniqueName: \"kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp\") pod \"network-check-target-q5jgp\" (UID: \"e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e\") " pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:47:40.208952 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205368    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1-host\") pod \"node-ca-r5gk9\" (UID: \"77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1\") " pod="openshift-image-registry/node-ca-r5gk9"
May 21 01:47:40.208952 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205420    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-multus-cni-dir\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.208952 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205452    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a845f37d-9eee-4e51-9334-f91b085d92a9-registration-dir\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.209551 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205484    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-cnibin\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.209551 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205513    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55dff604-dfbc-40e7-8bfc-2a63dc376b02-multus-daemon-config\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.209551 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205536    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-etc-sysctl-d\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.209551 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205567    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1-serviceca\") pod \"node-ca-r5gk9\" (UID: \"77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1\") " pod="openshift-image-registry/node-ca-r5gk9"
May 21 01:47:40.209551 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205594    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-etc-systemd\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.209551 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205622    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6cdb6843-4726-44d1-a4e2-a85ff70dd595-os-release\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.209551 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205669    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6cdb6843-4726-44d1-a4e2-a85ff70dd595-cni-binary-copy\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.209551 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205701    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-szhg4\" (UniqueName: \"kubernetes.io/projected/a845f37d-9eee-4e51-9334-f91b085d92a9-kube-api-access-szhg4\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.209551 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205731    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc9c0ad2-90b8-4733-9d0a-353df57696f3-host-slash\") pod \"iptables-alerter-snxsq\" (UID: \"bc9c0ad2-90b8-4733-9d0a-353df57696f3\") " pod="openshift-network-operator/iptables-alerter-snxsq"
May 21 01:47:40.209551 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205762    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-multus-conf-dir\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.209551 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.205791    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-etc-sysconfig\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.209551 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.206058    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a845f37d-9eee-4e51-9334-f91b085d92a9-device-dir\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.209551 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.206052    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-cni-bin\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.209551 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.206110    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a845f37d-9eee-4e51-9334-f91b085d92a9-registration-dir\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.209551 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.206170    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-cni-netd\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.209551 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.206220    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-etc-openvswitch\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.209551 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.206280    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-run-ovn-kubernetes\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.210205 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.206314    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bc9c0ad2-90b8-4733-9d0a-353df57696f3-host-slash\") pod \"iptables-alerter-snxsq\" (UID: \"bc9c0ad2-90b8-4733-9d0a-353df57696f3\") " pod="openshift-network-operator/iptables-alerter-snxsq"
May 21 01:47:40.210205 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.206422    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-env-overrides\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.210205 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.206577    2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 21 01:47:40.210205 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.206731    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-host-slash\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.210205 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.207010    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-run-ovn\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.210205 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.207044    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a845f37d-9eee-4e51-9334-f91b085d92a9-socket-dir\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.210205 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.207062    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bc9c0ad2-90b8-4733-9d0a-353df57696f3-iptables-alerter-script\") pod \"iptables-alerter-snxsq\" (UID: \"bc9c0ad2-90b8-4733-9d0a-353df57696f3\") " pod="openshift-network-operator/iptables-alerter-snxsq"
May 21 01:47:40.210205 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.207070    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-node-log\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.210205 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.207121    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-run-openvswitch\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.211370 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.211344    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0e6bc807-e178-4d74-b81f-03d96b556cd6-agent-certs\") pod \"konnectivity-agent-kl7mq\" (UID: \"0e6bc807-e178-4d74-b81f-03d96b556cd6\") " pod="kube-system/konnectivity-agent-kl7mq"
May 21 01:47:40.212411 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.212387    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-ovn-node-metrics-cert\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.219351 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:40.219171    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 01:47:40.219351 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:40.219201    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 01:47:40.219351 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:40.219214    2582 projected.go:194] Error preparing data for projected volume kube-api-access-jl7kp for pod openshift-network-diagnostics/network-check-target-q5jgp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:40.219351 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:40.219282    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp podName:e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e nodeName:}" failed. No retries permitted until 2026-05-21 01:47:40.719267442 +0000 UTC m=+3.132786805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jl7kp" (UniqueName: "kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp") pod "network-check-target-q5jgp" (UID: "e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:40.222669 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.222579    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nn7wb\" (UniqueName: \"kubernetes.io/projected/4b0e871e-0753-4434-9ea6-2d139f7766c8-kube-api-access-nn7wb\") pod \"network-metrics-daemon-2dkkl\" (UID: \"4b0e871e-0753-4434-9ea6-2d139f7766c8\") " pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:47:40.223227 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.223170    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xqhck\" (UniqueName: \"kubernetes.io/projected/bc9c0ad2-90b8-4733-9d0a-353df57696f3-kube-api-access-xqhck\") pod \"iptables-alerter-snxsq\" (UID: \"bc9c0ad2-90b8-4733-9d0a-353df57696f3\") " pod="openshift-network-operator/iptables-alerter-snxsq"
May 21 01:47:40.223227 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.223181    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvgsl\" (UniqueName: \"kubernetes.io/projected/97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a-kube-api-access-qvgsl\") pod \"ovnkube-node-5ttwc\" (UID: \"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a\") " pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.223950 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.223928    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szhg4\" (UniqueName: \"kubernetes.io/projected/a845f37d-9eee-4e51-9334-f91b085d92a9-kube-api-access-szhg4\") pod \"aws-ebs-csi-driver-node-tlht5\" (UID: \"a845f37d-9eee-4e51-9334-f91b085d92a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.307031 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.306992    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-host-run-netns\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.307217 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307046    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-system-cni-dir\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.307217 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307070    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fmhkx\" (UniqueName: \"kubernetes.io/projected/55dff604-dfbc-40e7-8bfc-2a63dc376b02-kube-api-access-fmhkx\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.307217 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307095    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6cdb6843-4726-44d1-a4e2-a85ff70dd595-cnibin\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.307217 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307123    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-host-run-netns\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.307217 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307140    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qx92k\" (UniqueName: \"kubernetes.io/projected/80d874e6-8977-4487-8559-364f023d087c-kube-api-access-qx92k\") pod \"node-resolver-v9n7p\" (UID: \"80d874e6-8977-4487-8559-364f023d087c\") " pod="openshift-dns/node-resolver-v9n7p"
May 21 01:47:40.307217 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307145    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-system-cni-dir\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.307217 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307166    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gv5ss\" (UniqueName: \"kubernetes.io/projected/77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1-kube-api-access-gv5ss\") pod \"node-ca-r5gk9\" (UID: \"77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1\") " pod="openshift-image-registry/node-ca-r5gk9"
May 21 01:47:40.307217 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307191    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-host-var-lib-cni-bin\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.307217 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307194    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6cdb6843-4726-44d1-a4e2-a85ff70dd595-cnibin\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.307217 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307214    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6cdb6843-4726-44d1-a4e2-a85ff70dd595-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.307701 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307235    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-host-var-lib-cni-bin\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.307701 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307241    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80d874e6-8977-4487-8559-364f023d087c-tmp-dir\") pod \"node-resolver-v9n7p\" (UID: \"80d874e6-8977-4487-8559-364f023d087c\") " pod="openshift-dns/node-resolver-v9n7p"
May 21 01:47:40.307701 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307264    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-host-var-lib-kubelet\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.307701 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307285    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-etc-kubernetes\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.307701 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307310    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6cdb6843-4726-44d1-a4e2-a85ff70dd595-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.307701 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307337    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55dff604-dfbc-40e7-8bfc-2a63dc376b02-cni-binary-copy\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.307701 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307350    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-host-var-lib-kubelet\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.307701 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307359    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-host-var-lib-cni-multus\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.307701 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307368    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-etc-kubernetes\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.307701 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307385    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-hostroot\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.307701 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307406    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-etc-sysctl-conf\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.307701 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307420    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6cdb6843-4726-44d1-a4e2-a85ff70dd595-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.307701 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307425    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-run\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.307701 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307469    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4g5s2\" (UniqueName: \"kubernetes.io/projected/68604f4f-7500-4121-8b89-95705dc8444e-kube-api-access-4g5s2\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.307701 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307477    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-hostroot\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.307701 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307501    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-host-run-multus-certs\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.307701 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307518    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-host-var-lib-cni-multus\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.307701 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307526    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-host\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.308537 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307552    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/80d874e6-8977-4487-8559-364f023d087c-hosts-file\") pod \"node-resolver-v9n7p\" (UID: \"80d874e6-8977-4487-8559-364f023d087c\") " pod="openshift-dns/node-resolver-v9n7p"
May 21 01:47:40.308537 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307571    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-run\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.308537 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307578    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-flrtt\" (UniqueName: \"kubernetes.io/projected/6cdb6843-4726-44d1-a4e2-a85ff70dd595-kube-api-access-flrtt\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.308537 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307608    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-multus-socket-dir-parent\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.308537 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307672    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cdb6843-4726-44d1-a4e2-a85ff70dd595-system-cni-dir\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.308537 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307687    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/80d874e6-8977-4487-8559-364f023d087c-tmp-dir\") pod \"node-resolver-v9n7p\" (UID: \"80d874e6-8977-4487-8559-364f023d087c\") " pod="openshift-dns/node-resolver-v9n7p"
May 21 01:47:40.308537 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307697    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-lib-modules\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.308537 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307719    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-var-lib-kubelet\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.308537 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307738    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-etc-sysctl-conf\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.308537 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307746    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-os-release\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.308537 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307805    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-multus-socket-dir-parent\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.308537 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307831    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6cdb6843-4726-44d1-a4e2-a85ff70dd595-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.308537 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307861    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-host\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.308537 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307867    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-lib-modules\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.308537 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307881    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-var-lib-kubelet\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.308537 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307933    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/55dff604-dfbc-40e7-8bfc-2a63dc376b02-cni-binary-copy\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.308537 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307948    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/80d874e6-8977-4487-8559-364f023d087c-hosts-file\") pod \"node-resolver-v9n7p\" (UID: \"80d874e6-8977-4487-8559-364f023d087c\") " pod="openshift-dns/node-resolver-v9n7p"
May 21 01:47:40.308537 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307935    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-host-run-k8s-cni-cncf-io\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.309310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307976    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-host-run-k8s-cni-cncf-io\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.309310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307987    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-sys\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.309310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308007    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-os-release\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.309310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308016    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6cdb6843-4726-44d1-a4e2-a85ff70dd595-system-cni-dir\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.309310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308026    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-sys\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.309310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308026    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68604f4f-7500-4121-8b89-95705dc8444e-tmp\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.309310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.307947    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-host-run-multus-certs\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.309310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308074    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1-host\") pod \"node-ca-r5gk9\" (UID: \"77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1\") " pod="openshift-image-registry/node-ca-r5gk9"
May 21 01:47:40.309310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308108    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1-host\") pod \"node-ca-r5gk9\" (UID: \"77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1\") " pod="openshift-image-registry/node-ca-r5gk9"
May 21 01:47:40.309310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308136    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-multus-cni-dir\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.309310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308164    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-cnibin\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.309310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308191    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55dff604-dfbc-40e7-8bfc-2a63dc376b02-multus-daemon-config\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.309310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308189    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-multus-cni-dir\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.309310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308216    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-etc-sysctl-d\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.309310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308240    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1-serviceca\") pod \"node-ca-r5gk9\" (UID: \"77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1\") " pod="openshift-image-registry/node-ca-r5gk9"
May 21 01:47:40.309310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308245    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-cnibin\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.309310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308264    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-etc-systemd\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.309310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308291    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6cdb6843-4726-44d1-a4e2-a85ff70dd595-os-release\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.309923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308316    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6cdb6843-4726-44d1-a4e2-a85ff70dd595-cni-binary-copy\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.309923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308344    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-multus-conf-dir\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.309923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308369    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-etc-sysconfig\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.309923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308376    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-etc-sysctl-d\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.309923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308392    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68604f4f-7500-4121-8b89-95705dc8444e-etc-tuned\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.309923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308432    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-etc-kubernetes\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.309923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308454    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-etc-modprobe-d\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.309923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308466    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-etc-systemd\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.309923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308469    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6cdb6843-4726-44d1-a4e2-a85ff70dd595-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.309923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308699    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/55dff604-dfbc-40e7-8bfc-2a63dc376b02-multus-daemon-config\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.309923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308751    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1-serviceca\") pod \"node-ca-r5gk9\" (UID: \"77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1\") " pod="openshift-image-registry/node-ca-r5gk9"
May 21 01:47:40.309923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308784    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6cdb6843-4726-44d1-a4e2-a85ff70dd595-os-release\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.309923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308818    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-etc-kubernetes\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.309923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308835    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/55dff604-dfbc-40e7-8bfc-2a63dc376b02-multus-conf-dir\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.309923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308868    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6cdb6843-4726-44d1-a4e2-a85ff70dd595-cni-binary-copy\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.309923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308889    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-etc-sysconfig\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.309923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308915    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6cdb6843-4726-44d1-a4e2-a85ff70dd595-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.309923 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.308953    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/68604f4f-7500-4121-8b89-95705dc8444e-etc-modprobe-d\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.310566 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.310475    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/68604f4f-7500-4121-8b89-95705dc8444e-tmp\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.310842 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.310825    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/68604f4f-7500-4121-8b89-95705dc8444e-etc-tuned\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.316913 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.316863    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv5ss\" (UniqueName: \"kubernetes.io/projected/77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1-kube-api-access-gv5ss\") pod \"node-ca-r5gk9\" (UID: \"77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1\") " pod="openshift-image-registry/node-ca-r5gk9"
May 21 01:47:40.317900 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.317877    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4g5s2\" (UniqueName: \"kubernetes.io/projected/68604f4f-7500-4121-8b89-95705dc8444e-kube-api-access-4g5s2\") pod \"tuned-9sznz\" (UID: \"68604f4f-7500-4121-8b89-95705dc8444e\") " pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.318034 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.318007    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx92k\" (UniqueName: \"kubernetes.io/projected/80d874e6-8977-4487-8559-364f023d087c-kube-api-access-qx92k\") pod \"node-resolver-v9n7p\" (UID: \"80d874e6-8977-4487-8559-364f023d087c\") " pod="openshift-dns/node-resolver-v9n7p"
May 21 01:47:40.318417 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.318396    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmhkx\" (UniqueName: \"kubernetes.io/projected/55dff604-dfbc-40e7-8bfc-2a63dc376b02-kube-api-access-fmhkx\") pod \"multus-l52ds\" (UID: \"55dff604-dfbc-40e7-8bfc-2a63dc376b02\") " pod="openshift-multus/multus-l52ds"
May 21 01:47:40.318616 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.318597    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-flrtt\" (UniqueName: \"kubernetes.io/projected/6cdb6843-4726-44d1-a4e2-a85ff70dd595-kube-api-access-flrtt\") pod \"multus-additional-cni-plugins-7gzt5\" (UID: \"6cdb6843-4726-44d1-a4e2-a85ff70dd595\") " pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.388608 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.388570    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5"
May 21 01:47:40.405688 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.405654    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-snxsq"
May 21 01:47:40.414815 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.414784    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:47:40.421547 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.421526    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-kl7mq"
May 21 01:47:40.429191 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.429141    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-l52ds"
May 21 01:47:40.435719 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.435697    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-v9n7p"
May 21 01:47:40.442237 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.442208    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-r5gk9"
May 21 01:47:40.449813 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.449792    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9sznz"
May 21 01:47:40.456359 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.456342    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7gzt5"
May 21 01:47:40.711505 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.711429    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs\") pod \"network-metrics-daemon-2dkkl\" (UID: \"4b0e871e-0753-4434-9ea6-2d139f7766c8\") " pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:47:40.711645 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:40.711540    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:40.711645 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:40.711595    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs podName:4b0e871e-0753-4434-9ea6-2d139f7766c8 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:41.711580337 +0000 UTC m=+4.125099696 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs") pod "network-metrics-daemon-2dkkl" (UID: "4b0e871e-0753-4434-9ea6-2d139f7766c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:40.811968 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:40.811929    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7kp\" (UniqueName: \"kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp\") pod \"network-check-target-q5jgp\" (UID: \"e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e\") " pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:47:40.812126 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:40.812068    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 01:47:40.812126 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:40.812083    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 01:47:40.812126 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:40.812093    2582 projected.go:194] Error preparing data for projected volume kube-api-access-jl7kp for pod openshift-network-diagnostics/network-check-target-q5jgp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:40.812217 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:40.812150    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp podName:e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e nodeName:}" failed. No retries permitted until 2026-05-21 01:47:41.812128107 +0000 UTC m=+4.225647465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jl7kp" (UniqueName: "kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp") pod "network-check-target-q5jgp" (UID: "e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:40.916453 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:40.916427    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97ae1a73_bfe1_4bd4_a1b2_dc2bb5a5a32a.slice/crio-8778e075258915a0dc61847d7a76059967acf727d339af1a2a144945caba2278 WatchSource:0}: Error finding container 8778e075258915a0dc61847d7a76059967acf727d339af1a2a144945caba2278: Status 404 returned error can't find the container with id 8778e075258915a0dc61847d7a76059967acf727d339af1a2a144945caba2278
May 21 01:47:40.918778 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:40.918756    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77ce3cac_0f80_42a3_9dab_6fdcb65ff3e1.slice/crio-7d908ad2120dac41a7afa2c149954d25df83dfbb99d92dc7d696f54dbdfe29a2 WatchSource:0}: Error finding container 7d908ad2120dac41a7afa2c149954d25df83dfbb99d92dc7d696f54dbdfe29a2: Status 404 returned error can't find the container with id 7d908ad2120dac41a7afa2c149954d25df83dfbb99d92dc7d696f54dbdfe29a2
May 21 01:47:40.920664 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:40.920621    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc9c0ad2_90b8_4733_9d0a_353df57696f3.slice/crio-d9308f8a5f4b98ad0fcc42a112ee6d6e06014109d8c7f237cdaf4e46b4759bf6 WatchSource:0}: Error finding container d9308f8a5f4b98ad0fcc42a112ee6d6e06014109d8c7f237cdaf4e46b4759bf6: Status 404 returned error can't find the container with id d9308f8a5f4b98ad0fcc42a112ee6d6e06014109d8c7f237cdaf4e46b4759bf6
May 21 01:47:40.923136 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:40.923096    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80d874e6_8977_4487_8559_364f023d087c.slice/crio-5b04df2bba5837fa80905a67feecdf353d3aaf19e829861e5974901a80a6fdd1 WatchSource:0}: Error finding container 5b04df2bba5837fa80905a67feecdf353d3aaf19e829861e5974901a80a6fdd1: Status 404 returned error can't find the container with id 5b04df2bba5837fa80905a67feecdf353d3aaf19e829861e5974901a80a6fdd1
May 21 01:47:40.924048 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:40.923968    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55dff604_dfbc_40e7_8bfc_2a63dc376b02.slice/crio-fb59935b0e54da13bb1896fab590546e00242bc4a92e94d21d6404d08a0e5158 WatchSource:0}: Error finding container fb59935b0e54da13bb1896fab590546e00242bc4a92e94d21d6404d08a0e5158: Status 404 returned error can't find the container with id fb59935b0e54da13bb1896fab590546e00242bc4a92e94d21d6404d08a0e5158
May 21 01:47:40.924984 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:40.924965    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e6bc807_e178_4d74_b81f_03d96b556cd6.slice/crio-7dac9564ad14196d080fdb50129cfabc7618b798cb050183d22a3d5b1bbdfdc0 WatchSource:0}: Error finding container 7dac9564ad14196d080fdb50129cfabc7618b798cb050183d22a3d5b1bbdfdc0: Status 404 returned error can't find the container with id 7dac9564ad14196d080fdb50129cfabc7618b798cb050183d22a3d5b1bbdfdc0
May 21 01:47:40.945456 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:40.945429    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda845f37d_9eee_4e51_9334_f91b085d92a9.slice/crio-aa973ae980bdc040b8c989969010a148776879bdfa52778920f10d712ebf05ad WatchSource:0}: Error finding container aa973ae980bdc040b8c989969010a148776879bdfa52778920f10d712ebf05ad: Status 404 returned error can't find the container with id aa973ae980bdc040b8c989969010a148776879bdfa52778920f10d712ebf05ad
May 21 01:47:40.946463 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:40.946435    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cdb6843_4726_44d1_a4e2_a85ff70dd595.slice/crio-6f74251bdb14e5f669785271a93379db76d7a82eaaa3a1aba9af83b7655d9265 WatchSource:0}: Error finding container 6f74251bdb14e5f669785271a93379db76d7a82eaaa3a1aba9af83b7655d9265: Status 404 returned error can't find the container with id 6f74251bdb14e5f669785271a93379db76d7a82eaaa3a1aba9af83b7655d9265
May 21 01:47:40.947148 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:47:40.947121    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68604f4f_7500_4121_8b89_95705dc8444e.slice/crio-a59f920689b358594a3adb1a439f285ee394961f4e517ecfd5777ac843592221 WatchSource:0}: Error finding container a59f920689b358594a3adb1a439f285ee394961f4e517ecfd5777ac843592221: Status 404 returned error can't find the container with id a59f920689b358594a3adb1a439f285ee394961f4e517ecfd5777ac843592221
May 21 01:47:41.127460 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:41.127225    2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-20 01:42:39 +0000 UTC" deadline="2028-02-18 16:46:34.677396828 +0000 UTC"
May 21 01:47:41.127460 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:41.127461    2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15326h58m53.549941995s"
May 21 01:47:41.232397 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:41.232369    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:47:41.232554 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:41.232487    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5jgp" podUID="e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e"
May 21 01:47:41.240188 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:41.240150    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal" event={"ID":"6c3a868fe1e79d317fac062e00f67b49","Type":"ContainerStarted","Data":"a56dbd2e43e69c25a2dac5272de6ef9393f305e2d1dd295be1970d95d509d12c"}
May 21 01:47:41.241339 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:41.241313    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9sznz" event={"ID":"68604f4f-7500-4121-8b89-95705dc8444e","Type":"ContainerStarted","Data":"a59f920689b358594a3adb1a439f285ee394961f4e517ecfd5777ac843592221"}
May 21 01:47:41.242392 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:41.242371    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7gzt5" event={"ID":"6cdb6843-4726-44d1-a4e2-a85ff70dd595","Type":"ContainerStarted","Data":"6f74251bdb14e5f669785271a93379db76d7a82eaaa3a1aba9af83b7655d9265"}
May 21 01:47:41.243974 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:41.243947    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v9n7p" event={"ID":"80d874e6-8977-4487-8559-364f023d087c","Type":"ContainerStarted","Data":"5b04df2bba5837fa80905a67feecdf353d3aaf19e829861e5974901a80a6fdd1"}
May 21 01:47:41.245190 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:41.245156    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-snxsq" event={"ID":"bc9c0ad2-90b8-4733-9d0a-353df57696f3","Type":"ContainerStarted","Data":"d9308f8a5f4b98ad0fcc42a112ee6d6e06014109d8c7f237cdaf4e46b4759bf6"}
May 21 01:47:41.246314 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:41.246287    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc" event={"ID":"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a","Type":"ContainerStarted","Data":"8778e075258915a0dc61847d7a76059967acf727d339af1a2a144945caba2278"}
May 21 01:47:41.247771 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:41.247747    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal" event={"ID":"39d5ec9834fb2fe3b4915cc23fe476be","Type":"ContainerStarted","Data":"b716c9670e8a3c6e4ab3464b029f8618692f9009eb983816921af5061dcfae26"}
May 21 01:47:41.249518 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:41.249492    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5" event={"ID":"a845f37d-9eee-4e51-9334-f91b085d92a9","Type":"ContainerStarted","Data":"aa973ae980bdc040b8c989969010a148776879bdfa52778920f10d712ebf05ad"}
May 21 01:47:41.250568 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:41.250544    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kl7mq" event={"ID":"0e6bc807-e178-4d74-b81f-03d96b556cd6","Type":"ContainerStarted","Data":"7dac9564ad14196d080fdb50129cfabc7618b798cb050183d22a3d5b1bbdfdc0"}
May 21 01:47:41.251574 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:41.251550    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l52ds" event={"ID":"55dff604-dfbc-40e7-8bfc-2a63dc376b02","Type":"ContainerStarted","Data":"fb59935b0e54da13bb1896fab590546e00242bc4a92e94d21d6404d08a0e5158"}
May 21 01:47:41.252656 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:41.252594    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-167.ec2.internal" podStartSLOduration=2.252583136 podStartE2EDuration="2.252583136s" podCreationTimestamp="2026-05-21 01:47:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:47:41.252388499 +0000 UTC m=+3.665907883" watchObservedRunningTime="2026-05-21 01:47:41.252583136 +0000 UTC m=+3.666102517"
May 21 01:47:41.253484 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:41.253458    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r5gk9" event={"ID":"77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1","Type":"ContainerStarted","Data":"7d908ad2120dac41a7afa2c149954d25df83dfbb99d92dc7d696f54dbdfe29a2"}
May 21 01:47:41.719655 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:41.719604    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs\") pod \"network-metrics-daemon-2dkkl\" (UID: \"4b0e871e-0753-4434-9ea6-2d139f7766c8\") " pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:47:41.720239 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:41.719819    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:41.720239 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:41.719888    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs podName:4b0e871e-0753-4434-9ea6-2d139f7766c8 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:43.719869026 +0000 UTC m=+6.133388386 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs") pod "network-metrics-daemon-2dkkl" (UID: "4b0e871e-0753-4434-9ea6-2d139f7766c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:41.820910 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:41.820294    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7kp\" (UniqueName: \"kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp\") pod \"network-check-target-q5jgp\" (UID: \"e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e\") " pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:47:41.820910 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:41.820455    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 01:47:41.820910 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:41.820473    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 01:47:41.820910 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:41.820485    2582 projected.go:194] Error preparing data for projected volume kube-api-access-jl7kp for pod openshift-network-diagnostics/network-check-target-q5jgp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:41.820910 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:41.820547    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp podName:e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e nodeName:}" failed. No retries permitted until 2026-05-21 01:47:43.820528383 +0000 UTC m=+6.234047745 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jl7kp" (UniqueName: "kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp") pod "network-check-target-q5jgp" (UID: "e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:42.232838 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:42.232806    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:47:42.233387 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:42.232979    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkkl" podUID="4b0e871e-0753-4434-9ea6-2d139f7766c8"
May 21 01:47:42.273950 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:42.273196    2582 generic.go:358] "Generic (PLEG): container finished" podID="39d5ec9834fb2fe3b4915cc23fe476be" containerID="b716c9670e8a3c6e4ab3464b029f8618692f9009eb983816921af5061dcfae26" exitCode=0
May 21 01:47:42.273950 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:42.273722    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal" event={"ID":"39d5ec9834fb2fe3b4915cc23fe476be","Type":"ContainerDied","Data":"b716c9670e8a3c6e4ab3464b029f8618692f9009eb983816921af5061dcfae26"}
May 21 01:47:42.732163 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:42.731372    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-r25km"]
May 21 01:47:42.734859 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:42.734405    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:42.734859 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:42.734482    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r25km" podUID="e4d14bdc-b170-419a-8e48-a9b89dc283c3"
May 21 01:47:42.830243 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:42.830142    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e4d14bdc-b170-419a-8e48-a9b89dc283c3-kubelet-config\") pod \"global-pull-secret-syncer-r25km\" (UID: \"e4d14bdc-b170-419a-8e48-a9b89dc283c3\") " pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:42.830243 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:42.830205    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret\") pod \"global-pull-secret-syncer-r25km\" (UID: \"e4d14bdc-b170-419a-8e48-a9b89dc283c3\") " pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:42.830467 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:42.830282    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e4d14bdc-b170-419a-8e48-a9b89dc283c3-dbus\") pod \"global-pull-secret-syncer-r25km\" (UID: \"e4d14bdc-b170-419a-8e48-a9b89dc283c3\") " pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:42.931317 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:42.931282    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret\") pod \"global-pull-secret-syncer-r25km\" (UID: \"e4d14bdc-b170-419a-8e48-a9b89dc283c3\") " pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:42.931538 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:42.931374    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e4d14bdc-b170-419a-8e48-a9b89dc283c3-dbus\") pod \"global-pull-secret-syncer-r25km\" (UID: \"e4d14bdc-b170-419a-8e48-a9b89dc283c3\") " pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:42.931538 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:42.931421    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e4d14bdc-b170-419a-8e48-a9b89dc283c3-kubelet-config\") pod \"global-pull-secret-syncer-r25km\" (UID: \"e4d14bdc-b170-419a-8e48-a9b89dc283c3\") " pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:42.931538 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:42.931513    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e4d14bdc-b170-419a-8e48-a9b89dc283c3-kubelet-config\") pod \"global-pull-secret-syncer-r25km\" (UID: \"e4d14bdc-b170-419a-8e48-a9b89dc283c3\") " pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:42.931720 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:42.931651    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 01:47:42.931720 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:42.931710    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret podName:e4d14bdc-b170-419a-8e48-a9b89dc283c3 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:43.431691849 +0000 UTC m=+5.845211216 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret") pod "global-pull-secret-syncer-r25km" (UID: "e4d14bdc-b170-419a-8e48-a9b89dc283c3") : object "kube-system"/"original-pull-secret" not registered
May 21 01:47:42.932051 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:42.932026    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e4d14bdc-b170-419a-8e48-a9b89dc283c3-dbus\") pod \"global-pull-secret-syncer-r25km\" (UID: \"e4d14bdc-b170-419a-8e48-a9b89dc283c3\") " pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:43.232386 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:43.232292    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:47:43.232535 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:43.232424    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5jgp" podUID="e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e"
May 21 01:47:43.282028 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:43.281975    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal" event={"ID":"39d5ec9834fb2fe3b4915cc23fe476be","Type":"ContainerStarted","Data":"d4b7a95d2e235d872b18b8b0bbc3d85f04454321c6b9e16b1d4969d279d8b9b8"}
May 21 01:47:43.434308 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:43.434271    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret\") pod \"global-pull-secret-syncer-r25km\" (UID: \"e4d14bdc-b170-419a-8e48-a9b89dc283c3\") " pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:43.434576 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:43.434406    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 01:47:43.434576 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:43.434465    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret podName:e4d14bdc-b170-419a-8e48-a9b89dc283c3 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:44.434447396 +0000 UTC m=+6.847966759 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret") pod "global-pull-secret-syncer-r25km" (UID: "e4d14bdc-b170-419a-8e48-a9b89dc283c3") : object "kube-system"/"original-pull-secret" not registered
May 21 01:47:43.737580 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:43.737026    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs\") pod \"network-metrics-daemon-2dkkl\" (UID: \"4b0e871e-0753-4434-9ea6-2d139f7766c8\") " pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:47:43.737580 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:43.737178    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:43.737580 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:43.737241    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs podName:4b0e871e-0753-4434-9ea6-2d139f7766c8 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:47.737222677 +0000 UTC m=+10.150742039 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs") pod "network-metrics-daemon-2dkkl" (UID: "4b0e871e-0753-4434-9ea6-2d139f7766c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:43.838751 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:43.838105    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7kp\" (UniqueName: \"kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp\") pod \"network-check-target-q5jgp\" (UID: \"e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e\") " pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:47:43.838751 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:43.838288    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 01:47:43.838751 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:43.838308    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 01:47:43.838751 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:43.838321    2582 projected.go:194] Error preparing data for projected volume kube-api-access-jl7kp for pod openshift-network-diagnostics/network-check-target-q5jgp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:43.838751 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:43.838381    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp podName:e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e nodeName:}" failed. No retries permitted until 2026-05-21 01:47:47.838361962 +0000 UTC m=+10.251881328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jl7kp" (UniqueName: "kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp") pod "network-check-target-q5jgp" (UID: "e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:44.234112 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:44.234004    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:44.234287 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:44.234140    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r25km" podUID="e4d14bdc-b170-419a-8e48-a9b89dc283c3"
May 21 01:47:44.234588 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:44.234565    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:47:44.234719 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:44.234696    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkkl" podUID="4b0e871e-0753-4434-9ea6-2d139f7766c8"
May 21 01:47:44.442575 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:44.442511    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret\") pod \"global-pull-secret-syncer-r25km\" (UID: \"e4d14bdc-b170-419a-8e48-a9b89dc283c3\") " pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:44.443047 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:44.442722    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 01:47:44.443047 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:44.442794    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret podName:e4d14bdc-b170-419a-8e48-a9b89dc283c3 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:46.442773382 +0000 UTC m=+8.856292744 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret") pod "global-pull-secret-syncer-r25km" (UID: "e4d14bdc-b170-419a-8e48-a9b89dc283c3") : object "kube-system"/"original-pull-secret" not registered
May 21 01:47:45.232882 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:45.232405    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:47:45.232882 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:45.232533    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5jgp" podUID="e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e"
May 21 01:47:46.232840 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:46.232601    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:47:46.232840 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:46.232772    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkkl" podUID="4b0e871e-0753-4434-9ea6-2d139f7766c8"
May 21 01:47:46.233328 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:46.232985    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:46.233328 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:46.233116    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r25km" podUID="e4d14bdc-b170-419a-8e48-a9b89dc283c3"
May 21 01:47:46.461808 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:46.461767    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret\") pod \"global-pull-secret-syncer-r25km\" (UID: \"e4d14bdc-b170-419a-8e48-a9b89dc283c3\") " pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:46.461991 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:46.461922    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 01:47:46.462050 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:46.461994    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret podName:e4d14bdc-b170-419a-8e48-a9b89dc283c3 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:50.461977334 +0000 UTC m=+12.875496697 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret") pod "global-pull-secret-syncer-r25km" (UID: "e4d14bdc-b170-419a-8e48-a9b89dc283c3") : object "kube-system"/"original-pull-secret" not registered
May 21 01:47:47.232372 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:47.232335    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:47:47.232670 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:47.232472    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5jgp" podUID="e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e"
May 21 01:47:47.773440 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:47.773396    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs\") pod \"network-metrics-daemon-2dkkl\" (UID: \"4b0e871e-0753-4434-9ea6-2d139f7766c8\") " pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:47:47.773904 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:47.773583    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:47.773904 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:47.773666    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs podName:4b0e871e-0753-4434-9ea6-2d139f7766c8 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:55.773628027 +0000 UTC m=+18.187147391 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs") pod "network-metrics-daemon-2dkkl" (UID: "4b0e871e-0753-4434-9ea6-2d139f7766c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:47.874161 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:47.874122    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7kp\" (UniqueName: \"kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp\") pod \"network-check-target-q5jgp\" (UID: \"e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e\") " pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:47:47.874327 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:47.874292    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 01:47:47.874368 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:47.874335    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 01:47:47.874368 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:47.874349    2582 projected.go:194] Error preparing data for projected volume kube-api-access-jl7kp for pod openshift-network-diagnostics/network-check-target-q5jgp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:47.874424 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:47.874405    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp podName:e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e nodeName:}" failed. No retries permitted until 2026-05-21 01:47:55.874385864 +0000 UTC m=+18.287905229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jl7kp" (UniqueName: "kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp") pod "network-check-target-q5jgp" (UID: "e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:48.232989 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:48.232957    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:48.233182 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:48.233067    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r25km" podUID="e4d14bdc-b170-419a-8e48-a9b89dc283c3"
May 21 01:47:48.233182 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:48.233145    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:47:48.233288 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:48.233236    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkkl" podUID="4b0e871e-0753-4434-9ea6-2d139f7766c8"
May 21 01:47:49.232769 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:49.232265    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:47:49.232769 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:49.232394    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5jgp" podUID="e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e"
May 21 01:47:50.232031 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:50.231994    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:50.232240 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:50.231994    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:47:50.232240 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:50.232143    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r25km" podUID="e4d14bdc-b170-419a-8e48-a9b89dc283c3"
May 21 01:47:50.232357 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:50.232246    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkkl" podUID="4b0e871e-0753-4434-9ea6-2d139f7766c8"
May 21 01:47:50.493018 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:50.492937    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret\") pod \"global-pull-secret-syncer-r25km\" (UID: \"e4d14bdc-b170-419a-8e48-a9b89dc283c3\") " pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:50.493408 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:50.493057    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 01:47:50.493408 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:50.493124    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret podName:e4d14bdc-b170-419a-8e48-a9b89dc283c3 nodeName:}" failed. No retries permitted until 2026-05-21 01:47:58.493105976 +0000 UTC m=+20.906625336 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret") pod "global-pull-secret-syncer-r25km" (UID: "e4d14bdc-b170-419a-8e48-a9b89dc283c3") : object "kube-system"/"original-pull-secret" not registered
May 21 01:47:51.232411 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:51.232367    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:47:51.232561 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:51.232504    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5jgp" podUID="e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e"
May 21 01:47:52.232452 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:52.232410    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:52.232910 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:52.232459    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:47:52.232910 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:52.232537    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r25km" podUID="e4d14bdc-b170-419a-8e48-a9b89dc283c3"
May 21 01:47:52.232910 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:52.232724    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkkl" podUID="4b0e871e-0753-4434-9ea6-2d139f7766c8"
May 21 01:47:53.231974 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:53.231933    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:47:53.232203 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:53.232058    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5jgp" podUID="e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e"
May 21 01:47:54.232379 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:54.232331    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:47:54.232905 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:54.232493    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkkl" podUID="4b0e871e-0753-4434-9ea6-2d139f7766c8"
May 21 01:47:54.232905 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:54.232348    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:54.233010 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:54.232968    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r25km" podUID="e4d14bdc-b170-419a-8e48-a9b89dc283c3"
May 21 01:47:55.232015 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:55.231974    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:47:55.232206 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:55.232102    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5jgp" podUID="e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e"
May 21 01:47:55.827615 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:55.827575    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs\") pod \"network-metrics-daemon-2dkkl\" (UID: \"4b0e871e-0753-4434-9ea6-2d139f7766c8\") " pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:47:55.828077 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:55.827760    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:55.828077 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:55.827827    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs podName:4b0e871e-0753-4434-9ea6-2d139f7766c8 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:11.827811088 +0000 UTC m=+34.241330446 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs") pod "network-metrics-daemon-2dkkl" (UID: "4b0e871e-0753-4434-9ea6-2d139f7766c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:47:55.928672 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:55.928616    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7kp\" (UniqueName: \"kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp\") pod \"network-check-target-q5jgp\" (UID: \"e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e\") " pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:47:55.928823 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:55.928798    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 01:47:55.928823 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:55.928820    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 01:47:55.928920 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:55.928835    2582 projected.go:194] Error preparing data for projected volume kube-api-access-jl7kp for pod openshift-network-diagnostics/network-check-target-q5jgp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:55.928920 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:55.928903    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp podName:e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e nodeName:}" failed. No retries permitted until 2026-05-21 01:48:11.92888191 +0000 UTC m=+34.342401269 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jl7kp" (UniqueName: "kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp") pod "network-check-target-q5jgp" (UID: "e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:47:56.232451 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:56.232415    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:47:56.232451 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:56.232458    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:56.232702 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:56.232564    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkkl" podUID="4b0e871e-0753-4434-9ea6-2d139f7766c8"
May 21 01:47:56.232702 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:56.232682    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r25km" podUID="e4d14bdc-b170-419a-8e48-a9b89dc283c3"
May 21 01:47:57.232058 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:57.232021    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:47:57.232495 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:57.232146    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5jgp" podUID="e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e"
May 21 01:47:58.233541 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:58.233508    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:47:58.233963 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:58.233660    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkkl" podUID="4b0e871e-0753-4434-9ea6-2d139f7766c8"
May 21 01:47:58.233963 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:58.233668    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:58.233963 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:58.233752    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r25km" podUID="e4d14bdc-b170-419a-8e48-a9b89dc283c3"
May 21 01:47:58.548276 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:58.548199    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret\") pod \"global-pull-secret-syncer-r25km\" (UID: \"e4d14bdc-b170-419a-8e48-a9b89dc283c3\") " pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:47:58.548424 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:58.548372    2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 21 01:47:58.548481 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:58.548455    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret podName:e4d14bdc-b170-419a-8e48-a9b89dc283c3 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:14.548431482 +0000 UTC m=+36.961950847 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret") pod "global-pull-secret-syncer-r25km" (UID: "e4d14bdc-b170-419a-8e48-a9b89dc283c3") : object "kube-system"/"original-pull-secret" not registered
May 21 01:47:59.232544 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:47:59.232516    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:47:59.232708 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:47:59.232618    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5jgp" podUID="e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e"
May 21 01:48:00.232907 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.232547    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:48:00.233746 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:00.233021    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkkl" podUID="4b0e871e-0753-4434-9ea6-2d139f7766c8"
May 21 01:48:00.233746 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.232656    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:48:00.233746 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:00.233456    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r25km" podUID="e4d14bdc-b170-419a-8e48-a9b89dc283c3"
May 21 01:48:00.314669 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.314614    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9sznz" event={"ID":"68604f4f-7500-4121-8b89-95705dc8444e","Type":"ContainerStarted","Data":"91d16cba50d777060505a1dcbbfab146763fa659a1c907e462110c07a3aa28b7"}
May 21 01:48:00.316211 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.316179    2582 generic.go:358] "Generic (PLEG): container finished" podID="6cdb6843-4726-44d1-a4e2-a85ff70dd595" containerID="6b003c6472435d0e2e2cde13143d03c5cf8590cdc91512ccc14484030c47743f" exitCode=0
May 21 01:48:00.316367 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.316260    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7gzt5" event={"ID":"6cdb6843-4726-44d1-a4e2-a85ff70dd595","Type":"ContainerDied","Data":"6b003c6472435d0e2e2cde13143d03c5cf8590cdc91512ccc14484030c47743f"}
May 21 01:48:00.318174 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.318124    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-v9n7p" event={"ID":"80d874e6-8977-4487-8559-364f023d087c","Type":"ContainerStarted","Data":"bbead00cc50f4b82c8661ed7506c4092315d68548b478a378721b305b60f43bc"}
May 21 01:48:00.321064 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.321044    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/ovn-acl-logging/0.log"
May 21 01:48:00.321425 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.321406    2582 generic.go:358] "Generic (PLEG): container finished" podID="97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a" containerID="33d32ecc833b54fef745da12f9fd2e3f68e2e2e3dd37b75ad4508734e86d7cc4" exitCode=1
May 21 01:48:00.321559 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.321475    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc" event={"ID":"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a","Type":"ContainerStarted","Data":"f232a74732a5d603da9701434062df37805ac95377a825d15a3c59cc11945efd"}
May 21 01:48:00.321559 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.321511    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc" event={"ID":"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a","Type":"ContainerStarted","Data":"8cc1768f17be573cc3c54ff044831732a141d30318374642fca963f5a596844b"}
May 21 01:48:00.321559 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.321526    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc" event={"ID":"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a","Type":"ContainerStarted","Data":"9214b56dd4254192d35ae61f6a88811995f629420b1c7325c0a198b2904ade82"}
May 21 01:48:00.321559 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.321538    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc" event={"ID":"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a","Type":"ContainerStarted","Data":"e6bc480b29c6cbd233e424863a0e5e8b20f3012c9033e17a9edd920445c70073"}
May 21 01:48:00.321559 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.321549    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc" event={"ID":"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a","Type":"ContainerDied","Data":"33d32ecc833b54fef745da12f9fd2e3f68e2e2e3dd37b75ad4508734e86d7cc4"}
May 21 01:48:00.321799 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.321563    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc" event={"ID":"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a","Type":"ContainerStarted","Data":"034adbe03f0be13e21a663a1be7f0c9c12943c505c70f6ba68ffd510fcc0127f"}
May 21 01:48:00.322936 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.322912    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5" event={"ID":"a845f37d-9eee-4e51-9334-f91b085d92a9","Type":"ContainerStarted","Data":"18f97a40d42008caaccdf60f9ba03d4bc44029390e9f2cc53c4d0db8fd952156"}
May 21 01:48:00.324552 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.324518    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-kl7mq" event={"ID":"0e6bc807-e178-4d74-b81f-03d96b556cd6","Type":"ContainerStarted","Data":"4bbf3e85c01cf78bc911325506b39cff18eb86838a33fd2a46c2025e52af9601"}
May 21 01:48:00.326131 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.326111    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-l52ds" event={"ID":"55dff604-dfbc-40e7-8bfc-2a63dc376b02","Type":"ContainerStarted","Data":"3f582cb1887bb57b755aec52a675bbfc5bbc788973a676b0553819a3066ea301"}
May 21 01:48:00.327444 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.327422    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-r5gk9" event={"ID":"77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1","Type":"ContainerStarted","Data":"173911319a9623354648b035d8e5e3c7883df70c1e8301cdb5832e52af89056f"}
May 21 01:48:00.331464 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.331432    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-167.ec2.internal" podStartSLOduration=21.331421835 podStartE2EDuration="21.331421835s" podCreationTimestamp="2026-05-21 01:47:39 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:47:43.306716039 +0000 UTC m=+5.720235423" watchObservedRunningTime="2026-05-21 01:48:00.331421835 +0000 UTC m=+22.744941215"
May 21 01:48:00.331744 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.331717    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9sznz" podStartSLOduration=3.855530521 podStartE2EDuration="22.331709742s" podCreationTimestamp="2026-05-21 01:47:38 +0000 UTC" firstStartedPulling="2026-05-21 01:47:40.949709603 +0000 UTC m=+3.363228978" lastFinishedPulling="2026-05-21 01:47:59.42588882 +0000 UTC m=+21.839408199" observedRunningTime="2026-05-21 01:48:00.331325492 +0000 UTC m=+22.744844874" watchObservedRunningTime="2026-05-21 01:48:00.331709742 +0000 UTC m=+22.745229124"
May 21 01:48:00.345182 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.345121    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-kl7mq" podStartSLOduration=4.103664333 podStartE2EDuration="22.345111335s" podCreationTimestamp="2026-05-21 01:47:38 +0000 UTC" firstStartedPulling="2026-05-21 01:47:40.944422792 +0000 UTC m=+3.357942151" lastFinishedPulling="2026-05-21 01:47:59.185869782 +0000 UTC m=+21.599389153" observedRunningTime="2026-05-21 01:48:00.34467709 +0000 UTC m=+22.758196470" watchObservedRunningTime="2026-05-21 01:48:00.345111335 +0000 UTC m=+22.758630716"
May 21 01:48:00.358380 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.358317    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-r5gk9" podStartSLOduration=4.093151086 podStartE2EDuration="22.358305418s" podCreationTimestamp="2026-05-21 01:47:38 +0000 UTC" firstStartedPulling="2026-05-21 01:47:40.920711498 +0000 UTC m=+3.334230864" lastFinishedPulling="2026-05-21 01:47:59.185865838 +0000 UTC m=+21.599385196" observedRunningTime="2026-05-21 01:48:00.35817753 +0000 UTC m=+22.771696913" watchObservedRunningTime="2026-05-21 01:48:00.358305418 +0000 UTC m=+22.771824798"
May 21 01:48:00.374396 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.374312    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-l52ds" podStartSLOduration=3.891257489 podStartE2EDuration="22.374296793s" podCreationTimestamp="2026-05-21 01:47:38 +0000 UTC" firstStartedPulling="2026-05-21 01:47:40.944408756 +0000 UTC m=+3.357928114" lastFinishedPulling="2026-05-21 01:47:59.427448048 +0000 UTC m=+21.840967418" observedRunningTime="2026-05-21 01:48:00.374257396 +0000 UTC m=+22.787776777" watchObservedRunningTime="2026-05-21 01:48:00.374296793 +0000 UTC m=+22.787816189"
May 21 01:48:00.386825 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:00.386780    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-v9n7p" podStartSLOduration=3.904538178 podStartE2EDuration="22.386767094s" podCreationTimestamp="2026-05-21 01:47:38 +0000 UTC" firstStartedPulling="2026-05-21 01:47:40.944517467 +0000 UTC m=+3.358036826" lastFinishedPulling="2026-05-21 01:47:59.42674637 +0000 UTC m=+21.840265742" observedRunningTime="2026-05-21 01:48:00.386431754 +0000 UTC m=+22.799951134" watchObservedRunningTime="2026-05-21 01:48:00.386767094 +0000 UTC m=+22.800286471"
May 21 01:48:01.109294 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:01.109266    2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 21 01:48:01.167829 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:01.167671    2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-21T01:48:01.109286673Z","UUID":"34a93d47-eb9a-4729-bae7-165ff54efcb6","Handler":null,"Name":"","Endpoint":""}
May 21 01:48:01.169706 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:01.169684    2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 21 01:48:01.169845 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:01.169715    2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 21 01:48:01.232493 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:01.232454    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:48:01.232687 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:01.232593    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5jgp" podUID="e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e"
May 21 01:48:01.331049 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:01.331017    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-snxsq" event={"ID":"bc9c0ad2-90b8-4733-9d0a-353df57696f3","Type":"ContainerStarted","Data":"a0d9a68efe052fc26fa473ae63ed7ad658d45a11e7fcf6b0059a45d499d92f27"}
May 21 01:48:01.333001 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:01.332962    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5" event={"ID":"a845f37d-9eee-4e51-9334-f91b085d92a9","Type":"ContainerStarted","Data":"f2d2d31c0052aec234e3fb1f5b54ab300b3c26b6eada62ab7e0eee432763c5f0"}
May 21 01:48:01.344473 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:01.344432    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-snxsq" podStartSLOduration=4.843016659 podStartE2EDuration="23.344419009s" podCreationTimestamp="2026-05-21 01:47:38 +0000 UTC" firstStartedPulling="2026-05-21 01:47:40.9228171 +0000 UTC m=+3.336336462" lastFinishedPulling="2026-05-21 01:47:59.424219432 +0000 UTC m=+21.837738812" observedRunningTime="2026-05-21 01:48:01.344395823 +0000 UTC m=+23.757915256" watchObservedRunningTime="2026-05-21 01:48:01.344419009 +0000 UTC m=+23.757938429"
May 21 01:48:02.232322 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:02.232277    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:48:02.232499 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:02.232276    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:48:02.232499 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:02.232434    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkkl" podUID="4b0e871e-0753-4434-9ea6-2d139f7766c8"
May 21 01:48:02.232581 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:02.232512    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r25km" podUID="e4d14bdc-b170-419a-8e48-a9b89dc283c3"
May 21 01:48:03.232467 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:03.232271    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:48:03.232926 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:03.232570    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5jgp" podUID="e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e"
May 21 01:48:03.350917 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:03.350888    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/ovn-acl-logging/0.log"
May 21 01:48:03.351281 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:03.351248    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc" event={"ID":"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a","Type":"ContainerStarted","Data":"77f23ebe954efb472a1c711d4ae6115270d8de9cd06ec0ecf54bad3c038fe151"}
May 21 01:48:03.353077 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:03.353050    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5" event={"ID":"a845f37d-9eee-4e51-9334-f91b085d92a9","Type":"ContainerStarted","Data":"848ed510b2755595d38664d86af42b7870f56a0ea3a463c9fabdb8dc7a75e241"}
May 21 01:48:03.369643 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:03.369598    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tlht5" podStartSLOduration=4.037337903 podStartE2EDuration="25.369584174s" podCreationTimestamp="2026-05-21 01:47:38 +0000 UTC" firstStartedPulling="2026-05-21 01:47:40.949710228 +0000 UTC m=+3.363229601" lastFinishedPulling="2026-05-21 01:48:02.281956512 +0000 UTC m=+24.695475872" observedRunningTime="2026-05-21 01:48:03.368882247 +0000 UTC m=+25.782401628" watchObservedRunningTime="2026-05-21 01:48:03.369584174 +0000 UTC m=+25.783103560"
May 21 01:48:03.795324 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:03.794801    2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-kl7mq"
May 21 01:48:03.795489 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:03.795376    2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-kl7mq"
May 21 01:48:04.232253 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:04.232222    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:48:04.232446 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:04.232222    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:48:04.232446 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:04.232349    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkkl" podUID="4b0e871e-0753-4434-9ea6-2d139f7766c8"
May 21 01:48:04.232932 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:04.232437    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r25km" podUID="e4d14bdc-b170-419a-8e48-a9b89dc283c3"
May 21 01:48:04.355367 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:04.355333    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-kl7mq"
May 21 01:48:04.355702 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:04.355681    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-kl7mq"
May 21 01:48:05.232417 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:05.232205    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:48:05.232677 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:05.232501    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5jgp" podUID="e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e"
May 21 01:48:05.359594 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:05.359561    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/ovn-acl-logging/0.log"
May 21 01:48:05.359922 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:05.359889    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc" event={"ID":"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a","Type":"ContainerStarted","Data":"6e6b5b3f64aa94b660683623e43a60618ed2792497c263ef3f4f7c6061d92e04"}
May 21 01:48:05.360340 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:05.360321    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:48:05.360483 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:05.360464    2582 scope.go:117] "RemoveContainer" containerID="33d32ecc833b54fef745da12f9fd2e3f68e2e2e3dd37b75ad4508734e86d7cc4"
May 21 01:48:05.361492 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:05.361463    2582 generic.go:358] "Generic (PLEG): container finished" podID="6cdb6843-4726-44d1-a4e2-a85ff70dd595" containerID="7961104febaae07df2e120813c0de76262d3a30b94dc1008cce6d5db83da11b5" exitCode=0
May 21 01:48:05.361578 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:05.361531    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7gzt5" event={"ID":"6cdb6843-4726-44d1-a4e2-a85ff70dd595","Type":"ContainerDied","Data":"7961104febaae07df2e120813c0de76262d3a30b94dc1008cce6d5db83da11b5"}
May 21 01:48:05.378651 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:05.378613    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:48:06.232622 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:06.232575    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:48:06.232622 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:06.232614    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:48:06.233076 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:06.232717    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r25km" podUID="e4d14bdc-b170-419a-8e48-a9b89dc283c3"
May 21 01:48:06.233076 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:06.232847    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkkl" podUID="4b0e871e-0753-4434-9ea6-2d139f7766c8"
May 21 01:48:06.365515 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:06.365481    2582 generic.go:358] "Generic (PLEG): container finished" podID="6cdb6843-4726-44d1-a4e2-a85ff70dd595" containerID="8cf1b38626f79a898d637637622af82facee9dbca04398a503730b2c22d3efef" exitCode=0
May 21 01:48:06.365698 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:06.365575    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7gzt5" event={"ID":"6cdb6843-4726-44d1-a4e2-a85ff70dd595","Type":"ContainerDied","Data":"8cf1b38626f79a898d637637622af82facee9dbca04398a503730b2c22d3efef"}
May 21 01:48:06.368975 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:06.368957    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/ovn-acl-logging/0.log"
May 21 01:48:06.371450 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:06.371415    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc" event={"ID":"97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a","Type":"ContainerStarted","Data":"453ccd1251a0c3374f82e4b1e34da8038281df1655d52628e1d332c8c1f1ab3d"}
May 21 01:48:06.372202 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:06.371692    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:48:06.372202 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:06.371900    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:48:06.387758 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:06.387726    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:48:06.413626 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:06.413524    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc" podStartSLOduration=9.86360666 podStartE2EDuration="28.41350976s" podCreationTimestamp="2026-05-21 01:47:38 +0000 UTC" firstStartedPulling="2026-05-21 01:47:40.919233725 +0000 UTC m=+3.332753084" lastFinishedPulling="2026-05-21 01:47:59.46913682 +0000 UTC m=+21.882656184" observedRunningTime="2026-05-21 01:48:06.411710872 +0000 UTC m=+28.825230257" watchObservedRunningTime="2026-05-21 01:48:06.41350976 +0000 UTC m=+28.827029175"
May 21 01:48:06.456502 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:06.456461    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r25km"]
May 21 01:48:06.456672 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:06.456592    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:48:06.456751 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:06.456715    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r25km" podUID="e4d14bdc-b170-419a-8e48-a9b89dc283c3"
May 21 01:48:06.459178 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:06.459153    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2dkkl"]
May 21 01:48:06.459312 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:06.459245    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:48:06.459368 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:06.459318    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkkl" podUID="4b0e871e-0753-4434-9ea6-2d139f7766c8"
May 21 01:48:06.466735 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:06.466711    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q5jgp"]
May 21 01:48:06.466829 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:06.466802    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:48:06.466887 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:06.466871    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5jgp" podUID="e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e"
May 21 01:48:07.373193 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:07.372936    2582 generic.go:358] "Generic (PLEG): container finished" podID="6cdb6843-4726-44d1-a4e2-a85ff70dd595" containerID="702e71d4180d99806263b8b11d0c7c5a3fc44286ad7beec66e401b0c213f2809" exitCode=0
May 21 01:48:07.373529 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:07.373024    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7gzt5" event={"ID":"6cdb6843-4726-44d1-a4e2-a85ff70dd595","Type":"ContainerDied","Data":"702e71d4180d99806263b8b11d0c7c5a3fc44286ad7beec66e401b0c213f2809"}
May 21 01:48:08.233431 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:08.233386    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:48:08.233618 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:08.233499    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r25km" podUID="e4d14bdc-b170-419a-8e48-a9b89dc283c3"
May 21 01:48:08.233618 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:08.233592    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:48:08.233754 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:08.233731    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:48:08.233804 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:08.233781    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkkl" podUID="4b0e871e-0753-4434-9ea6-2d139f7766c8"
May 21 01:48:08.233853 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:08.233808    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5jgp" podUID="e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e"
May 21 01:48:10.231742 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:10.231706    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:48:10.232395 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:10.231745    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:48:10.232395 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:10.231842    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkkl" podUID="4b0e871e-0753-4434-9ea6-2d139f7766c8"
May 21 01:48:10.232395 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:10.231879    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:48:10.232395 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:10.231967    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5jgp" podUID="e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e"
May 21 01:48:10.232395 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:10.232051    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r25km" podUID="e4d14bdc-b170-419a-8e48-a9b89dc283c3"
May 21 01:48:11.850820 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:11.850778    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs\") pod \"network-metrics-daemon-2dkkl\" (UID: \"4b0e871e-0753-4434-9ea6-2d139f7766c8\") " pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:48:11.851242 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:11.850960    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:48:11.851242 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:11.851048    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs podName:4b0e871e-0753-4434-9ea6-2d139f7766c8 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:43.851010943 +0000 UTC m=+66.264530320 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs") pod "network-metrics-daemon-2dkkl" (UID: "4b0e871e-0753-4434-9ea6-2d139f7766c8") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 21 01:48:11.951846 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:11.951802    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7kp\" (UniqueName: \"kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp\") pod \"network-check-target-q5jgp\" (UID: \"e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e\") " pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:48:11.952024 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:11.951992    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 21 01:48:11.952024 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:11.952010    2582 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 21 01:48:11.952024 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:11.952022    2582 projected.go:194] Error preparing data for projected volume kube-api-access-jl7kp for pod openshift-network-diagnostics/network-check-target-q5jgp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:48:11.952171 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:11.952086    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp podName:e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e nodeName:}" failed. No retries permitted until 2026-05-21 01:48:43.952070939 +0000 UTC m=+66.365590301 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jl7kp" (UniqueName: "kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp") pod "network-check-target-q5jgp" (UID: "e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 21 01:48:12.232080 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.232045    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:48:12.232314 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.232045    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:48:12.232314 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:12.232172    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r25km" podUID="e4d14bdc-b170-419a-8e48-a9b89dc283c3"
May 21 01:48:12.232314 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:12.232269    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2dkkl" podUID="4b0e871e-0753-4434-9ea6-2d139f7766c8"
May 21 01:48:12.233477 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.233455    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:48:12.233591 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:12.233573    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-q5jgp" podUID="e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e"
May 21 01:48:12.428244 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.428211    2582 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-129-167.ec2.internal" event="NodeReady"
May 21 01:48:12.428498 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.428356    2582 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 21 01:48:12.467850 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.467817    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-bkvlq"]
May 21 01:48:12.501542 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.501464    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dnsw7"]
May 21 01:48:12.501706 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.501676    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bkvlq"
May 21 01:48:12.504596 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.504429    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 21 01:48:12.504596 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.504494    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 21 01:48:12.504596 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.504504    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qjjsz\""
May 21 01:48:12.517967 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.517944    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bkvlq"]
May 21 01:48:12.517967 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.517971    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dnsw7"]
May 21 01:48:12.518137 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.518100    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dnsw7"
May 21 01:48:12.520677 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.520628    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bvhf9\""
May 21 01:48:12.520973 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.520941    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 21 01:48:12.521080 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.520985    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 21 01:48:12.521080 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.520949    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 21 01:48:12.656983 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.656926    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db15baee-ec33-43bc-a10d-681ec1ddaf48-config-volume\") pod \"dns-default-bkvlq\" (UID: \"db15baee-ec33-43bc-a10d-681ec1ddaf48\") " pod="openshift-dns/dns-default-bkvlq"
May 21 01:48:12.656983 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.656968    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert\") pod \"ingress-canary-dnsw7\" (UID: \"815f1db1-cfdb-4f49-a288-6cc22596f870\") " pod="openshift-ingress-canary/ingress-canary-dnsw7"
May 21 01:48:12.657219 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.656996    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8hzz\" (UniqueName: \"kubernetes.io/projected/815f1db1-cfdb-4f49-a288-6cc22596f870-kube-api-access-x8hzz\") pod \"ingress-canary-dnsw7\" (UID: \"815f1db1-cfdb-4f49-a288-6cc22596f870\") " pod="openshift-ingress-canary/ingress-canary-dnsw7"
May 21 01:48:12.657219 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.657020    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls\") pod \"dns-default-bkvlq\" (UID: \"db15baee-ec33-43bc-a10d-681ec1ddaf48\") " pod="openshift-dns/dns-default-bkvlq"
May 21 01:48:12.657219 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.657067    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w67p6\" (UniqueName: \"kubernetes.io/projected/db15baee-ec33-43bc-a10d-681ec1ddaf48-kube-api-access-w67p6\") pod \"dns-default-bkvlq\" (UID: \"db15baee-ec33-43bc-a10d-681ec1ddaf48\") " pod="openshift-dns/dns-default-bkvlq"
May 21 01:48:12.657351 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.657222    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db15baee-ec33-43bc-a10d-681ec1ddaf48-tmp-dir\") pod \"dns-default-bkvlq\" (UID: \"db15baee-ec33-43bc-a10d-681ec1ddaf48\") " pod="openshift-dns/dns-default-bkvlq"
May 21 01:48:12.757946 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.757852    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db15baee-ec33-43bc-a10d-681ec1ddaf48-config-volume\") pod \"dns-default-bkvlq\" (UID: \"db15baee-ec33-43bc-a10d-681ec1ddaf48\") " pod="openshift-dns/dns-default-bkvlq"
May 21 01:48:12.757946 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.757906    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert\") pod \"ingress-canary-dnsw7\" (UID: \"815f1db1-cfdb-4f49-a288-6cc22596f870\") " pod="openshift-ingress-canary/ingress-canary-dnsw7"
May 21 01:48:12.757946 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.757931    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x8hzz\" (UniqueName: \"kubernetes.io/projected/815f1db1-cfdb-4f49-a288-6cc22596f870-kube-api-access-x8hzz\") pod \"ingress-canary-dnsw7\" (UID: \"815f1db1-cfdb-4f49-a288-6cc22596f870\") " pod="openshift-ingress-canary/ingress-canary-dnsw7"
May 21 01:48:12.758229 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.757953    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls\") pod \"dns-default-bkvlq\" (UID: \"db15baee-ec33-43bc-a10d-681ec1ddaf48\") " pod="openshift-dns/dns-default-bkvlq"
May 21 01:48:12.758229 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.757978    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w67p6\" (UniqueName: \"kubernetes.io/projected/db15baee-ec33-43bc-a10d-681ec1ddaf48-kube-api-access-w67p6\") pod \"dns-default-bkvlq\" (UID: \"db15baee-ec33-43bc-a10d-681ec1ddaf48\") " pod="openshift-dns/dns-default-bkvlq"
May 21 01:48:12.758229 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.758048    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db15baee-ec33-43bc-a10d-681ec1ddaf48-tmp-dir\") pod \"dns-default-bkvlq\" (UID: \"db15baee-ec33-43bc-a10d-681ec1ddaf48\") " pod="openshift-dns/dns-default-bkvlq"
May 21 01:48:12.758446 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.758425    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db15baee-ec33-43bc-a10d-681ec1ddaf48-tmp-dir\") pod \"dns-default-bkvlq\" (UID: \"db15baee-ec33-43bc-a10d-681ec1ddaf48\") " pod="openshift-dns/dns-default-bkvlq"
May 21 01:48:12.758938 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.758915    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/db15baee-ec33-43bc-a10d-681ec1ddaf48-config-volume\") pod \"dns-default-bkvlq\" (UID: \"db15baee-ec33-43bc-a10d-681ec1ddaf48\") " pod="openshift-dns/dns-default-bkvlq"
May 21 01:48:12.759037 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:12.759014    2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 01:48:12.759092 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:12.759066    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert podName:815f1db1-cfdb-4f49-a288-6cc22596f870 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:13.259053195 +0000 UTC m=+35.672572555 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert") pod "ingress-canary-dnsw7" (UID: "815f1db1-cfdb-4f49-a288-6cc22596f870") : secret "canary-serving-cert" not found
May 21 01:48:12.759389 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:12.759368    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 01:48:12.759490 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:12.759418    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls podName:db15baee-ec33-43bc-a10d-681ec1ddaf48 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:13.259402479 +0000 UTC m=+35.672921852 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls") pod "dns-default-bkvlq" (UID: "db15baee-ec33-43bc-a10d-681ec1ddaf48") : secret "dns-default-metrics-tls" not found
May 21 01:48:12.770839 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.770811    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w67p6\" (UniqueName: \"kubernetes.io/projected/db15baee-ec33-43bc-a10d-681ec1ddaf48-kube-api-access-w67p6\") pod \"dns-default-bkvlq\" (UID: \"db15baee-ec33-43bc-a10d-681ec1ddaf48\") " pod="openshift-dns/dns-default-bkvlq"
May 21 01:48:12.771211 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:12.771185    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8hzz\" (UniqueName: \"kubernetes.io/projected/815f1db1-cfdb-4f49-a288-6cc22596f870-kube-api-access-x8hzz\") pod \"ingress-canary-dnsw7\" (UID: \"815f1db1-cfdb-4f49-a288-6cc22596f870\") " pod="openshift-ingress-canary/ingress-canary-dnsw7"
May 21 01:48:13.262967 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:13.262927    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert\") pod \"ingress-canary-dnsw7\" (UID: \"815f1db1-cfdb-4f49-a288-6cc22596f870\") " pod="openshift-ingress-canary/ingress-canary-dnsw7"
May 21 01:48:13.263574 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:13.262974    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls\") pod \"dns-default-bkvlq\" (UID: \"db15baee-ec33-43bc-a10d-681ec1ddaf48\") " pod="openshift-dns/dns-default-bkvlq"
May 21 01:48:13.263574 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:13.263107    2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 01:48:13.263574 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:13.263133    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 01:48:13.263574 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:13.263186    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert podName:815f1db1-cfdb-4f49-a288-6cc22596f870 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:14.263165231 +0000 UTC m=+36.676684603 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert") pod "ingress-canary-dnsw7" (UID: "815f1db1-cfdb-4f49-a288-6cc22596f870") : secret "canary-serving-cert" not found
May 21 01:48:13.263574 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:13.263207    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls podName:db15baee-ec33-43bc-a10d-681ec1ddaf48 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:14.263196673 +0000 UTC m=+36.676716036 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls") pod "dns-default-bkvlq" (UID: "db15baee-ec33-43bc-a10d-681ec1ddaf48") : secret "dns-default-metrics-tls" not found
May 21 01:48:14.232794 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:14.232692    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:48:14.232794 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:14.232747    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:48:14.233072 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:14.232943    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:48:14.236930 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:14.236906    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 01:48:14.237076 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:14.236935    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8dzcp\""
May 21 01:48:14.237076 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:14.236943    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 01:48:14.237076 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:14.236956    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 21 01:48:14.237076 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:14.236911    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 01:48:14.237233 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:14.237169    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ng7kc\""
May 21 01:48:14.271550 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:14.271524    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert\") pod \"ingress-canary-dnsw7\" (UID: \"815f1db1-cfdb-4f49-a288-6cc22596f870\") " pod="openshift-ingress-canary/ingress-canary-dnsw7"
May 21 01:48:14.271876 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:14.271557    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls\") pod \"dns-default-bkvlq\" (UID: \"db15baee-ec33-43bc-a10d-681ec1ddaf48\") " pod="openshift-dns/dns-default-bkvlq"
May 21 01:48:14.271876 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:14.271681    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 01:48:14.271876 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:14.271686    2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 01:48:14.271876 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:14.271730    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls podName:db15baee-ec33-43bc-a10d-681ec1ddaf48 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:16.271716991 +0000 UTC m=+38.685236351 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls") pod "dns-default-bkvlq" (UID: "db15baee-ec33-43bc-a10d-681ec1ddaf48") : secret "dns-default-metrics-tls" not found
May 21 01:48:14.271876 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:14.271743    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert podName:815f1db1-cfdb-4f49-a288-6cc22596f870 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:16.271737004 +0000 UTC m=+38.685256363 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert") pod "ingress-canary-dnsw7" (UID: "815f1db1-cfdb-4f49-a288-6cc22596f870") : secret "canary-serving-cert" not found
May 21 01:48:14.387994 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:14.387961    2582 generic.go:358] "Generic (PLEG): container finished" podID="6cdb6843-4726-44d1-a4e2-a85ff70dd595" containerID="71dc3efd47b1ff906d0927d178eddc91ddb9a8614023846ef0ef784f15d9a55f" exitCode=0
May 21 01:48:14.388138 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:14.388026    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7gzt5" event={"ID":"6cdb6843-4726-44d1-a4e2-a85ff70dd595","Type":"ContainerDied","Data":"71dc3efd47b1ff906d0927d178eddc91ddb9a8614023846ef0ef784f15d9a55f"}
May 21 01:48:14.573916 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:14.573883    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret\") pod \"global-pull-secret-syncer-r25km\" (UID: \"e4d14bdc-b170-419a-8e48-a9b89dc283c3\") " pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:48:14.576233 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:14.576210    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e4d14bdc-b170-419a-8e48-a9b89dc283c3-original-pull-secret\") pod \"global-pull-secret-syncer-r25km\" (UID: \"e4d14bdc-b170-419a-8e48-a9b89dc283c3\") " pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:48:14.848199 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:14.848105    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r25km"
May 21 01:48:14.991599 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:14.991396    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r25km"]
May 21 01:48:14.996300 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:48:14.996270    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4d14bdc_b170_419a_8e48_a9b89dc283c3.slice/crio-20adedb963d9b5e6af6a1d040635edabf7fd137cd69c42027e1e131e3fbc4b8a WatchSource:0}: Error finding container 20adedb963d9b5e6af6a1d040635edabf7fd137cd69c42027e1e131e3fbc4b8a: Status 404 returned error can't find the container with id 20adedb963d9b5e6af6a1d040635edabf7fd137cd69c42027e1e131e3fbc4b8a
May 21 01:48:15.392483 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:15.392448    2582 generic.go:358] "Generic (PLEG): container finished" podID="6cdb6843-4726-44d1-a4e2-a85ff70dd595" containerID="7b89bb2e784f42bd0fc625f5a831466387f00f6ae32706e85d2c79a32bc14587" exitCode=0
May 21 01:48:15.392918 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:15.392530    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7gzt5" event={"ID":"6cdb6843-4726-44d1-a4e2-a85ff70dd595","Type":"ContainerDied","Data":"7b89bb2e784f42bd0fc625f5a831466387f00f6ae32706e85d2c79a32bc14587"}
May 21 01:48:15.393543 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:15.393512    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r25km" event={"ID":"e4d14bdc-b170-419a-8e48-a9b89dc283c3","Type":"ContainerStarted","Data":"20adedb963d9b5e6af6a1d040635edabf7fd137cd69c42027e1e131e3fbc4b8a"}
May 21 01:48:16.286686 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:16.286589    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert\") pod \"ingress-canary-dnsw7\" (UID: \"815f1db1-cfdb-4f49-a288-6cc22596f870\") " pod="openshift-ingress-canary/ingress-canary-dnsw7"
May 21 01:48:16.286686 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:16.286652    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls\") pod \"dns-default-bkvlq\" (UID: \"db15baee-ec33-43bc-a10d-681ec1ddaf48\") " pod="openshift-dns/dns-default-bkvlq"
May 21 01:48:16.286882 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:16.286759    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 01:48:16.286882 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:16.286758    2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 01:48:16.286882 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:16.286815    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls podName:db15baee-ec33-43bc-a10d-681ec1ddaf48 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:20.286801522 +0000 UTC m=+42.700320893 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls") pod "dns-default-bkvlq" (UID: "db15baee-ec33-43bc-a10d-681ec1ddaf48") : secret "dns-default-metrics-tls" not found
May 21 01:48:16.286882 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:16.286830    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert podName:815f1db1-cfdb-4f49-a288-6cc22596f870 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:20.286823414 +0000 UTC m=+42.700342773 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert") pod "ingress-canary-dnsw7" (UID: "815f1db1-cfdb-4f49-a288-6cc22596f870") : secret "canary-serving-cert" not found
May 21 01:48:16.398732 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:16.398679    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7gzt5" event={"ID":"6cdb6843-4726-44d1-a4e2-a85ff70dd595","Type":"ContainerStarted","Data":"9be107bac069ba7db844bc342d8358e5953e6700381b7fa27fcfd72cafba7228"}
May 21 01:48:16.419747 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:16.419610    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7gzt5" podStartSLOduration=5.726868443 podStartE2EDuration="38.419591882s" podCreationTimestamp="2026-05-21 01:47:38 +0000 UTC" firstStartedPulling="2026-05-21 01:47:40.949536158 +0000 UTC m=+3.363055517" lastFinishedPulling="2026-05-21 01:48:13.642259596 +0000 UTC m=+36.055778956" observedRunningTime="2026-05-21 01:48:16.417795078 +0000 UTC m=+38.831314488" watchObservedRunningTime="2026-05-21 01:48:16.419591882 +0000 UTC m=+38.833111264"
May 21 01:48:19.406895 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:19.406706    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r25km" event={"ID":"e4d14bdc-b170-419a-8e48-a9b89dc283c3","Type":"ContainerStarted","Data":"920c97bda64cbc8b71948944a593395d0f7da7cac5730a245ce0e25d6b94416b"}
May 21 01:48:19.421356 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:19.421311    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r25km" podStartSLOduration=33.395425132 podStartE2EDuration="37.421298048s" podCreationTimestamp="2026-05-21 01:47:42 +0000 UTC" firstStartedPulling="2026-05-21 01:48:14.998881778 +0000 UTC m=+37.412401137" lastFinishedPulling="2026-05-21 01:48:19.024754681 +0000 UTC m=+41.438274053" observedRunningTime="2026-05-21 01:48:19.420782751 +0000 UTC m=+41.834302132" watchObservedRunningTime="2026-05-21 01:48:19.421298048 +0000 UTC m=+41.834817445"
May 21 01:48:20.316894 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:20.316858    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert\") pod \"ingress-canary-dnsw7\" (UID: \"815f1db1-cfdb-4f49-a288-6cc22596f870\") " pod="openshift-ingress-canary/ingress-canary-dnsw7"
May 21 01:48:20.316894 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:20.316896    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls\") pod \"dns-default-bkvlq\" (UID: \"db15baee-ec33-43bc-a10d-681ec1ddaf48\") " pod="openshift-dns/dns-default-bkvlq"
May 21 01:48:20.317153 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:20.317014    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 01:48:20.317153 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:20.317032    2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 01:48:20.317153 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:20.317065    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls podName:db15baee-ec33-43bc-a10d-681ec1ddaf48 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:28.317052932 +0000 UTC m=+50.730572291 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls") pod "dns-default-bkvlq" (UID: "db15baee-ec33-43bc-a10d-681ec1ddaf48") : secret "dns-default-metrics-tls" not found
May 21 01:48:20.317153 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:20.317095    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert podName:815f1db1-cfdb-4f49-a288-6cc22596f870 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:28.317078624 +0000 UTC m=+50.730598090 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert") pod "ingress-canary-dnsw7" (UID: "815f1db1-cfdb-4f49-a288-6cc22596f870") : secret "canary-serving-cert" not found
May 21 01:48:28.373859 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:28.373815    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert\") pod \"ingress-canary-dnsw7\" (UID: \"815f1db1-cfdb-4f49-a288-6cc22596f870\") " pod="openshift-ingress-canary/ingress-canary-dnsw7"
May 21 01:48:28.373859 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:28.373865    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls\") pod \"dns-default-bkvlq\" (UID: \"db15baee-ec33-43bc-a10d-681ec1ddaf48\") " pod="openshift-dns/dns-default-bkvlq"
May 21 01:48:28.374403 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:28.373966    2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 01:48:28.374403 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:28.374021    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 01:48:28.374403 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:28.374030    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert podName:815f1db1-cfdb-4f49-a288-6cc22596f870 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:44.374014918 +0000 UTC m=+66.787534276 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert") pod "ingress-canary-dnsw7" (UID: "815f1db1-cfdb-4f49-a288-6cc22596f870") : secret "canary-serving-cert" not found
May 21 01:48:28.374403 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:28.374072    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls podName:db15baee-ec33-43bc-a10d-681ec1ddaf48 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:44.374055508 +0000 UTC m=+66.787574868 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls") pod "dns-default-bkvlq" (UID: "db15baee-ec33-43bc-a10d-681ec1ddaf48") : secret "dns-default-metrics-tls" not found
May 21 01:48:38.385957 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:38.385925    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-5ttwc"
May 21 01:48:43.882479 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.882445    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs\") pod \"network-metrics-daemon-2dkkl\" (UID: \"4b0e871e-0753-4434-9ea6-2d139f7766c8\") " pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:48:43.885652 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.885605    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 21 01:48:43.892702 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:43.892684    2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 21 01:48:43.892807 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:43.892755    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs podName:4b0e871e-0753-4434-9ea6-2d139f7766c8 nodeName:}" failed. No retries permitted until 2026-05-21 01:49:47.892732716 +0000 UTC m=+130.306252094 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs") pod "network-metrics-daemon-2dkkl" (UID: "4b0e871e-0753-4434-9ea6-2d139f7766c8") : secret "metrics-daemon-secret" not found
May 21 01:48:43.963075 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.963042    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc"]
May 21 01:48:43.975380 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.975353    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-8c88869c6-88w97"]
May 21 01:48:43.975547 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.975515    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc"
May 21 01:48:43.978069 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.978050    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 21 01:48:43.978526 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.978502    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 21 01:48:43.980757 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.980734    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 21 01:48:43.981068 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.981051    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 21 01:48:43.981142 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.981094    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-z7mm9\""
May 21 01:48:43.983060 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.982840    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7kp\" (UniqueName: \"kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp\") pod \"network-check-target-q5jgp\" (UID: \"e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e\") " pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:48:43.984830 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.984813    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc"]
May 21 01:48:43.984916 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.984835    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8c88869c6-88w97"]
May 21 01:48:43.984979 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.984918    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:43.985384 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.985360    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 21 01:48:43.987492 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.987473    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 21 01:48:43.987594 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.987501    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 21 01:48:43.987676 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.987655    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-b8jns\""
May 21 01:48:43.988145 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.988128    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 21 01:48:43.988252 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.988188    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 21 01:48:43.988252 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.988215    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 21 01:48:43.988252 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.988238    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 21 01:48:43.995093 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:43.995076    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 21 01:48:44.007116 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.007096    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl7kp\" (UniqueName: \"kubernetes.io/projected/e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e-kube-api-access-jl7kp\") pod \"network-check-target-q5jgp\" (UID: \"e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e\") " pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:48:44.064501 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.064472    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-b7flf"]
May 21 01:48:44.079826 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.079788    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-b9p2v"]
May 21 01:48:44.079992 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.079961    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-b7flf"
May 21 01:48:44.082877 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.082844    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
May 21 01:48:44.083021 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.082854    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
May 21 01:48:44.083021 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.082960    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
May 21 01:48:44.083128 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.083086    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-n6ftb\""
May 21 01:48:44.083128 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.083115    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-metrics-certs\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:44.083225 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.083148    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-service-ca-bundle\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:44.083225 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.083214    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/19175863-e76e-4995-ae22-76c7ca5e4651-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-9xcwc\" (UID: \"19175863-e76e-4995-ae22-76c7ca5e4651\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc"
May 21 01:48:44.083297 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.083274    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vpdp5\" (UniqueName: \"kubernetes.io/projected/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-kube-api-access-vpdp5\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:44.083334 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.083313    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
May 21 01:48:44.083366 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.083331    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9xcwc\" (UID: \"19175863-e76e-4995-ae22-76c7ca5e4651\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc"
May 21 01:48:44.083366 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.083355    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-stats-auth\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:44.083444 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.083375    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkm57\" (UniqueName: \"kubernetes.io/projected/19175863-e76e-4995-ae22-76c7ca5e4651-kube-api-access-fkm57\") pod \"cluster-monitoring-operator-6c75959455-9xcwc\" (UID: \"19175863-e76e-4995-ae22-76c7ca5e4651\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc"
May 21 01:48:44.083444 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.083407    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-default-certificate\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:44.088316 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.088289    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-b7flf"]
May 21 01:48:44.088462 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.088448    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-b9p2v"
May 21 01:48:44.091505 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.091481    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
May 21 01:48:44.091684 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.091664    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
May 21 01:48:44.091767 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.091752    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
May 21 01:48:44.091818 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.091795    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-ttdj7\""
May 21 01:48:44.091861 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.091752    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
May 21 01:48:44.094189 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.094162    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-b9p2v"]
May 21 01:48:44.183948 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.183856    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-service-ca-bundle\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:44.183948 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.183906    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a6b2b8d-5658-420b-bae0-d4f1778fd9fa-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-b7flf\" (UID: \"1a6b2b8d-5658-420b-bae0-d4f1778fd9fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-b7flf"
May 21 01:48:44.183948 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.183933    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a6b2b8d-5658-420b-bae0-d4f1778fd9fa-config\") pod \"kube-storage-version-migrator-operator-565644f49-b7flf\" (UID: \"1a6b2b8d-5658-420b-bae0-d4f1778fd9fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-b7flf"
May 21 01:48:44.184159 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.183956    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85vnc\" (UniqueName: \"kubernetes.io/projected/1a6b2b8d-5658-420b-bae0-d4f1778fd9fa-kube-api-access-85vnc\") pod \"kube-storage-version-migrator-operator-565644f49-b7flf\" (UID: \"1a6b2b8d-5658-420b-bae0-d4f1778fd9fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-b7flf"
May 21 01:48:44.184159 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.184013    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/19175863-e76e-4995-ae22-76c7ca5e4651-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-9xcwc\" (UID: \"19175863-e76e-4995-ae22-76c7ca5e4651\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc"
May 21 01:48:44.184159 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:44.184042    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-service-ca-bundle podName:c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f nodeName:}" failed. No retries permitted until 2026-05-21 01:48:44.684022361 +0000 UTC m=+67.097541743 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-service-ca-bundle") pod "router-default-8c88869c6-88w97" (UID: "c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f") : configmap references non-existent config key: service-ca.crt
May 21 01:48:44.184159 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.184123    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vpdp5\" (UniqueName: \"kubernetes.io/projected/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-kube-api-access-vpdp5\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:44.184362 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.184161    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9xcwc\" (UID: \"19175863-e76e-4995-ae22-76c7ca5e4651\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc"
May 21 01:48:44.184362 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.184191    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-stats-auth\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:44.184362 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.184212    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fkm57\" (UniqueName: \"kubernetes.io/projected/19175863-e76e-4995-ae22-76c7ca5e4651-kube-api-access-fkm57\") pod \"cluster-monitoring-operator-6c75959455-9xcwc\" (UID: \"19175863-e76e-4995-ae22-76c7ca5e4651\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc"
May 21 01:48:44.184362 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.184229    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-default-certificate\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:44.184362 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.184258    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4px4\" (UniqueName: \"kubernetes.io/projected/ff098bfb-2c09-473a-a031-f90be46ed6fe-kube-api-access-l4px4\") pod \"service-ca-operator-57b5b68b8-b9p2v\" (UID: \"ff098bfb-2c09-473a-a031-f90be46ed6fe\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-b9p2v"
May 21 01:48:44.184362 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.184291    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff098bfb-2c09-473a-a031-f90be46ed6fe-config\") pod \"service-ca-operator-57b5b68b8-b9p2v\" (UID: \"ff098bfb-2c09-473a-a031-f90be46ed6fe\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-b9p2v"
May 21 01:48:44.184669 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.184362    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff098bfb-2c09-473a-a031-f90be46ed6fe-serving-cert\") pod \"service-ca-operator-57b5b68b8-b9p2v\" (UID: \"ff098bfb-2c09-473a-a031-f90be46ed6fe\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-b9p2v"
May 21 01:48:44.184669 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:44.184399    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 01:48:44.184669 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.184424    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-metrics-certs\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:44.184669 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:44.184480    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls podName:19175863-e76e-4995-ae22-76c7ca5e4651 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:44.684458478 +0000 UTC m=+67.097977848 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-9xcwc" (UID: "19175863-e76e-4995-ae22-76c7ca5e4651") : secret "cluster-monitoring-operator-tls" not found
May 21 01:48:44.184669 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:44.184566    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 01:48:44.184669 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:44.184663    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-metrics-certs podName:c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f nodeName:}" failed. No retries permitted until 2026-05-21 01:48:44.684623421 +0000 UTC m=+67.098142780 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-metrics-certs") pod "router-default-8c88869c6-88w97" (UID: "c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f") : secret "router-metrics-certs-default" not found
May 21 01:48:44.184950 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.184778    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/19175863-e76e-4995-ae22-76c7ca5e4651-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-9xcwc\" (UID: \"19175863-e76e-4995-ae22-76c7ca5e4651\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc"
May 21 01:48:44.186801 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.186780    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-stats-auth\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:44.186926 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.186857    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-default-certificate\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:44.192733 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.192713    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vpdp5\" (UniqueName: \"kubernetes.io/projected/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-kube-api-access-vpdp5\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:44.193117 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.193097    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkm57\" (UniqueName: \"kubernetes.io/projected/19175863-e76e-4995-ae22-76c7ca5e4651-kube-api-access-fkm57\") pod \"cluster-monitoring-operator-6c75959455-9xcwc\" (UID: \"19175863-e76e-4995-ae22-76c7ca5e4651\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc"
May 21 01:48:44.245432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.245408    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8dzcp\""
May 21 01:48:44.253377 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.253358    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:48:44.285314 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.285278    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l4px4\" (UniqueName: \"kubernetes.io/projected/ff098bfb-2c09-473a-a031-f90be46ed6fe-kube-api-access-l4px4\") pod \"service-ca-operator-57b5b68b8-b9p2v\" (UID: \"ff098bfb-2c09-473a-a031-f90be46ed6fe\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-b9p2v"
May 21 01:48:44.285477 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.285318    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff098bfb-2c09-473a-a031-f90be46ed6fe-config\") pod \"service-ca-operator-57b5b68b8-b9p2v\" (UID: \"ff098bfb-2c09-473a-a031-f90be46ed6fe\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-b9p2v"
May 21 01:48:44.285477 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.285351    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff098bfb-2c09-473a-a031-f90be46ed6fe-serving-cert\") pod \"service-ca-operator-57b5b68b8-b9p2v\" (UID: \"ff098bfb-2c09-473a-a031-f90be46ed6fe\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-b9p2v"
May 21 01:48:44.285477 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.285409    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a6b2b8d-5658-420b-bae0-d4f1778fd9fa-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-b7flf\" (UID: \"1a6b2b8d-5658-420b-bae0-d4f1778fd9fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-b7flf"
May 21 01:48:44.285477 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.285432    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a6b2b8d-5658-420b-bae0-d4f1778fd9fa-config\") pod \"kube-storage-version-migrator-operator-565644f49-b7flf\" (UID: \"1a6b2b8d-5658-420b-bae0-d4f1778fd9fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-b7flf"
May 21 01:48:44.285714 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.285569    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-85vnc\" (UniqueName: \"kubernetes.io/projected/1a6b2b8d-5658-420b-bae0-d4f1778fd9fa-kube-api-access-85vnc\") pod \"kube-storage-version-migrator-operator-565644f49-b7flf\" (UID: \"1a6b2b8d-5658-420b-bae0-d4f1778fd9fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-b7flf"
May 21 01:48:44.286020 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.285996    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ff098bfb-2c09-473a-a031-f90be46ed6fe-config\") pod \"service-ca-operator-57b5b68b8-b9p2v\" (UID: \"ff098bfb-2c09-473a-a031-f90be46ed6fe\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-b9p2v"
May 21 01:48:44.286020 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.286010    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1a6b2b8d-5658-420b-bae0-d4f1778fd9fa-config\") pod \"kube-storage-version-migrator-operator-565644f49-b7flf\" (UID: \"1a6b2b8d-5658-420b-bae0-d4f1778fd9fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-b7flf"
May 21 01:48:44.287787 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.287769    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1a6b2b8d-5658-420b-bae0-d4f1778fd9fa-serving-cert\") pod \"kube-storage-version-migrator-operator-565644f49-b7flf\" (UID: \"1a6b2b8d-5658-420b-bae0-d4f1778fd9fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-b7flf"
May 21 01:48:44.287873 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.287854    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ff098bfb-2c09-473a-a031-f90be46ed6fe-serving-cert\") pod \"service-ca-operator-57b5b68b8-b9p2v\" (UID: \"ff098bfb-2c09-473a-a031-f90be46ed6fe\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-b9p2v"
May 21 01:48:44.293081 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.293057    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85vnc\" (UniqueName: \"kubernetes.io/projected/1a6b2b8d-5658-420b-bae0-d4f1778fd9fa-kube-api-access-85vnc\") pod \"kube-storage-version-migrator-operator-565644f49-b7flf\" (UID: \"1a6b2b8d-5658-420b-bae0-d4f1778fd9fa\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-b7flf"
May 21 01:48:44.305223 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.305161    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4px4\" (UniqueName: \"kubernetes.io/projected/ff098bfb-2c09-473a-a031-f90be46ed6fe-kube-api-access-l4px4\") pod \"service-ca-operator-57b5b68b8-b9p2v\" (UID: \"ff098bfb-2c09-473a-a031-f90be46ed6fe\") " pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-b9p2v"
May 21 01:48:44.386867 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.386834    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert\") pod \"ingress-canary-dnsw7\" (UID: \"815f1db1-cfdb-4f49-a288-6cc22596f870\") " pod="openshift-ingress-canary/ingress-canary-dnsw7"
May 21 01:48:44.387043 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.386877    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls\") pod \"dns-default-bkvlq\" (UID: \"db15baee-ec33-43bc-a10d-681ec1ddaf48\") " pod="openshift-dns/dns-default-bkvlq"
May 21 01:48:44.387043 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:44.386991    2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 21 01:48:44.387043 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:44.386994    2582 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 21 01:48:44.387168 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:44.387064    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert podName:815f1db1-cfdb-4f49-a288-6cc22596f870 nodeName:}" failed. No retries permitted until 2026-05-21 01:49:16.387041384 +0000 UTC m=+98.800560744 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert") pod "ingress-canary-dnsw7" (UID: "815f1db1-cfdb-4f49-a288-6cc22596f870") : secret "canary-serving-cert" not found
May 21 01:48:44.387168 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:44.387086    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls podName:db15baee-ec33-43bc-a10d-681ec1ddaf48 nodeName:}" failed. No retries permitted until 2026-05-21 01:49:16.387076159 +0000 UTC m=+98.800595519 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls") pod "dns-default-bkvlq" (UID: "db15baee-ec33-43bc-a10d-681ec1ddaf48") : secret "dns-default-metrics-tls" not found
May 21 01:48:44.388988 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.388964    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-q5jgp"]
May 21 01:48:44.391025 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.391005    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-b7flf"
May 21 01:48:44.391866 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:48:44.391839    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2ac1cd3_15eb_4d37_bcbd_ef5956149f6e.slice/crio-09806f2fd3316225269214fa996c6d264242242582c3259fdce0a9f475d11314 WatchSource:0}: Error finding container 09806f2fd3316225269214fa996c6d264242242582c3259fdce0a9f475d11314: Status 404 returned error can't find the container with id 09806f2fd3316225269214fa996c6d264242242582c3259fdce0a9f475d11314
May 21 01:48:44.399440 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.399420    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-b9p2v"
May 21 01:48:44.455012 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.454956    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q5jgp" event={"ID":"e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e","Type":"ContainerStarted","Data":"09806f2fd3316225269214fa996c6d264242242582c3259fdce0a9f475d11314"}
May 21 01:48:44.519026 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.518991    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-b7flf"]
May 21 01:48:44.522146 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:48:44.522118    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a6b2b8d_5658_420b_bae0_d4f1778fd9fa.slice/crio-6a42535aa703919e81463902bd644f59b77d04981d009403525b9e14d59fb9f0 WatchSource:0}: Error finding container 6a42535aa703919e81463902bd644f59b77d04981d009403525b9e14d59fb9f0: Status 404 returned error can't find the container with id 6a42535aa703919e81463902bd644f59b77d04981d009403525b9e14d59fb9f0
May 21 01:48:44.533887 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.533866    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-57b5b68b8-b9p2v"]
May 21 01:48:44.537125 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:48:44.537095    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff098bfb_2c09_473a_a031_f90be46ed6fe.slice/crio-44944a40e96bbdd1854b2ce83eab436b3e237217983b90f1a5322e3f180e5944 WatchSource:0}: Error finding container 44944a40e96bbdd1854b2ce83eab436b3e237217983b90f1a5322e3f180e5944: Status 404 returned error can't find the container with id 44944a40e96bbdd1854b2ce83eab436b3e237217983b90f1a5322e3f180e5944
May 21 01:48:44.690271 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.690179    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-metrics-certs\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:44.690271 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.690224    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-service-ca-bundle\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:44.690443 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:44.690305    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9xcwc\" (UID: \"19175863-e76e-4995-ae22-76c7ca5e4651\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc"
May 21 01:48:44.690443 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:44.690336    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 01:48:44.690443 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:44.690390    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 01:48:44.690443 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:44.690403    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-metrics-certs podName:c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f nodeName:}" failed. No retries permitted until 2026-05-21 01:48:45.690388203 +0000 UTC m=+68.103907561 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-metrics-certs") pod "router-default-8c88869c6-88w97" (UID: "c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f") : secret "router-metrics-certs-default" not found
May 21 01:48:44.690443 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:44.690417    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-service-ca-bundle podName:c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f nodeName:}" failed. No retries permitted until 2026-05-21 01:48:45.690410708 +0000 UTC m=+68.103930067 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-service-ca-bundle") pod "router-default-8c88869c6-88w97" (UID: "c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f") : configmap references non-existent config key: service-ca.crt
May 21 01:48:44.690443 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:44.690432    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls podName:19175863-e76e-4995-ae22-76c7ca5e4651 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:45.69042128 +0000 UTC m=+68.103940639 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-9xcwc" (UID: "19175863-e76e-4995-ae22-76c7ca5e4651") : secret "cluster-monitoring-operator-tls" not found
May 21 01:48:45.459228 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:45.459095    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-b7flf" event={"ID":"1a6b2b8d-5658-420b-bae0-d4f1778fd9fa","Type":"ContainerStarted","Data":"6a42535aa703919e81463902bd644f59b77d04981d009403525b9e14d59fb9f0"}
May 21 01:48:45.460984 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:45.460950    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-b9p2v" event={"ID":"ff098bfb-2c09-473a-a031-f90be46ed6fe","Type":"ContainerStarted","Data":"44944a40e96bbdd1854b2ce83eab436b3e237217983b90f1a5322e3f180e5944"}
May 21 01:48:45.699537 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:45.699470    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9xcwc\" (UID: \"19175863-e76e-4995-ae22-76c7ca5e4651\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc"
May 21 01:48:45.699537 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:45.699534    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-metrics-certs\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:45.699828 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:45.699568    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-service-ca-bundle\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:45.699828 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:45.699764    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-service-ca-bundle podName:c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f nodeName:}" failed. No retries permitted until 2026-05-21 01:48:47.699745519 +0000 UTC m=+70.113264885 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-service-ca-bundle") pod "router-default-8c88869c6-88w97" (UID: "c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f") : configmap references non-existent config key: service-ca.crt
May 21 01:48:45.700222 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:45.700196    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 01:48:45.700315 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:45.700257    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls podName:19175863-e76e-4995-ae22-76c7ca5e4651 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:47.70024121 +0000 UTC m=+70.113760574 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-9xcwc" (UID: "19175863-e76e-4995-ae22-76c7ca5e4651") : secret "cluster-monitoring-operator-tls" not found
May 21 01:48:45.700385 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:45.700323    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 01:48:45.700385 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:45.700355    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-metrics-certs podName:c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f nodeName:}" failed. No retries permitted until 2026-05-21 01:48:47.700344277 +0000 UTC m=+70.113863640 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-metrics-certs") pod "router-default-8c88869c6-88w97" (UID: "c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f") : secret "router-metrics-certs-default" not found
May 21 01:48:47.713057 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:47.713019    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-metrics-certs\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:47.713057 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:47.713064    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-service-ca-bundle\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:47.713561 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:47.713175    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9xcwc\" (UID: \"19175863-e76e-4995-ae22-76c7ca5e4651\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc"
May 21 01:48:47.713561 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:47.713189    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 01:48:47.713561 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:47.713266    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-metrics-certs podName:c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f nodeName:}" failed. No retries permitted until 2026-05-21 01:48:51.713244754 +0000 UTC m=+74.126764117 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-metrics-certs") pod "router-default-8c88869c6-88w97" (UID: "c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f") : secret "router-metrics-certs-default" not found
May 21 01:48:47.713561 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:47.713271    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 01:48:47.713561 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:47.713285    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-service-ca-bundle podName:c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f nodeName:}" failed. No retries permitted until 2026-05-21 01:48:51.713275914 +0000 UTC m=+74.126795276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-service-ca-bundle") pod "router-default-8c88869c6-88w97" (UID: "c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f") : configmap references non-existent config key: service-ca.crt
May 21 01:48:47.713561 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:47.713307    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls podName:19175863-e76e-4995-ae22-76c7ca5e4651 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:51.713294887 +0000 UTC m=+74.126814246 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-9xcwc" (UID: "19175863-e76e-4995-ae22-76c7ca5e4651") : secret "cluster-monitoring-operator-tls" not found
May 21 01:48:48.468843 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:48.468804    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-q5jgp" event={"ID":"e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e","Type":"ContainerStarted","Data":"c17b650fd8154e376c001b3cf4796f17fcdbe4e311a9474807ae8b3cbc61d97e"}
May 21 01:48:48.469048 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:48.469038    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:48:48.470276 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:48.470251    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-b9p2v" event={"ID":"ff098bfb-2c09-473a-a031-f90be46ed6fe","Type":"ContainerStarted","Data":"b4ad2d68378927dc3b932bcac2187e3845fb8728ed3c26f20283aef34c4e9f67"}
May 21 01:48:48.471651 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:48.471608    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-b7flf" event={"ID":"1a6b2b8d-5658-420b-bae0-d4f1778fd9fa","Type":"ContainerStarted","Data":"a24a05d1f218a0e6144156faf16c0d441a13fa6212bed784c1a48b0144ba4691"}
May 21 01:48:48.482534 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:48.482461    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-q5jgp" podStartSLOduration=66.831973008 podStartE2EDuration="1m10.482446726s" podCreationTimestamp="2026-05-21 01:47:38 +0000 UTC" firstStartedPulling="2026-05-21 01:48:44.396319342 +0000 UTC m=+66.809838714" lastFinishedPulling="2026-05-21 01:48:48.046793064 +0000 UTC m=+70.460312432" observedRunningTime="2026-05-21 01:48:48.481979806 +0000 UTC m=+70.895499188" watchObservedRunningTime="2026-05-21 01:48:48.482446726 +0000 UTC m=+70.895966111"
May 21 01:48:48.496268 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:48.496210    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-b7flf" podStartSLOduration=0.986411098 podStartE2EDuration="4.496191658s" podCreationTimestamp="2026-05-21 01:48:44 +0000 UTC" firstStartedPulling="2026-05-21 01:48:44.524350449 +0000 UTC m=+66.937869808" lastFinishedPulling="2026-05-21 01:48:48.034131003 +0000 UTC m=+70.447650368" observedRunningTime="2026-05-21 01:48:48.495079412 +0000 UTC m=+70.908598794" watchObservedRunningTime="2026-05-21 01:48:48.496191658 +0000 UTC m=+70.909711041"
May 21 01:48:48.512918 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:48.512871    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-b9p2v" podStartSLOduration=1.021900309 podStartE2EDuration="4.512855999s" podCreationTimestamp="2026-05-21 01:48:44 +0000 UTC" firstStartedPulling="2026-05-21 01:48:44.538962829 +0000 UTC m=+66.952482189" lastFinishedPulling="2026-05-21 01:48:48.029918518 +0000 UTC m=+70.443437879" observedRunningTime="2026-05-21 01:48:48.512566034 +0000 UTC m=+70.926085415" watchObservedRunningTime="2026-05-21 01:48:48.512855999 +0000 UTC m=+70.926375384"
May 21 01:48:49.051691 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:49.051655    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-qtrfm"]
May 21 01:48:49.054736 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:49.054718    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qtrfm"
May 21 01:48:49.057139 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:49.057122    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
May 21 01:48:49.058271 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:49.058255    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
May 21 01:48:49.058347 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:49.058257    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-2tllm\""
May 21 01:48:49.063111 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:49.063088    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-qtrfm"]
May 21 01:48:49.124241 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:49.124202    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2jdp2\" (UniqueName: \"kubernetes.io/projected/f8d911b6-4332-43e4-8dcf-817195087d3c-kube-api-access-2jdp2\") pod \"migrator-b985f5d89-qtrfm\" (UID: \"f8d911b6-4332-43e4-8dcf-817195087d3c\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qtrfm"
May 21 01:48:49.224772 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:49.224728    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2jdp2\" (UniqueName: \"kubernetes.io/projected/f8d911b6-4332-43e4-8dcf-817195087d3c-kube-api-access-2jdp2\") pod \"migrator-b985f5d89-qtrfm\" (UID: \"f8d911b6-4332-43e4-8dcf-817195087d3c\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qtrfm"
May 21 01:48:49.232122 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:49.232089    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2jdp2\" (UniqueName: \"kubernetes.io/projected/f8d911b6-4332-43e4-8dcf-817195087d3c-kube-api-access-2jdp2\") pod \"migrator-b985f5d89-qtrfm\" (UID: \"f8d911b6-4332-43e4-8dcf-817195087d3c\") " pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qtrfm"
May 21 01:48:49.363762 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:49.363683    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qtrfm"
May 21 01:48:49.487462 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:49.484869    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-b985f5d89-qtrfm"]
May 21 01:48:49.490367 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:48:49.490342    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8d911b6_4332_43e4_8dcf_817195087d3c.slice/crio-7f0e6a16506ca789389d5044d2f792c28ecca70501a5047ed3cfe5b8f40f2fac WatchSource:0}: Error finding container 7f0e6a16506ca789389d5044d2f792c28ecca70501a5047ed3cfe5b8f40f2fac: Status 404 returned error can't find the container with id 7f0e6a16506ca789389d5044d2f792c28ecca70501a5047ed3cfe5b8f40f2fac
May 21 01:48:50.476869 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:50.476838    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qtrfm" event={"ID":"f8d911b6-4332-43e4-8dcf-817195087d3c","Type":"ContainerStarted","Data":"7f0e6a16506ca789389d5044d2f792c28ecca70501a5047ed3cfe5b8f40f2fac"}
May 21 01:48:50.930467 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:50.930441    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v9n7p_80d874e6-8977-4487-8559-364f023d087c/dns-node-resolver/0.log"
May 21 01:48:51.482097 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.482063    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qtrfm" event={"ID":"f8d911b6-4332-43e4-8dcf-817195087d3c","Type":"ContainerStarted","Data":"c4fe5900549404abe55d94e824a62b4ea0cf10b3ca91f977659485f1539884eb"}
May 21 01:48:51.482097 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.482096    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qtrfm" event={"ID":"f8d911b6-4332-43e4-8dcf-817195087d3c","Type":"ContainerStarted","Data":"65f0f12ab0e1d43210ac5c039840557a2fa4cef77c2264ac4e81e72d1274c4bc"}
May 21 01:48:51.496186 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.496143    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-b985f5d89-qtrfm" podStartSLOduration=1.548999931 podStartE2EDuration="2.496129442s" podCreationTimestamp="2026-05-21 01:48:49 +0000 UTC" firstStartedPulling="2026-05-21 01:48:49.492740962 +0000 UTC m=+71.906260324" lastFinishedPulling="2026-05-21 01:48:50.439870469 +0000 UTC m=+72.853389835" observedRunningTime="2026-05-21 01:48:51.49544323 +0000 UTC m=+73.908962609" watchObservedRunningTime="2026-05-21 01:48:51.496129442 +0000 UTC m=+73.909648848"
May 21 01:48:51.545503 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.545463    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-6pjc7"]
May 21 01:48:51.548530 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.548514    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-6pjc7"
May 21 01:48:51.551103 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.550998    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 21 01:48:51.551103 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.551084    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 21 01:48:51.551103 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.551092    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-t4h5s\""
May 21 01:48:51.551375 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.551146    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 21 01:48:51.551375 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.551146    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 21 01:48:51.556778 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.556755    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-6pjc7"]
May 21 01:48:51.643903 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.643869    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ba015774-6c8f-4c6e-9a9f-2c2f6f22299e-signing-key\") pod \"service-ca-67d667c7d-6pjc7\" (UID: \"ba015774-6c8f-4c6e-9a9f-2c2f6f22299e\") " pod="openshift-service-ca/service-ca-67d667c7d-6pjc7"
May 21 01:48:51.643903 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.643905    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ba015774-6c8f-4c6e-9a9f-2c2f6f22299e-signing-cabundle\") pod \"service-ca-67d667c7d-6pjc7\" (UID: \"ba015774-6c8f-4c6e-9a9f-2c2f6f22299e\") " pod="openshift-service-ca/service-ca-67d667c7d-6pjc7"
May 21 01:48:51.644113 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.643937    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9zj8\" (UniqueName: \"kubernetes.io/projected/ba015774-6c8f-4c6e-9a9f-2c2f6f22299e-kube-api-access-d9zj8\") pod \"service-ca-67d667c7d-6pjc7\" (UID: \"ba015774-6c8f-4c6e-9a9f-2c2f6f22299e\") " pod="openshift-service-ca/service-ca-67d667c7d-6pjc7"
May 21 01:48:51.731138 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.731101    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r5gk9_77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1/node-ca/0.log"
May 21 01:48:51.744507 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.744425    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9zj8\" (UniqueName: \"kubernetes.io/projected/ba015774-6c8f-4c6e-9a9f-2c2f6f22299e-kube-api-access-d9zj8\") pod \"service-ca-67d667c7d-6pjc7\" (UID: \"ba015774-6c8f-4c6e-9a9f-2c2f6f22299e\") " pod="openshift-service-ca/service-ca-67d667c7d-6pjc7"
May 21 01:48:51.744507 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.744469    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-metrics-certs\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:51.744760 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.744523    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-service-ca-bundle\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:51.744760 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:51.744574    2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 21 01:48:51.744760 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.744630    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9xcwc\" (UID: \"19175863-e76e-4995-ae22-76c7ca5e4651\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc"
May 21 01:48:51.744760 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:51.744666    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-metrics-certs podName:c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f nodeName:}" failed. No retries permitted until 2026-05-21 01:48:59.744626712 +0000 UTC m=+82.158146084 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-metrics-certs") pod "router-default-8c88869c6-88w97" (UID: "c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f") : secret "router-metrics-certs-default" not found
May 21 01:48:51.744760 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.744706    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ba015774-6c8f-4c6e-9a9f-2c2f6f22299e-signing-key\") pod \"service-ca-67d667c7d-6pjc7\" (UID: \"ba015774-6c8f-4c6e-9a9f-2c2f6f22299e\") " pod="openshift-service-ca/service-ca-67d667c7d-6pjc7"
May 21 01:48:51.744760 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:51.744728    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 01:48:51.744760 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.744734    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ba015774-6c8f-4c6e-9a9f-2c2f6f22299e-signing-cabundle\") pod \"service-ca-67d667c7d-6pjc7\" (UID: \"ba015774-6c8f-4c6e-9a9f-2c2f6f22299e\") " pod="openshift-service-ca/service-ca-67d667c7d-6pjc7"
May 21 01:48:51.744760 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:51.744744    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-service-ca-bundle podName:c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f nodeName:}" failed. No retries permitted until 2026-05-21 01:48:59.744727198 +0000 UTC m=+82.158246577 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-service-ca-bundle") pod "router-default-8c88869c6-88w97" (UID: "c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f") : configmap references non-existent config key: service-ca.crt
May 21 01:48:51.745187 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:51.744774    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls podName:19175863-e76e-4995-ae22-76c7ca5e4651 nodeName:}" failed. No retries permitted until 2026-05-21 01:48:59.744762846 +0000 UTC m=+82.158282223 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-9xcwc" (UID: "19175863-e76e-4995-ae22-76c7ca5e4651") : secret "cluster-monitoring-operator-tls" not found
May 21 01:48:51.745432 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.745411    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/ba015774-6c8f-4c6e-9a9f-2c2f6f22299e-signing-cabundle\") pod \"service-ca-67d667c7d-6pjc7\" (UID: \"ba015774-6c8f-4c6e-9a9f-2c2f6f22299e\") " pod="openshift-service-ca/service-ca-67d667c7d-6pjc7"
May 21 01:48:51.747366 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.747344    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/ba015774-6c8f-4c6e-9a9f-2c2f6f22299e-signing-key\") pod \"service-ca-67d667c7d-6pjc7\" (UID: \"ba015774-6c8f-4c6e-9a9f-2c2f6f22299e\") " pod="openshift-service-ca/service-ca-67d667c7d-6pjc7"
May 21 01:48:51.752455 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.752435    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9zj8\" (UniqueName: \"kubernetes.io/projected/ba015774-6c8f-4c6e-9a9f-2c2f6f22299e-kube-api-access-d9zj8\") pod \"service-ca-67d667c7d-6pjc7\" (UID: \"ba015774-6c8f-4c6e-9a9f-2c2f6f22299e\") " pod="openshift-service-ca/service-ca-67d667c7d-6pjc7"
May 21 01:48:51.857185 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.857150    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-6pjc7"
May 21 01:48:51.981736 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:51.981702    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-6pjc7"]
May 21 01:48:51.984434 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:48:51.984403    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba015774_6c8f_4c6e_9a9f_2c2f6f22299e.slice/crio-7adf919a77bf7a2ff57f5454981f25ef2db779dce1bdb5ce2c5d9a924a199cea WatchSource:0}: Error finding container 7adf919a77bf7a2ff57f5454981f25ef2db779dce1bdb5ce2c5d9a924a199cea: Status 404 returned error can't find the container with id 7adf919a77bf7a2ff57f5454981f25ef2db779dce1bdb5ce2c5d9a924a199cea
May 21 01:48:52.486022 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:52.485983    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-6pjc7" event={"ID":"ba015774-6c8f-4c6e-9a9f-2c2f6f22299e","Type":"ContainerStarted","Data":"b22354c82aebc3f2fe94bbc75bc2d408b8aeffcc2f2f847915af80e5e564f458"}
May 21 01:48:52.486430 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:52.486031    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-6pjc7" event={"ID":"ba015774-6c8f-4c6e-9a9f-2c2f6f22299e","Type":"ContainerStarted","Data":"7adf919a77bf7a2ff57f5454981f25ef2db779dce1bdb5ce2c5d9a924a199cea"}
May 21 01:48:52.504191 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:52.504148    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-6pjc7" podStartSLOduration=1.504135567 podStartE2EDuration="1.504135567s" podCreationTimestamp="2026-05-21 01:48:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:48:52.502850442 +0000 UTC m=+74.916369823" watchObservedRunningTime="2026-05-21 01:48:52.504135567 +0000 UTC m=+74.917654947"
May 21 01:48:59.814373 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:59.814307    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9xcwc\" (UID: \"19175863-e76e-4995-ae22-76c7ca5e4651\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc"
May 21 01:48:59.814894 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:59.814397    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-metrics-certs\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:59.814894 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:59.814478    2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 21 01:48:59.814894 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:59.814551    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-service-ca-bundle\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:59.814894 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:48:59.814605    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls podName:19175863-e76e-4995-ae22-76c7ca5e4651 nodeName:}" failed. No retries permitted until 2026-05-21 01:49:15.814569896 +0000 UTC m=+98.228089263 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-9xcwc" (UID: "19175863-e76e-4995-ae22-76c7ca5e4651") : secret "cluster-monitoring-operator-tls" not found
May 21 01:48:59.815065 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:59.815042    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-service-ca-bundle\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:59.816942 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:59.816919    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f-metrics-certs\") pod \"router-default-8c88869c6-88w97\" (UID: \"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f\") " pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:48:59.893873 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:48:59.893836    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:49:00.027320 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:00.027289    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-8c88869c6-88w97"]
May 21 01:49:00.030700 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:49:00.030671    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3c2aa6e_1ccd_4df7_830e_0d96a5b3579f.slice/crio-e0cf4d8292f8978feedb37dec319f62b51faa5b8d50cd3e3ff80e029d9a6090e WatchSource:0}: Error finding container e0cf4d8292f8978feedb37dec319f62b51faa5b8d50cd3e3ff80e029d9a6090e: Status 404 returned error can't find the container with id e0cf4d8292f8978feedb37dec319f62b51faa5b8d50cd3e3ff80e029d9a6090e
May 21 01:49:00.508301 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:00.508263    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8c88869c6-88w97" event={"ID":"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f","Type":"ContainerStarted","Data":"acd502d83b4277af9d51cc56b14ee887c8fa61172fb668686f1a8d821ffba3fe"}
May 21 01:49:00.508507 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:00.508300    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-8c88869c6-88w97" event={"ID":"c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f","Type":"ContainerStarted","Data":"e0cf4d8292f8978feedb37dec319f62b51faa5b8d50cd3e3ff80e029d9a6090e"}
May 21 01:49:00.525592 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:00.525541    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-8c88869c6-88w97" podStartSLOduration=17.525524481 podStartE2EDuration="17.525524481s" podCreationTimestamp="2026-05-21 01:48:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:49:00.524136222 +0000 UTC m=+82.937655605" watchObservedRunningTime="2026-05-21 01:49:00.525524481 +0000 UTC m=+82.939043859"
May 21 01:49:00.894048 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:00.894006    2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:49:00.896528 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:00.896504    2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:49:01.513997 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:01.513963    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:49:01.515250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:01.515226    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-8c88869c6-88w97"
May 21 01:49:12.533833 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.533802    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sqcgc"]
May 21 01:49:12.538205 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.538187    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sqcgc"
May 21 01:49:12.540939 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.540916    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 21 01:49:12.542160 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.542127    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 21 01:49:12.542296 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.542157    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pnbl7\""
May 21 01:49:12.542296 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.542236    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 21 01:49:12.542296 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.542257    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 21 01:49:12.549788 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.549766    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sqcgc"]
May 21 01:49:12.616250 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.616220    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9k8bk\" (UniqueName: \"kubernetes.io/projected/78ab7d30-4e1a-41e7-9730-0bd80b984067-kube-api-access-9k8bk\") pod \"insights-runtime-extractor-sqcgc\" (UID: \"78ab7d30-4e1a-41e7-9730-0bd80b984067\") " pod="openshift-insights/insights-runtime-extractor-sqcgc"
May 21 01:49:12.616417 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.616265    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78ab7d30-4e1a-41e7-9730-0bd80b984067-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sqcgc\" (UID: \"78ab7d30-4e1a-41e7-9730-0bd80b984067\") " pod="openshift-insights/insights-runtime-extractor-sqcgc"
May 21 01:49:12.616417 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.616290    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/78ab7d30-4e1a-41e7-9730-0bd80b984067-crio-socket\") pod \"insights-runtime-extractor-sqcgc\" (UID: \"78ab7d30-4e1a-41e7-9730-0bd80b984067\") " pod="openshift-insights/insights-runtime-extractor-sqcgc"
May 21 01:49:12.616417 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.616375    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78ab7d30-4e1a-41e7-9730-0bd80b984067-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sqcgc\" (UID: \"78ab7d30-4e1a-41e7-9730-0bd80b984067\") " pod="openshift-insights/insights-runtime-extractor-sqcgc"
May 21 01:49:12.616417 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.616409    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/78ab7d30-4e1a-41e7-9730-0bd80b984067-data-volume\") pod \"insights-runtime-extractor-sqcgc\" (UID: \"78ab7d30-4e1a-41e7-9730-0bd80b984067\") " pod="openshift-insights/insights-runtime-extractor-sqcgc"
May 21 01:49:12.717343 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.717314    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78ab7d30-4e1a-41e7-9730-0bd80b984067-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sqcgc\" (UID: \"78ab7d30-4e1a-41e7-9730-0bd80b984067\") " pod="openshift-insights/insights-runtime-extractor-sqcgc"
May 21 01:49:12.717526 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.717352    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/78ab7d30-4e1a-41e7-9730-0bd80b984067-crio-socket\") pod \"insights-runtime-extractor-sqcgc\" (UID: \"78ab7d30-4e1a-41e7-9730-0bd80b984067\") " pod="openshift-insights/insights-runtime-extractor-sqcgc"
May 21 01:49:12.717526 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.717395    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78ab7d30-4e1a-41e7-9730-0bd80b984067-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sqcgc\" (UID: \"78ab7d30-4e1a-41e7-9730-0bd80b984067\") " pod="openshift-insights/insights-runtime-extractor-sqcgc"
May 21 01:49:12.717526 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.717426    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/78ab7d30-4e1a-41e7-9730-0bd80b984067-data-volume\") pod \"insights-runtime-extractor-sqcgc\" (UID: \"78ab7d30-4e1a-41e7-9730-0bd80b984067\") " pod="openshift-insights/insights-runtime-extractor-sqcgc"
May 21 01:49:12.717526 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.717505    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9k8bk\" (UniqueName: \"kubernetes.io/projected/78ab7d30-4e1a-41e7-9730-0bd80b984067-kube-api-access-9k8bk\") pod \"insights-runtime-extractor-sqcgc\" (UID: \"78ab7d30-4e1a-41e7-9730-0bd80b984067\") " pod="openshift-insights/insights-runtime-extractor-sqcgc"
May 21 01:49:12.717778 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.717503    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/78ab7d30-4e1a-41e7-9730-0bd80b984067-crio-socket\") pod \"insights-runtime-extractor-sqcgc\" (UID: \"78ab7d30-4e1a-41e7-9730-0bd80b984067\") " pod="openshift-insights/insights-runtime-extractor-sqcgc"
May 21 01:49:12.717832 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.717783    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/78ab7d30-4e1a-41e7-9730-0bd80b984067-data-volume\") pod \"insights-runtime-extractor-sqcgc\" (UID: \"78ab7d30-4e1a-41e7-9730-0bd80b984067\") " pod="openshift-insights/insights-runtime-extractor-sqcgc"
May 21 01:49:12.717975 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.717956    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/78ab7d30-4e1a-41e7-9730-0bd80b984067-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sqcgc\" (UID: \"78ab7d30-4e1a-41e7-9730-0bd80b984067\") " pod="openshift-insights/insights-runtime-extractor-sqcgc"
May 21 01:49:12.720089 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.720059    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/78ab7d30-4e1a-41e7-9730-0bd80b984067-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sqcgc\" (UID: \"78ab7d30-4e1a-41e7-9730-0bd80b984067\") " pod="openshift-insights/insights-runtime-extractor-sqcgc"
May 21 01:49:12.726466 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.726441    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9k8bk\" (UniqueName: \"kubernetes.io/projected/78ab7d30-4e1a-41e7-9730-0bd80b984067-kube-api-access-9k8bk\") pod \"insights-runtime-extractor-sqcgc\" (UID: \"78ab7d30-4e1a-41e7-9730-0bd80b984067\") " pod="openshift-insights/insights-runtime-extractor-sqcgc"
May 21 01:49:12.848187 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.848105    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sqcgc"
May 21 01:49:12.973439 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:12.973404    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sqcgc"]
May 21 01:49:12.978160 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:49:12.978131    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78ab7d30_4e1a_41e7_9730_0bd80b984067.slice/crio-4e6a46068763a17734465f755a9ed4a2a24e5c1ceaa23f3a0d98dd45678ad473 WatchSource:0}: Error finding container 4e6a46068763a17734465f755a9ed4a2a24e5c1ceaa23f3a0d98dd45678ad473: Status 404 returned error can't find the container with id 4e6a46068763a17734465f755a9ed4a2a24e5c1ceaa23f3a0d98dd45678ad473
May 21 01:49:13.544938 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:13.544907    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sqcgc" event={"ID":"78ab7d30-4e1a-41e7-9730-0bd80b984067","Type":"ContainerStarted","Data":"8330579fa1ad26c1193138a05105fb67c352b69f036f8b2b37aca68556248fad"}
May 21 01:49:13.544938 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:13.544943    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sqcgc" event={"ID":"78ab7d30-4e1a-41e7-9730-0bd80b984067","Type":"ContainerStarted","Data":"4e6a46068763a17734465f755a9ed4a2a24e5c1ceaa23f3a0d98dd45678ad473"}
May 21 01:49:14.549122 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:14.549079    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sqcgc" event={"ID":"78ab7d30-4e1a-41e7-9730-0bd80b984067","Type":"ContainerStarted","Data":"5bfc0b2a3e3e73c8f171103803707fc63e5fc38bf7b4b90fd418400845a147b0"}
May 21 01:49:15.553990 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:15.553954    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sqcgc" event={"ID":"78ab7d30-4e1a-41e7-9730-0bd80b984067","Type":"ContainerStarted","Data":"d02577acdfa7b61bcc0ad8b43babddbda4b830ca5046d0198965b9da785cbb0a"}
May 21 01:49:15.570979 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:15.570930    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sqcgc" podStartSLOduration=1.613250335 podStartE2EDuration="3.570916842s" podCreationTimestamp="2026-05-21 01:49:12 +0000 UTC" firstStartedPulling="2026-05-21 01:49:13.033401018 +0000 UTC m=+95.446920377" lastFinishedPulling="2026-05-21 01:49:14.99106752 +0000 UTC m=+97.404586884" observedRunningTime="2026-05-21 01:49:15.569054851 +0000 UTC m=+97.982574231" watchObservedRunningTime="2026-05-21 01:49:15.570916842 +0000 UTC m=+97.984436222"
May 21 01:49:15.844936 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:15.844824    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9xcwc\" (UID: \"19175863-e76e-4995-ae22-76c7ca5e4651\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc"
May 21 01:49:15.847290 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:15.847267    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/19175863-e76e-4995-ae22-76c7ca5e4651-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-9xcwc\" (UID: \"19175863-e76e-4995-ae22-76c7ca5e4651\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc"
May 21 01:49:16.086465 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:16.086417    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc"
May 21 01:49:16.212284 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:16.212254    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc"]
May 21 01:49:16.215441 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:49:16.215402    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19175863_e76e_4995_ae22_76c7ca5e4651.slice/crio-088969de145422050abc6e399b6f3486ca20ca4f2aa9d9f95b1b793e899cda26 WatchSource:0}: Error finding container 088969de145422050abc6e399b6f3486ca20ca4f2aa9d9f95b1b793e899cda26: Status 404 returned error can't find the container with id 088969de145422050abc6e399b6f3486ca20ca4f2aa9d9f95b1b793e899cda26
May 21 01:49:16.450078 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:16.449974    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls\") pod \"dns-default-bkvlq\" (UID: \"db15baee-ec33-43bc-a10d-681ec1ddaf48\") " pod="openshift-dns/dns-default-bkvlq"
May 21 01:49:16.450078 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:16.450026    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert\") pod \"ingress-canary-dnsw7\" (UID: \"815f1db1-cfdb-4f49-a288-6cc22596f870\") " pod="openshift-ingress-canary/ingress-canary-dnsw7"
May 21 01:49:16.452579 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:16.452548    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/db15baee-ec33-43bc-a10d-681ec1ddaf48-metrics-tls\") pod \"dns-default-bkvlq\" (UID: \"db15baee-ec33-43bc-a10d-681ec1ddaf48\") " pod="openshift-dns/dns-default-bkvlq"
May 21 01:49:16.452706 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:16.452560    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/815f1db1-cfdb-4f49-a288-6cc22596f870-cert\") pod \"ingress-canary-dnsw7\" (UID: \"815f1db1-cfdb-4f49-a288-6cc22596f870\") " pod="openshift-ingress-canary/ingress-canary-dnsw7"
May 21 01:49:16.557476 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:16.557442    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc" event={"ID":"19175863-e76e-4995-ae22-76c7ca5e4651","Type":"ContainerStarted","Data":"088969de145422050abc6e399b6f3486ca20ca4f2aa9d9f95b1b793e899cda26"}
May 21 01:49:16.716276 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:16.716203    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-qjjsz\""
May 21 01:49:16.724374 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:16.724349    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-bkvlq"
May 21 01:49:16.731171 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:16.731152    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bvhf9\""
May 21 01:49:16.739145 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:16.739121    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dnsw7"
May 21 01:49:16.879190 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:16.879145    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-bkvlq"]
May 21 01:49:16.884307 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:49:16.884270    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb15baee_ec33_43bc_a10d_681ec1ddaf48.slice/crio-5e694ac4fedcf1b53b746b3b71cf7da934be4e2571c55e05b1ebb27d5a8018f7 WatchSource:0}: Error finding container 5e694ac4fedcf1b53b746b3b71cf7da934be4e2571c55e05b1ebb27d5a8018f7: Status 404 returned error can't find the container with id 5e694ac4fedcf1b53b746b3b71cf7da934be4e2571c55e05b1ebb27d5a8018f7
May 21 01:49:16.891416 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:16.891385    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dnsw7"]
May 21 01:49:16.894805 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:49:16.894778    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod815f1db1_cfdb_4f49_a288_6cc22596f870.slice/crio-d2cc04dccb2f91a845e1db80c88d6aa3212f4bfc1a1bb9815e962fe7617a6b02 WatchSource:0}: Error finding container d2cc04dccb2f91a845e1db80c88d6aa3212f4bfc1a1bb9815e962fe7617a6b02: Status 404 returned error can't find the container with id d2cc04dccb2f91a845e1db80c88d6aa3212f4bfc1a1bb9815e962fe7617a6b02
May 21 01:49:17.563605 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:17.563568    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dnsw7" event={"ID":"815f1db1-cfdb-4f49-a288-6cc22596f870","Type":"ContainerStarted","Data":"d2cc04dccb2f91a845e1db80c88d6aa3212f4bfc1a1bb9815e962fe7617a6b02"}
May 21 01:49:17.564800 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:17.564765    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bkvlq" event={"ID":"db15baee-ec33-43bc-a10d-681ec1ddaf48","Type":"ContainerStarted","Data":"5e694ac4fedcf1b53b746b3b71cf7da934be4e2571c55e05b1ebb27d5a8018f7"}
May 21 01:49:18.569813 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:18.569774    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc" event={"ID":"19175863-e76e-4995-ae22-76c7ca5e4651","Type":"ContainerStarted","Data":"c155cef3b62e69fd604b38e87a6c2dfd15eb650e438b7f3a0bffa7a0446f7108"}
May 21 01:49:18.585287 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:18.585231    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-9xcwc" podStartSLOduration=33.870388088 podStartE2EDuration="35.585211672s" podCreationTimestamp="2026-05-21 01:48:43 +0000 UTC" firstStartedPulling="2026-05-21 01:49:16.217322648 +0000 UTC m=+98.630842007" lastFinishedPulling="2026-05-21 01:49:17.932146219 +0000 UTC m=+100.345665591" observedRunningTime="2026-05-21 01:49:18.584961478 +0000 UTC m=+100.998480872" watchObservedRunningTime="2026-05-21 01:49:18.585211672 +0000 UTC m=+100.998731054"
May 21 01:49:19.476871 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:19.476834    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-q5jgp"
May 21 01:49:19.574607 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:19.574573    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dnsw7" event={"ID":"815f1db1-cfdb-4f49-a288-6cc22596f870","Type":"ContainerStarted","Data":"35cacd34e68d5976570f77fe0fe55010a0d3c18bb01aac700b95202fafa42782"}
May 21 01:49:19.576365 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:19.576338    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bkvlq" event={"ID":"db15baee-ec33-43bc-a10d-681ec1ddaf48","Type":"ContainerStarted","Data":"b4728d35ed66b2f9908aa9687b866915b839e07aad84e22b167359bd9235ddea"}
May 21 01:49:19.576533 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:19.576371    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-bkvlq" event={"ID":"db15baee-ec33-43bc-a10d-681ec1ddaf48","Type":"ContainerStarted","Data":"fb883b5f838a8e4880a9426bedcd2611997cca71d055666a9da104d6e21d6872"}
May 21 01:49:19.588880 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:19.588834    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dnsw7" podStartSLOduration=65.433500819 podStartE2EDuration="1m7.588820116s" podCreationTimestamp="2026-05-21 01:48:12 +0000 UTC" firstStartedPulling="2026-05-21 01:49:16.897029512 +0000 UTC m=+99.310548875" lastFinishedPulling="2026-05-21 01:49:19.052348814 +0000 UTC m=+101.465868172" observedRunningTime="2026-05-21 01:49:19.588335288 +0000 UTC m=+102.001854679" watchObservedRunningTime="2026-05-21 01:49:19.588820116 +0000 UTC m=+102.002339496"
May 21 01:49:19.604594 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:19.604545    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-bkvlq" podStartSLOduration=65.437394793 podStartE2EDuration="1m7.604530013s" podCreationTimestamp="2026-05-21 01:48:12 +0000 UTC" firstStartedPulling="2026-05-21 01:49:16.88674156 +0000 UTC m=+99.300260923" lastFinishedPulling="2026-05-21 01:49:19.053876782 +0000 UTC m=+101.467396143" observedRunningTime="2026-05-21 01:49:19.603679103 +0000 UTC m=+102.017198488" watchObservedRunningTime="2026-05-21 01:49:19.604530013 +0000 UTC m=+102.018049396"
May 21 01:49:20.581380 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:20.581347    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-bkvlq"
May 21 01:49:21.515625 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.515594    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm"]
May 21 01:49:21.546711 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.546681    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm"]
May 21 01:49:21.546877 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.546810    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm"
May 21 01:49:21.550190 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.550159    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 21 01:49:21.550329 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.550281    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 21 01:49:21.550329 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.550306    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-qpg8d\""
May 21 01:49:21.563329 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.563287    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 21 01:49:21.691364 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.691318    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c77669e-e03b-4ea1-bac8-7cea53006476-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-6rpqm\" (UID: \"4c77669e-e03b-4ea1-bac8-7cea53006476\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm"
May 21 01:49:21.691827 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.691374    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vppxf\" (UniqueName: \"kubernetes.io/projected/4c77669e-e03b-4ea1-bac8-7cea53006476-kube-api-access-vppxf\") pod \"prometheus-operator-7779bbdd78-6rpqm\" (UID: \"4c77669e-e03b-4ea1-bac8-7cea53006476\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm"
May 21 01:49:21.691827 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.691484    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c77669e-e03b-4ea1-bac8-7cea53006476-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-6rpqm\" (UID: \"4c77669e-e03b-4ea1-bac8-7cea53006476\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm"
May 21 01:49:21.691827 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.691519    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c77669e-e03b-4ea1-bac8-7cea53006476-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-6rpqm\" (UID: \"4c77669e-e03b-4ea1-bac8-7cea53006476\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm"
May 21 01:49:21.792328 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.792236    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c77669e-e03b-4ea1-bac8-7cea53006476-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-6rpqm\" (UID: \"4c77669e-e03b-4ea1-bac8-7cea53006476\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm"
May 21 01:49:21.792328 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.792285    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c77669e-e03b-4ea1-bac8-7cea53006476-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-6rpqm\" (UID: \"4c77669e-e03b-4ea1-bac8-7cea53006476\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm"
May 21 01:49:21.792328 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.792328    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c77669e-e03b-4ea1-bac8-7cea53006476-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-6rpqm\" (UID: \"4c77669e-e03b-4ea1-bac8-7cea53006476\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm"
May 21 01:49:21.792582 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.792353    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vppxf\" (UniqueName: \"kubernetes.io/projected/4c77669e-e03b-4ea1-bac8-7cea53006476-kube-api-access-vppxf\") pod \"prometheus-operator-7779bbdd78-6rpqm\" (UID: \"4c77669e-e03b-4ea1-bac8-7cea53006476\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm"
May 21 01:49:21.792999 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.792973    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4c77669e-e03b-4ea1-bac8-7cea53006476-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-6rpqm\" (UID: \"4c77669e-e03b-4ea1-bac8-7cea53006476\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm"
May 21 01:49:21.800652 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.800617    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4c77669e-e03b-4ea1-bac8-7cea53006476-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-6rpqm\" (UID: \"4c77669e-e03b-4ea1-bac8-7cea53006476\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm"
May 21 01:49:21.800735 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.800625    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4c77669e-e03b-4ea1-bac8-7cea53006476-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-6rpqm\" (UID: \"4c77669e-e03b-4ea1-bac8-7cea53006476\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm"
May 21 01:49:21.800775 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.800763    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vppxf\" (UniqueName: \"kubernetes.io/projected/4c77669e-e03b-4ea1-bac8-7cea53006476-kube-api-access-vppxf\") pod \"prometheus-operator-7779bbdd78-6rpqm\" (UID: \"4c77669e-e03b-4ea1-bac8-7cea53006476\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm"
May 21 01:49:21.856324 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.856287    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm"
May 21 01:49:21.980096 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:21.980048    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm"]
May 21 01:49:21.982869 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:49:21.982844    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c77669e_e03b_4ea1_bac8_7cea53006476.slice/crio-b08c1f93bbd2fbc61a7a08f4a6b23f83e0ace486891b5fa2baeb21ed2f46a924 WatchSource:0}: Error finding container b08c1f93bbd2fbc61a7a08f4a6b23f83e0ace486891b5fa2baeb21ed2f46a924: Status 404 returned error can't find the container with id b08c1f93bbd2fbc61a7a08f4a6b23f83e0ace486891b5fa2baeb21ed2f46a924
May 21 01:49:22.588337 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:22.588296    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm" event={"ID":"4c77669e-e03b-4ea1-bac8-7cea53006476","Type":"ContainerStarted","Data":"b08c1f93bbd2fbc61a7a08f4a6b23f83e0ace486891b5fa2baeb21ed2f46a924"}
May 21 01:49:23.594387 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:23.594303    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm" event={"ID":"4c77669e-e03b-4ea1-bac8-7cea53006476","Type":"ContainerStarted","Data":"5937373f6e674dc5db0e2bc1b56aef740747cab7b0e5cfce7691b768daf46649"}
May 21 01:49:23.594387 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:23.594345    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm" event={"ID":"4c77669e-e03b-4ea1-bac8-7cea53006476","Type":"ContainerStarted","Data":"342141ded9506d800dc76d6e7aef2be96f4506ccf21effcb21b661071e05c4ca"}
May 21 01:49:23.610682 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:23.610622    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-6rpqm" podStartSLOduration=1.36673009 podStartE2EDuration="2.610608257s" podCreationTimestamp="2026-05-21 01:49:21 +0000 UTC" firstStartedPulling="2026-05-21 01:49:21.984812285 +0000 UTC m=+104.398331644" lastFinishedPulling="2026-05-21 01:49:23.228690448 +0000 UTC m=+105.642209811" observedRunningTime="2026-05-21 01:49:23.609193594 +0000 UTC m=+106.022712988" watchObservedRunningTime="2026-05-21 01:49:23.610608257 +0000 UTC m=+106.024127638"
May 21 01:49:25.847507 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:25.847463    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"]
May 21 01:49:25.851298 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:25.851276    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:25.853988 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:25.853955    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 21 01:49:25.855187 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:25.855168    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 21 01:49:25.855399 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:25.855169    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 21 01:49:25.855475 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:25.855175    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-9kxnk\""
May 21 01:49:25.858037 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:25.858007    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-d6t55"]
May 21 01:49:25.863544 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:25.862499    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"]
May 21 01:49:25.863544 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:25.862661    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:25.883009 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:25.882978    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 21 01:49:25.883339 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:25.883316    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 21 01:49:25.883436 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:25.883341    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bsgjt\""
May 21 01:49:25.883436 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:25.883316    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 21 01:49:25.922653 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:25.922586    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ad0c44f-220b-438c-996b-9a8d58594dfa-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-h69zv\" (UID: \"4ad0c44f-220b-438c-996b-9a8d58594dfa\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:25.922838 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:25.922683    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ad0c44f-220b-438c-996b-9a8d58594dfa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-h69zv\" (UID: \"4ad0c44f-220b-438c-996b-9a8d58594dfa\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:25.922838 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:25.922782    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4ad0c44f-220b-438c-996b-9a8d58594dfa-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-h69zv\" (UID: \"4ad0c44f-220b-438c-996b-9a8d58594dfa\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:25.922838 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:25.922829    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4ad0c44f-220b-438c-996b-9a8d58594dfa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-h69zv\" (UID: \"4ad0c44f-220b-438c-996b-9a8d58594dfa\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:25.922994 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:25.922860    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jtms\" (UniqueName: \"kubernetes.io/projected/4ad0c44f-220b-438c-996b-9a8d58594dfa-kube-api-access-8jtms\") pod \"kube-state-metrics-54fd6bc5c4-h69zv\" (UID: \"4ad0c44f-220b-438c-996b-9a8d58594dfa\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:25.922994 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:25.922901    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ad0c44f-220b-438c-996b-9a8d58594dfa-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-h69zv\" (UID: \"4ad0c44f-220b-438c-996b-9a8d58594dfa\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:26.023972 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.023939    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34b0e000-0c66-441e-98c9-0e972586c670-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.023972 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.023982    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4ad0c44f-220b-438c-996b-9a8d58594dfa-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-h69zv\" (UID: \"4ad0c44f-220b-438c-996b-9a8d58594dfa\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:26.024232 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.024007    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4ad0c44f-220b-438c-996b-9a8d58594dfa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-h69zv\" (UID: \"4ad0c44f-220b-438c-996b-9a8d58594dfa\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:26.024232 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.024063    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jtms\" (UniqueName: \"kubernetes.io/projected/4ad0c44f-220b-438c-996b-9a8d58594dfa-kube-api-access-8jtms\") pod \"kube-state-metrics-54fd6bc5c4-h69zv\" (UID: \"4ad0c44f-220b-438c-996b-9a8d58594dfa\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:26.024232 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.024098    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ad0c44f-220b-438c-996b-9a8d58594dfa-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-h69zv\" (UID: \"4ad0c44f-220b-438c-996b-9a8d58594dfa\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:26.024232 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.024125    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/34b0e000-0c66-441e-98c9-0e972586c670-node-exporter-textfile\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.024232 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.024161    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/34b0e000-0c66-441e-98c9-0e972586c670-node-exporter-wtmp\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.024457 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.024289    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/34b0e000-0c66-441e-98c9-0e972586c670-node-exporter-tls\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.024457 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:49:26.024322    2582 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 21 01:49:26.024457 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:49:26.024377    2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4ad0c44f-220b-438c-996b-9a8d58594dfa-kube-state-metrics-tls podName:4ad0c44f-220b-438c-996b-9a8d58594dfa nodeName:}" failed. No retries permitted until 2026-05-21 01:49:26.524361191 +0000 UTC m=+108.937880571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/4ad0c44f-220b-438c-996b-9a8d58594dfa-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-h69zv" (UID: "4ad0c44f-220b-438c-996b-9a8d58594dfa") : secret "kube-state-metrics-tls" not found
May 21 01:49:26.024457 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.024396    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34b0e000-0c66-441e-98c9-0e972586c670-sys\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.024457 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.024414    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2s8r\" (UniqueName: \"kubernetes.io/projected/34b0e000-0c66-441e-98c9-0e972586c670-kube-api-access-v2s8r\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.024457 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.024447    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4ad0c44f-220b-438c-996b-9a8d58594dfa-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-h69zv\" (UID: \"4ad0c44f-220b-438c-996b-9a8d58594dfa\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:26.024792 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.024486    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ad0c44f-220b-438c-996b-9a8d58594dfa-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-h69zv\" (UID: \"4ad0c44f-220b-438c-996b-9a8d58594dfa\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:26.024792 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.024508    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ad0c44f-220b-438c-996b-9a8d58594dfa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-h69zv\" (UID: \"4ad0c44f-220b-438c-996b-9a8d58594dfa\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:26.024792 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.024538    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/34b0e000-0c66-441e-98c9-0e972586c670-root\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.024792 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.024610    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34b0e000-0c66-441e-98c9-0e972586c670-metrics-client-ca\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.024792 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.024701    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/34b0e000-0c66-441e-98c9-0e972586c670-node-exporter-accelerators-collector-config\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.024792 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.024754    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4ad0c44f-220b-438c-996b-9a8d58594dfa-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-h69zv\" (UID: \"4ad0c44f-220b-438c-996b-9a8d58594dfa\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:26.025056 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.025038    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4ad0c44f-220b-438c-996b-9a8d58594dfa-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-h69zv\" (UID: \"4ad0c44f-220b-438c-996b-9a8d58594dfa\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:26.027017 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.026996    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4ad0c44f-220b-438c-996b-9a8d58594dfa-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-h69zv\" (UID: \"4ad0c44f-220b-438c-996b-9a8d58594dfa\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:26.038019 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.037998    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jtms\" (UniqueName: \"kubernetes.io/projected/4ad0c44f-220b-438c-996b-9a8d58594dfa-kube-api-access-8jtms\") pod \"kube-state-metrics-54fd6bc5c4-h69zv\" (UID: \"4ad0c44f-220b-438c-996b-9a8d58594dfa\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:26.125620 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.125586    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/34b0e000-0c66-441e-98c9-0e972586c670-node-exporter-accelerators-collector-config\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.125832 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.125651    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34b0e000-0c66-441e-98c9-0e972586c670-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.125832 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.125709    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/34b0e000-0c66-441e-98c9-0e972586c670-node-exporter-textfile\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.125832 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.125735    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/34b0e000-0c66-441e-98c9-0e972586c670-node-exporter-wtmp\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.125832 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.125762    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/34b0e000-0c66-441e-98c9-0e972586c670-node-exporter-tls\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.125832 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.125798    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34b0e000-0c66-441e-98c9-0e972586c670-sys\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.125832 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.125819    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v2s8r\" (UniqueName: \"kubernetes.io/projected/34b0e000-0c66-441e-98c9-0e972586c670-kube-api-access-v2s8r\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.126126 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.125886    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/34b0e000-0c66-441e-98c9-0e972586c670-root\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.126126 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.125915    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34b0e000-0c66-441e-98c9-0e972586c670-metrics-client-ca\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.126126 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.125954    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/34b0e000-0c66-441e-98c9-0e972586c670-node-exporter-wtmp\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.126126 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.125992    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/34b0e000-0c66-441e-98c9-0e972586c670-root\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.126126 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.126023    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/34b0e000-0c66-441e-98c9-0e972586c670-sys\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.126382 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.126129    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/34b0e000-0c66-441e-98c9-0e972586c670-node-exporter-textfile\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.126382 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.126292    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/34b0e000-0c66-441e-98c9-0e972586c670-node-exporter-accelerators-collector-config\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.126559 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.126538    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/34b0e000-0c66-441e-98c9-0e972586c670-metrics-client-ca\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.128269 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.128240    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/34b0e000-0c66-441e-98c9-0e972586c670-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.128513 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.128494    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/34b0e000-0c66-441e-98c9-0e972586c670-node-exporter-tls\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.135121 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.135102    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2s8r\" (UniqueName: \"kubernetes.io/projected/34b0e000-0c66-441e-98c9-0e972586c670-kube-api-access-v2s8r\") pod \"node-exporter-d6t55\" (UID: \"34b0e000-0c66-441e-98c9-0e972586c670\") " pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.175252 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.175219    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-d6t55"
May 21 01:49:26.184745 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:49:26.184715    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34b0e000_0c66_441e_98c9_0e972586c670.slice/crio-457e922fbf6446a31998f844674e5e7c413d04230ef3368a0656f229ac3bf6bb WatchSource:0}: Error finding container 457e922fbf6446a31998f844674e5e7c413d04230ef3368a0656f229ac3bf6bb: Status 404 returned error can't find the container with id 457e922fbf6446a31998f844674e5e7c413d04230ef3368a0656f229ac3bf6bb
May 21 01:49:26.529383 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.529292    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ad0c44f-220b-438c-996b-9a8d58594dfa-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-h69zv\" (UID: \"4ad0c44f-220b-438c-996b-9a8d58594dfa\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:26.531808 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.531789    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4ad0c44f-220b-438c-996b-9a8d58594dfa-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-h69zv\" (UID: \"4ad0c44f-220b-438c-996b-9a8d58594dfa\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:26.603719 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.603684    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6t55" event={"ID":"34b0e000-0c66-441e-98c9-0e972586c670","Type":"ContainerStarted","Data":"457e922fbf6446a31998f844674e5e7c413d04230ef3368a0656f229ac3bf6bb"}
May 21 01:49:26.764396 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.764355    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"
May 21 01:49:26.925085 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:26.925050    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv"]
May 21 01:49:26.930896 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:49:26.930868    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ad0c44f_220b_438c_996b_9a8d58594dfa.slice/crio-e6ce038d22a6195328c3e63d992de3b5ee29327af0ffd503b20f29262078d5e9 WatchSource:0}: Error finding container e6ce038d22a6195328c3e63d992de3b5ee29327af0ffd503b20f29262078d5e9: Status 404 returned error can't find the container with id e6ce038d22a6195328c3e63d992de3b5ee29327af0ffd503b20f29262078d5e9
May 21 01:49:27.607781 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:27.607677    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv" event={"ID":"4ad0c44f-220b-438c-996b-9a8d58594dfa","Type":"ContainerStarted","Data":"e6ce038d22a6195328c3e63d992de3b5ee29327af0ffd503b20f29262078d5e9"}
May 21 01:49:27.609398 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:27.609366    2582 generic.go:358] "Generic (PLEG): container finished" podID="34b0e000-0c66-441e-98c9-0e972586c670" containerID="750dd6ef27f069f57ce312c2a6511ba30b3f68a568c850d5e8c2f794ecd1590e" exitCode=0
May 21 01:49:27.609544 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:27.609417    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6t55" event={"ID":"34b0e000-0c66-441e-98c9-0e972586c670","Type":"ContainerDied","Data":"750dd6ef27f069f57ce312c2a6511ba30b3f68a568c850d5e8c2f794ecd1590e"}
May 21 01:49:28.615064 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:28.615027    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6t55" event={"ID":"34b0e000-0c66-441e-98c9-0e972586c670","Type":"ContainerStarted","Data":"6737be3f08e0633d304c4c0631b3283d98ea610ab17f39d67c2c2fe3415a30f3"}
May 21 01:49:28.615064 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:28.615071    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-d6t55" event={"ID":"34b0e000-0c66-441e-98c9-0e972586c670","Type":"ContainerStarted","Data":"57a9a25c21e1d1fee70d9de3c01006175ba71f0a121f337ec3d3405018a0191c"}
May 21 01:49:28.616821 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:28.616791    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv" event={"ID":"4ad0c44f-220b-438c-996b-9a8d58594dfa","Type":"ContainerStarted","Data":"03c6ab7e876a48f0b3e3968689f292e6ea931c551d6ccdca6f30aed8f665a12d"}
May 21 01:49:28.616919 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:28.616829    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv" event={"ID":"4ad0c44f-220b-438c-996b-9a8d58594dfa","Type":"ContainerStarted","Data":"e25d373e63ec1e118df98b750e059b53cef75684249945997cf27136866eb1fc"}
May 21 01:49:28.616919 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:28.616844    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv" event={"ID":"4ad0c44f-220b-438c-996b-9a8d58594dfa","Type":"ContainerStarted","Data":"dc3abec6c41f8c9503ff3d8f8ed1b62b0a73e931778c951d9a50a36f8f0648cf"}
May 21 01:49:28.631942 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:28.631889    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-d6t55" podStartSLOduration=2.569207908 podStartE2EDuration="3.631875563s" podCreationTimestamp="2026-05-21 01:49:25 +0000 UTC" firstStartedPulling="2026-05-21 01:49:26.186425182 +0000 UTC m=+108.599944541" lastFinishedPulling="2026-05-21 01:49:27.24909283 +0000 UTC m=+109.662612196" observedRunningTime="2026-05-21 01:49:28.630659647 +0000 UTC m=+111.044179025" watchObservedRunningTime="2026-05-21 01:49:28.631875563 +0000 UTC m=+111.045394987"
May 21 01:49:28.647041 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:28.646989    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-h69zv" podStartSLOduration=2.47795389 podStartE2EDuration="3.646974667s" podCreationTimestamp="2026-05-21 01:49:25 +0000 UTC" firstStartedPulling="2026-05-21 01:49:26.933295487 +0000 UTC m=+109.346814846" lastFinishedPulling="2026-05-21 01:49:28.102316261 +0000 UTC m=+110.515835623" observedRunningTime="2026-05-21 01:49:28.64590366 +0000 UTC m=+111.059423043" watchObservedRunningTime="2026-05-21 01:49:28.646974667 +0000 UTC m=+111.060494048"
May 21 01:49:30.156018 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.155984    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-8878985cb-t4bmw"]
May 21 01:49:30.159231 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.159207    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.162961 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.162934    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
May 21 01:49:30.162961 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.162957    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1kjcpdqu3htt3\""
May 21 01:49:30.163162 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.162969    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
May 21 01:49:30.163162 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.162979    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
May 21 01:49:30.163162 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.163048    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
May 21 01:49:30.163162 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.163068    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-c7rqr\""
May 21 01:49:30.171578 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.171552    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8878985cb-t4bmw"]
May 21 01:49:30.266579 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.266534    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69a74158-048a-424b-b42b-757de4e72e71-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.266796 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.266596    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/69a74158-048a-424b-b42b-757de4e72e71-secret-metrics-server-client-certs\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.266796 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.266704    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/69a74158-048a-424b-b42b-757de4e72e71-audit-log\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.266796 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.266750    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/69a74158-048a-424b-b42b-757de4e72e71-metrics-server-audit-profiles\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.266796 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.266769    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jbb66\" (UniqueName: \"kubernetes.io/projected/69a74158-048a-424b-b42b-757de4e72e71-kube-api-access-jbb66\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.266947 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.266804    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/69a74158-048a-424b-b42b-757de4e72e71-secret-metrics-server-tls\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.266947 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.266820    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69a74158-048a-424b-b42b-757de4e72e71-client-ca-bundle\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.367940 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.367903    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/69a74158-048a-424b-b42b-757de4e72e71-secret-metrics-server-client-certs\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.368089 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.367947    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/69a74158-048a-424b-b42b-757de4e72e71-audit-log\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.368089 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.367973    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/69a74158-048a-424b-b42b-757de4e72e71-metrics-server-audit-profiles\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.368089 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.368027    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jbb66\" (UniqueName: \"kubernetes.io/projected/69a74158-048a-424b-b42b-757de4e72e71-kube-api-access-jbb66\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.368089 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.368084    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/69a74158-048a-424b-b42b-757de4e72e71-secret-metrics-server-tls\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.368292 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.368104    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69a74158-048a-424b-b42b-757de4e72e71-client-ca-bundle\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.368292 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.368144    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69a74158-048a-424b-b42b-757de4e72e71-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.368439 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.368412    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/69a74158-048a-424b-b42b-757de4e72e71-audit-log\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.368965 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.368798    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/69a74158-048a-424b-b42b-757de4e72e71-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.369304 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.369280    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/69a74158-048a-424b-b42b-757de4e72e71-metrics-server-audit-profiles\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.370745 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.370723    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/69a74158-048a-424b-b42b-757de4e72e71-secret-metrics-server-tls\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.370817 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.370794    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/69a74158-048a-424b-b42b-757de4e72e71-secret-metrics-server-client-certs\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.370817 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.370801    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/69a74158-048a-424b-b42b-757de4e72e71-client-ca-bundle\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.376041 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.376019    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jbb66\" (UniqueName: \"kubernetes.io/projected/69a74158-048a-424b-b42b-757de4e72e71-kube-api-access-jbb66\") pod \"metrics-server-8878985cb-t4bmw\" (UID: \"69a74158-048a-424b-b42b-757de4e72e71\") " pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.472466 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.472371    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:30.585568 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.585092    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-bkvlq"
May 21 01:49:30.605326 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.605292    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-8878985cb-t4bmw"]
May 21 01:49:30.609615 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:49:30.609587    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69a74158_048a_424b_b42b_757de4e72e71.slice/crio-079991cd712d6978d3d5f5442b2e32288b15d10be56fd766876fe55acfc96674 WatchSource:0}: Error finding container 079991cd712d6978d3d5f5442b2e32288b15d10be56fd766876fe55acfc96674: Status 404 returned error can't find the container with id 079991cd712d6978d3d5f5442b2e32288b15d10be56fd766876fe55acfc96674
May 21 01:49:30.624768 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.624730    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8878985cb-t4bmw" event={"ID":"69a74158-048a-424b-b42b-757de4e72e71","Type":"ContainerStarted","Data":"079991cd712d6978d3d5f5442b2e32288b15d10be56fd766876fe55acfc96674"}
May 21 01:49:30.975153 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.975124    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-fpx87"]
May 21 01:49:30.979795 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.979778    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-fpx87"
May 21 01:49:30.982421 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.982399    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 21 01:49:30.982543 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.982446    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-bhtww\""
May 21 01:49:30.982543 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.982497    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 21 01:49:30.985435 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:30.985409    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-fpx87"]
May 21 01:49:31.075252 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:31.075212    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqb8w\" (UniqueName: \"kubernetes.io/projected/510779a2-f776-47cc-b022-f905a77d92c3-kube-api-access-pqb8w\") pod \"downloads-57bd96b888-fpx87\" (UID: \"510779a2-f776-47cc-b022-f905a77d92c3\") " pod="openshift-console/downloads-57bd96b888-fpx87"
May 21 01:49:31.176558 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:31.176516    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pqb8w\" (UniqueName: \"kubernetes.io/projected/510779a2-f776-47cc-b022-f905a77d92c3-kube-api-access-pqb8w\") pod \"downloads-57bd96b888-fpx87\" (UID: \"510779a2-f776-47cc-b022-f905a77d92c3\") " pod="openshift-console/downloads-57bd96b888-fpx87"
May 21 01:49:31.184752 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:31.184727    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pqb8w\" (UniqueName: \"kubernetes.io/projected/510779a2-f776-47cc-b022-f905a77d92c3-kube-api-access-pqb8w\") pod \"downloads-57bd96b888-fpx87\" (UID: \"510779a2-f776-47cc-b022-f905a77d92c3\") " pod="openshift-console/downloads-57bd96b888-fpx87"
May 21 01:49:31.291020 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:31.290802    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-fpx87"
May 21 01:49:31.441895 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:31.441859    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-fpx87"]
May 21 01:49:31.445376 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:49:31.445340    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod510779a2_f776_47cc_b022_f905a77d92c3.slice/crio-15cb4855ab03afad8c4e53f1b6357ebcfa4788fa159c3b2c4d7f81b83ae25373 WatchSource:0}: Error finding container 15cb4855ab03afad8c4e53f1b6357ebcfa4788fa159c3b2c4d7f81b83ae25373: Status 404 returned error can't find the container with id 15cb4855ab03afad8c4e53f1b6357ebcfa4788fa159c3b2c4d7f81b83ae25373
May 21 01:49:31.630127 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:31.630082    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-fpx87" event={"ID":"510779a2-f776-47cc-b022-f905a77d92c3","Type":"ContainerStarted","Data":"15cb4855ab03afad8c4e53f1b6357ebcfa4788fa159c3b2c4d7f81b83ae25373"}
May 21 01:49:32.072710 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.071501    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 01:49:32.077512 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.077470    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.080469 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.080446    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-npwc5\""
May 21 01:49:32.080719 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.080689    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 21 01:49:32.080821 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.080720    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 21 01:49:32.080821 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.080746    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 21 01:49:32.080821 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.080765    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 21 01:49:32.080821 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.080694    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 21 01:49:32.081174 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.081154    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 21 01:49:32.084715 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.082964    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 21 01:49:32.084715 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.083193    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-55e0fk0c4vsma\""
May 21 01:49:32.084715 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.083437    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 21 01:49:32.084715 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.084304    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 21 01:49:32.086707 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.086683    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 21 01:49:32.086837 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.086718    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 21 01:49:32.086837 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.086811    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 01:49:32.088540 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.088522    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 21 01:49:32.189085 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.188994    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.189085 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.189055    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.189592 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.189101    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.189592 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.189135    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.189592 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.189166    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-web-config\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.189592 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.189217    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-config\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.189592 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.189264    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5s5j\" (UniqueName: \"kubernetes.io/projected/e2a76978-0537-4781-a695-77e97d7019bc-kube-api-access-m5s5j\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.189592 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.189318    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.189592 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.189349    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2a76978-0537-4781-a695-77e97d7019bc-config-out\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.189592 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.189372    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.190025 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.189426    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.190025 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.189946    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2a76978-0537-4781-a695-77e97d7019bc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.190025 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.189989    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.190025 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.190022    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.190232 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.190206    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e2a76978-0537-4781-a695-77e97d7019bc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.190308 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.190290    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.190356 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.190339    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.190410 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.190379    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.291368 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.291332    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.291533 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.291388    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.291533 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.291418    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.291533 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.291497    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.291684 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.291534    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-web-config\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.291684 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.291560    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-config\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.291684 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.291582    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m5s5j\" (UniqueName: \"kubernetes.io/projected/e2a76978-0537-4781-a695-77e97d7019bc-kube-api-access-m5s5j\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.291684 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.291608    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.291684 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.291655    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2a76978-0537-4781-a695-77e97d7019bc-config-out\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.291684 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.291680    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.292018 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.291708    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.292018 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.291766    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2a76978-0537-4781-a695-77e97d7019bc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.292018 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.291795    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.292018 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.291820    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.292018 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.291844    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e2a76978-0537-4781-a695-77e97d7019bc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.292018 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.291900    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.292018 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.291942    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.292018 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.291979    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.293358 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.293010    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e2a76978-0537-4781-a695-77e97d7019bc-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.293358 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.293091    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.293358 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.293291    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.294716 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.294443    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.295005 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.294977    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.295720 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.295686    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.296788 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.296734    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-web-config\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.297498 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.297449    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.300173 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.300072    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.304174 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.303992    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.304174 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.304115    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.304350 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.304337    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2a76978-0537-4781-a695-77e97d7019bc-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.304761 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.304720    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.304903 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.304878    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.305707 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.305318    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.305707 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.305673    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-config\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.306166 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.306148    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2a76978-0537-4781-a695-77e97d7019bc-config-out\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.309248 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.309061    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5s5j\" (UniqueName: \"kubernetes.io/projected/e2a76978-0537-4781-a695-77e97d7019bc-kube-api-access-m5s5j\") pod \"prometheus-k8s-0\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.406657 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.406211    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:32.600175 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.600079    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 01:49:32.605977 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:49:32.605944    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2a76978_0537_4781_a695_77e97d7019bc.slice/crio-246b580e61df2815eefb77d4a7e17d872d1caea173ba394f5ee4cbf3d547c714 WatchSource:0}: Error finding container 246b580e61df2815eefb77d4a7e17d872d1caea173ba394f5ee4cbf3d547c714: Status 404 returned error can't find the container with id 246b580e61df2815eefb77d4a7e17d872d1caea173ba394f5ee4cbf3d547c714
May 21 01:49:32.636692 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.636649    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2a76978-0537-4781-a695-77e97d7019bc","Type":"ContainerStarted","Data":"246b580e61df2815eefb77d4a7e17d872d1caea173ba394f5ee4cbf3d547c714"}
May 21 01:49:32.638277 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.638235    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-8878985cb-t4bmw" event={"ID":"69a74158-048a-424b-b42b-757de4e72e71","Type":"ContainerStarted","Data":"915de5453bc37eed94e33fa0132b97afba21e01c83bc6d7be2999beeb53e0fc4"}
May 21 01:49:32.659580 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:32.659472    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-8878985cb-t4bmw" podStartSLOduration=1.219514246 podStartE2EDuration="2.659451877s" podCreationTimestamp="2026-05-21 01:49:30 +0000 UTC" firstStartedPulling="2026-05-21 01:49:30.612087391 +0000 UTC m=+113.025606752" lastFinishedPulling="2026-05-21 01:49:32.05202501 +0000 UTC m=+114.465544383" observedRunningTime="2026-05-21 01:49:32.658592437 +0000 UTC m=+115.072111828" watchObservedRunningTime="2026-05-21 01:49:32.659451877 +0000 UTC m=+115.072971259"
May 21 01:49:34.645882 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:34.645846    2582 generic.go:358] "Generic (PLEG): container finished" podID="e2a76978-0537-4781-a695-77e97d7019bc" containerID="032d8535bd64010218adeacc22f3c21c14650ce27ed1c7aab0d8e9ef296a9a18" exitCode=0
May 21 01:49:34.646371 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:34.645923    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2a76978-0537-4781-a695-77e97d7019bc","Type":"ContainerDied","Data":"032d8535bd64010218adeacc22f3c21c14650ce27ed1c7aab0d8e9ef296a9a18"}
May 21 01:49:37.659425 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:37.659386    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2a76978-0537-4781-a695-77e97d7019bc","Type":"ContainerStarted","Data":"e4ba32946501662ff3c492b55dac2fd42a57cbb8297a48185c3af72afa93d718"}
May 21 01:49:37.659783 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:37.659435    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2a76978-0537-4781-a695-77e97d7019bc","Type":"ContainerStarted","Data":"5e1e78687baa0a91c776a7896f8a79c06f2ff311c82392ad6ef1c8d9ff0f8055"}
May 21 01:49:39.670178 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:39.670099    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2a76978-0537-4781-a695-77e97d7019bc","Type":"ContainerStarted","Data":"a4eedfd7783e908ea50b7186c94ddd0a74d1a5be9829a910f265241f4c6e703a"}
May 21 01:49:39.670178 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:39.670142    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2a76978-0537-4781-a695-77e97d7019bc","Type":"ContainerStarted","Data":"6c013d6867e3e958e236c1f9abecdcabf0558ea9645cca00980d67aa9e68dff7"}
May 21 01:49:39.670178 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:39.670158    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2a76978-0537-4781-a695-77e97d7019bc","Type":"ContainerStarted","Data":"c96941f1b4d3a8cad0dbca3300b2f47fb25347a7bae06e486d331e7814ca3cce"}
May 21 01:49:40.676400 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:40.676364    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2a76978-0537-4781-a695-77e97d7019bc","Type":"ContainerStarted","Data":"fc4646a25e1fea608df4579aa82fbf7796a0ef5292d6f7f21b835811d35512a0"}
May 21 01:49:40.701613 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:40.701529    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=1.875524958 podStartE2EDuration="8.701514194s" podCreationTimestamp="2026-05-21 01:49:32 +0000 UTC" firstStartedPulling="2026-05-21 01:49:32.609964991 +0000 UTC m=+115.023484409" lastFinishedPulling="2026-05-21 01:49:39.43595428 +0000 UTC m=+121.849473645" observedRunningTime="2026-05-21 01:49:40.700125868 +0000 UTC m=+123.113645285" watchObservedRunningTime="2026-05-21 01:49:40.701514194 +0000 UTC m=+123.115033579"
May 21 01:49:42.407326 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:42.407282    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:49:47.938494 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:47.934709    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs\") pod \"network-metrics-daemon-2dkkl\" (UID: \"4b0e871e-0753-4434-9ea6-2d139f7766c8\") " pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:49:47.938494 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:47.937947    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0e871e-0753-4434-9ea6-2d139f7766c8-metrics-certs\") pod \"network-metrics-daemon-2dkkl\" (UID: \"4b0e871e-0753-4434-9ea6-2d139f7766c8\") " pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:49:48.155475 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:48.155443    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ng7kc\""
May 21 01:49:48.163490 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:48.163454    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2dkkl"
May 21 01:49:48.681866 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:48.681818    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2dkkl"]
May 21 01:49:48.684625 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:49:48.684592    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b0e871e_0753_4434_9ea6_2d139f7766c8.slice/crio-130d6a06adf60761ec67bb36404a4e966479072e8d299c840cceaa7e990e7fe2 WatchSource:0}: Error finding container 130d6a06adf60761ec67bb36404a4e966479072e8d299c840cceaa7e990e7fe2: Status 404 returned error can't find the container with id 130d6a06adf60761ec67bb36404a4e966479072e8d299c840cceaa7e990e7fe2
May 21 01:49:48.702093 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:48.702047    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2dkkl" event={"ID":"4b0e871e-0753-4434-9ea6-2d139f7766c8","Type":"ContainerStarted","Data":"130d6a06adf60761ec67bb36404a4e966479072e8d299c840cceaa7e990e7fe2"}
May 21 01:49:49.706989 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:49.706944    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-fpx87" event={"ID":"510779a2-f776-47cc-b022-f905a77d92c3","Type":"ContainerStarted","Data":"29e3ce1b90333a44a358c759191c756309bc0983b26d2e86542b8758f290bbac"}
May 21 01:49:49.707510 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:49.707311    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-fpx87"
May 21 01:49:49.724173 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:49.724141    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-fpx87"
May 21 01:49:49.727011 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:49.726956    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-fpx87" podStartSLOduration=2.238567114 podStartE2EDuration="19.726938196s" podCreationTimestamp="2026-05-21 01:49:30 +0000 UTC" firstStartedPulling="2026-05-21 01:49:31.447606618 +0000 UTC m=+113.861125990" lastFinishedPulling="2026-05-21 01:49:48.935977702 +0000 UTC m=+131.349497072" observedRunningTime="2026-05-21 01:49:49.724362056 +0000 UTC m=+132.137881469" watchObservedRunningTime="2026-05-21 01:49:49.726938196 +0000 UTC m=+132.140457577"
May 21 01:49:50.472846 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:50.472806    2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:50.473064 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:50.472864    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:49:50.712676 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:50.712610    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2dkkl" event={"ID":"4b0e871e-0753-4434-9ea6-2d139f7766c8","Type":"ContainerStarted","Data":"b9b106d034b01e47ff4653931abacc05736432573b57e095c85399de51b7e441"}
May 21 01:49:50.712676 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:50.712683    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2dkkl" event={"ID":"4b0e871e-0753-4434-9ea6-2d139f7766c8","Type":"ContainerStarted","Data":"7fa5ee5721f5dbe388cca16eef076aaec5808f11d83e64d395f977a8b9c54c7d"}
May 21 01:49:50.729060 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:50.728997    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2dkkl" podStartSLOduration=131.358006823 podStartE2EDuration="2m12.728981346s" podCreationTimestamp="2026-05-21 01:47:38 +0000 UTC" firstStartedPulling="2026-05-21 01:49:48.686602699 +0000 UTC m=+131.100122060" lastFinishedPulling="2026-05-21 01:49:50.057577219 +0000 UTC m=+132.471096583" observedRunningTime="2026-05-21 01:49:50.727992641 +0000 UTC m=+133.141512045" watchObservedRunningTime="2026-05-21 01:49:50.728981346 +0000 UTC m=+133.142500727"
May 21 01:49:53.723626 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:53.723577    2582 generic.go:358] "Generic (PLEG): container finished" podID="1a6b2b8d-5658-420b-bae0-d4f1778fd9fa" containerID="a24a05d1f218a0e6144156faf16c0d441a13fa6212bed784c1a48b0144ba4691" exitCode=0
May 21 01:49:53.724057 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:53.723672    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-b7flf" event={"ID":"1a6b2b8d-5658-420b-bae0-d4f1778fd9fa","Type":"ContainerDied","Data":"a24a05d1f218a0e6144156faf16c0d441a13fa6212bed784c1a48b0144ba4691"}
May 21 01:49:53.724104 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:53.724088    2582 scope.go:117] "RemoveContainer" containerID="a24a05d1f218a0e6144156faf16c0d441a13fa6212bed784c1a48b0144ba4691"
May 21 01:49:54.729160 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:54.729122    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-565644f49-b7flf" event={"ID":"1a6b2b8d-5658-420b-bae0-d4f1778fd9fa","Type":"ContainerStarted","Data":"58dcd29e5ac3bcc9452c1e2513361fbea5119dc9819a41f1a432775dce5f01c4"}
May 21 01:49:58.744566 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:58.744530    2582 generic.go:358] "Generic (PLEG): container finished" podID="ff098bfb-2c09-473a-a031-f90be46ed6fe" containerID="b4ad2d68378927dc3b932bcac2187e3845fb8728ed3c26f20283aef34c4e9f67" exitCode=0
May 21 01:49:58.745092 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:58.744612    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-b9p2v" event={"ID":"ff098bfb-2c09-473a-a031-f90be46ed6fe","Type":"ContainerDied","Data":"b4ad2d68378927dc3b932bcac2187e3845fb8728ed3c26f20283aef34c4e9f67"}
May 21 01:49:58.745161 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:58.745091    2582 scope.go:117] "RemoveContainer" containerID="b4ad2d68378927dc3b932bcac2187e3845fb8728ed3c26f20283aef34c4e9f67"
May 21 01:49:59.749371 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:49:59.749341    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-57b5b68b8-b9p2v" event={"ID":"ff098bfb-2c09-473a-a031-f90be46ed6fe","Type":"ContainerStarted","Data":"a3f932cc0bad8cc472decbb3498180ddd35c9607c6d1ee483bc8176fe3ee49a6"}
May 21 01:50:10.478332 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:10.478294    2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:50:10.482290 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:10.482266    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-8878985cb-t4bmw"
May 21 01:50:32.407352 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:32.407311    2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:32.424581 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:32.424554    2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:32.871754 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:32.871720    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:50.434082 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:50.434047    2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 01:50:50.434951 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:50.434719    2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="thanos-sidecar" containerID="cri-o://c96941f1b4d3a8cad0dbca3300b2f47fb25347a7bae06e486d331e7814ca3cce" gracePeriod=600
May 21 01:50:50.434951 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:50.434721    2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="kube-rbac-proxy" containerID="cri-o://a4eedfd7783e908ea50b7186c94ddd0a74d1a5be9829a910f265241f4c6e703a" gracePeriod=600
May 21 01:50:50.434951 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:50.434787    2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="prometheus" containerID="cri-o://5e1e78687baa0a91c776a7896f8a79c06f2ff311c82392ad6ef1c8d9ff0f8055" gracePeriod=600
May 21 01:50:50.434951 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:50.434729    2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="kube-rbac-proxy-web" containerID="cri-o://6c013d6867e3e958e236c1f9abecdcabf0558ea9645cca00980d67aa9e68dff7" gracePeriod=600
May 21 01:50:50.434951 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:50.434718    2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="config-reloader" containerID="cri-o://e4ba32946501662ff3c492b55dac2fd42a57cbb8297a48185c3af72afa93d718" gracePeriod=600
May 21 01:50:50.435236 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:50.434958    2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="kube-rbac-proxy-thanos" containerID="cri-o://fc4646a25e1fea608df4579aa82fbf7796a0ef5292d6f7f21b835811d35512a0" gracePeriod=600
May 21 01:50:50.914447 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:50.914416    2582 generic.go:358] "Generic (PLEG): container finished" podID="e2a76978-0537-4781-a695-77e97d7019bc" containerID="fc4646a25e1fea608df4579aa82fbf7796a0ef5292d6f7f21b835811d35512a0" exitCode=0
May 21 01:50:50.914447 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:50.914439    2582 generic.go:358] "Generic (PLEG): container finished" podID="e2a76978-0537-4781-a695-77e97d7019bc" containerID="a4eedfd7783e908ea50b7186c94ddd0a74d1a5be9829a910f265241f4c6e703a" exitCode=0
May 21 01:50:50.914447 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:50.914445    2582 generic.go:358] "Generic (PLEG): container finished" podID="e2a76978-0537-4781-a695-77e97d7019bc" containerID="c96941f1b4d3a8cad0dbca3300b2f47fb25347a7bae06e486d331e7814ca3cce" exitCode=0
May 21 01:50:50.914447 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:50.914451    2582 generic.go:358] "Generic (PLEG): container finished" podID="e2a76978-0537-4781-a695-77e97d7019bc" containerID="e4ba32946501662ff3c492b55dac2fd42a57cbb8297a48185c3af72afa93d718" exitCode=0
May 21 01:50:50.914447 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:50.914455    2582 generic.go:358] "Generic (PLEG): container finished" podID="e2a76978-0537-4781-a695-77e97d7019bc" containerID="5e1e78687baa0a91c776a7896f8a79c06f2ff311c82392ad6ef1c8d9ff0f8055" exitCode=0
May 21 01:50:50.914764 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:50.914491    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2a76978-0537-4781-a695-77e97d7019bc","Type":"ContainerDied","Data":"fc4646a25e1fea608df4579aa82fbf7796a0ef5292d6f7f21b835811d35512a0"}
May 21 01:50:50.914764 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:50.914522    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2a76978-0537-4781-a695-77e97d7019bc","Type":"ContainerDied","Data":"a4eedfd7783e908ea50b7186c94ddd0a74d1a5be9829a910f265241f4c6e703a"}
May 21 01:50:50.914764 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:50.914533    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2a76978-0537-4781-a695-77e97d7019bc","Type":"ContainerDied","Data":"c96941f1b4d3a8cad0dbca3300b2f47fb25347a7bae06e486d331e7814ca3cce"}
May 21 01:50:50.914764 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:50.914541    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2a76978-0537-4781-a695-77e97d7019bc","Type":"ContainerDied","Data":"e4ba32946501662ff3c492b55dac2fd42a57cbb8297a48185c3af72afa93d718"}
May 21 01:50:50.914764 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:50.914549    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2a76978-0537-4781-a695-77e97d7019bc","Type":"ContainerDied","Data":"5e1e78687baa0a91c776a7896f8a79c06f2ff311c82392ad6ef1c8d9ff0f8055"}
May 21 01:50:51.686918 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.686897    2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:51.798594 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.798509    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-configmap-serving-certs-ca-bundle\") pod \"e2a76978-0537-4781-a695-77e97d7019bc\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") "
May 21 01:50:51.798594 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.798544    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-configmap-metrics-client-ca\") pod \"e2a76978-0537-4781-a695-77e97d7019bc\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") "
May 21 01:50:51.798594 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.798575    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-prometheus-trusted-ca-bundle\") pod \"e2a76978-0537-4781-a695-77e97d7019bc\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") "
May 21 01:50:51.798892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.798606    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-thanos-prometheus-http-client-file\") pod \"e2a76978-0537-4781-a695-77e97d7019bc\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") "
May 21 01:50:51.798892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.798666    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m5s5j\" (UniqueName: \"kubernetes.io/projected/e2a76978-0537-4781-a695-77e97d7019bc-kube-api-access-m5s5j\") pod \"e2a76978-0537-4781-a695-77e97d7019bc\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") "
May 21 01:50:51.798892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.798709    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2a76978-0537-4781-a695-77e97d7019bc-config-out\") pod \"e2a76978-0537-4781-a695-77e97d7019bc\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") "
May 21 01:50:51.798892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.798765    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-prometheus-k8s-tls\") pod \"e2a76978-0537-4781-a695-77e97d7019bc\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") "
May 21 01:50:51.798892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.798794    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2a76978-0537-4781-a695-77e97d7019bc-tls-assets\") pod \"e2a76978-0537-4781-a695-77e97d7019bc\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") "
May 21 01:50:51.798892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.798830    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-configmap-kubelet-serving-ca-bundle\") pod \"e2a76978-0537-4781-a695-77e97d7019bc\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") "
May 21 01:50:51.798892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.798855    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-web-config\") pod \"e2a76978-0537-4781-a695-77e97d7019bc\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") "
May 21 01:50:51.798892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.798882    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"e2a76978-0537-4781-a695-77e97d7019bc\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") "
May 21 01:50:51.799273 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.798921    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-metrics-client-certs\") pod \"e2a76978-0537-4781-a695-77e97d7019bc\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") "
May 21 01:50:51.799273 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.798952    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-config\") pod \"e2a76978-0537-4781-a695-77e97d7019bc\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") "
May 21 01:50:51.799273 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.798986    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e2a76978-0537-4781-a695-77e97d7019bc-prometheus-k8s-db\") pod \"e2a76978-0537-4781-a695-77e97d7019bc\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") "
May 21 01:50:51.799273 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.799025    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "e2a76978-0537-4781-a695-77e97d7019bc" (UID: "e2a76978-0537-4781-a695-77e97d7019bc"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:50:51.799273 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.799044    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "e2a76978-0537-4781-a695-77e97d7019bc" (UID: "e2a76978-0537-4781-a695-77e97d7019bc"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:50:51.799273 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.799039    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-prometheus-k8s-rulefiles-0\") pod \"e2a76978-0537-4781-a695-77e97d7019bc\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") "
May 21 01:50:51.799273 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.799112    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-grpc-tls\") pod \"e2a76978-0537-4781-a695-77e97d7019bc\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") "
May 21 01:50:51.799273 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.799142    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-kube-rbac-proxy\") pod \"e2a76978-0537-4781-a695-77e97d7019bc\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") "
May 21 01:50:51.799273 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.799186    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"e2a76978-0537-4781-a695-77e97d7019bc\" (UID: \"e2a76978-0537-4781-a695-77e97d7019bc\") "
May 21 01:50:51.799895 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.799571    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-configmap-metrics-client-ca\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:50:51.799895 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.799594    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-prometheus-trusted-ca-bundle\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:50:51.801016 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.799033    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "e2a76978-0537-4781-a695-77e97d7019bc" (UID: "e2a76978-0537-4781-a695-77e97d7019bc"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:50:51.801016 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.800964    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "e2a76978-0537-4781-a695-77e97d7019bc" (UID: "e2a76978-0537-4781-a695-77e97d7019bc"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:50:51.801957 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.801927    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "e2a76978-0537-4781-a695-77e97d7019bc" (UID: "e2a76978-0537-4781-a695-77e97d7019bc"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 21 01:50:51.803086 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.803059    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2a76978-0537-4781-a695-77e97d7019bc-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "e2a76978-0537-4781-a695-77e97d7019bc" (UID: "e2a76978-0537-4781-a695-77e97d7019bc"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:50:51.803484 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.803319    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "e2a76978-0537-4781-a695-77e97d7019bc" (UID: "e2a76978-0537-4781-a695-77e97d7019bc"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:50:51.803484 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.803356    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2a76978-0537-4781-a695-77e97d7019bc-kube-api-access-m5s5j" (OuterVolumeSpecName: "kube-api-access-m5s5j") pod "e2a76978-0537-4781-a695-77e97d7019bc" (UID: "e2a76978-0537-4781-a695-77e97d7019bc"). InnerVolumeSpecName "kube-api-access-m5s5j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:50:51.803484 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.803409    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "e2a76978-0537-4781-a695-77e97d7019bc" (UID: "e2a76978-0537-4781-a695-77e97d7019bc"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:50:51.803484 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.803459    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2a76978-0537-4781-a695-77e97d7019bc-config-out" (OuterVolumeSpecName: "config-out") pod "e2a76978-0537-4781-a695-77e97d7019bc" (UID: "e2a76978-0537-4781-a695-77e97d7019bc"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 21 01:50:51.803774 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.803547    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "e2a76978-0537-4781-a695-77e97d7019bc" (UID: "e2a76978-0537-4781-a695-77e97d7019bc"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:50:51.803774 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.803735    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2a76978-0537-4781-a695-77e97d7019bc-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e2a76978-0537-4781-a695-77e97d7019bc" (UID: "e2a76978-0537-4781-a695-77e97d7019bc"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:50:51.803977 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.803942    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "e2a76978-0537-4781-a695-77e97d7019bc" (UID: "e2a76978-0537-4781-a695-77e97d7019bc"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:50:51.804078 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.803972    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "e2a76978-0537-4781-a695-77e97d7019bc" (UID: "e2a76978-0537-4781-a695-77e97d7019bc"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:50:51.804172 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.804153    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "e2a76978-0537-4781-a695-77e97d7019bc" (UID: "e2a76978-0537-4781-a695-77e97d7019bc"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:50:51.804238 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.804223    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "e2a76978-0537-4781-a695-77e97d7019bc" (UID: "e2a76978-0537-4781-a695-77e97d7019bc"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:50:51.805329 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.805308    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-config" (OuterVolumeSpecName: "config") pod "e2a76978-0537-4781-a695-77e97d7019bc" (UID: "e2a76978-0537-4781-a695-77e97d7019bc"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:50:51.816143 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.816115    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-web-config" (OuterVolumeSpecName: "web-config") pod "e2a76978-0537-4781-a695-77e97d7019bc" (UID: "e2a76978-0537-4781-a695-77e97d7019bc"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:50:51.900957 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.900923    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:50:51.900957 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.900952    2582 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-web-config\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:50:51.900957 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.900962    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:50:51.901183 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.900971    2582 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-metrics-client-certs\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:50:51.901183 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.900981    2582 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-config\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:50:51.901183 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.900990    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e2a76978-0537-4781-a695-77e97d7019bc-prometheus-k8s-db\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:50:51.901183 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.900998    2582 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:50:51.901183 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.901007    2582 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-grpc-tls\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:50:51.901183 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.901017    2582 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-kube-rbac-proxy\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:50:51.901183 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.901026    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:50:51.901183 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.901036    2582 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e2a76978-0537-4781-a695-77e97d7019bc-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:50:51.901183 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.901045    2582 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-thanos-prometheus-http-client-file\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:50:51.901183 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.901055    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m5s5j\" (UniqueName: \"kubernetes.io/projected/e2a76978-0537-4781-a695-77e97d7019bc-kube-api-access-m5s5j\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:50:51.901183 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.901063    2582 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e2a76978-0537-4781-a695-77e97d7019bc-config-out\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:50:51.901183 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.901071    2582 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e2a76978-0537-4781-a695-77e97d7019bc-secret-prometheus-k8s-tls\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:50:51.901183 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.901080    2582 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e2a76978-0537-4781-a695-77e97d7019bc-tls-assets\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:50:51.919574 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.919542    2582 generic.go:358] "Generic (PLEG): container finished" podID="e2a76978-0537-4781-a695-77e97d7019bc" containerID="6c013d6867e3e958e236c1f9abecdcabf0558ea9645cca00980d67aa9e68dff7" exitCode=0
May 21 01:50:51.919768 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.919661    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2a76978-0537-4781-a695-77e97d7019bc","Type":"ContainerDied","Data":"6c013d6867e3e958e236c1f9abecdcabf0558ea9645cca00980d67aa9e68dff7"}
May 21 01:50:51.919768 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.919703    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e2a76978-0537-4781-a695-77e97d7019bc","Type":"ContainerDied","Data":"246b580e61df2815eefb77d4a7e17d872d1caea173ba394f5ee4cbf3d547c714"}
May 21 01:50:51.919768 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.919708    2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:51.919768 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.919719    2582 scope.go:117] "RemoveContainer" containerID="fc4646a25e1fea608df4579aa82fbf7796a0ef5292d6f7f21b835811d35512a0"
May 21 01:50:51.928297 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.928279    2582 scope.go:117] "RemoveContainer" containerID="a4eedfd7783e908ea50b7186c94ddd0a74d1a5be9829a910f265241f4c6e703a"
May 21 01:50:51.934970 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.934954    2582 scope.go:117] "RemoveContainer" containerID="6c013d6867e3e958e236c1f9abecdcabf0558ea9645cca00980d67aa9e68dff7"
May 21 01:50:51.941612 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.941595    2582 scope.go:117] "RemoveContainer" containerID="c96941f1b4d3a8cad0dbca3300b2f47fb25347a7bae06e486d331e7814ca3cce"
May 21 01:50:51.943346 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.943319    2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 01:50:51.946280 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.946257    2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 01:50:51.949773 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.949749    2582 scope.go:117] "RemoveContainer" containerID="e4ba32946501662ff3c492b55dac2fd42a57cbb8297a48185c3af72afa93d718"
May 21 01:50:51.956374 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.956358    2582 scope.go:117] "RemoveContainer" containerID="5e1e78687baa0a91c776a7896f8a79c06f2ff311c82392ad6ef1c8d9ff0f8055"
May 21 01:50:51.963594 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.963574    2582 scope.go:117] "RemoveContainer" containerID="032d8535bd64010218adeacc22f3c21c14650ce27ed1c7aab0d8e9ef296a9a18"
May 21 01:50:51.967967 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.967943    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 01:50:51.968426 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.968332    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="init-config-reloader"
May 21 01:50:51.968426 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.968412    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="init-config-reloader"
May 21 01:50:51.968599 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.968473    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="kube-rbac-proxy-web"
May 21 01:50:51.968599 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.968484    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="kube-rbac-proxy-web"
May 21 01:50:51.968599 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.968507    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="thanos-sidecar"
May 21 01:50:51.968599 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.968545    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="thanos-sidecar"
May 21 01:50:51.968863 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.968599    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="kube-rbac-proxy-thanos"
May 21 01:50:51.968863 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.968622    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="kube-rbac-proxy-thanos"
May 21 01:50:51.968863 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.968654    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="config-reloader"
May 21 01:50:51.968863 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.968665    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="config-reloader"
May 21 01:50:51.968863 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.968680    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="kube-rbac-proxy"
May 21 01:50:51.968863 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.968690    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="kube-rbac-proxy"
May 21 01:50:51.968863 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.968705    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="prometheus"
May 21 01:50:51.968863 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.968714    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="prometheus"
May 21 01:50:51.969212 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.968801    2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="kube-rbac-proxy"
May 21 01:50:51.969265 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.969225    2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="kube-rbac-proxy-thanos"
May 21 01:50:51.969265 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.969249    2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="prometheus"
May 21 01:50:51.969265 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.969261    2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="config-reloader"
May 21 01:50:51.969389 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.969271    2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="kube-rbac-proxy-web"
May 21 01:50:51.969389 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.969281    2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="e2a76978-0537-4781-a695-77e97d7019bc" containerName="thanos-sidecar"
May 21 01:50:51.972311 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.972279    2582 scope.go:117] "RemoveContainer" containerID="fc4646a25e1fea608df4579aa82fbf7796a0ef5292d6f7f21b835811d35512a0"
May 21 01:50:51.972698 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:50:51.972671    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fc4646a25e1fea608df4579aa82fbf7796a0ef5292d6f7f21b835811d35512a0\": container with ID starting with fc4646a25e1fea608df4579aa82fbf7796a0ef5292d6f7f21b835811d35512a0 not found: ID does not exist" containerID="fc4646a25e1fea608df4579aa82fbf7796a0ef5292d6f7f21b835811d35512a0"
May 21 01:50:51.972787 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.972709    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fc4646a25e1fea608df4579aa82fbf7796a0ef5292d6f7f21b835811d35512a0"} err="failed to get container status \"fc4646a25e1fea608df4579aa82fbf7796a0ef5292d6f7f21b835811d35512a0\": rpc error: code = NotFound desc = could not find container \"fc4646a25e1fea608df4579aa82fbf7796a0ef5292d6f7f21b835811d35512a0\": container with ID starting with fc4646a25e1fea608df4579aa82fbf7796a0ef5292d6f7f21b835811d35512a0 not found: ID does not exist"
May 21 01:50:51.972787 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.972752    2582 scope.go:117] "RemoveContainer" containerID="a4eedfd7783e908ea50b7186c94ddd0a74d1a5be9829a910f265241f4c6e703a"
May 21 01:50:51.973420 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:50:51.973398    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4eedfd7783e908ea50b7186c94ddd0a74d1a5be9829a910f265241f4c6e703a\": container with ID starting with a4eedfd7783e908ea50b7186c94ddd0a74d1a5be9829a910f265241f4c6e703a not found: ID does not exist" containerID="a4eedfd7783e908ea50b7186c94ddd0a74d1a5be9829a910f265241f4c6e703a"
May 21 01:50:51.973490 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.973423    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4eedfd7783e908ea50b7186c94ddd0a74d1a5be9829a910f265241f4c6e703a"} err="failed to get container status \"a4eedfd7783e908ea50b7186c94ddd0a74d1a5be9829a910f265241f4c6e703a\": rpc error: code = NotFound desc = could not find container \"a4eedfd7783e908ea50b7186c94ddd0a74d1a5be9829a910f265241f4c6e703a\": container with ID starting with a4eedfd7783e908ea50b7186c94ddd0a74d1a5be9829a910f265241f4c6e703a not found: ID does not exist"
May 21 01:50:51.973490 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.973438    2582 scope.go:117] "RemoveContainer" containerID="6c013d6867e3e958e236c1f9abecdcabf0558ea9645cca00980d67aa9e68dff7"
May 21 01:50:51.973592 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.973520    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:51.973892 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:50:51.973711    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c013d6867e3e958e236c1f9abecdcabf0558ea9645cca00980d67aa9e68dff7\": container with ID starting with 6c013d6867e3e958e236c1f9abecdcabf0558ea9645cca00980d67aa9e68dff7 not found: ID does not exist" containerID="6c013d6867e3e958e236c1f9abecdcabf0558ea9645cca00980d67aa9e68dff7"
May 21 01:50:51.973892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.973743    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c013d6867e3e958e236c1f9abecdcabf0558ea9645cca00980d67aa9e68dff7"} err="failed to get container status \"6c013d6867e3e958e236c1f9abecdcabf0558ea9645cca00980d67aa9e68dff7\": rpc error: code = NotFound desc = could not find container \"6c013d6867e3e958e236c1f9abecdcabf0558ea9645cca00980d67aa9e68dff7\": container with ID starting with 6c013d6867e3e958e236c1f9abecdcabf0558ea9645cca00980d67aa9e68dff7 not found: ID does not exist"
May 21 01:50:51.973892 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.973768    2582 scope.go:117] "RemoveContainer" containerID="c96941f1b4d3a8cad0dbca3300b2f47fb25347a7bae06e486d331e7814ca3cce"
May 21 01:50:51.974093 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:50:51.974008    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c96941f1b4d3a8cad0dbca3300b2f47fb25347a7bae06e486d331e7814ca3cce\": container with ID starting with c96941f1b4d3a8cad0dbca3300b2f47fb25347a7bae06e486d331e7814ca3cce not found: ID does not exist" containerID="c96941f1b4d3a8cad0dbca3300b2f47fb25347a7bae06e486d331e7814ca3cce"
May 21 01:50:51.974093 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.974034    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c96941f1b4d3a8cad0dbca3300b2f47fb25347a7bae06e486d331e7814ca3cce"} err="failed to get container status \"c96941f1b4d3a8cad0dbca3300b2f47fb25347a7bae06e486d331e7814ca3cce\": rpc error: code = NotFound desc = could not find container \"c96941f1b4d3a8cad0dbca3300b2f47fb25347a7bae06e486d331e7814ca3cce\": container with ID starting with c96941f1b4d3a8cad0dbca3300b2f47fb25347a7bae06e486d331e7814ca3cce not found: ID does not exist"
May 21 01:50:51.974093 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.974054    2582 scope.go:117] "RemoveContainer" containerID="e4ba32946501662ff3c492b55dac2fd42a57cbb8297a48185c3af72afa93d718"
May 21 01:50:51.974341 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:50:51.974320    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e4ba32946501662ff3c492b55dac2fd42a57cbb8297a48185c3af72afa93d718\": container with ID starting with e4ba32946501662ff3c492b55dac2fd42a57cbb8297a48185c3af72afa93d718 not found: ID does not exist" containerID="e4ba32946501662ff3c492b55dac2fd42a57cbb8297a48185c3af72afa93d718"
May 21 01:50:51.974385 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.974354    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e4ba32946501662ff3c492b55dac2fd42a57cbb8297a48185c3af72afa93d718"} err="failed to get container status \"e4ba32946501662ff3c492b55dac2fd42a57cbb8297a48185c3af72afa93d718\": rpc error: code = NotFound desc = could not find container \"e4ba32946501662ff3c492b55dac2fd42a57cbb8297a48185c3af72afa93d718\": container with ID starting with e4ba32946501662ff3c492b55dac2fd42a57cbb8297a48185c3af72afa93d718 not found: ID does not exist"
May 21 01:50:51.974385 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.974377    2582 scope.go:117] "RemoveContainer" containerID="5e1e78687baa0a91c776a7896f8a79c06f2ff311c82392ad6ef1c8d9ff0f8055"
May 21 01:50:51.974610 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:50:51.974589    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e1e78687baa0a91c776a7896f8a79c06f2ff311c82392ad6ef1c8d9ff0f8055\": container with ID starting with 5e1e78687baa0a91c776a7896f8a79c06f2ff311c82392ad6ef1c8d9ff0f8055 not found: ID does not exist" containerID="5e1e78687baa0a91c776a7896f8a79c06f2ff311c82392ad6ef1c8d9ff0f8055"
May 21 01:50:51.974716 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.974619    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e1e78687baa0a91c776a7896f8a79c06f2ff311c82392ad6ef1c8d9ff0f8055"} err="failed to get container status \"5e1e78687baa0a91c776a7896f8a79c06f2ff311c82392ad6ef1c8d9ff0f8055\": rpc error: code = NotFound desc = could not find container \"5e1e78687baa0a91c776a7896f8a79c06f2ff311c82392ad6ef1c8d9ff0f8055\": container with ID starting with 5e1e78687baa0a91c776a7896f8a79c06f2ff311c82392ad6ef1c8d9ff0f8055 not found: ID does not exist"
May 21 01:50:51.974716 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.974666    2582 scope.go:117] "RemoveContainer" containerID="032d8535bd64010218adeacc22f3c21c14650ce27ed1c7aab0d8e9ef296a9a18"
May 21 01:50:51.974904 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:50:51.974883    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"032d8535bd64010218adeacc22f3c21c14650ce27ed1c7aab0d8e9ef296a9a18\": container with ID starting with 032d8535bd64010218adeacc22f3c21c14650ce27ed1c7aab0d8e9ef296a9a18 not found: ID does not exist" containerID="032d8535bd64010218adeacc22f3c21c14650ce27ed1c7aab0d8e9ef296a9a18"
May 21 01:50:51.974945 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.974916    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"032d8535bd64010218adeacc22f3c21c14650ce27ed1c7aab0d8e9ef296a9a18"} err="failed to get container status \"032d8535bd64010218adeacc22f3c21c14650ce27ed1c7aab0d8e9ef296a9a18\": rpc error: code = NotFound desc = could not find container \"032d8535bd64010218adeacc22f3c21c14650ce27ed1c7aab0d8e9ef296a9a18\": container with ID starting with 032d8535bd64010218adeacc22f3c21c14650ce27ed1c7aab0d8e9ef296a9a18 not found: ID does not exist"
May 21 01:50:51.976314 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.976294    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
May 21 01:50:51.976314 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.976308    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
May 21 01:50:51.976492 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.976331    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-55e0fk0c4vsma\""
May 21 01:50:51.976492 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.976361    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
May 21 01:50:51.976734 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.976686    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
May 21 01:50:51.976734 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.976705    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
May 21 01:50:51.976734 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.976715    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
May 21 01:50:51.976913 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.976718    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
May 21 01:50:51.977021 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.977008    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
May 21 01:50:51.977949 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.977918    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
May 21 01:50:51.977949 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.977932    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
May 21 01:50:51.978293 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.977921    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-npwc5\""
May 21 01:50:51.980325 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.980306    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
May 21 01:50:51.982775 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.982753    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
May 21 01:50:51.989016 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:51.984321    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 01:50:52.102885 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.102790    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-web-config\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.102885 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.102838    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d0d7926d-93f9-4f39-926a-bf3229d9aa17-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.102885 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.102858    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0d7926d-93f9-4f39-926a-bf3229d9aa17-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.103103 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.102945    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.103103 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.102983    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.103103 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.103011    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fj6px\" (UniqueName: \"kubernetes.io/projected/d0d7926d-93f9-4f39-926a-bf3229d9aa17-kube-api-access-fj6px\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.103103 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.103042    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d7926d-93f9-4f39-926a-bf3229d9aa17-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.103103 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.103066    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.103103 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.103083    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d7926d-93f9-4f39-926a-bf3229d9aa17-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.103299 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.103132    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.103299 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.103164    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0d7926d-93f9-4f39-926a-bf3229d9aa17-config-out\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.103299 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.103183    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.103299 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.103200    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.103299 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.103225    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d7926d-93f9-4f39-926a-bf3229d9aa17-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.103299 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.103241    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d0d7926d-93f9-4f39-926a-bf3229d9aa17-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.103299 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.103258    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0d7926d-93f9-4f39-926a-bf3229d9aa17-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.103299 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.103273    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.103562 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.103343    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-config\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.204000 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.203957    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-config\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.204000 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.204000    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-web-config\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.204256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.204023    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d0d7926d-93f9-4f39-926a-bf3229d9aa17-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.204256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.204049    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0d7926d-93f9-4f39-926a-bf3229d9aa17-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.204256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.204077    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.204256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.204095    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.204256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.204126    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fj6px\" (UniqueName: \"kubernetes.io/projected/d0d7926d-93f9-4f39-926a-bf3229d9aa17-kube-api-access-fj6px\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.204256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.204150    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d7926d-93f9-4f39-926a-bf3229d9aa17-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.204256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.204186    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.204256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.204213    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d7926d-93f9-4f39-926a-bf3229d9aa17-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.204256 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.204244    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.204687 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.204283    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0d7926d-93f9-4f39-926a-bf3229d9aa17-config-out\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.204687 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.204313    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.204687 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.204337    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.204687 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.204378    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d7926d-93f9-4f39-926a-bf3229d9aa17-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.204687 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.204406    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d0d7926d-93f9-4f39-926a-bf3229d9aa17-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.204687 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.204433    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0d7926d-93f9-4f39-926a-bf3229d9aa17-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.204687 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.204458    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.206555 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.205517    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d0d7926d-93f9-4f39-926a-bf3229d9aa17-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.206555 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.205886    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d7926d-93f9-4f39-926a-bf3229d9aa17-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.206555 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.206449    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d7926d-93f9-4f39-926a-bf3229d9aa17-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.207236 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.206845    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d0d7926d-93f9-4f39-926a-bf3229d9aa17-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.207236 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.207228    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-web-config\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.207398 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.207354    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.207695 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.207654    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d0d7926d-93f9-4f39-926a-bf3229d9aa17-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.207981 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.207920    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.208343 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.208320    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-config\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.208833 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.208792    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d0d7926d-93f9-4f39-926a-bf3229d9aa17-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.209143 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.209112    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.209500 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.209475    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d0d7926d-93f9-4f39-926a-bf3229d9aa17-config-out\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.209584 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.209548    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d0d7926d-93f9-4f39-926a-bf3229d9aa17-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.209920 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.209880    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.209920 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.209915    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.210036 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.209920    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.210967 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.210948    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d0d7926d-93f9-4f39-926a-bf3229d9aa17-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.211897 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.211879    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fj6px\" (UniqueName: \"kubernetes.io/projected/d0d7926d-93f9-4f39-926a-bf3229d9aa17-kube-api-access-fj6px\") pod \"prometheus-k8s-0\" (UID: \"d0d7926d-93f9-4f39-926a-bf3229d9aa17\") " pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.235681 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.235619    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2a76978-0537-4781-a695-77e97d7019bc" path="/var/lib/kubelet/pods/e2a76978-0537-4781-a695-77e97d7019bc/volumes"
May 21 01:50:52.284680 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.284622    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:50:52.422949 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.422852    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
May 21 01:50:52.425097 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:50:52.425069    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0d7926d_93f9_4f39_926a_bf3229d9aa17.slice/crio-6e196b3274d6d149999f5124f14597ea236679372b2ed869c0267d8a07b197cc WatchSource:0}: Error finding container 6e196b3274d6d149999f5124f14597ea236679372b2ed869c0267d8a07b197cc: Status 404 returned error can't find the container with id 6e196b3274d6d149999f5124f14597ea236679372b2ed869c0267d8a07b197cc
May 21 01:50:52.923482 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.923449    2582 generic.go:358] "Generic (PLEG): container finished" podID="d0d7926d-93f9-4f39-926a-bf3229d9aa17" containerID="2cb5258ddd33b2117546b32160822ac9ee2c38d77f15de48cbf1ae1c32c93978" exitCode=0
May 21 01:50:52.923932 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.923533    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0d7926d-93f9-4f39-926a-bf3229d9aa17","Type":"ContainerDied","Data":"2cb5258ddd33b2117546b32160822ac9ee2c38d77f15de48cbf1ae1c32c93978"}
May 21 01:50:52.923932 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:52.923570    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0d7926d-93f9-4f39-926a-bf3229d9aa17","Type":"ContainerStarted","Data":"6e196b3274d6d149999f5124f14597ea236679372b2ed869c0267d8a07b197cc"}
May 21 01:50:53.930693 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:53.930656    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0d7926d-93f9-4f39-926a-bf3229d9aa17","Type":"ContainerStarted","Data":"0f08bf30bde3fcd7ac775f7828b1fa192b84869d04f2a56c1c8527a827be8f84"}
May 21 01:50:53.930693 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:53.930698    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0d7926d-93f9-4f39-926a-bf3229d9aa17","Type":"ContainerStarted","Data":"cdc0e405361c0f2a28cbc40443ac14c250b54dd8ac2065a94a95f87dbc9ebacb"}
May 21 01:50:53.931106 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:53.930715    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0d7926d-93f9-4f39-926a-bf3229d9aa17","Type":"ContainerStarted","Data":"3837901dcc74fa3410f2cc0d23f1918eaf2ea19e2f19d4260baf454ed1be994e"}
May 21 01:50:53.931106 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:53.930730    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0d7926d-93f9-4f39-926a-bf3229d9aa17","Type":"ContainerStarted","Data":"798eb9720b57816fb3374def41e12a53612fe0adff15642629f150a439de3dbd"}
May 21 01:50:53.931106 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:53.930742    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0d7926d-93f9-4f39-926a-bf3229d9aa17","Type":"ContainerStarted","Data":"aac31f4e2465972ec35b7b1d80373f6ee3e4581a0c007927ca183997585114a5"}
May 21 01:50:53.931106 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:53.930755    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d0d7926d-93f9-4f39-926a-bf3229d9aa17","Type":"ContainerStarted","Data":"b37fd37f91bfb7bc9d0bc3623bea830134e7c947cba310fce2749a6626a5a8f5"}
May 21 01:50:53.961058 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:53.959174    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.959154432 podStartE2EDuration="2.959154432s" podCreationTimestamp="2026-05-21 01:50:51 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 01:50:53.954779331 +0000 UTC m=+196.368298712" watchObservedRunningTime="2026-05-21 01:50:53.959154432 +0000 UTC m=+196.372673814"
May 21 01:50:57.285663 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:50:57.285604    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:51:52.285015 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:51:52.284972    2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:51:52.301044 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:51:52.301008    2582 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:51:53.112614 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:51:53.112586    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
May 21 01:52:38.108140 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:52:38.108111    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/ovn-acl-logging/0.log"
May 21 01:52:38.110126 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:52:38.110101    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/ovn-acl-logging/0.log"
May 21 01:52:38.115233 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:52:38.115209    2582 kubelet.go:1628] "Image garbage collection succeeded"
May 21 01:54:11.955576 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:11.955544    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64cdd6779c-mgb72"]
May 21 01:54:11.958870 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:11.958851    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-mgb72"
May 21 01:54:11.961954 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:11.961932    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 21 01:54:11.962066 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:11.962012    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 21 01:54:11.962209 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:11.962191    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 21 01:54:11.962320 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:11.962306    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 21 01:54:11.962383 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:11.962339    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fxg7r\""
May 21 01:54:11.973716 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:11.973693    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64cdd6779c-mgb72"]
May 21 01:54:11.991716 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:11.991681    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d08ce825-f54b-4543-928d-0cfcc249d3b3-webhook-cert\") pod \"opendatahub-operator-controller-manager-64cdd6779c-mgb72\" (UID: \"d08ce825-f54b-4543-928d-0cfcc249d3b3\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-mgb72"
May 21 01:54:11.991882 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:11.991733    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d08ce825-f54b-4543-928d-0cfcc249d3b3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64cdd6779c-mgb72\" (UID: \"d08ce825-f54b-4543-928d-0cfcc249d3b3\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-mgb72"
May 21 01:54:11.991882 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:11.991788    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxs6q\" (UniqueName: \"kubernetes.io/projected/d08ce825-f54b-4543-928d-0cfcc249d3b3-kube-api-access-sxs6q\") pod \"opendatahub-operator-controller-manager-64cdd6779c-mgb72\" (UID: \"d08ce825-f54b-4543-928d-0cfcc249d3b3\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-mgb72"
May 21 01:54:12.092217 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:12.092179    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d08ce825-f54b-4543-928d-0cfcc249d3b3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64cdd6779c-mgb72\" (UID: \"d08ce825-f54b-4543-928d-0cfcc249d3b3\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-mgb72"
May 21 01:54:12.092382 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:12.092232    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxs6q\" (UniqueName: \"kubernetes.io/projected/d08ce825-f54b-4543-928d-0cfcc249d3b3-kube-api-access-sxs6q\") pod \"opendatahub-operator-controller-manager-64cdd6779c-mgb72\" (UID: \"d08ce825-f54b-4543-928d-0cfcc249d3b3\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-mgb72"
May 21 01:54:12.092382 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:12.092281    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d08ce825-f54b-4543-928d-0cfcc249d3b3-webhook-cert\") pod \"opendatahub-operator-controller-manager-64cdd6779c-mgb72\" (UID: \"d08ce825-f54b-4543-928d-0cfcc249d3b3\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-mgb72"
May 21 01:54:12.094835 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:12.094807    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d08ce825-f54b-4543-928d-0cfcc249d3b3-webhook-cert\") pod \"opendatahub-operator-controller-manager-64cdd6779c-mgb72\" (UID: \"d08ce825-f54b-4543-928d-0cfcc249d3b3\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-mgb72"
May 21 01:54:12.094945 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:12.094842    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d08ce825-f54b-4543-928d-0cfcc249d3b3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64cdd6779c-mgb72\" (UID: \"d08ce825-f54b-4543-928d-0cfcc249d3b3\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-mgb72"
May 21 01:54:12.102012 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:12.101981    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxs6q\" (UniqueName: \"kubernetes.io/projected/d08ce825-f54b-4543-928d-0cfcc249d3b3-kube-api-access-sxs6q\") pod \"opendatahub-operator-controller-manager-64cdd6779c-mgb72\" (UID: \"d08ce825-f54b-4543-928d-0cfcc249d3b3\") " pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-mgb72"
May 21 01:54:12.269334 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:12.269244    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-mgb72"
May 21 01:54:12.403850 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:12.403815    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64cdd6779c-mgb72"]
May 21 01:54:12.407098 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:54:12.407070    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd08ce825_f54b_4543_928d_0cfcc249d3b3.slice/crio-05f9527c74ceeb975ef64acce6392190468801d4c94d73aa32b471a9709efaaf WatchSource:0}: Error finding container 05f9527c74ceeb975ef64acce6392190468801d4c94d73aa32b471a9709efaaf: Status 404 returned error can't find the container with id 05f9527c74ceeb975ef64acce6392190468801d4c94d73aa32b471a9709efaaf
May 21 01:54:12.408601 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:12.408582    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 01:54:12.492511 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:12.492472    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-mgb72" event={"ID":"d08ce825-f54b-4543-928d-0cfcc249d3b3","Type":"ContainerStarted","Data":"05f9527c74ceeb975ef64acce6392190468801d4c94d73aa32b471a9709efaaf"}
May 21 01:54:14.618153 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.618120    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g"]
May 21 01:54:14.622020 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.621995    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g"
May 21 01:54:14.626171 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.626145    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 21 01:54:14.626310 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.626146    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 21 01:54:14.627518 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.627488    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 21 01:54:14.627606 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.627526    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 21 01:54:14.627710 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.627692    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 21 01:54:14.627865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.627829    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-fllhs\""
May 21 01:54:14.634552 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.634526    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g"]
May 21 01:54:14.714155 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.714114    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/82627ba8-3967-406b-9589-bc0576a07eff-manager-config\") pod \"lws-controller-manager-5c8fd9c4f9-rwv2g\" (UID: \"82627ba8-3967-406b-9589-bc0576a07eff\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g"
May 21 01:54:14.714346 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.714190    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82627ba8-3967-406b-9589-bc0576a07eff-cert\") pod \"lws-controller-manager-5c8fd9c4f9-rwv2g\" (UID: \"82627ba8-3967-406b-9589-bc0576a07eff\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g"
May 21 01:54:14.714346 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.714221    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmb7p\" (UniqueName: \"kubernetes.io/projected/82627ba8-3967-406b-9589-bc0576a07eff-kube-api-access-pmb7p\") pod \"lws-controller-manager-5c8fd9c4f9-rwv2g\" (UID: \"82627ba8-3967-406b-9589-bc0576a07eff\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g"
May 21 01:54:14.714346 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.714326    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/82627ba8-3967-406b-9589-bc0576a07eff-metrics-cert\") pod \"lws-controller-manager-5c8fd9c4f9-rwv2g\" (UID: \"82627ba8-3967-406b-9589-bc0576a07eff\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g"
May 21 01:54:14.815025 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.814990    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/82627ba8-3967-406b-9589-bc0576a07eff-manager-config\") pod \"lws-controller-manager-5c8fd9c4f9-rwv2g\" (UID: \"82627ba8-3967-406b-9589-bc0576a07eff\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g"
May 21 01:54:14.815207 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.815054    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82627ba8-3967-406b-9589-bc0576a07eff-cert\") pod \"lws-controller-manager-5c8fd9c4f9-rwv2g\" (UID: \"82627ba8-3967-406b-9589-bc0576a07eff\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g"
May 21 01:54:14.815207 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.815083    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pmb7p\" (UniqueName: \"kubernetes.io/projected/82627ba8-3967-406b-9589-bc0576a07eff-kube-api-access-pmb7p\") pod \"lws-controller-manager-5c8fd9c4f9-rwv2g\" (UID: \"82627ba8-3967-406b-9589-bc0576a07eff\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g"
May 21 01:54:14.815328 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.815239    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/82627ba8-3967-406b-9589-bc0576a07eff-metrics-cert\") pod \"lws-controller-manager-5c8fd9c4f9-rwv2g\" (UID: \"82627ba8-3967-406b-9589-bc0576a07eff\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g"
May 21 01:54:14.815812 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.815783    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/82627ba8-3967-406b-9589-bc0576a07eff-manager-config\") pod \"lws-controller-manager-5c8fd9c4f9-rwv2g\" (UID: \"82627ba8-3967-406b-9589-bc0576a07eff\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g"
May 21 01:54:14.818036 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.818006    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/82627ba8-3967-406b-9589-bc0576a07eff-cert\") pod \"lws-controller-manager-5c8fd9c4f9-rwv2g\" (UID: \"82627ba8-3967-406b-9589-bc0576a07eff\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g"
May 21 01:54:14.818164 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.818012    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/82627ba8-3967-406b-9589-bc0576a07eff-metrics-cert\") pod \"lws-controller-manager-5c8fd9c4f9-rwv2g\" (UID: \"82627ba8-3967-406b-9589-bc0576a07eff\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g"
May 21 01:54:14.833733 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.833699    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmb7p\" (UniqueName: \"kubernetes.io/projected/82627ba8-3967-406b-9589-bc0576a07eff-kube-api-access-pmb7p\") pod \"lws-controller-manager-5c8fd9c4f9-rwv2g\" (UID: \"82627ba8-3967-406b-9589-bc0576a07eff\") " pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g"
May 21 01:54:14.933851 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:14.933818    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g"
May 21 01:54:15.076894 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:15.076816    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g"]
May 21 01:54:15.079587 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:54:15.079558    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82627ba8_3967_406b_9589_bc0576a07eff.slice/crio-b4b95885d89cc4574ab83d24813100843ae0dcec4825c260e480ab8909887692 WatchSource:0}: Error finding container b4b95885d89cc4574ab83d24813100843ae0dcec4825c260e480ab8909887692: Status 404 returned error can't find the container with id b4b95885d89cc4574ab83d24813100843ae0dcec4825c260e480ab8909887692
May 21 01:54:15.508797 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:15.508743    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-mgb72" event={"ID":"d08ce825-f54b-4543-928d-0cfcc249d3b3","Type":"ContainerStarted","Data":"90b2ff36a74db514d5c24947dc14a4a62a1a9fe8c263efd2c921441a9137d88c"}
May 21 01:54:15.509000 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:15.508815    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-mgb72"
May 21 01:54:15.509841 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:15.509815    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g" event={"ID":"82627ba8-3967-406b-9589-bc0576a07eff","Type":"ContainerStarted","Data":"b4b95885d89cc4574ab83d24813100843ae0dcec4825c260e480ab8909887692"}
May 21 01:54:15.534133 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:15.534089    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-mgb72" podStartSLOduration=1.9970098699999999 podStartE2EDuration="4.534074664s" podCreationTimestamp="2026-05-21 01:54:11 +0000 UTC" firstStartedPulling="2026-05-21 01:54:12.408729265 +0000 UTC m=+394.822248623" lastFinishedPulling="2026-05-21 01:54:14.945794058 +0000 UTC m=+397.359313417" observedRunningTime="2026-05-21 01:54:15.532870139 +0000 UTC m=+397.946389543" watchObservedRunningTime="2026-05-21 01:54:15.534074664 +0000 UTC m=+397.947594045"
May 21 01:54:18.521175 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:18.521135    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g" event={"ID":"82627ba8-3967-406b-9589-bc0576a07eff","Type":"ContainerStarted","Data":"4b907ec5416dce4501a832ca03cb6c00efd9cb85cde9c90d36c60caedf0f2e16"}
May 21 01:54:18.521590 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:18.521252    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g"
May 21 01:54:18.536564 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:18.536517    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g" podStartSLOduration=1.884847602 podStartE2EDuration="4.536500842s" podCreationTimestamp="2026-05-21 01:54:14 +0000 UTC" firstStartedPulling="2026-05-21 01:54:15.08125108 +0000 UTC m=+397.494770438" lastFinishedPulling="2026-05-21 01:54:17.732904316 +0000 UTC m=+400.146423678" observedRunningTime="2026-05-21 01:54:18.535366471 +0000 UTC m=+400.948885936" watchObservedRunningTime="2026-05-21 01:54:18.536500842 +0000 UTC m=+400.950020225"
May 21 01:54:26.516347 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:26.516310    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64cdd6779c-mgb72"
May 21 01:54:29.527283 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:29.527250    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c8fd9c4f9-rwv2g"
May 21 01:54:40.142629 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:40.142570    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-f6cbd8488-4qv9l"]
May 21 01:54:40.146492 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:40.146463    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f6cbd8488-4qv9l"
May 21 01:54:40.149161 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:40.149130    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 21 01:54:40.149286 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:40.149178    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 21 01:54:40.149362 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:40.149331    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-vxsmh\""
May 21 01:54:40.155292 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:40.155270    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f6cbd8488-4qv9l"]
May 21 01:54:40.241109 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:40.241066    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77ed2b90-7705-4010-90df-1ca4a5266494-tls-certs\") pod \"kube-auth-proxy-f6cbd8488-4qv9l\" (UID: \"77ed2b90-7705-4010-90df-1ca4a5266494\") " pod="openshift-ingress/kube-auth-proxy-f6cbd8488-4qv9l"
May 21 01:54:40.241300 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:40.241158    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf6df\" (UniqueName: \"kubernetes.io/projected/77ed2b90-7705-4010-90df-1ca4a5266494-kube-api-access-nf6df\") pod \"kube-auth-proxy-f6cbd8488-4qv9l\" (UID: \"77ed2b90-7705-4010-90df-1ca4a5266494\") " pod="openshift-ingress/kube-auth-proxy-f6cbd8488-4qv9l"
May 21 01:54:40.241300 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:40.241257    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77ed2b90-7705-4010-90df-1ca4a5266494-tmp\") pod \"kube-auth-proxy-f6cbd8488-4qv9l\" (UID: \"77ed2b90-7705-4010-90df-1ca4a5266494\") " pod="openshift-ingress/kube-auth-proxy-f6cbd8488-4qv9l"
May 21 01:54:40.342198 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:40.342147    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77ed2b90-7705-4010-90df-1ca4a5266494-tmp\") pod \"kube-auth-proxy-f6cbd8488-4qv9l\" (UID: \"77ed2b90-7705-4010-90df-1ca4a5266494\") " pod="openshift-ingress/kube-auth-proxy-f6cbd8488-4qv9l"
May 21 01:54:40.342405 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:40.342203    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77ed2b90-7705-4010-90df-1ca4a5266494-tls-certs\") pod \"kube-auth-proxy-f6cbd8488-4qv9l\" (UID: \"77ed2b90-7705-4010-90df-1ca4a5266494\") " pod="openshift-ingress/kube-auth-proxy-f6cbd8488-4qv9l"
May 21 01:54:40.342405 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:40.342282    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nf6df\" (UniqueName: \"kubernetes.io/projected/77ed2b90-7705-4010-90df-1ca4a5266494-kube-api-access-nf6df\") pod \"kube-auth-proxy-f6cbd8488-4qv9l\" (UID: \"77ed2b90-7705-4010-90df-1ca4a5266494\") " pod="openshift-ingress/kube-auth-proxy-f6cbd8488-4qv9l"
May 21 01:54:40.344670 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:40.344614    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/77ed2b90-7705-4010-90df-1ca4a5266494-tmp\") pod \"kube-auth-proxy-f6cbd8488-4qv9l\" (UID: \"77ed2b90-7705-4010-90df-1ca4a5266494\") " pod="openshift-ingress/kube-auth-proxy-f6cbd8488-4qv9l"
May 21 01:54:40.344844 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:40.344828    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/77ed2b90-7705-4010-90df-1ca4a5266494-tls-certs\") pod \"kube-auth-proxy-f6cbd8488-4qv9l\" (UID: \"77ed2b90-7705-4010-90df-1ca4a5266494\") " pod="openshift-ingress/kube-auth-proxy-f6cbd8488-4qv9l"
May 21 01:54:40.351261 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:40.351238    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf6df\" (UniqueName: \"kubernetes.io/projected/77ed2b90-7705-4010-90df-1ca4a5266494-kube-api-access-nf6df\") pod \"kube-auth-proxy-f6cbd8488-4qv9l\" (UID: \"77ed2b90-7705-4010-90df-1ca4a5266494\") " pod="openshift-ingress/kube-auth-proxy-f6cbd8488-4qv9l"
May 21 01:54:40.457620 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:40.457533    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-f6cbd8488-4qv9l"
May 21 01:54:40.588087 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:40.588059    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-f6cbd8488-4qv9l"]
May 21 01:54:40.590413 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:54:40.590383    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77ed2b90_7705_4010_90df_1ca4a5266494.slice/crio-dafe19fa654dda5b118c3b9faef7b4ff5fa1602d7f4a64cb4449e7f9ab7aa403 WatchSource:0}: Error finding container dafe19fa654dda5b118c3b9faef7b4ff5fa1602d7f4a64cb4449e7f9ab7aa403: Status 404 returned error can't find the container with id dafe19fa654dda5b118c3b9faef7b4ff5fa1602d7f4a64cb4449e7f9ab7aa403
May 21 01:54:41.598173 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:41.598131    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f6cbd8488-4qv9l" event={"ID":"77ed2b90-7705-4010-90df-1ca4a5266494","Type":"ContainerStarted","Data":"dafe19fa654dda5b118c3b9faef7b4ff5fa1602d7f4a64cb4449e7f9ab7aa403"}
May 21 01:54:44.609470 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:44.609434    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-f6cbd8488-4qv9l" event={"ID":"77ed2b90-7705-4010-90df-1ca4a5266494","Type":"ContainerStarted","Data":"bf1801b006b20b6881b908ef304397d8bfeb998c9298d39cda6609f44799d484"}
May 21 01:54:44.625873 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:54:44.625821    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-f6cbd8488-4qv9l" podStartSLOduration=1.301427538 podStartE2EDuration="4.625808887s" podCreationTimestamp="2026-05-21 01:54:40 +0000 UTC" firstStartedPulling="2026-05-21 01:54:40.592238987 +0000 UTC m=+423.005758346" lastFinishedPulling="2026-05-21 01:54:43.916620333 +0000 UTC m=+426.330139695" observedRunningTime="2026-05-21 01:54:44.623729447 +0000 UTC m=+427.037248829" watchObservedRunningTime="2026-05-21 01:54:44.625808887 +0000 UTC m=+427.039328267"
May 21 01:56:13.408074 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:56:13.408038    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-6pr9v"]
May 21 01:56:13.412331 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:56:13.412304    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-6pr9v"
May 21 01:56:13.415262 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:56:13.415241    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-4nk5g\""
May 21 01:56:13.415762 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:56:13.415745    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 21 01:56:13.416573 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:56:13.416560    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 21 01:56:13.427927 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:56:13.427901    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-6pr9v"]
May 21 01:56:13.537098 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:56:13.537060    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sn64t\" (UniqueName: \"kubernetes.io/projected/dd299222-0e9a-4e99-bcad-20a1eab98d67-kube-api-access-sn64t\") pod \"authorino-operator-657f44b778-6pr9v\" (UID: \"dd299222-0e9a-4e99-bcad-20a1eab98d67\") " pod="kuadrant-system/authorino-operator-657f44b778-6pr9v"
May 21 01:56:13.638578 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:56:13.638543    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sn64t\" (UniqueName: \"kubernetes.io/projected/dd299222-0e9a-4e99-bcad-20a1eab98d67-kube-api-access-sn64t\") pod \"authorino-operator-657f44b778-6pr9v\" (UID: \"dd299222-0e9a-4e99-bcad-20a1eab98d67\") " pod="kuadrant-system/authorino-operator-657f44b778-6pr9v"
May 21 01:56:13.646780 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:56:13.646752    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sn64t\" (UniqueName: \"kubernetes.io/projected/dd299222-0e9a-4e99-bcad-20a1eab98d67-kube-api-access-sn64t\") pod \"authorino-operator-657f44b778-6pr9v\" (UID: \"dd299222-0e9a-4e99-bcad-20a1eab98d67\") " pod="kuadrant-system/authorino-operator-657f44b778-6pr9v"
May 21 01:56:13.722842 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:56:13.722743    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-6pr9v"
May 21 01:56:13.852541 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:56:13.852469    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-6pr9v"]
May 21 01:56:13.855434 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:56:13.855404    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd299222_0e9a_4e99_bcad_20a1eab98d67.slice/crio-d7747673204cae8c57531ba5a4750f680f67afc5edb3d1f444fb2478a9ef698f WatchSource:0}: Error finding container d7747673204cae8c57531ba5a4750f680f67afc5edb3d1f444fb2478a9ef698f: Status 404 returned error can't find the container with id d7747673204cae8c57531ba5a4750f680f67afc5edb3d1f444fb2478a9ef698f
May 21 01:56:13.900370 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:56:13.900338    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-6pr9v" event={"ID":"dd299222-0e9a-4e99-bcad-20a1eab98d67","Type":"ContainerStarted","Data":"d7747673204cae8c57531ba5a4750f680f67afc5edb3d1f444fb2478a9ef698f"}
May 21 01:56:15.908196 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:56:15.908112    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-6pr9v" event={"ID":"dd299222-0e9a-4e99-bcad-20a1eab98d67","Type":"ContainerStarted","Data":"662a99c25d3f948a3901be166cbd9fdefbadce1fab7ea5be167bbe97a08e7968"}
May 21 01:56:15.908538 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:56:15.908255    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-6pr9v"
May 21 01:56:15.928589 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:56:15.928547    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-6pr9v" podStartSLOduration=1.159546079 podStartE2EDuration="2.928532016s" podCreationTimestamp="2026-05-21 01:56:13 +0000 UTC" firstStartedPulling="2026-05-21 01:56:13.857185504 +0000 UTC m=+516.270704863" lastFinishedPulling="2026-05-21 01:56:15.626171427 +0000 UTC m=+518.039690800" observedRunningTime="2026-05-21 01:56:15.927300771 +0000 UTC m=+518.340820153" watchObservedRunningTime="2026-05-21 01:56:15.928532016 +0000 UTC m=+518.342051396"
May 21 01:56:26.914426 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:56:26.914387    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-6pr9v"
May 21 01:57:10.187846 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:10.187807    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mb7kv"]
May 21 01:57:10.192112 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:10.192088    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mb7kv"
May 21 01:57:10.194893 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:10.194868    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7ntpb\""
May 21 01:57:10.197781 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:10.197752    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mb7kv"]
May 21 01:57:10.322461 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:10.322426    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2nxlh\" (UniqueName: \"kubernetes.io/projected/ab278cab-2dcf-4fc1-ae73-8d11bc884de1-kube-api-access-2nxlh\") pod \"authorino-f99f4b5cd-mb7kv\" (UID: \"ab278cab-2dcf-4fc1-ae73-8d11bc884de1\") " pod="kuadrant-system/authorino-f99f4b5cd-mb7kv"
May 21 01:57:10.423540 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:10.423495    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2nxlh\" (UniqueName: \"kubernetes.io/projected/ab278cab-2dcf-4fc1-ae73-8d11bc884de1-kube-api-access-2nxlh\") pod \"authorino-f99f4b5cd-mb7kv\" (UID: \"ab278cab-2dcf-4fc1-ae73-8d11bc884de1\") " pod="kuadrant-system/authorino-f99f4b5cd-mb7kv"
May 21 01:57:10.433773 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:10.433746    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2nxlh\" (UniqueName: \"kubernetes.io/projected/ab278cab-2dcf-4fc1-ae73-8d11bc884de1-kube-api-access-2nxlh\") pod \"authorino-f99f4b5cd-mb7kv\" (UID: \"ab278cab-2dcf-4fc1-ae73-8d11bc884de1\") " pod="kuadrant-system/authorino-f99f4b5cd-mb7kv"
May 21 01:57:10.510867 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:10.510771    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mb7kv"
May 21 01:57:10.639729 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:10.639612    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mb7kv"]
May 21 01:57:10.642551 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:57:10.642516    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podab278cab_2dcf_4fc1_ae73_8d11bc884de1.slice/crio-a3543d07ffd411e1a8faa6d08c6c206a7a58618dc268cc54c2c98d79e967ca31 WatchSource:0}: Error finding container a3543d07ffd411e1a8faa6d08c6c206a7a58618dc268cc54c2c98d79e967ca31: Status 404 returned error can't find the container with id a3543d07ffd411e1a8faa6d08c6c206a7a58618dc268cc54c2c98d79e967ca31
May 21 01:57:11.095283 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:11.095242    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mb7kv" event={"ID":"ab278cab-2dcf-4fc1-ae73-8d11bc884de1","Type":"ContainerStarted","Data":"a3543d07ffd411e1a8faa6d08c6c206a7a58618dc268cc54c2c98d79e967ca31"}
May 21 01:57:14.106693 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:14.106590    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mb7kv" event={"ID":"ab278cab-2dcf-4fc1-ae73-8d11bc884de1","Type":"ContainerStarted","Data":"be2ed53537cebc2035d1c5569a6d248024466179bdcd6c1b90e839cc926c52c8"}
May 21 01:57:14.123114 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:14.123053    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-f99f4b5cd-mb7kv" podStartSLOduration=0.9468085 podStartE2EDuration="4.123033576s" podCreationTimestamp="2026-05-21 01:57:10 +0000 UTC" firstStartedPulling="2026-05-21 01:57:10.643805226 +0000 UTC m=+573.057324585" lastFinishedPulling="2026-05-21 01:57:13.820030302 +0000 UTC m=+576.233549661" observedRunningTime="2026-05-21 01:57:14.119970733 +0000 UTC m=+576.533490125" watchObservedRunningTime="2026-05-21 01:57:14.123033576 +0000 UTC m=+576.536552959"
May 21 01:57:14.790987 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:14.790953    2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mb7kv"]
May 21 01:57:16.112701 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:16.112657    2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-f99f4b5cd-mb7kv" podUID="ab278cab-2dcf-4fc1-ae73-8d11bc884de1" containerName="authorino" containerID="cri-o://be2ed53537cebc2035d1c5569a6d248024466179bdcd6c1b90e839cc926c52c8" gracePeriod=30
May 21 01:57:16.360515 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:16.360491    2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mb7kv"
May 21 01:57:16.482869 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:16.482836    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2nxlh\" (UniqueName: \"kubernetes.io/projected/ab278cab-2dcf-4fc1-ae73-8d11bc884de1-kube-api-access-2nxlh\") pod \"ab278cab-2dcf-4fc1-ae73-8d11bc884de1\" (UID: \"ab278cab-2dcf-4fc1-ae73-8d11bc884de1\") "
May 21 01:57:16.485159 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:16.485137    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab278cab-2dcf-4fc1-ae73-8d11bc884de1-kube-api-access-2nxlh" (OuterVolumeSpecName: "kube-api-access-2nxlh") pod "ab278cab-2dcf-4fc1-ae73-8d11bc884de1" (UID: "ab278cab-2dcf-4fc1-ae73-8d11bc884de1"). InnerVolumeSpecName "kube-api-access-2nxlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:57:16.584149 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:16.584059    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2nxlh\" (UniqueName: \"kubernetes.io/projected/ab278cab-2dcf-4fc1-ae73-8d11bc884de1-kube-api-access-2nxlh\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:57:17.117415 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:17.117370    2582 generic.go:358] "Generic (PLEG): container finished" podID="ab278cab-2dcf-4fc1-ae73-8d11bc884de1" containerID="be2ed53537cebc2035d1c5569a6d248024466179bdcd6c1b90e839cc926c52c8" exitCode=0
May 21 01:57:17.117908 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:17.117427    2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f99f4b5cd-mb7kv"
May 21 01:57:17.117908 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:17.117458    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mb7kv" event={"ID":"ab278cab-2dcf-4fc1-ae73-8d11bc884de1","Type":"ContainerDied","Data":"be2ed53537cebc2035d1c5569a6d248024466179bdcd6c1b90e839cc926c52c8"}
May 21 01:57:17.117908 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:17.117502    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f99f4b5cd-mb7kv" event={"ID":"ab278cab-2dcf-4fc1-ae73-8d11bc884de1","Type":"ContainerDied","Data":"a3543d07ffd411e1a8faa6d08c6c206a7a58618dc268cc54c2c98d79e967ca31"}
May 21 01:57:17.117908 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:17.117519    2582 scope.go:117] "RemoveContainer" containerID="be2ed53537cebc2035d1c5569a6d248024466179bdcd6c1b90e839cc926c52c8"
May 21 01:57:17.125817 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:17.125792    2582 scope.go:117] "RemoveContainer" containerID="be2ed53537cebc2035d1c5569a6d248024466179bdcd6c1b90e839cc926c52c8"
May 21 01:57:17.126136 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:57:17.126111    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be2ed53537cebc2035d1c5569a6d248024466179bdcd6c1b90e839cc926c52c8\": container with ID starting with be2ed53537cebc2035d1c5569a6d248024466179bdcd6c1b90e839cc926c52c8 not found: ID does not exist" containerID="be2ed53537cebc2035d1c5569a6d248024466179bdcd6c1b90e839cc926c52c8"
May 21 01:57:17.126185 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:17.126148    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be2ed53537cebc2035d1c5569a6d248024466179bdcd6c1b90e839cc926c52c8"} err="failed to get container status \"be2ed53537cebc2035d1c5569a6d248024466179bdcd6c1b90e839cc926c52c8\": rpc error: code = NotFound desc = could not find container \"be2ed53537cebc2035d1c5569a6d248024466179bdcd6c1b90e839cc926c52c8\": container with ID starting with be2ed53537cebc2035d1c5569a6d248024466179bdcd6c1b90e839cc926c52c8 not found: ID does not exist"
May 21 01:57:17.139431 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:17.139404    2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mb7kv"]
May 21 01:57:17.142795 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:17.142775    2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f99f4b5cd-mb7kv"]
May 21 01:57:18.236190 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:18.236149    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab278cab-2dcf-4fc1-ae73-8d11bc884de1" path="/var/lib/kubelet/pods/ab278cab-2dcf-4fc1-ae73-8d11bc884de1/volumes"
May 21 01:57:38.142798 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:38.142774    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/ovn-acl-logging/0.log"
May 21 01:57:38.143747 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:38.143724    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/ovn-acl-logging/0.log"
May 21 01:57:42.175532 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.175496    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-8b475cf9f-mgskp"]
May 21 01:57:42.175967 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.175832    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab278cab-2dcf-4fc1-ae73-8d11bc884de1" containerName="authorino"
May 21 01:57:42.175967 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.175843    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab278cab-2dcf-4fc1-ae73-8d11bc884de1" containerName="authorino"
May 21 01:57:42.175967 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.175908    2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="ab278cab-2dcf-4fc1-ae73-8d11bc884de1" containerName="authorino"
May 21 01:57:42.180011 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.179987    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-mgskp"
May 21 01:57:42.182886 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.182861    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7ntpb\""
May 21 01:57:42.184359 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.184335    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-mgskp"]
May 21 01:57:42.194491 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.194465    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwrgg\" (UniqueName: \"kubernetes.io/projected/0d67757d-1527-498e-8826-65f63a01e4e9-kube-api-access-zwrgg\") pod \"authorino-8b475cf9f-mgskp\" (UID: \"0d67757d-1527-498e-8826-65f63a01e4e9\") " pod="kuadrant-system/authorino-8b475cf9f-mgskp"
May 21 01:57:42.295029 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.294999    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zwrgg\" (UniqueName: \"kubernetes.io/projected/0d67757d-1527-498e-8826-65f63a01e4e9-kube-api-access-zwrgg\") pod \"authorino-8b475cf9f-mgskp\" (UID: \"0d67757d-1527-498e-8826-65f63a01e4e9\") " pod="kuadrant-system/authorino-8b475cf9f-mgskp"
May 21 01:57:42.302751 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.302726    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwrgg\" (UniqueName: \"kubernetes.io/projected/0d67757d-1527-498e-8826-65f63a01e4e9-kube-api-access-zwrgg\") pod \"authorino-8b475cf9f-mgskp\" (UID: \"0d67757d-1527-498e-8826-65f63a01e4e9\") " pod="kuadrant-system/authorino-8b475cf9f-mgskp"
May 21 01:57:42.403990 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.403958    2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-mgskp"]
May 21 01:57:42.404172 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.404160    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-mgskp"
May 21 01:57:42.424134 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.424106    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6ddd569dcc-fq2bd"]
May 21 01:57:42.426926 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.426881    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6ddd569dcc-fq2bd"
May 21 01:57:42.432486 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.432457    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6ddd569dcc-fq2bd"]
May 21 01:57:42.497315 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.497283    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-964kh\" (UniqueName: \"kubernetes.io/projected/f5b83db4-19e2-46db-9b06-bf51d15df731-kube-api-access-964kh\") pod \"authorino-6ddd569dcc-fq2bd\" (UID: \"f5b83db4-19e2-46db-9b06-bf51d15df731\") " pod="kuadrant-system/authorino-6ddd569dcc-fq2bd"
May 21 01:57:42.531332 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.531304    2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6ddd569dcc-fq2bd"]
May 21 01:57:42.531579 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:57:42.531562    2582 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-964kh], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6ddd569dcc-fq2bd" podUID="f5b83db4-19e2-46db-9b06-bf51d15df731"
May 21 01:57:42.543921 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.543898    2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-mgskp"]
May 21 01:57:42.546595 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:57:42.546563    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0d67757d_1527_498e_8826_65f63a01e4e9.slice/crio-842af9d5ed6702976f1db55c9eca549c91b23123505d91ae5e19eb22e0932a9a WatchSource:0}: Error finding container 842af9d5ed6702976f1db55c9eca549c91b23123505d91ae5e19eb22e0932a9a: Status 404 returned error can't find the container with id 842af9d5ed6702976f1db55c9eca549c91b23123505d91ae5e19eb22e0932a9a
May 21 01:57:42.557002 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.556974    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d5c74ddd5-vf787"]
May 21 01:57:42.559320 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.559303    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d5c74ddd5-vf787"
May 21 01:57:42.561777 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.561756    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 21 01:57:42.568024 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.567998    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d5c74ddd5-vf787"]
May 21 01:57:42.597946 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.597915    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-964kh\" (UniqueName: \"kubernetes.io/projected/f5b83db4-19e2-46db-9b06-bf51d15df731-kube-api-access-964kh\") pod \"authorino-6ddd569dcc-fq2bd\" (UID: \"f5b83db4-19e2-46db-9b06-bf51d15df731\") " pod="kuadrant-system/authorino-6ddd569dcc-fq2bd"
May 21 01:57:42.598101 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.597966    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk4dj\" (UniqueName: \"kubernetes.io/projected/8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38-kube-api-access-lk4dj\") pod \"authorino-5d5c74ddd5-vf787\" (UID: \"8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38\") " pod="kuadrant-system/authorino-5d5c74ddd5-vf787"
May 21 01:57:42.598101 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.598019    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38-tls-cert\") pod \"authorino-5d5c74ddd5-vf787\" (UID: \"8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38\") " pod="kuadrant-system/authorino-5d5c74ddd5-vf787"
May 21 01:57:42.605841 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.605807    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-964kh\" (UniqueName: \"kubernetes.io/projected/f5b83db4-19e2-46db-9b06-bf51d15df731-kube-api-access-964kh\") pod \"authorino-6ddd569dcc-fq2bd\" (UID: \"f5b83db4-19e2-46db-9b06-bf51d15df731\") " pod="kuadrant-system/authorino-6ddd569dcc-fq2bd"
May 21 01:57:42.698791 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.698701    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lk4dj\" (UniqueName: \"kubernetes.io/projected/8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38-kube-api-access-lk4dj\") pod \"authorino-5d5c74ddd5-vf787\" (UID: \"8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38\") " pod="kuadrant-system/authorino-5d5c74ddd5-vf787"
May 21 01:57:42.698791 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.698754    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38-tls-cert\") pod \"authorino-5d5c74ddd5-vf787\" (UID: \"8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38\") " pod="kuadrant-system/authorino-5d5c74ddd5-vf787"
May 21 01:57:42.701329 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.701310    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38-tls-cert\") pod \"authorino-5d5c74ddd5-vf787\" (UID: \"8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38\") " pod="kuadrant-system/authorino-5d5c74ddd5-vf787"
May 21 01:57:42.706504 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.706484    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk4dj\" (UniqueName: \"kubernetes.io/projected/8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38-kube-api-access-lk4dj\") pod \"authorino-5d5c74ddd5-vf787\" (UID: \"8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38\") " pod="kuadrant-system/authorino-5d5c74ddd5-vf787"
May 21 01:57:42.869297 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:42.869270    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d5c74ddd5-vf787"
May 21 01:57:43.007096 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:43.006890    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d5c74ddd5-vf787"]
May 21 01:57:43.011655 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:57:43.011611    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bd52d71_9c81_4330_9bf3_0ffdb4f1aa38.slice/crio-ac4b7f4ad11a1e6de282f80b04401433acfce916567c60e6ebdcde006ed67834 WatchSource:0}: Error finding container ac4b7f4ad11a1e6de282f80b04401433acfce916567c60e6ebdcde006ed67834: Status 404 returned error can't find the container with id ac4b7f4ad11a1e6de282f80b04401433acfce916567c60e6ebdcde006ed67834
May 21 01:57:43.198969 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:43.198927    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-mgskp" event={"ID":"0d67757d-1527-498e-8826-65f63a01e4e9","Type":"ContainerStarted","Data":"235db4098b2dd77cd60783a7ad500da2fa9af45963be8c5ec3eeae5cb06cc966"}
May 21 01:57:43.198969 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:43.198964    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-mgskp" event={"ID":"0d67757d-1527-498e-8826-65f63a01e4e9","Type":"ContainerStarted","Data":"842af9d5ed6702976f1db55c9eca549c91b23123505d91ae5e19eb22e0932a9a"}
May 21 01:57:43.199440 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:43.198995    2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-8b475cf9f-mgskp" podUID="0d67757d-1527-498e-8826-65f63a01e4e9" containerName="authorino" containerID="cri-o://235db4098b2dd77cd60783a7ad500da2fa9af45963be8c5ec3eeae5cb06cc966" gracePeriod=30
May 21 01:57:43.200002 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:43.199979    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d5c74ddd5-vf787" event={"ID":"8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38","Type":"ContainerStarted","Data":"ac4b7f4ad11a1e6de282f80b04401433acfce916567c60e6ebdcde006ed67834"}
May 21 01:57:43.200126 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:43.200005    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6ddd569dcc-fq2bd"
May 21 01:57:43.204832 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:43.204813    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6ddd569dcc-fq2bd"
May 21 01:57:43.213087 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:43.213045    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-8b475cf9f-mgskp" podStartSLOduration=0.941319235 podStartE2EDuration="1.213032889s" podCreationTimestamp="2026-05-21 01:57:42 +0000 UTC" firstStartedPulling="2026-05-21 01:57:42.547843471 +0000 UTC m=+604.961362830" lastFinishedPulling="2026-05-21 01:57:42.819557123 +0000 UTC m=+605.233076484" observedRunningTime="2026-05-21 01:57:43.211949728 +0000 UTC m=+605.625469109" watchObservedRunningTime="2026-05-21 01:57:43.213032889 +0000 UTC m=+605.626552270"
May 21 01:57:43.303818 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:43.303782    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-964kh\" (UniqueName: \"kubernetes.io/projected/f5b83db4-19e2-46db-9b06-bf51d15df731-kube-api-access-964kh\") pod \"f5b83db4-19e2-46db-9b06-bf51d15df731\" (UID: \"f5b83db4-19e2-46db-9b06-bf51d15df731\") "
May 21 01:57:43.306082 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:43.306049    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5b83db4-19e2-46db-9b06-bf51d15df731-kube-api-access-964kh" (OuterVolumeSpecName: "kube-api-access-964kh") pod "f5b83db4-19e2-46db-9b06-bf51d15df731" (UID: "f5b83db4-19e2-46db-9b06-bf51d15df731"). InnerVolumeSpecName "kube-api-access-964kh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:57:43.405344 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:43.405314    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-964kh\" (UniqueName: \"kubernetes.io/projected/f5b83db4-19e2-46db-9b06-bf51d15df731-kube-api-access-964kh\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:57:43.449190 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:43.449167    2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-mgskp"
May 21 01:57:43.506345 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:43.506319    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zwrgg\" (UniqueName: \"kubernetes.io/projected/0d67757d-1527-498e-8826-65f63a01e4e9-kube-api-access-zwrgg\") pod \"0d67757d-1527-498e-8826-65f63a01e4e9\" (UID: \"0d67757d-1527-498e-8826-65f63a01e4e9\") "
May 21 01:57:43.508323 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:43.508304    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d67757d-1527-498e-8826-65f63a01e4e9-kube-api-access-zwrgg" (OuterVolumeSpecName: "kube-api-access-zwrgg") pod "0d67757d-1527-498e-8826-65f63a01e4e9" (UID: "0d67757d-1527-498e-8826-65f63a01e4e9"). InnerVolumeSpecName "kube-api-access-zwrgg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:57:43.608034 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:43.607994    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zwrgg\" (UniqueName: \"kubernetes.io/projected/0d67757d-1527-498e-8826-65f63a01e4e9-kube-api-access-zwrgg\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:57:44.205065 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:44.205024    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d5c74ddd5-vf787" event={"ID":"8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38","Type":"ContainerStarted","Data":"0a0608c09a81f425bdda2a45ebea48dba48f1c87acd1931b3233a0281a93c1f8"}
May 21 01:57:44.206218 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:44.206181    2582 generic.go:358] "Generic (PLEG): container finished" podID="0d67757d-1527-498e-8826-65f63a01e4e9" containerID="235db4098b2dd77cd60783a7ad500da2fa9af45963be8c5ec3eeae5cb06cc966" exitCode=0
May 21 01:57:44.206353 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:44.206225    2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-8b475cf9f-mgskp"
May 21 01:57:44.206353 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:44.206267    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-mgskp" event={"ID":"0d67757d-1527-498e-8826-65f63a01e4e9","Type":"ContainerDied","Data":"235db4098b2dd77cd60783a7ad500da2fa9af45963be8c5ec3eeae5cb06cc966"}
May 21 01:57:44.206353 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:44.206311    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-8b475cf9f-mgskp" event={"ID":"0d67757d-1527-498e-8826-65f63a01e4e9","Type":"ContainerDied","Data":"842af9d5ed6702976f1db55c9eca549c91b23123505d91ae5e19eb22e0932a9a"}
May 21 01:57:44.206353 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:44.206330    2582 scope.go:117] "RemoveContainer" containerID="235db4098b2dd77cd60783a7ad500da2fa9af45963be8c5ec3eeae5cb06cc966"
May 21 01:57:44.206548 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:44.206385    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6ddd569dcc-fq2bd"
May 21 01:57:44.214315 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:44.214300    2582 scope.go:117] "RemoveContainer" containerID="235db4098b2dd77cd60783a7ad500da2fa9af45963be8c5ec3eeae5cb06cc966"
May 21 01:57:44.214568 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:57:44.214540    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"235db4098b2dd77cd60783a7ad500da2fa9af45963be8c5ec3eeae5cb06cc966\": container with ID starting with 235db4098b2dd77cd60783a7ad500da2fa9af45963be8c5ec3eeae5cb06cc966 not found: ID does not exist" containerID="235db4098b2dd77cd60783a7ad500da2fa9af45963be8c5ec3eeae5cb06cc966"
May 21 01:57:44.214664 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:44.214572    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"235db4098b2dd77cd60783a7ad500da2fa9af45963be8c5ec3eeae5cb06cc966"} err="failed to get container status \"235db4098b2dd77cd60783a7ad500da2fa9af45963be8c5ec3eeae5cb06cc966\": rpc error: code = NotFound desc = could not find container \"235db4098b2dd77cd60783a7ad500da2fa9af45963be8c5ec3eeae5cb06cc966\": container with ID starting with 235db4098b2dd77cd60783a7ad500da2fa9af45963be8c5ec3eeae5cb06cc966 not found: ID does not exist"
May 21 01:57:44.219804 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:44.219767    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-5d5c74ddd5-vf787" podStartSLOduration=1.755908978 podStartE2EDuration="2.219755705s" podCreationTimestamp="2026-05-21 01:57:42 +0000 UTC" firstStartedPulling="2026-05-21 01:57:43.013192279 +0000 UTC m=+605.426711638" lastFinishedPulling="2026-05-21 01:57:43.477039004 +0000 UTC m=+605.890558365" observedRunningTime="2026-05-21 01:57:44.219370853 +0000 UTC m=+606.632890234" watchObservedRunningTime="2026-05-21 01:57:44.219755705 +0000 UTC m=+606.633275085"
May 21 01:57:44.238431 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:44.238401    2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-mgskp"]
May 21 01:57:44.239445 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:44.239424    2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-8b475cf9f-mgskp"]
May 21 01:57:44.264183 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:44.264138    2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6ddd569dcc-fq2bd"]
May 21 01:57:44.266445 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:44.266414    2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6ddd569dcc-fq2bd"]
May 21 01:57:46.238703 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:46.238605    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d67757d-1527-498e-8826-65f63a01e4e9" path="/var/lib/kubelet/pods/0d67757d-1527-498e-8826-65f63a01e4e9/volumes"
May 21 01:57:46.239212 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:57:46.239179    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5b83db4-19e2-46db-9b06-bf51d15df731" path="/var/lib/kubelet/pods/f5b83db4-19e2-46db-9b06-bf51d15df731/volumes"
May 21 01:58:29.290305 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.290256    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"]
May 21 01:58:29.292911 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.290624    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d67757d-1527-498e-8826-65f63a01e4e9" containerName="authorino"
May 21 01:58:29.292911 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.290649    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d67757d-1527-498e-8826-65f63a01e4e9" containerName="authorino"
May 21 01:58:29.292911 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.290702    2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="0d67757d-1527-498e-8826-65f63a01e4e9" containerName="authorino"
May 21 01:58:29.293868 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.293852    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:29.296439 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.296415    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 21 01:58:29.297738 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.297716    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8vpnv\""
May 21 01:58:29.297832 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.297717    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 21 01:58:29.297913 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.297726    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
May 21 01:58:29.302455 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.302433    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"]
May 21 01:58:29.307571 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.307545    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0ba2bd24-21ab-4f20-a772-fb440443b717-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz\" (UID: \"0ba2bd24-21ab-4f20-a772-fb440443b717\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:29.307682 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.307651    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ba2bd24-21ab-4f20-a772-fb440443b717-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz\" (UID: \"0ba2bd24-21ab-4f20-a772-fb440443b717\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:29.307725 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.307690    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5hwz\" (UniqueName: \"kubernetes.io/projected/0ba2bd24-21ab-4f20-a772-fb440443b717-kube-api-access-m5hwz\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz\" (UID: \"0ba2bd24-21ab-4f20-a772-fb440443b717\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:29.307767 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.307732    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ba2bd24-21ab-4f20-a772-fb440443b717-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz\" (UID: \"0ba2bd24-21ab-4f20-a772-fb440443b717\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:29.307767 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.307760    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ba2bd24-21ab-4f20-a772-fb440443b717-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz\" (UID: \"0ba2bd24-21ab-4f20-a772-fb440443b717\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:29.307865 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.307846    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ba2bd24-21ab-4f20-a772-fb440443b717-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz\" (UID: \"0ba2bd24-21ab-4f20-a772-fb440443b717\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:29.408491 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.408451    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0ba2bd24-21ab-4f20-a772-fb440443b717-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz\" (UID: \"0ba2bd24-21ab-4f20-a772-fb440443b717\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:29.408717 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.408512    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ba2bd24-21ab-4f20-a772-fb440443b717-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz\" (UID: \"0ba2bd24-21ab-4f20-a772-fb440443b717\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:29.408717 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.408546    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m5hwz\" (UniqueName: \"kubernetes.io/projected/0ba2bd24-21ab-4f20-a772-fb440443b717-kube-api-access-m5hwz\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz\" (UID: \"0ba2bd24-21ab-4f20-a772-fb440443b717\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:29.408717 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.408573    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ba2bd24-21ab-4f20-a772-fb440443b717-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz\" (UID: \"0ba2bd24-21ab-4f20-a772-fb440443b717\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:29.408717 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.408591    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ba2bd24-21ab-4f20-a772-fb440443b717-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz\" (UID: \"0ba2bd24-21ab-4f20-a772-fb440443b717\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:29.408717 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.408692    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ba2bd24-21ab-4f20-a772-fb440443b717-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz\" (UID: \"0ba2bd24-21ab-4f20-a772-fb440443b717\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:29.408995 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.408910    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0ba2bd24-21ab-4f20-a772-fb440443b717-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz\" (UID: \"0ba2bd24-21ab-4f20-a772-fb440443b717\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:29.408995 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.408956    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0ba2bd24-21ab-4f20-a772-fb440443b717-model-cache\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz\" (UID: \"0ba2bd24-21ab-4f20-a772-fb440443b717\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:29.409086 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.409022    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0ba2bd24-21ab-4f20-a772-fb440443b717-home\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz\" (UID: \"0ba2bd24-21ab-4f20-a772-fb440443b717\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:29.411092 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.411068    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0ba2bd24-21ab-4f20-a772-fb440443b717-dshm\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz\" (UID: \"0ba2bd24-21ab-4f20-a772-fb440443b717\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:29.411259 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.411240    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0ba2bd24-21ab-4f20-a772-fb440443b717-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz\" (UID: \"0ba2bd24-21ab-4f20-a772-fb440443b717\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:29.416073 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.416057    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5hwz\" (UniqueName: \"kubernetes.io/projected/0ba2bd24-21ab-4f20-a772-fb440443b717-kube-api-access-m5hwz\") pod \"facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz\" (UID: \"0ba2bd24-21ab-4f20-a772-fb440443b717\") " pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:29.604497 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.604414    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:29.740187 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:29.740161    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"]
May 21 01:58:29.741978 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:58:29.741946    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba2bd24_21ab_4f20_a772_fb440443b717.slice/crio-66d32309313938741691c0d4a44570867f46d08e19191f79349205df3033b10f WatchSource:0}: Error finding container 66d32309313938741691c0d4a44570867f46d08e19191f79349205df3033b10f: Status 404 returned error can't find the container with id 66d32309313938741691c0d4a44570867f46d08e19191f79349205df3033b10f
May 21 01:58:30.360249 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:30.360211    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz" event={"ID":"0ba2bd24-21ab-4f20-a772-fb440443b717","Type":"ContainerStarted","Data":"66d32309313938741691c0d4a44570867f46d08e19191f79349205df3033b10f"}
May 21 01:58:33.908398 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:33.908362    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-76cccccb49-94snr"]
May 21 01:58:33.943595 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:33.943563    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-76cccccb49-94snr"]
May 21 01:58:33.943784 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:33.943731    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-76cccccb49-94snr"
May 21 01:58:33.946401 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:33.946380    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
May 21 01:58:33.947609 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:33.947591    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
May 21 01:58:33.947731 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:33.947605    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-sxwq9\""
May 21 01:58:34.052780 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:34.052746    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf257d39-c608-41f1-861f-777977a82074-maas-api-tls\") pod \"maas-api-76cccccb49-94snr\" (UID: \"bf257d39-c608-41f1-861f-777977a82074\") " pod="opendatahub/maas-api-76cccccb49-94snr"
May 21 01:58:34.052959 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:34.052806    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhq68\" (UniqueName: \"kubernetes.io/projected/bf257d39-c608-41f1-861f-777977a82074-kube-api-access-hhq68\") pod \"maas-api-76cccccb49-94snr\" (UID: \"bf257d39-c608-41f1-861f-777977a82074\") " pod="opendatahub/maas-api-76cccccb49-94snr"
May 21 01:58:34.154287 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:34.154237    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hhq68\" (UniqueName: \"kubernetes.io/projected/bf257d39-c608-41f1-861f-777977a82074-kube-api-access-hhq68\") pod \"maas-api-76cccccb49-94snr\" (UID: \"bf257d39-c608-41f1-861f-777977a82074\") " pod="opendatahub/maas-api-76cccccb49-94snr"
May 21 01:58:34.154488 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:34.154384    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf257d39-c608-41f1-861f-777977a82074-maas-api-tls\") pod \"maas-api-76cccccb49-94snr\" (UID: \"bf257d39-c608-41f1-861f-777977a82074\") " pod="opendatahub/maas-api-76cccccb49-94snr"
May 21 01:58:34.157550 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:34.157521    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bf257d39-c608-41f1-861f-777977a82074-maas-api-tls\") pod \"maas-api-76cccccb49-94snr\" (UID: \"bf257d39-c608-41f1-861f-777977a82074\") " pod="opendatahub/maas-api-76cccccb49-94snr"
May 21 01:58:34.162145 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:34.162081    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhq68\" (UniqueName: \"kubernetes.io/projected/bf257d39-c608-41f1-861f-777977a82074-kube-api-access-hhq68\") pod \"maas-api-76cccccb49-94snr\" (UID: \"bf257d39-c608-41f1-861f-777977a82074\") " pod="opendatahub/maas-api-76cccccb49-94snr"
May 21 01:58:34.255698 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:34.255619    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-76cccccb49-94snr"
May 21 01:58:34.916657 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:34.916613    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-76cccccb49-94snr"]
May 21 01:58:34.920352 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:58:34.920324    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf257d39_c608_41f1_861f_777977a82074.slice/crio-617f0420cfbd333a109c4e0c3f8b8e2263acfb0a405cfb23337b5de51eaddb18 WatchSource:0}: Error finding container 617f0420cfbd333a109c4e0c3f8b8e2263acfb0a405cfb23337b5de51eaddb18: Status 404 returned error can't find the container with id 617f0420cfbd333a109c4e0c3f8b8e2263acfb0a405cfb23337b5de51eaddb18
May 21 01:58:35.380324 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:35.380281    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-76cccccb49-94snr" event={"ID":"bf257d39-c608-41f1-861f-777977a82074","Type":"ContainerStarted","Data":"617f0420cfbd333a109c4e0c3f8b8e2263acfb0a405cfb23337b5de51eaddb18"}
May 21 01:58:35.382072 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:35.382035    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz" event={"ID":"0ba2bd24-21ab-4f20-a772-fb440443b717","Type":"ContainerStarted","Data":"95c8fb78c1c1da3307234f5540f937a53e5e99817293f420f0d5781911fed353"}
May 21 01:58:37.396455 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:37.396363    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-76cccccb49-94snr" event={"ID":"bf257d39-c608-41f1-861f-777977a82074","Type":"ContainerStarted","Data":"81924ee1e800237cb2ea47a88b57597ef9e4666facdf7ce2a9098503a54cb2fa"}
May 21 01:58:37.396849 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:37.396498    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-76cccccb49-94snr"
May 21 01:58:37.413922 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:37.413856    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-76cccccb49-94snr" podStartSLOduration=2.194966081 podStartE2EDuration="4.413836262s" podCreationTimestamp="2026-05-21 01:58:33 +0000 UTC" firstStartedPulling="2026-05-21 01:58:34.922257008 +0000 UTC m=+657.335776366" lastFinishedPulling="2026-05-21 01:58:37.141127186 +0000 UTC m=+659.554646547" observedRunningTime="2026-05-21 01:58:37.412033965 +0000 UTC m=+659.825553390" watchObservedRunningTime="2026-05-21 01:58:37.413836262 +0000 UTC m=+659.827355646"
May 21 01:58:41.412570 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:41.412536    2582 generic.go:358] "Generic (PLEG): container finished" podID="0ba2bd24-21ab-4f20-a772-fb440443b717" containerID="95c8fb78c1c1da3307234f5540f937a53e5e99817293f420f0d5781911fed353" exitCode=0
May 21 01:58:41.412990 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:41.412607    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz" event={"ID":"0ba2bd24-21ab-4f20-a772-fb440443b717","Type":"ContainerDied","Data":"95c8fb78c1c1da3307234f5540f937a53e5e99817293f420f0d5781911fed353"}
May 21 01:58:43.284859 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.284828    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"]
May 21 01:58:43.288542 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.288518    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:43.291065 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.291044    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
May 21 01:58:43.301308 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.301279    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"]
May 21 01:58:43.352660 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.352605    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j5w6m\" (UniqueName: \"kubernetes.io/projected/65e1b121-1499-4d95-a18d-b3faa2fb235f-kube-api-access-j5w6m\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w\" (UID: \"65e1b121-1499-4d95-a18d-b3faa2fb235f\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:43.352864 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.352677    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65e1b121-1499-4d95-a18d-b3faa2fb235f-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w\" (UID: \"65e1b121-1499-4d95-a18d-b3faa2fb235f\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:43.352864 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.352717    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65e1b121-1499-4d95-a18d-b3faa2fb235f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w\" (UID: \"65e1b121-1499-4d95-a18d-b3faa2fb235f\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:43.352864 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.352748    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65e1b121-1499-4d95-a18d-b3faa2fb235f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w\" (UID: \"65e1b121-1499-4d95-a18d-b3faa2fb235f\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:43.352864 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.352772    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/65e1b121-1499-4d95-a18d-b3faa2fb235f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w\" (UID: \"65e1b121-1499-4d95-a18d-b3faa2fb235f\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:43.352864 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.352799    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65e1b121-1499-4d95-a18d-b3faa2fb235f-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w\" (UID: \"65e1b121-1499-4d95-a18d-b3faa2fb235f\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:43.407367 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.407334    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-76cccccb49-94snr"
May 21 01:58:43.421505 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.421470    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz" event={"ID":"0ba2bd24-21ab-4f20-a772-fb440443b717","Type":"ContainerStarted","Data":"8a06a1c026bddea672021dfe0f2051977be93192649a7e795fd7170a7b1c17bc"}
May 21 01:58:43.421713 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.421696    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:58:43.441404 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.441346    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz" podStartSLOduration=1.732074543 podStartE2EDuration="14.44132635s" podCreationTimestamp="2026-05-21 01:58:29 +0000 UTC" firstStartedPulling="2026-05-21 01:58:29.743805652 +0000 UTC m=+652.157325012" lastFinishedPulling="2026-05-21 01:58:42.453057457 +0000 UTC m=+664.866576819" observedRunningTime="2026-05-21 01:58:43.44037743 +0000 UTC m=+665.853896811" watchObservedRunningTime="2026-05-21 01:58:43.44132635 +0000 UTC m=+665.854845748"
May 21 01:58:43.454236 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.454200    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j5w6m\" (UniqueName: \"kubernetes.io/projected/65e1b121-1499-4d95-a18d-b3faa2fb235f-kube-api-access-j5w6m\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w\" (UID: \"65e1b121-1499-4d95-a18d-b3faa2fb235f\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:43.454418 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.454241    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65e1b121-1499-4d95-a18d-b3faa2fb235f-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w\" (UID: \"65e1b121-1499-4d95-a18d-b3faa2fb235f\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:43.454418 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.454305    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65e1b121-1499-4d95-a18d-b3faa2fb235f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w\" (UID: \"65e1b121-1499-4d95-a18d-b3faa2fb235f\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:43.454529 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.454444    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65e1b121-1499-4d95-a18d-b3faa2fb235f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w\" (UID: \"65e1b121-1499-4d95-a18d-b3faa2fb235f\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:43.454577 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.454527    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/65e1b121-1499-4d95-a18d-b3faa2fb235f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w\" (UID: \"65e1b121-1499-4d95-a18d-b3faa2fb235f\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:43.454700 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.454676    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65e1b121-1499-4d95-a18d-b3faa2fb235f-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w\" (UID: \"65e1b121-1499-4d95-a18d-b3faa2fb235f\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:43.454824 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.454751    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/65e1b121-1499-4d95-a18d-b3faa2fb235f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w\" (UID: \"65e1b121-1499-4d95-a18d-b3faa2fb235f\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:43.454824 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.454790    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/65e1b121-1499-4d95-a18d-b3faa2fb235f-home\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w\" (UID: \"65e1b121-1499-4d95-a18d-b3faa2fb235f\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:43.454952 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.454929    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/65e1b121-1499-4d95-a18d-b3faa2fb235f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w\" (UID: \"65e1b121-1499-4d95-a18d-b3faa2fb235f\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:43.457037 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.457014    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/65e1b121-1499-4d95-a18d-b3faa2fb235f-dshm\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w\" (UID: \"65e1b121-1499-4d95-a18d-b3faa2fb235f\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:43.457411 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.457391    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/65e1b121-1499-4d95-a18d-b3faa2fb235f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w\" (UID: \"65e1b121-1499-4d95-a18d-b3faa2fb235f\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:43.464540 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.464512    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j5w6m\" (UniqueName: \"kubernetes.io/projected/65e1b121-1499-4d95-a18d-b3faa2fb235f-kube-api-access-j5w6m\") pod \"e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w\" (UID: \"65e1b121-1499-4d95-a18d-b3faa2fb235f\") " pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:43.600331 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.600239    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:43.734150 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:43.734129    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"]
May 21 01:58:43.736528 ip-10-0-129-167 kubenswrapper[2582]: W0521 01:58:43.736493    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65e1b121_1499_4d95_a18d_b3faa2fb235f.slice/crio-bbfb1982b3fe4049ceaf587eaa2c9673a377d0cb424bd633edc37702ab1c11bc WatchSource:0}: Error finding container bbfb1982b3fe4049ceaf587eaa2c9673a377d0cb424bd633edc37702ab1c11bc: Status 404 returned error can't find the container with id bbfb1982b3fe4049ceaf587eaa2c9673a377d0cb424bd633edc37702ab1c11bc
May 21 01:58:44.426297 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:44.426248    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w" event={"ID":"65e1b121-1499-4d95-a18d-b3faa2fb235f","Type":"ContainerStarted","Data":"e42371094246658edaa090753da17c993ba69f53cd72bb5bde6099fa234febd5"}
May 21 01:58:44.426297 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:44.426302    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w" event={"ID":"65e1b121-1499-4d95-a18d-b3faa2fb235f","Type":"ContainerStarted","Data":"bbfb1982b3fe4049ceaf587eaa2c9673a377d0cb424bd633edc37702ab1c11bc"}
May 21 01:58:49.445507 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:49.445408    2582 generic.go:358] "Generic (PLEG): container finished" podID="65e1b121-1499-4d95-a18d-b3faa2fb235f" containerID="e42371094246658edaa090753da17c993ba69f53cd72bb5bde6099fa234febd5" exitCode=0
May 21 01:58:49.445507 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:49.445475    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w" event={"ID":"65e1b121-1499-4d95-a18d-b3faa2fb235f","Type":"ContainerDied","Data":"e42371094246658edaa090753da17c993ba69f53cd72bb5bde6099fa234febd5"}
May 21 01:58:50.451252 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:50.451212    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w" event={"ID":"65e1b121-1499-4d95-a18d-b3faa2fb235f","Type":"ContainerStarted","Data":"1b70de67a6343f32fb04dce51ffaf5543bd2f3a0b72d343e8204407b1074bdd7"}
May 21 01:58:50.451680 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:50.451435    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:58:50.472896 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:50.472843    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w" podStartSLOduration=7.305551622 podStartE2EDuration="7.472825101s" podCreationTimestamp="2026-05-21 01:58:43 +0000 UTC" firstStartedPulling="2026-05-21 01:58:49.446095712 +0000 UTC m=+671.859615070" lastFinishedPulling="2026-05-21 01:58:49.61336919 +0000 UTC m=+672.026888549" observedRunningTime="2026-05-21 01:58:50.471609111 +0000 UTC m=+672.885128490" watchObservedRunningTime="2026-05-21 01:58:50.472825101 +0000 UTC m=+672.886344482"
May 21 01:58:54.439367 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:58:54.439328    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz"
May 21 01:59:01.467580 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:59:01.467545    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w"
May 21 01:59:17.199466 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:59:17.199427    2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d5c74ddd5-vf787"]
May 21 01:59:17.199899 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:59:17.199660    2582 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-5d5c74ddd5-vf787" podUID="8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38" containerName="authorino" containerID="cri-o://0a0608c09a81f425bdda2a45ebea48dba48f1c87acd1931b3233a0281a93c1f8" gracePeriod=30
May 21 01:59:17.454013 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:59:17.453947    2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d5c74ddd5-vf787"
May 21 01:59:17.541503 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:59:17.541465    2582 generic.go:358] "Generic (PLEG): container finished" podID="8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38" containerID="0a0608c09a81f425bdda2a45ebea48dba48f1c87acd1931b3233a0281a93c1f8" exitCode=0
May 21 01:59:17.541739 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:59:17.541515    2582 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d5c74ddd5-vf787"
May 21 01:59:17.541739 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:59:17.541525    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d5c74ddd5-vf787" event={"ID":"8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38","Type":"ContainerDied","Data":"0a0608c09a81f425bdda2a45ebea48dba48f1c87acd1931b3233a0281a93c1f8"}
May 21 01:59:17.541739 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:59:17.541561    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d5c74ddd5-vf787" event={"ID":"8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38","Type":"ContainerDied","Data":"ac4b7f4ad11a1e6de282f80b04401433acfce916567c60e6ebdcde006ed67834"}
May 21 01:59:17.541739 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:59:17.541582    2582 scope.go:117] "RemoveContainer" containerID="0a0608c09a81f425bdda2a45ebea48dba48f1c87acd1931b3233a0281a93c1f8"
May 21 01:59:17.549516 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:59:17.549494    2582 scope.go:117] "RemoveContainer" containerID="0a0608c09a81f425bdda2a45ebea48dba48f1c87acd1931b3233a0281a93c1f8"
May 21 01:59:17.549814 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:59:17.549793    2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a0608c09a81f425bdda2a45ebea48dba48f1c87acd1931b3233a0281a93c1f8\": container with ID starting with 0a0608c09a81f425bdda2a45ebea48dba48f1c87acd1931b3233a0281a93c1f8 not found: ID does not exist" containerID="0a0608c09a81f425bdda2a45ebea48dba48f1c87acd1931b3233a0281a93c1f8"
May 21 01:59:17.549868 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:59:17.549823    2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a0608c09a81f425bdda2a45ebea48dba48f1c87acd1931b3233a0281a93c1f8"} err="failed to get container status \"0a0608c09a81f425bdda2a45ebea48dba48f1c87acd1931b3233a0281a93c1f8\": rpc error: code = NotFound desc = could not find container \"0a0608c09a81f425bdda2a45ebea48dba48f1c87acd1931b3233a0281a93c1f8\": container with ID starting with 0a0608c09a81f425bdda2a45ebea48dba48f1c87acd1931b3233a0281a93c1f8 not found: ID does not exist"
May 21 01:59:17.568294 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:59:17.568271    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lk4dj\" (UniqueName: \"kubernetes.io/projected/8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38-kube-api-access-lk4dj\") pod \"8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38\" (UID: \"8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38\") "
May 21 01:59:17.568429 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:59:17.568381    2582 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38-tls-cert\") pod \"8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38\" (UID: \"8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38\") "
May 21 01:59:17.570517 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:59:17.570492    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38-kube-api-access-lk4dj" (OuterVolumeSpecName: "kube-api-access-lk4dj") pod "8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38" (UID: "8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38"). InnerVolumeSpecName "kube-api-access-lk4dj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 21 01:59:17.578196 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:59:17.578173    2582 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38" (UID: "8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 21 01:59:17.669554 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:59:17.669519    2582 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38-tls-cert\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:59:17.669554 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:59:17.669552    2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lk4dj\" (UniqueName: \"kubernetes.io/projected/8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38-kube-api-access-lk4dj\") on node \"ip-10-0-129-167.ec2.internal\" DevicePath \"\""
May 21 01:59:17.874019 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:59:17.873990    2582 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d5c74ddd5-vf787"]
May 21 01:59:17.877563 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:59:17.877534    2582 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d5c74ddd5-vf787"]
May 21 01:59:17.881864 ip-10-0-129-167 kubenswrapper[2582]: E0521 01:59:17.881838    2582 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bd52d71_9c81_4330_9bf3_0ffdb4f1aa38.slice/crio-ac4b7f4ad11a1e6de282f80b04401433acfce916567c60e6ebdcde006ed67834\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bd52d71_9c81_4330_9bf3_0ffdb4f1aa38.slice\": RecentStats: unable to find data in memory cache]"
May 21 01:59:18.236985 ip-10-0-129-167 kubenswrapper[2582]: I0521 01:59:18.236954    2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38" path="/var/lib/kubelet/pods/8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38/volumes"
May 21 02:00:03.215901 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.215863    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"]
May 21 02:00:03.216503 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.216245    2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38" containerName="authorino"
May 21 02:00:03.216503 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.216258    2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38" containerName="authorino"
May 21 02:00:03.216503 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.216325    2582 memory_manager.go:356] "RemoveStaleState removing state" podUID="8bd52d71-9c81-4330-9bf3-0ffdb4f1aa38" containerName="authorino"
May 21 02:00:03.219595 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.219573    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:03.222046 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.222026    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 21 02:00:03.229738 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.229712    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"]
May 21 02:00:03.280729 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.280685    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11f8ec66-264d-4994-9e46-b8c6e5a4fd8f-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq\" (UID: \"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:03.280729 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.280741    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nlkn\" (UniqueName: \"kubernetes.io/projected/11f8ec66-264d-4994-9e46-b8c6e5a4fd8f-kube-api-access-7nlkn\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq\" (UID: \"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:03.280998 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.280817    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11f8ec66-264d-4994-9e46-b8c6e5a4fd8f-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq\" (UID: \"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:03.280998 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.280879    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/11f8ec66-264d-4994-9e46-b8c6e5a4fd8f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq\" (UID: \"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:03.280998 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.280931    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11f8ec66-264d-4994-9e46-b8c6e5a4fd8f-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq\" (UID: \"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:03.280998 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.280959    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11f8ec66-264d-4994-9e46-b8c6e5a4fd8f-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq\" (UID: \"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:03.382072 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.382033    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7nlkn\" (UniqueName: \"kubernetes.io/projected/11f8ec66-264d-4994-9e46-b8c6e5a4fd8f-kube-api-access-7nlkn\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq\" (UID: \"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:03.382262 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.382099    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11f8ec66-264d-4994-9e46-b8c6e5a4fd8f-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq\" (UID: \"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:03.382262 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.382140    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/11f8ec66-264d-4994-9e46-b8c6e5a4fd8f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq\" (UID: \"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:03.382262 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.382171    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11f8ec66-264d-4994-9e46-b8c6e5a4fd8f-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq\" (UID: \"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:03.382262 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.382191    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11f8ec66-264d-4994-9e46-b8c6e5a4fd8f-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq\" (UID: \"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:03.382262 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.382227    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11f8ec66-264d-4994-9e46-b8c6e5a4fd8f-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq\" (UID: \"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:03.382719 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.382696    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/11f8ec66-264d-4994-9e46-b8c6e5a4fd8f-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq\" (UID: \"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:03.382719 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.382710    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/11f8ec66-264d-4994-9e46-b8c6e5a4fd8f-home\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq\" (UID: \"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:03.382981 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.382750    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/11f8ec66-264d-4994-9e46-b8c6e5a4fd8f-model-cache\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq\" (UID: \"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:03.384586 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.384563    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/11f8ec66-264d-4994-9e46-b8c6e5a4fd8f-dshm\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq\" (UID: \"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:03.384882 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.384865    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/11f8ec66-264d-4994-9e46-b8c6e5a4fd8f-tls-certs\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq\" (UID: \"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:03.389899 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.389878    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nlkn\" (UniqueName: \"kubernetes.io/projected/11f8ec66-264d-4994-9e46-b8c6e5a4fd8f-kube-api-access-7nlkn\") pod \"e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq\" (UID: \"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f\") " pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:03.530563 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.530458    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:03.665768 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.665744    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"]
May 21 02:00:03.667664 ip-10-0-129-167 kubenswrapper[2582]: W0521 02:00:03.667612    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f8ec66_264d_4994_9e46_b8c6e5a4fd8f.slice/crio-d01b57d50ccf283bdab9577ef0c673d7b608daede70983aa8af5c08ad1450470 WatchSource:0}: Error finding container d01b57d50ccf283bdab9577ef0c673d7b608daede70983aa8af5c08ad1450470: Status 404 returned error can't find the container with id d01b57d50ccf283bdab9577ef0c673d7b608daede70983aa8af5c08ad1450470
May 21 02:00:03.669379 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.669357    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 02:00:03.693721 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:03.693689    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq" event={"ID":"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f","Type":"ContainerStarted","Data":"d01b57d50ccf283bdab9577ef0c673d7b608daede70983aa8af5c08ad1450470"}
May 21 02:00:04.701624 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:04.701587    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq" event={"ID":"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f","Type":"ContainerStarted","Data":"22604677cc552fc7bdf2b0bf0ccaebd85404ee8b4f0b8437ea8be18fabab5042"}
May 21 02:00:09.721320 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:09.721290    2582 generic.go:358] "Generic (PLEG): container finished" podID="11f8ec66-264d-4994-9e46-b8c6e5a4fd8f" containerID="22604677cc552fc7bdf2b0bf0ccaebd85404ee8b4f0b8437ea8be18fabab5042" exitCode=0
May 21 02:00:09.721754 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:09.721366    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq" event={"ID":"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f","Type":"ContainerDied","Data":"22604677cc552fc7bdf2b0bf0ccaebd85404ee8b4f0b8437ea8be18fabab5042"}
May 21 02:00:19.757649 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:19.757599    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq" event={"ID":"11f8ec66-264d-4994-9e46-b8c6e5a4fd8f","Type":"ContainerStarted","Data":"fa6f1a82f376855c5b1684559e1787153fa0435d7caf8278425d5df1e3477881"}
May 21 02:00:19.758064 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:19.757847    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:00:19.775292 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:19.775236    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq" podStartSLOduration=7.565840231 podStartE2EDuration="16.775220783s" podCreationTimestamp="2026-05-21 02:00:03 +0000 UTC" firstStartedPulling="2026-05-21 02:00:09.722096681 +0000 UTC m=+752.135616039" lastFinishedPulling="2026-05-21 02:00:18.931477228 +0000 UTC m=+761.344996591" observedRunningTime="2026-05-21 02:00:19.773888626 +0000 UTC m=+762.187408010" watchObservedRunningTime="2026-05-21 02:00:19.775220783 +0000 UTC m=+762.188740164"
May 21 02:00:30.773475 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:00:30.773446    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq"
May 21 02:02:38.167561 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:02:38.167481    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/ovn-acl-logging/0.log"
May 21 02:02:38.168147 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:02:38.167713    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/ovn-acl-logging/0.log"
May 21 02:07:38.191409 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:07:38.191381    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/ovn-acl-logging/0.log"
May 21 02:07:38.194100 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:07:38.192251    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/ovn-acl-logging/0.log"
May 21 02:12:38.216625 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:12:38.216516    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/ovn-acl-logging/0.log"
May 21 02:12:38.218816 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:12:38.218798    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/ovn-acl-logging/0.log"
May 21 02:17:38.241278 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:17:38.241180    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/ovn-acl-logging/0.log"
May 21 02:17:38.248235 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:17:38.243902    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/ovn-acl-logging/0.log"
May 21 02:21:47.376454 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:21:47.376368    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-76cccccb49-94snr_bf257d39-c608-41f1-861f-777977a82074/maas-api/0.log"
May 21 02:21:48.162584 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:21:48.162552    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64cdd6779c-mgb72_d08ce825-f54b-4543-928d-0cfcc249d3b3/manager/0.log"
May 21 02:21:49.604919 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:21:49.604884    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-6pr9v_dd299222-0e9a-4e99-bcad-20a1eab98d67/manager/0.log"
May 21 02:21:50.796889 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:21:50.796851    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f6cbd8488-4qv9l_77ed2b90-7705-4010-90df-1ca4a5266494/kube-auth-proxy/0.log"
May 21 02:21:51.227143 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:21:51.227109    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8c88869c6-88w97_c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f/router/0.log"
May 21 02:21:51.557252 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:21:51.557168    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w_65e1b121-1499-4d95-a18d-b3faa2fb235f/storage-initializer/0.log"
May 21 02:21:51.563144 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:21:51.563121    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-7f849f6b56-24w5w_65e1b121-1499-4d95-a18d-b3faa2fb235f/main/0.log"
May 21 02:21:51.670252 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:21:51.670217    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq_11f8ec66-264d-4994-9e46-b8c6e5a4fd8f/main/0.log"
May 21 02:21:51.675859 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:21:51.675834    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-7bb4cdb4d7-kt7tq_11f8ec66-264d-4994-9e46-b8c6e5a4fd8f/storage-initializer/0.log"
May 21 02:21:52.007161 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:21:52.007131    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz_0ba2bd24-21ab-4f20-a772-fb440443b717/storage-initializer/0.log"
May 21 02:21:52.013184 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:21:52.013154    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-8f8dc67b7-zbgpz_0ba2bd24-21ab-4f20-a772-fb440443b717/main/0.log"
May 21 02:21:58.433690 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:21:58.433652    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r25km_e4d14bdc-b170-419a-8e48-a9b89dc283c3/global-pull-secret-syncer/0.log"
May 21 02:21:58.543198 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:21:58.543161    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-kl7mq_0e6bc807-e178-4d74-b81f-03d96b556cd6/konnectivity-agent/0.log"
May 21 02:21:58.591236 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:21:58.591203    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-167.ec2.internal_6c3a868fe1e79d317fac062e00f67b49/haproxy/0.log"
May 21 02:22:02.754180 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:02.754151    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-6pr9v_dd299222-0e9a-4e99-bcad-20a1eab98d67/manager/0.log"
May 21 02:22:04.278326 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:04.278282    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-9xcwc_19175863-e76e-4995-ae22-76c7ca5e4651/cluster-monitoring-operator/0.log"
May 21 02:22:04.308692 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:04.308601    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-h69zv_4ad0c44f-220b-438c-996b-9a8d58594dfa/kube-state-metrics/0.log"
May 21 02:22:04.326797 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:04.326753    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-h69zv_4ad0c44f-220b-438c-996b-9a8d58594dfa/kube-rbac-proxy-main/0.log"
May 21 02:22:04.339526 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:04.339504    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-h69zv_4ad0c44f-220b-438c-996b-9a8d58594dfa/kube-rbac-proxy-self/0.log"
May 21 02:22:04.362743 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:04.362718    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-8878985cb-t4bmw_69a74158-048a-424b-b42b-757de4e72e71/metrics-server/0.log"
May 21 02:22:04.411090 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:04.411047    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d6t55_34b0e000-0c66-441e-98c9-0e972586c670/node-exporter/0.log"
May 21 02:22:04.427238 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:04.427205    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d6t55_34b0e000-0c66-441e-98c9-0e972586c670/kube-rbac-proxy/0.log"
May 21 02:22:04.443359 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:04.443336    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-d6t55_34b0e000-0c66-441e-98c9-0e972586c670/init-textfile/0.log"
May 21 02:22:04.709334 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:04.709306    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d0d7926d-93f9-4f39-926a-bf3229d9aa17/prometheus/0.log"
May 21 02:22:04.724680 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:04.724657    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d0d7926d-93f9-4f39-926a-bf3229d9aa17/config-reloader/0.log"
May 21 02:22:04.740125 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:04.740104    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d0d7926d-93f9-4f39-926a-bf3229d9aa17/thanos-sidecar/0.log"
May 21 02:22:04.754977 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:04.754952    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d0d7926d-93f9-4f39-926a-bf3229d9aa17/kube-rbac-proxy-web/0.log"
May 21 02:22:04.776005 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:04.775978    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d0d7926d-93f9-4f39-926a-bf3229d9aa17/kube-rbac-proxy/0.log"
May 21 02:22:04.792003 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:04.791972    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d0d7926d-93f9-4f39-926a-bf3229d9aa17/kube-rbac-proxy-thanos/0.log"
May 21 02:22:04.806958 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:04.806934    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d0d7926d-93f9-4f39-926a-bf3229d9aa17/init-config-reloader/0.log"
May 21 02:22:04.830056 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:04.830032    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-6rpqm_4c77669e-e03b-4ea1-bac8-7cea53006476/prometheus-operator/0.log"
May 21 02:22:04.845214 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:04.845188    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-6rpqm_4c77669e-e03b-4ea1-bac8-7cea53006476/kube-rbac-proxy/0.log"
May 21 02:22:07.106102 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.106061    2582 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"]
May 21 02:22:07.109717 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.109693    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"
May 21 02:22:07.112359 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.112338    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mwfm7\"/\"openshift-service-ca.crt\""
May 21 02:22:07.112576 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.112497    2582 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mwfm7\"/\"default-dockercfg-zddpb\""
May 21 02:22:07.112576 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.112538    2582 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mwfm7\"/\"kube-root-ca.crt\""
May 21 02:22:07.116296 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.116275    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"]
May 21 02:22:07.162477 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.162440    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cf4474a-ad83-4622-98a0-e3d7e5b742a0-sys\") pod \"perf-node-gather-daemonset-h4bmw\" (UID: \"0cf4474a-ad83-4622-98a0-e3d7e5b742a0\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"
May 21 02:22:07.162665 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.162491    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0cf4474a-ad83-4622-98a0-e3d7e5b742a0-podres\") pod \"perf-node-gather-daemonset-h4bmw\" (UID: \"0cf4474a-ad83-4622-98a0-e3d7e5b742a0\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"
May 21 02:22:07.162665 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.162513    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0cf4474a-ad83-4622-98a0-e3d7e5b742a0-proc\") pod \"perf-node-gather-daemonset-h4bmw\" (UID: \"0cf4474a-ad83-4622-98a0-e3d7e5b742a0\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"
May 21 02:22:07.162665 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.162538    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0cf4474a-ad83-4622-98a0-e3d7e5b742a0-lib-modules\") pod \"perf-node-gather-daemonset-h4bmw\" (UID: \"0cf4474a-ad83-4622-98a0-e3d7e5b742a0\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"
May 21 02:22:07.162665 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.162624    2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bmpp\" (UniqueName: \"kubernetes.io/projected/0cf4474a-ad83-4622-98a0-e3d7e5b742a0-kube-api-access-2bmpp\") pod \"perf-node-gather-daemonset-h4bmw\" (UID: \"0cf4474a-ad83-4622-98a0-e3d7e5b742a0\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"
May 21 02:22:07.219763 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.219734    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-fpx87_510779a2-f776-47cc-b022-f905a77d92c3/download-server/0.log"
May 21 02:22:07.263296 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.263263    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cf4474a-ad83-4622-98a0-e3d7e5b742a0-sys\") pod \"perf-node-gather-daemonset-h4bmw\" (UID: \"0cf4474a-ad83-4622-98a0-e3d7e5b742a0\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"
May 21 02:22:07.263459 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.263340    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0cf4474a-ad83-4622-98a0-e3d7e5b742a0-podres\") pod \"perf-node-gather-daemonset-h4bmw\" (UID: \"0cf4474a-ad83-4622-98a0-e3d7e5b742a0\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"
May 21 02:22:07.263459 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.263359    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0cf4474a-ad83-4622-98a0-e3d7e5b742a0-proc\") pod \"perf-node-gather-daemonset-h4bmw\" (UID: \"0cf4474a-ad83-4622-98a0-e3d7e5b742a0\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"
May 21 02:22:07.263459 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.263373    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0cf4474a-ad83-4622-98a0-e3d7e5b742a0-sys\") pod \"perf-node-gather-daemonset-h4bmw\" (UID: \"0cf4474a-ad83-4622-98a0-e3d7e5b742a0\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"
May 21 02:22:07.263459 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.263385    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0cf4474a-ad83-4622-98a0-e3d7e5b742a0-lib-modules\") pod \"perf-node-gather-daemonset-h4bmw\" (UID: \"0cf4474a-ad83-4622-98a0-e3d7e5b742a0\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"
May 21 02:22:07.263731 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.263486    2582 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bmpp\" (UniqueName: \"kubernetes.io/projected/0cf4474a-ad83-4622-98a0-e3d7e5b742a0-kube-api-access-2bmpp\") pod \"perf-node-gather-daemonset-h4bmw\" (UID: \"0cf4474a-ad83-4622-98a0-e3d7e5b742a0\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"
May 21 02:22:07.263731 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.263510    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0cf4474a-ad83-4622-98a0-e3d7e5b742a0-lib-modules\") pod \"perf-node-gather-daemonset-h4bmw\" (UID: \"0cf4474a-ad83-4622-98a0-e3d7e5b742a0\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"
May 21 02:22:07.263731 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.263527    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/0cf4474a-ad83-4622-98a0-e3d7e5b742a0-podres\") pod \"perf-node-gather-daemonset-h4bmw\" (UID: \"0cf4474a-ad83-4622-98a0-e3d7e5b742a0\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"
May 21 02:22:07.263731 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.263507    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/0cf4474a-ad83-4622-98a0-e3d7e5b742a0-proc\") pod \"perf-node-gather-daemonset-h4bmw\" (UID: \"0cf4474a-ad83-4622-98a0-e3d7e5b742a0\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"
May 21 02:22:07.271173 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.271154    2582 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bmpp\" (UniqueName: \"kubernetes.io/projected/0cf4474a-ad83-4622-98a0-e3d7e5b742a0-kube-api-access-2bmpp\") pod \"perf-node-gather-daemonset-h4bmw\" (UID: \"0cf4474a-ad83-4622-98a0-e3d7e5b742a0\") " pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"
May 21 02:22:07.421358 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.421321    2582 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"
May 21 02:22:07.550954 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.550923    2582 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"]
May 21 02:22:07.553512 ip-10-0-129-167 kubenswrapper[2582]: W0521 02:22:07.553486    2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod0cf4474a_ad83_4622_98a0_e3d7e5b742a0.slice/crio-85380e2ed19e76cb06bd7d15510e67add44a86757905c404a0174a72d1d52759 WatchSource:0}: Error finding container 85380e2ed19e76cb06bd7d15510e67add44a86757905c404a0174a72d1d52759: Status 404 returned error can't find the container with id 85380e2ed19e76cb06bd7d15510e67add44a86757905c404a0174a72d1d52759
May 21 02:22:07.555088 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:07.555069    2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 21 02:22:08.128669 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:08.128617    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw" event={"ID":"0cf4474a-ad83-4622-98a0-e3d7e5b742a0","Type":"ContainerStarted","Data":"b36a4fbf7abe43876194539b27aae4b433c583630426ec680625c70c4998d4c9"}
May 21 02:22:08.129138 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:08.128681    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"
May 21 02:22:08.129138 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:08.128694    2582 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw" event={"ID":"0cf4474a-ad83-4622-98a0-e3d7e5b742a0","Type":"ContainerStarted","Data":"85380e2ed19e76cb06bd7d15510e67add44a86757905c404a0174a72d1d52759"}
May 21 02:22:08.143972 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:08.143919    2582 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw" podStartSLOduration=1.143901729 podStartE2EDuration="1.143901729s" podCreationTimestamp="2026-05-21 02:22:07 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-21 02:22:08.143023416 +0000 UTC m=+2070.556542832" watchObservedRunningTime="2026-05-21 02:22:08.143901729 +0000 UTC m=+2070.557421112"
May 21 02:22:08.438169 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:08.438093    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bkvlq_db15baee-ec33-43bc-a10d-681ec1ddaf48/dns/0.log"
May 21 02:22:08.453165 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:08.453130    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-bkvlq_db15baee-ec33-43bc-a10d-681ec1ddaf48/kube-rbac-proxy/0.log"
May 21 02:22:08.591297 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:08.591270    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-v9n7p_80d874e6-8977-4487-8559-364f023d087c/dns-node-resolver/0.log"
May 21 02:22:09.040689 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:09.040656    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-r5gk9_77ce3cac-0f80-42a3-9dab-6fdcb65ff3e1/node-ca/0.log"
May 21 02:22:09.924131 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:09.924097    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-f6cbd8488-4qv9l_77ed2b90-7705-4010-90df-1ca4a5266494/kube-auth-proxy/0.log"
May 21 02:22:10.075298 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:10.075270    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-8c88869c6-88w97_c3c2aa6e-1ccd-4df7-830e-0d96a5b3579f/router/0.log"
May 21 02:22:10.580087 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:10.580049    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dnsw7_815f1db1-cfdb-4f49-a288-6cc22596f870/serve-healthcheck-canary/0.log"
May 21 02:22:11.126434 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:11.126407    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sqcgc_78ab7d30-4e1a-41e7-9730-0bd80b984067/kube-rbac-proxy/0.log"
May 21 02:22:11.141612 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:11.141585    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sqcgc_78ab7d30-4e1a-41e7-9730-0bd80b984067/exporter/0.log"
May 21 02:22:11.156742 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:11.156701    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sqcgc_78ab7d30-4e1a-41e7-9730-0bd80b984067/extractor/0.log"
May 21 02:22:12.910669 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:12.910620    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-76cccccb49-94snr_bf257d39-c608-41f1-861f-777977a82074/maas-api/0.log"
May 21 02:22:13.107415 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:13.107386    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64cdd6779c-mgb72_d08ce825-f54b-4543-928d-0cfcc249d3b3/manager/0.log"
May 21 02:22:14.143006 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:14.142977    2582 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mwfm7/perf-node-gather-daemonset-h4bmw"
May 21 02:22:14.159546 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:14.159500    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c8fd9c4f9-rwv2g_82627ba8-3967-406b-9589-bc0576a07eff/manager/0.log"
May 21 02:22:18.502546 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:18.502464    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-qtrfm_f8d911b6-4332-43e4-8dcf-817195087d3c/migrator/0.log"
May 21 02:22:18.517418 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:18.517389    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-b985f5d89-qtrfm_f8d911b6-4332-43e4-8dcf-817195087d3c/graceful-termination/0.log"
May 21 02:22:18.795500 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:18.795428    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-b7flf_1a6b2b8d-5658-420b-bae0-d4f1778fd9fa/kube-storage-version-migrator-operator/1.log"
May 21 02:22:18.796237 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:18.796216    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-565644f49-b7flf_1a6b2b8d-5658-420b-bae0-d4f1778fd9fa/kube-storage-version-migrator-operator/0.log"
May 21 02:22:19.672369 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:19.672340    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7gzt5_6cdb6843-4726-44d1-a4e2-a85ff70dd595/kube-multus-additional-cni-plugins/0.log"
May 21 02:22:19.691654 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:19.691591    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7gzt5_6cdb6843-4726-44d1-a4e2-a85ff70dd595/egress-router-binary-copy/0.log"
May 21 02:22:19.707755 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:19.707730    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7gzt5_6cdb6843-4726-44d1-a4e2-a85ff70dd595/cni-plugins/0.log"
May 21 02:22:19.722690 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:19.722667    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7gzt5_6cdb6843-4726-44d1-a4e2-a85ff70dd595/bond-cni-plugin/0.log"
May 21 02:22:19.737328 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:19.737300    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7gzt5_6cdb6843-4726-44d1-a4e2-a85ff70dd595/routeoverride-cni/0.log"
May 21 02:22:19.753094 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:19.753071    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7gzt5_6cdb6843-4726-44d1-a4e2-a85ff70dd595/whereabouts-cni-bincopy/0.log"
May 21 02:22:19.769234 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:19.769204    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7gzt5_6cdb6843-4726-44d1-a4e2-a85ff70dd595/whereabouts-cni/0.log"
May 21 02:22:20.092874 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:20.092785    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-l52ds_55dff604-dfbc-40e7-8bfc-2a63dc376b02/kube-multus/0.log"
May 21 02:22:20.108196 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:20.108167    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2dkkl_4b0e871e-0753-4434-9ea6-2d139f7766c8/network-metrics-daemon/0.log"
May 21 02:22:20.122856 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:20.122828    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2dkkl_4b0e871e-0753-4434-9ea6-2d139f7766c8/kube-rbac-proxy/0.log"
May 21 02:22:20.934057 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:20.934017    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/ovn-controller/0.log"
May 21 02:22:20.945990 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:20.945970    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/ovn-acl-logging/0.log"
May 21 02:22:20.955055 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:20.955037    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/ovn-acl-logging/1.log"
May 21 02:22:20.968055 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:20.968036    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/kube-rbac-proxy-node/0.log"
May 21 02:22:20.983451 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:20.983430    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/kube-rbac-proxy-ovn-metrics/0.log"
May 21 02:22:20.997868 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:20.997842    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/northd/0.log"
May 21 02:22:21.012993 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:21.012970    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/nbdb/0.log"
May 21 02:22:21.028235 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:21.028212    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/sbdb/0.log"
May 21 02:22:21.118229 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:21.118199    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-5ttwc_97ae1a73-bfe1-4bd4-a1b2-dc2bb5a5a32a/ovnkube-controller/0.log"
May 21 02:22:22.696309 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:22.696219    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-q5jgp_e2ac1cd3-15eb-4d37-bcbd-ef5956149f6e/network-check-target-container/0.log"
May 21 02:22:23.618697 ip-10-0-129-167 kubenswrapper[2582]: I0521 02:22:23.618657    2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-snxsq_bc9c0ad2-90b8-4733-9d0a-353df57696f3/iptables-alerter/0.log"