May 29 02:24:52.301117 ip-10-0-141-109 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
May 29 02:24:52.301131 ip-10-0-141-109 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
May 29 02:24:52.301141 ip-10-0-141-109 systemd[1]: kubelet.service: Failed with result 'resources'.
May 29 02:24:52.301493 ip-10-0-141-109 systemd[1]: Failed to start Kubernetes Kubelet.
May 29 02:25:00.949549 ip-10-0-141-109 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found.
May 29 02:25:00.949559 ip-10-0-141-109 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4c6cd35dd5194099a985d4461cb52c89 --
May 29 02:27:11.203649 ip-10-0-141-109 systemd[1]: Starting Kubernetes Kubelet...
May 29 02:27:11.735142 ip-10-0-141-109 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 02:27:11.735142 ip-10-0-141-109 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
May 29 02:27:11.735142 ip-10-0-141-109 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 02:27:11.735142 ip-10-0-141-109 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
May 29 02:27:11.735142 ip-10-0-141-109 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
May 29 02:27:11.737472 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.737371    2573 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
May 29 02:27:11.740804 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740786    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 02:27:11.740804 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740804    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 02:27:11.740868 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740808    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 02:27:11.740868 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740811    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 02:27:11.740868 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740814    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 02:27:11.740868 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740817    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 02:27:11.740868 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740821    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 02:27:11.740868 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740824    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 02:27:11.740868 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740827    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 02:27:11.740868 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740830    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 02:27:11.740868 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740833    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 02:27:11.740868 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740835    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 02:27:11.740868 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740838    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 02:27:11.740868 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740841    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 02:27:11.740868 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740844    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 02:27:11.740868 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740846    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 02:27:11.740868 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740849    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 02:27:11.740868 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740851    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 02:27:11.740868 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740854    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 02:27:11.740868 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740857    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 02:27:11.740868 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740859    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 02:27:11.741343 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740862    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 02:27:11.741343 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740864    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 02:27:11.741343 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740869    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 02:27:11.741343 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740873    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 02:27:11.741343 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740876    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 02:27:11.741343 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740879    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 02:27:11.741343 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740882    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 02:27:11.741343 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740885    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 02:27:11.741343 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740887    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 02:27:11.741343 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740890    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 02:27:11.741343 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740892    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 02:27:11.741343 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740895    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 02:27:11.741343 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740898    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 02:27:11.741343 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740900    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 02:27:11.741343 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740903    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 02:27:11.741343 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740906    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 02:27:11.741343 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740908    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 02:27:11.741343 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740911    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 02:27:11.741343 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740913    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 02:27:11.741343 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740917    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 02:27:11.741846 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740920    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 02:27:11.741846 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740922    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 02:27:11.741846 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740925    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 02:27:11.741846 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740928    2573 feature_gate.go:328] unrecognized feature gate: Example2
May 29 02:27:11.741846 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740930    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 02:27:11.741846 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740933    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 02:27:11.741846 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740935    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 02:27:11.741846 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740938    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 02:27:11.741846 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740941    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 02:27:11.741846 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740943    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 02:27:11.741846 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740945    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 02:27:11.741846 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740948    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 02:27:11.741846 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740950    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 02:27:11.741846 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740953    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 02:27:11.741846 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740958    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 02:27:11.741846 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740962    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 02:27:11.741846 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740965    2573 feature_gate.go:328] unrecognized feature gate: Example
May 29 02:27:11.741846 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740968    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 02:27:11.741846 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740971    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 02:27:11.742326 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740974    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 02:27:11.742326 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740976    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 02:27:11.742326 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740979    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 02:27:11.742326 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740981    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 02:27:11.742326 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740984    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 02:27:11.742326 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740986    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 02:27:11.742326 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740989    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 02:27:11.742326 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740991    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 02:27:11.742326 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740994    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 02:27:11.742326 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.740998    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 02:27:11.742326 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741000    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 02:27:11.742326 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741003    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 02:27:11.742326 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741005    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 02:27:11.742326 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741009    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 02:27:11.742326 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741011    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 02:27:11.742326 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741014    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 02:27:11.742326 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741017    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 02:27:11.742326 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741019    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 02:27:11.742326 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741023    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 02:27:11.742326 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741025    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 02:27:11.742811 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741028    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 02:27:11.742811 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741031    2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 02:27:11.742811 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741033    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 02:27:11.742811 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741036    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 02:27:11.742811 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741038    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 02:27:11.742811 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741041    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 02:27:11.742811 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741459    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 02:27:11.742811 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741465    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 02:27:11.742811 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741468    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 02:27:11.742811 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741471    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 02:27:11.742811 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741474    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 02:27:11.742811 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741478    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 02:27:11.742811 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741482    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 02:27:11.742811 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741485    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 02:27:11.742811 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741488    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 02:27:11.742811 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741491    2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 02:27:11.742811 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741493    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 02:27:11.742811 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741496    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 02:27:11.742811 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741499    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 02:27:11.743277 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741501    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 02:27:11.743277 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741504    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 02:27:11.743277 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741506    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 02:27:11.743277 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741509    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 02:27:11.743277 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741512    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 02:27:11.743277 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741514    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 02:27:11.743277 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741517    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 02:27:11.743277 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741520    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 02:27:11.743277 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741523    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 02:27:11.743277 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741525    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 02:27:11.743277 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741528    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 02:27:11.743277 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741531    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 02:27:11.743277 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741533    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 02:27:11.743277 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741536    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 02:27:11.743277 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741540    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 02:27:11.743277 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741543    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 02:27:11.743277 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741545    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 02:27:11.743277 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741548    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 02:27:11.743277 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741550    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 02:27:11.743277 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741554    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 02:27:11.743781 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741557    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 02:27:11.743781 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741560    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 02:27:11.743781 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741563    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 02:27:11.743781 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741565    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 02:27:11.743781 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741568    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 02:27:11.743781 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741570    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 02:27:11.743781 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741573    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 02:27:11.743781 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741576    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 02:27:11.743781 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741578    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 02:27:11.743781 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741581    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 02:27:11.743781 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741583    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 02:27:11.743781 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741586    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 02:27:11.743781 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741588    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 02:27:11.743781 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741591    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 02:27:11.743781 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741594    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 02:27:11.743781 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741596    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 02:27:11.743781 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741599    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 02:27:11.743781 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741601    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 02:27:11.743781 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741604    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 02:27:11.743781 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741607    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 02:27:11.744282 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741609    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 02:27:11.744282 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741612    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 02:27:11.744282 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741615    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 02:27:11.744282 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741618    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 02:27:11.744282 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741620    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 02:27:11.744282 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741623    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 02:27:11.744282 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741625    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 02:27:11.744282 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741628    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 02:27:11.744282 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741631    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 02:27:11.744282 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741634    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 02:27:11.744282 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741636    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 02:27:11.744282 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741639    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 02:27:11.744282 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741642    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 02:27:11.744282 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741644    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 02:27:11.744282 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741647    2573 feature_gate.go:328] unrecognized feature gate: Example
May 29 02:27:11.744282 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741650    2573 feature_gate.go:328] unrecognized feature gate: Example2
May 29 02:27:11.744282 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741652    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 02:27:11.744282 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741655    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 02:27:11.744282 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741657    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 02:27:11.744282 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741660    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741663    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741666    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741668    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741671    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741673    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741676    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741678    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741681    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741683    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741686    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741688    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741691    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.741694    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741766    2573 flags.go:64] FLAG: --address="0.0.0.0"
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741773    2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741780    2573 flags.go:64] FLAG: --anonymous-auth="true"
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741785    2573 flags.go:64] FLAG: --application-metrics-count-limit="100"
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741789    2573 flags.go:64] FLAG: --authentication-token-webhook="false"
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741792    2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741797    2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
May 29 02:27:11.744807 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741806    2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741810    2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741813    2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741817    2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741821    2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741824    2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741827    2573 flags.go:64] FLAG: --cgroup-root=""
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741830    2573 flags.go:64] FLAG: --cgroups-per-qos="true"
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741833    2573 flags.go:64] FLAG: --client-ca-file=""
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741836    2573 flags.go:64] FLAG: --cloud-config=""
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741839    2573 flags.go:64] FLAG: --cloud-provider="external"
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741842    2573 flags.go:64] FLAG: --cluster-dns="[]"
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741847    2573 flags.go:64] FLAG: --cluster-domain=""
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741850    2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741853    2573 flags.go:64] FLAG: --config-dir=""
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741856    2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741860    2573 flags.go:64] FLAG: --container-log-max-files="5"
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741864    2573 flags.go:64] FLAG: --container-log-max-size="10Mi"
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741867    2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741870    2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741874    2573 flags.go:64] FLAG: --containerd-namespace="k8s.io"
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741876    2573 flags.go:64] FLAG: --contention-profiling="false"
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741880    2573 flags.go:64] FLAG: --cpu-cfs-quota="true"
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741883    2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741886    2573 flags.go:64] FLAG: --cpu-manager-policy="none"
May 29 02:27:11.745329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741889    2573 flags.go:64] FLAG: --cpu-manager-policy-options=""
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741894    2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741897    2573 flags.go:64] FLAG: --enable-controller-attach-detach="true"
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741900    2573 flags.go:64] FLAG: --enable-debugging-handlers="true"
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741902    2573 flags.go:64] FLAG: --enable-load-reader="false"
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741905    2573 flags.go:64] FLAG: --enable-server="true"
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741909    2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741914    2573 flags.go:64] FLAG: --event-burst="100"
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741918    2573 flags.go:64] FLAG: --event-qps="50"
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741921    2573 flags.go:64] FLAG: --event-storage-age-limit="default=0"
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741924    2573 flags.go:64] FLAG: --event-storage-event-limit="default=0"
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741928    2573 flags.go:64] FLAG: --eviction-hard=""
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741932    2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741935    2573 flags.go:64] FLAG: --eviction-minimum-reclaim=""
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741938    2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741941    2573 flags.go:64] FLAG: --eviction-soft=""
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741944    2573 flags.go:64] FLAG: --eviction-soft-grace-period=""
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741947    2573 flags.go:64] FLAG: --exit-on-lock-contention="false"
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741950    2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741953    2573 flags.go:64] FLAG: --experimental-mounter-path=""
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741956    2573 flags.go:64] FLAG: --fail-cgroupv1="false"
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741959    2573 flags.go:64] FLAG: --fail-swap-on="true"
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741962    2573 flags.go:64] FLAG: --feature-gates=""
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741966    2573 flags.go:64] FLAG: --file-check-frequency="20s"
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741969    2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
May 29 02:27:11.745935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741973    2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741976    2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741979    2573 flags.go:64] FLAG: --healthz-port="10248"
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741982    2573 flags.go:64] FLAG: --help="false"
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741985    2573 flags.go:64] FLAG: --hostname-override="ip-10-0-141-109.ec2.internal"
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741989    2573 flags.go:64] FLAG: --housekeeping-interval="10s"
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741992    2573 flags.go:64] FLAG: --http-check-frequency="20s"
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741995    2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.741998    2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742002    2573 flags.go:64] FLAG: --image-gc-high-threshold="85"
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742005    2573 flags.go:64] FLAG: --image-gc-low-threshold="80"
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742008    2573 flags.go:64] FLAG: --image-service-endpoint=""
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742011    2573 flags.go:64] FLAG: --kernel-memcg-notification="false"
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742014    2573 flags.go:64] FLAG: --kube-api-burst="100"
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742017    2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742020    2573 flags.go:64] FLAG: --kube-api-qps="50"
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742023    2573 flags.go:64] FLAG: --kube-reserved=""
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742027    2573 flags.go:64] FLAG: --kube-reserved-cgroup=""
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742030    2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742033    2573 flags.go:64] FLAG: --kubelet-cgroups=""
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742036    2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742039    2573 flags.go:64] FLAG: --lock-file=""
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742042    2573 flags.go:64] FLAG: --log-cadvisor-usage="false"
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742045    2573 flags.go:64] FLAG: --log-flush-frequency="5s"
May 29 02:27:11.746616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742048    2573 flags.go:64] FLAG: --log-json-info-buffer-size="0"
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742053    2573 flags.go:64] FLAG: --log-json-split-stream="false"
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742056    2573 flags.go:64] FLAG: --log-text-info-buffer-size="0"
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742059    2573 flags.go:64] FLAG: --log-text-split-stream="false"
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742062    2573 flags.go:64] FLAG: --logging-format="text"
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742065    2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742069    2573 flags.go:64] FLAG: --make-iptables-util-chains="true"
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742072    2573 flags.go:64] FLAG: --manifest-url=""
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742075    2573 flags.go:64] FLAG: --manifest-url-header=""
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742079    2573 flags.go:64] FLAG: --max-housekeeping-interval="15s"
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742082    2573 flags.go:64] FLAG: --max-open-files="1000000"
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742087    2573 flags.go:64] FLAG: --max-pods="110"
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742090    2573 flags.go:64] FLAG: --maximum-dead-containers="-1"
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742093    2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742096    2573 flags.go:64] FLAG: --memory-manager-policy="None"
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742100    2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742103    2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742106    2573 flags.go:64] FLAG: --node-ip="0.0.0.0"
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742110    2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742118    2573 flags.go:64] FLAG: --node-status-max-images="50"
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742121    2573 flags.go:64] FLAG: --node-status-update-frequency="10s"
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742125    2573 flags.go:64] FLAG: --oom-score-adj="-999"
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742128    2573 flags.go:64] FLAG: --pod-cidr=""
May 29 02:27:11.747204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742131    2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:afe88671bf163c42b467d159dc6f0b784dbe28b1ed44e171edc9c06fd99cc6fc"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742137    2573 flags.go:64] FLAG: --pod-manifest-path=""
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742140    2573 flags.go:64] FLAG: --pod-max-pids="-1"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742143    2573 flags.go:64] FLAG: --pods-per-core="0"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742146    2573 flags.go:64] FLAG: --port="10250"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742150    2573 flags.go:64] FLAG: --protect-kernel-defaults="false"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742153    2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ec6b7abe377b4832"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742156    2573 flags.go:64] FLAG: --qos-reserved=""
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742159    2573 flags.go:64] FLAG: --read-only-port="10255"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742162    2573 flags.go:64] FLAG: --register-node="true"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742165    2573 flags.go:64] FLAG: --register-schedulable="true"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742168    2573 flags.go:64] FLAG: --register-with-taints=""
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742171    2573 flags.go:64] FLAG: --registry-burst="10"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742174    2573 flags.go:64] FLAG: --registry-qps="5"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742177    2573 flags.go:64] FLAG: --reserved-cpus=""
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742180    2573 flags.go:64] FLAG: --reserved-memory=""
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742184    2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742187    2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742190    2573 flags.go:64] FLAG: --rotate-certificates="false"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742193    2573 flags.go:64] FLAG: --rotate-server-certificates="false"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742196    2573 flags.go:64] FLAG: --runonce="false"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742199    2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742202    2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742205    2573 flags.go:64] FLAG: --seccomp-default="false"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742207    2573 flags.go:64] FLAG: --serialize-image-pulls="true"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742210    2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
May 29 02:27:11.747813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742213    2573 flags.go:64] FLAG: --storage-driver-db="cadvisor"
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742220    2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742223    2573 flags.go:64] FLAG: --storage-driver-password="root"
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742226    2573 flags.go:64] FLAG: --storage-driver-secure="false"
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742229    2573 flags.go:64] FLAG: --storage-driver-table="stats"
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742232    2573 flags.go:64] FLAG: --storage-driver-user="root"
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742236    2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742239    2573 flags.go:64] FLAG: --sync-frequency="1m0s"
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742242    2573 flags.go:64] FLAG: --system-cgroups=""
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742245    2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742266    2573 flags.go:64] FLAG: --system-reserved-cgroup=""
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742269    2573 flags.go:64] FLAG: --tls-cert-file=""
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742272    2573 flags.go:64] FLAG: --tls-cipher-suites="[]"
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742278    2573 flags.go:64] FLAG: --tls-min-version=""
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742281    2573 flags.go:64] FLAG: --tls-private-key-file=""
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742284    2573 flags.go:64] FLAG: --topology-manager-policy="none"
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742287    2573 flags.go:64] FLAG: --topology-manager-policy-options=""
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742290    2573 flags.go:64] FLAG: --topology-manager-scope="container"
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742293    2573 flags.go:64] FLAG: --v="2"
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742297    2573 flags.go:64] FLAG: --version="false"
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742302    2573 flags.go:64] FLAG: --vmodule=""
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742306    2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742310    2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742405    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 02:27:11.748842 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742409    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 02:27:11.749641 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742412    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 02:27:11.749641 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742415    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 02:27:11.749641 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742417    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 02:27:11.749641 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742420    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 02:27:11.749641 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742423    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 02:27:11.749641 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742425    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 02:27:11.749641 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742428    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 02:27:11.749641 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742431    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 02:27:11.749641 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742438    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 02:27:11.749641 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742442    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 02:27:11.749641 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742444    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 02:27:11.749641 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742447    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 02:27:11.749641 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742450    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 02:27:11.749641 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742452    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 02:27:11.749641 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742455    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 02:27:11.749641 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742458    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 02:27:11.749641 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742460    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 02:27:11.749641 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742463    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 02:27:11.749641 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742465    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 02:27:11.749641 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742468    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 02:27:11.750438 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742471    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 02:27:11.750438 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742474    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 02:27:11.750438 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742476    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 02:27:11.750438 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742479    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 02:27:11.750438 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742481    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 02:27:11.750438 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742484    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 02:27:11.750438 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742488    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 02:27:11.750438 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742492    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 02:27:11.750438 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742497    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 02:27:11.750438 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742499    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 02:27:11.750438 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742502    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 02:27:11.750438 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742505    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 02:27:11.750438 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742507    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 02:27:11.750438 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742510    2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 02:27:11.750438 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742512    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 02:27:11.750438 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742515    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 02:27:11.750438 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742518    2573 feature_gate.go:328] unrecognized feature gate: Example
May 29 02:27:11.750438 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742520    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 02:27:11.750438 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742523    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 02:27:11.750915 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742526    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 02:27:11.750915 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742530    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 02:27:11.750915 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742533    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 02:27:11.750915 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742536    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 02:27:11.750915 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742539    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 02:27:11.750915 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742541    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 02:27:11.750915 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742544    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 02:27:11.750915 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742547    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 02:27:11.750915 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742549    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 02:27:11.750915 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742552    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 02:27:11.750915 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742554    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 02:27:11.750915 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742557    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 02:27:11.750915 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742560    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 02:27:11.750915 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742562    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 02:27:11.750915 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742564    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 02:27:11.750915 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742567    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 02:27:11.750915 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742570    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 02:27:11.750915 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742573    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 02:27:11.750915 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742575    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 02:27:11.750915 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742578    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 02:27:11.751430 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742582    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 02:27:11.751430 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742586    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 02:27:11.751430 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742589    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 02:27:11.751430 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742592    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 02:27:11.751430 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742595    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 02:27:11.751430 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742597    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 02:27:11.751430 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742600    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 02:27:11.751430 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742602    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 02:27:11.751430 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742605    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 02:27:11.751430 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742607    2573 feature_gate.go:328] unrecognized feature gate: Example2
May 29 02:27:11.751430 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742610    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 02:27:11.751430 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742612    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 02:27:11.751430 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742615    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 02:27:11.751430 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742619    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 02:27:11.751430 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742621    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 02:27:11.751430 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742624    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 02:27:11.751430 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742627    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 02:27:11.751430 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742630    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 02:27:11.751430 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742632    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 02:27:11.752003 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742635    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 02:27:11.752003 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742637    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 02:27:11.752003 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742640    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 02:27:11.752003 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742643    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 02:27:11.752003 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742645    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 02:27:11.752003 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.742648    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 02:27:11.752003 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.742654    2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 02:27:11.752003 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.751000    2573 server.go:530] "Kubelet version" kubeletVersion="v1.33.11"
May 29 02:27:11.752003 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.751019    2573 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
May 29 02:27:11.752003 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751073    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 02:27:11.752003 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751078    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 02:27:11.752003 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751081    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 02:27:11.752003 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751084    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 02:27:11.752003 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751088    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 02:27:11.752003 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751090    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 02:27:11.752003 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751093    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 02:27:11.752437 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751096    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 02:27:11.752437 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751098    2573 feature_gate.go:328] unrecognized feature gate: Example
May 29 02:27:11.752437 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751101    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 02:27:11.752437 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751104    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 02:27:11.752437 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751107    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 02:27:11.752437 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751109    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 02:27:11.752437 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751112    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 02:27:11.752437 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751115    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 02:27:11.752437 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751118    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 02:27:11.752437 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751121    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 02:27:11.752437 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751123    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 02:27:11.752437 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751126    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 02:27:11.752437 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751129    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 02:27:11.752437 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751132    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 02:27:11.752437 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751134    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 02:27:11.752437 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751137    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 02:27:11.752437 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751140    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 02:27:11.752437 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751143    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 02:27:11.752437 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751146    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 02:27:11.752437 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751149    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 02:27:11.752932 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751152    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 02:27:11.752932 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751154    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 02:27:11.752932 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751157    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 02:27:11.752932 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751160    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 02:27:11.752932 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751164    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 02:27:11.752932 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751166    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 02:27:11.752932 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751169    2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 02:27:11.752932 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751171    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 02:27:11.752932 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751174    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 02:27:11.752932 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751177    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 02:27:11.752932 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751181    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 02:27:11.752932 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751185    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 02:27:11.752932 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751188    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 02:27:11.752932 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751190    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 02:27:11.752932 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751193    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 02:27:11.752932 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751196    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 02:27:11.752932 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751199    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 02:27:11.752932 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751203    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 02:27:11.752932 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751208    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 02:27:11.753405 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751211    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 02:27:11.753405 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751214    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 02:27:11.753405 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751217    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 02:27:11.753405 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751220    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 02:27:11.753405 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751222    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 02:27:11.753405 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751225    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 02:27:11.753405 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751228    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 02:27:11.753405 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751231    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 02:27:11.753405 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751233    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 02:27:11.753405 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751236    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 02:27:11.753405 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751239    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 02:27:11.753405 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751241    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 02:27:11.753405 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751244    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 02:27:11.753405 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751247    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 02:27:11.753405 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751266    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 02:27:11.753405 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751270    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 02:27:11.753405 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751273    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 02:27:11.753405 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751276    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 02:27:11.753405 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751279    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 02:27:11.753405 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751282    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 02:27:11.753888 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751284    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 02:27:11.753888 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751287    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 02:27:11.753888 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751290    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 02:27:11.753888 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751292    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 02:27:11.753888 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751295    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 02:27:11.753888 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751298    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 02:27:11.753888 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751300    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 02:27:11.753888 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751303    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 02:27:11.753888 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751305    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 02:27:11.753888 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751309    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 02:27:11.753888 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751312    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 02:27:11.753888 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751315    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 02:27:11.753888 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751317    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 02:27:11.753888 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751321    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 02:27:11.753888 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751323    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 02:27:11.753888 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751326    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 02:27:11.753888 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751328    2573 feature_gate.go:328] unrecognized feature gate: Example2
May 29 02:27:11.753888 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751331    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 02:27:11.753888 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751334    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 02:27:11.753888 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751336    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 02:27:11.754473 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.751341    2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 02:27:11.754473 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751440    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
May 29 02:27:11.754473 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751445    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
May 29 02:27:11.754473 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751448    2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
May 29 02:27:11.754473 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751451    2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
May 29 02:27:11.754473 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751454    2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
May 29 02:27:11.754473 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751457    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
May 29 02:27:11.754473 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751460    2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
May 29 02:27:11.754473 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751463    2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
May 29 02:27:11.754473 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751466    2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
May 29 02:27:11.754473 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751469    2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
May 29 02:27:11.754473 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751471    2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
May 29 02:27:11.754473 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751474    2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
May 29 02:27:11.754473 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751477    2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
May 29 02:27:11.754473 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751479    2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
May 29 02:27:11.754847 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751482    2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
May 29 02:27:11.754847 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751484    2573 feature_gate.go:328] unrecognized feature gate: NewOLM
May 29 02:27:11.754847 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751487    2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
May 29 02:27:11.754847 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751489    2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
May 29 02:27:11.754847 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751492    2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
May 29 02:27:11.754847 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751494    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
May 29 02:27:11.754847 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751497    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
May 29 02:27:11.754847 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751500    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
May 29 02:27:11.754847 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751503    2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
May 29 02:27:11.754847 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751505    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
May 29 02:27:11.754847 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751508    2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
May 29 02:27:11.754847 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751511    2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
May 29 02:27:11.754847 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751513    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
May 29 02:27:11.754847 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751516    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
May 29 02:27:11.754847 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751518    2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
May 29 02:27:11.754847 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751521    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
May 29 02:27:11.754847 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751525    2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
May 29 02:27:11.754847 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751529    2573 feature_gate.go:328] unrecognized feature gate: PinnedImages
May 29 02:27:11.754847 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751532    2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
May 29 02:27:11.754847 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751536    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI
May 29 02:27:11.755353 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751538    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
May 29 02:27:11.755353 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751541    2573 feature_gate.go:328] unrecognized feature gate: Example2
May 29 02:27:11.755353 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751543    2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
May 29 02:27:11.755353 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751546    2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
May 29 02:27:11.755353 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751548    2573 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
May 29 02:27:11.755353 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751551    2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
May 29 02:27:11.755353 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751554    2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
May 29 02:27:11.755353 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751556    2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
May 29 02:27:11.755353 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751559    2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
May 29 02:27:11.755353 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751562    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
May 29 02:27:11.755353 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751564    2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
May 29 02:27:11.755353 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751567    2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
May 29 02:27:11.755353 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751569    2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
May 29 02:27:11.755353 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751571    2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
May 29 02:27:11.755353 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751574    2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
May 29 02:27:11.755353 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751576    2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
May 29 02:27:11.755353 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751579    2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
May 29 02:27:11.755353 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751582    2573 feature_gate.go:328] unrecognized feature gate: DualReplica
May 29 02:27:11.755353 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751584    2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
May 29 02:27:11.755353 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751587    2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
May 29 02:27:11.755852 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751589    2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
May 29 02:27:11.755852 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751592    2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
May 29 02:27:11.755852 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751595    2573 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
May 29 02:27:11.755852 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751597    2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
May 29 02:27:11.755852 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751599    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
May 29 02:27:11.755852 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751602    2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
May 29 02:27:11.755852 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751604    2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
May 29 02:27:11.755852 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751607    2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
May 29 02:27:11.755852 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751609    2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
May 29 02:27:11.755852 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751612    2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
May 29 02:27:11.755852 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751614    2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
May 29 02:27:11.755852 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751617    2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
May 29 02:27:11.755852 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751619    2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
May 29 02:27:11.755852 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751622    2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
May 29 02:27:11.755852 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751625    2573 feature_gate.go:328] unrecognized feature gate: SignatureStores
May 29 02:27:11.755852 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751627    2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig
May 29 02:27:11.755852 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751630    2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
May 29 02:27:11.755852 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751632    2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
May 29 02:27:11.755852 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751635    2573 feature_gate.go:328] unrecognized feature gate: Example
May 29 02:27:11.755852 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751638    2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
May 29 02:27:11.756360 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751641    2573 feature_gate.go:328] unrecognized feature gate: OVNObservability
May 29 02:27:11.756360 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751643    2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
May 29 02:27:11.756360 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751646    2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
May 29 02:27:11.756360 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751648    2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
May 29 02:27:11.756360 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751651    2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
May 29 02:27:11.756360 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751653    2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
May 29 02:27:11.756360 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751656    2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
May 29 02:27:11.756360 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751658    2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
May 29 02:27:11.756360 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751661    2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
May 29 02:27:11.756360 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751663    2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
May 29 02:27:11.756360 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751666    2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
May 29 02:27:11.756360 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:11.751670    2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
May 29 02:27:11.756360 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.751675    2573 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
May 29 02:27:11.756360 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.752621    2573 server.go:962] "Client rotation is on, will bootstrap in background"
May 29 02:27:11.756360 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.755154    2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
May 29 02:27:11.756750 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.756220    2573 server.go:1019] "Starting client certificate rotation"
May 29 02:27:11.756750 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.756320    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 29 02:27:11.756750 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.756359    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
May 29 02:27:11.785531 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.785508    2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 29 02:27:11.789193 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.789168    2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
May 29 02:27:11.805058 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.805034    2573 log.go:25] "Validated CRI v1 runtime API"
May 29 02:27:11.811089 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.811069    2573 log.go:25] "Validated CRI v1 image API"
May 29 02:27:11.812638 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.812625    2573 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
May 29 02:27:11.818789 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.818769    2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 29 02:27:11.820200 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.820163    2573 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 8713a0bf-5698-4b37-8d06-d57d624843c6:/dev/nvme0n1p3 aedb9652-faa3-4346-b9b0-8f42c34237ce:/dev/nvme0n1p4]
May 29 02:27:11.820340 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.820203    2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
May 29 02:27:11.825218 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.825086    2573 manager.go:217] Machine: {Timestamp:2026-05-29 02:27:11.824551344 +0000 UTC m=+0.479558971 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100081 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cabddac73757337f19629dde35765 SystemUUID:ec2cabdd-ac73-7573-37f1-9629dde35765 BootID:4c6cd35d-d519-4099-a985-d4461cb52c89 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e9:0a:41:ff:ef Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e9:0a:41:ff:ef Speed:0 Mtu:9001} {Name:ovs-system MacAddress:c2:1f:af:30:4c:c9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
May 29 02:27:11.826011 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.825998    2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
May 29 02:27:11.826111 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.826098    2573 manager.go:233] Version: {KernelVersion:5.14.0-570.114.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260512-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
May 29 02:27:11.827429 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.827396    2573 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
May 29 02:27:11.827605 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.827431    2573 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-109.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
May 29 02:27:11.827681 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.827619    2573 topology_manager.go:138] "Creating topology manager with none policy"
May 29 02:27:11.827681 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.827632    2573 container_manager_linux.go:306] "Creating device plugin manager"
May 29 02:27:11.827681 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.827643    2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
May 29 02:27:11.828580 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.828565    2573 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
May 29 02:27:11.831246 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.831227    2573 state_mem.go:36] "Initialized new in-memory state store"
May 29 02:27:11.831611 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.831596    2573 server.go:1267] "Using root directory" path="/var/lib/kubelet"
May 29 02:27:11.834545 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.834531    2573 kubelet.go:491] "Attempting to sync node with API server"
May 29 02:27:11.834621 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.834552    2573 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
May 29 02:27:11.834621 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.834573    2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
May 29 02:27:11.834621 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.834586    2573 kubelet.go:397] "Adding apiserver pod source"
May 29 02:27:11.834621 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.834599    2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
May 29 02:27:11.835944 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.835929    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 29 02:27:11.836023 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.835955    2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
May 29 02:27:11.839633 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.839616    2573 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.11-2.rhaos4.20.gitb2a8320.el9" apiVersion="v1"
May 29 02:27:11.842053 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.842039    2573 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
May 29 02:27:11.843029 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.843017    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
May 29 02:27:11.843072 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.843035    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
May 29 02:27:11.843072 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.843041    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
May 29 02:27:11.843072 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.843047    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
May 29 02:27:11.843072 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.843055    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
May 29 02:27:11.843072 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.843060    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
May 29 02:27:11.843072 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.843066    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
May 29 02:27:11.843072 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.843071    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
May 29 02:27:11.843265 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.843078    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
May 29 02:27:11.843265 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.843084    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
May 29 02:27:11.843265 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.843092    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
May 29 02:27:11.843558 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.843548    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
May 29 02:27:11.844552 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.844542    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
May 29 02:27:11.844552 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.844552    2573 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
May 29 02:27:11.848202 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.848176    2573 watchdog_linux.go:99] "Systemd watchdog is not enabled"
May 29 02:27:11.848202 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:11.848183    2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
May 29 02:27:11.848414 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.848247    2573 server.go:1295] "Started kubelet"
May 29 02:27:11.848711 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.848692    2573 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-109.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
May 29 02:27:11.848779 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:11.848736    2573 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
May 29 02:27:11.849225 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.849182    2573 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
May 29 02:27:11.849309 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.849240    2573 server_v1.go:47] "podresources" method="list" useActivePods=true
May 29 02:27:11.849300 ip-10-0-141-109 systemd[1]: Started Kubernetes Kubelet.
May 29 02:27:11.850090 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.849986    2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
May 29 02:27:11.851198 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.851180    2573 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
May 29 02:27:11.852693 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.852677    2573 server.go:317] "Adding debug handlers to kubelet server"
May 29 02:27:11.858217 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:11.857141    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-109.ec2.internal.18b3e83e42d2c2bd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-109.ec2.internal,UID:ip-10-0-141-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-109.ec2.internal,},FirstTimestamp:2026-05-29 02:27:11.848202941 +0000 UTC m=+0.503210568,LastTimestamp:2026-05-29 02:27:11.848202941 +0000 UTC m=+0.503210568,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-109.ec2.internal,}"
May 29 02:27:11.858498 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:11.858482    2573 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
May 29 02:27:11.858742 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.858711    2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
May 29 02:27:11.859333 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.859317    2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
May 29 02:27:11.861595 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.861572    2573 volume_manager.go:295] "The desired_state_of_world populator starts"
May 29 02:27:11.861595 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.861595    2573 volume_manager.go:297] "Starting Kubelet Volume Manager"
May 29 02:27:11.862092 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.861707    2573 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
May 29 02:27:11.862170 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.861792    2573 reconstruct.go:97] "Volume reconstruction finished"
May 29 02:27:11.862170 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.862162    2573 reconciler.go:26] "Reconciler: start to sync state"
May 29 02:27:11.862495 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.862474    2573 factory.go:55] Registering systemd factory
May 29 02:27:11.862558 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.862500    2573 factory.go:223] Registration of the systemd container factory successfully
May 29 02:27:11.862811 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:11.862791    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-109.ec2.internal\" not found"
May 29 02:27:11.862918 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.862900    2573 factory.go:153] Registering CRI-O factory
May 29 02:27:11.862977 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.862939    2573 factory.go:223] Registration of the crio container factory successfully
May 29 02:27:11.863049 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.863036    2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
May 29 02:27:11.863871 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.863852    2573 factory.go:103] Registering Raw factory
May 29 02:27:11.863952 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.863891    2573 manager.go:1196] Started watching for new ooms in manager
May 29 02:27:11.864337 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.864322    2573 manager.go:319] Starting recovery of all containers
May 29 02:27:11.865313 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:11.865289    2573 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
May 29 02:27:11.865726 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:11.865666    2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-109.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
May 29 02:27:11.874634 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.874511    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h7m56"
May 29 02:27:11.875204 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.875185    2573 manager.go:324] Recovery completed
May 29 02:27:11.879234 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.879218    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 02:27:11.881302 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.881285    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-109.ec2.internal" event="NodeHasSufficientMemory"
May 29 02:27:11.881378 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.881314    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-109.ec2.internal" event="NodeHasNoDiskPressure"
May 29 02:27:11.881378 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.881325    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-109.ec2.internal" event="NodeHasSufficientPID"
May 29 02:27:11.881864 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.881852    2573 cpu_manager.go:222] "Starting CPU manager" policy="none"
May 29 02:27:11.881906 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.881864    2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
May 29 02:27:11.881906 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.881880    2573 state_mem.go:36] "Initialized new in-memory state store"
May 29 02:27:11.883583 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:11.883518    2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-109.ec2.internal.18b3e83e44cbcd9f  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-109.ec2.internal,UID:ip-10-0-141-109.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-141-109.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-141-109.ec2.internal,},FirstTimestamp:2026-05-29 02:27:11.881301407 +0000 UTC m=+0.536309034,LastTimestamp:2026-05-29 02:27:11.881301407 +0000 UTC m=+0.536309034,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-109.ec2.internal,}"
May 29 02:27:11.885592 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.885578    2573 policy_none.go:49] "None policy: Start"
May 29 02:27:11.885687 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.885598    2573 memory_manager.go:186] "Starting memorymanager" policy="None"
May 29 02:27:11.885687 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.885646    2573 state_mem.go:35] "Initializing new in-memory state store"
May 29 02:27:11.886053 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.886033    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h7m56"
May 29 02:27:11.919857 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.919839    2573 manager.go:341] "Starting Device Plugin manager"
May 29 02:27:11.947462 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:11.919879    2573 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
May 29 02:27:11.947462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.919892    2573 server.go:85] "Starting device plugin registration server"
May 29 02:27:11.947462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.920148    2573 eviction_manager.go:189] "Eviction manager: starting control loop"
May 29 02:27:11.947462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.920170    2573 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
May 29 02:27:11.947462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.920263    2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
May 29 02:27:11.947462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.920344    2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
May 29 02:27:11.947462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.920350    2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
May 29 02:27:11.947462 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:11.920973    2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
May 29 02:27:11.947462 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:11.921011    2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-109.ec2.internal\" not found"
May 29 02:27:11.965045 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.965015    2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
May 29 02:27:11.966187 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.966168    2573 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
May 29 02:27:11.966237 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.966200    2573 status_manager.go:230] "Starting to sync pod status with apiserver"
May 29 02:27:11.966237 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.966224    2573 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
May 29 02:27:11.966237 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.966233    2573 kubelet.go:2451] "Starting kubelet main sync loop"
May 29 02:27:11.966374 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:11.966296    2573 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
May 29 02:27:11.970752 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:11.970728    2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 02:27:12.020687 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.020596    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 02:27:12.021813 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.021793    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-109.ec2.internal" event="NodeHasSufficientMemory"
May 29 02:27:12.021911 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.021827    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-109.ec2.internal" event="NodeHasNoDiskPressure"
May 29 02:27:12.021911 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.021839    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-109.ec2.internal" event="NodeHasSufficientPID"
May 29 02:27:12.021911 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.021863    2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-109.ec2.internal"
May 29 02:27:12.031574 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.031551    2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-109.ec2.internal"
May 29 02:27:12.031683 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:12.031582    2573 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-109.ec2.internal\": node \"ip-10-0-141-109.ec2.internal\" not found"
May 29 02:27:12.044352 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:12.044321    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-109.ec2.internal\" not found"
May 29 02:27:12.067009 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.066957    2573 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-109.ec2.internal"]
May 29 02:27:12.067093 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.067058    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 02:27:12.068023 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.068007    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-109.ec2.internal" event="NodeHasSufficientMemory"
May 29 02:27:12.068103 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.068035    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-109.ec2.internal" event="NodeHasNoDiskPressure"
May 29 02:27:12.068103 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.068048    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-109.ec2.internal" event="NodeHasSufficientPID"
May 29 02:27:12.069387 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.069374    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 02:27:12.069534 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.069518    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal"
May 29 02:27:12.069571 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.069553    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 02:27:12.070135 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.070117    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-109.ec2.internal" event="NodeHasSufficientMemory"
May 29 02:27:12.070275 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.070145    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-109.ec2.internal" event="NodeHasNoDiskPressure"
May 29 02:27:12.070275 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.070154    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-109.ec2.internal" event="NodeHasSufficientPID"
May 29 02:27:12.070275 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.070118    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-109.ec2.internal" event="NodeHasSufficientMemory"
May 29 02:27:12.070275 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.070224    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-109.ec2.internal" event="NodeHasNoDiskPressure"
May 29 02:27:12.070275 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.070242    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-109.ec2.internal" event="NodeHasSufficientPID"
May 29 02:27:12.071760 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.071744    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-109.ec2.internal"
May 29 02:27:12.071850 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.071775    2573 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
May 29 02:27:12.072556 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.072540    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-109.ec2.internal" event="NodeHasSufficientMemory"
May 29 02:27:12.072663 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.072571    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-109.ec2.internal" event="NodeHasNoDiskPressure"
May 29 02:27:12.072663 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.072583    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-109.ec2.internal" event="NodeHasSufficientPID"
May 29 02:27:12.108319 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:12.108288    2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-109.ec2.internal\" not found" node="ip-10-0-141-109.ec2.internal"
May 29 02:27:12.111672 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:12.111654    2573 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-109.ec2.internal\" not found" node="ip-10-0-141-109.ec2.internal"
May 29 02:27:12.145241 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:12.145209    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-109.ec2.internal\" not found"
May 29 02:27:12.164493 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.164462    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7a531431cf6407f8b2b9581365ac5ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal\" (UID: \"f7a531431cf6407f8b2b9581365ac5ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal"
May 29 02:27:12.164563 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.164495    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/070b9e105d9b4685ab2c760a71e155cd-config\") pod \"kube-apiserver-proxy-ip-10-0-141-109.ec2.internal\" (UID: \"070b9e105d9b4685ab2c760a71e155cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-109.ec2.internal"
May 29 02:27:12.164563 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.164514    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f7a531431cf6407f8b2b9581365ac5ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal\" (UID: \"f7a531431cf6407f8b2b9581365ac5ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal"
May 29 02:27:12.245620 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:12.245582    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-109.ec2.internal\" not found"
May 29 02:27:12.265050 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.265021    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f7a531431cf6407f8b2b9581365ac5ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal\" (UID: \"f7a531431cf6407f8b2b9581365ac5ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal"
May 29 02:27:12.265099 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.265032    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/f7a531431cf6407f8b2b9581365ac5ff-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal\" (UID: \"f7a531431cf6407f8b2b9581365ac5ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal"
May 29 02:27:12.265099 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.265091    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7a531431cf6407f8b2b9581365ac5ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal\" (UID: \"f7a531431cf6407f8b2b9581365ac5ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal"
May 29 02:27:12.265161 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.265119    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/070b9e105d9b4685ab2c760a71e155cd-config\") pod \"kube-apiserver-proxy-ip-10-0-141-109.ec2.internal\" (UID: \"070b9e105d9b4685ab2c760a71e155cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-109.ec2.internal"
May 29 02:27:12.265161 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.265154    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/070b9e105d9b4685ab2c760a71e155cd-config\") pod \"kube-apiserver-proxy-ip-10-0-141-109.ec2.internal\" (UID: \"070b9e105d9b4685ab2c760a71e155cd\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-109.ec2.internal"
May 29 02:27:12.265223 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.265206    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f7a531431cf6407f8b2b9581365ac5ff-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal\" (UID: \"f7a531431cf6407f8b2b9581365ac5ff\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal"
May 29 02:27:12.346510 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:12.346439    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-109.ec2.internal\" not found"
May 29 02:27:12.410939 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.410908    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal"
May 29 02:27:12.414655 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.414631    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-109.ec2.internal"
May 29 02:27:12.447266 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:12.447220    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-109.ec2.internal\" not found"
May 29 02:27:12.547770 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:12.547720    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-109.ec2.internal\" not found"
May 29 02:27:12.648218 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:12.648182    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-109.ec2.internal\" not found"
May 29 02:27:12.748816 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:12.748780    2573 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-141-109.ec2.internal\" not found"
May 29 02:27:12.755980 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.755947    2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
May 29 02:27:12.756143 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.756104    2573 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
May 29 02:27:12.848065 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.848030    2573 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 02:27:12.859395 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.859364    2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
May 29 02:27:12.862538 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.862508    2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal"
May 29 02:27:12.872146 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.872071    2573 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
May 29 02:27:12.877618 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.877599    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 29 02:27:12.879614 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.879599    2573 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-109.ec2.internal"
May 29 02:27:12.888430 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.888399    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-28 02:22:11 +0000 UTC" deadline="2027-12-14 11:04:08.072306915 +0000 UTC"
May 29 02:27:12.888534 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.888425    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13544h36m55.183885136s"
May 29 02:27:12.888534 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.888472    2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
May 29 02:27:12.893936 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.893913    2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-cjhw4"
May 29 02:27:12.903296 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.903246    2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-cjhw4"
May 29 02:27:12.939512 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:12.939477    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7a531431cf6407f8b2b9581365ac5ff.slice/crio-e7fa6cd47d8a46035deeafc46f025a16ab68df892efa5961c191003b7c66465d WatchSource:0}: Error finding container e7fa6cd47d8a46035deeafc46f025a16ab68df892efa5961c191003b7c66465d: Status 404 returned error can't find the container with id e7fa6cd47d8a46035deeafc46f025a16ab68df892efa5961c191003b7c66465d
May 29 02:27:12.939737 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:12.939717    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod070b9e105d9b4685ab2c760a71e155cd.slice/crio-2b465ff1bb57ed900fa61c8674f8e56325e07860e03075d80f17a7427d35ff4d WatchSource:0}: Error finding container 2b465ff1bb57ed900fa61c8674f8e56325e07860e03075d80f17a7427d35ff4d: Status 404 returned error can't find the container with id 2b465ff1bb57ed900fa61c8674f8e56325e07860e03075d80f17a7427d35ff4d
May 29 02:27:12.944333 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.944312    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 02:27:12.969400 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.969347    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-109.ec2.internal" event={"ID":"070b9e105d9b4685ab2c760a71e155cd","Type":"ContainerStarted","Data":"2b465ff1bb57ed900fa61c8674f8e56325e07860e03075d80f17a7427d35ff4d"}
May 29 02:27:12.970233 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:12.970211    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal" event={"ID":"f7a531431cf6407f8b2b9581365ac5ff","Type":"ContainerStarted","Data":"e7fa6cd47d8a46035deeafc46f025a16ab68df892efa5961c191003b7c66465d"}
May 29 02:27:13.182723 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.182642    2573 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 02:27:13.425753 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.425722    2573 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 02:27:13.835797 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.835759    2573 apiserver.go:52] "Watching apiserver"
May 29 02:27:13.849056 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.849030    2573 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
May 29 02:27:13.849924 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.849824    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-109.ec2.internal","openshift-cluster-node-tuning-operator/tuned-gbfkn","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal","openshift-multus/multus-additional-cni-plugins-v8vwt","openshift-multus/multus-rrpxl","openshift-network-operator/iptables-alerter-5pdp5","openshift-ovn-kubernetes/ovnkube-node-6wldp","kube-system/konnectivity-agent-xjw8k","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6","openshift-image-registry/node-ca-jtmf8","openshift-multus/network-metrics-daemon-bbj9n","openshift-network-diagnostics/network-check-target-6bs6h"]
May 29 02:27:13.852686 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.852665    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.854807 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.854770    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.856482 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.856458    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
May 29 02:27:13.856579 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.856478    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
May 29 02:27:13.856916 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.856882    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.858008 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.857989    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
May 29 02:27:13.859236 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.858930    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5pdp5"
May 29 02:27:13.859396 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.859377    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7vphr\""
May 29 02:27:13.861183 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.861166    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.863549 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.863525    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xjw8k"
May 29 02:27:13.864916 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.864887    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sp5ch\""
May 29 02:27:13.864916 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.864909    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
May 29 02:27:13.865342 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.865156    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
May 29 02:27:13.865342 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.865188    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
May 29 02:27:13.865342 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.865316    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
May 29 02:27:13.865527 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.865427    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
May 29 02:27:13.865593 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.865573    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
May 29 02:27:13.865707 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.865597    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
May 29 02:27:13.865707 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.865628    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
May 29 02:27:13.865707 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.865642    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-52m6z\""
May 29 02:27:13.865858 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.865731    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
May 29 02:27:13.866019 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.865998    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:13.866564 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.866546    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
May 29 02:27:13.866657 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.866570    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
May 29 02:27:13.867387 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.867363    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
May 29 02:27:13.867475 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.867392    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
May 29 02:27:13.867537 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.867487    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-h4f9k\""
May 29 02:27:13.867590 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.867544    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5b4wg\""
May 29 02:27:13.867641 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.867616    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-45trd\""
May 29 02:27:13.867689 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.867678    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
May 29 02:27:13.867806 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.867792    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
May 29 02:27:13.867868 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.867817    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
May 29 02:27:13.868322 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.868307    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jtmf8"
May 29 02:27:13.869981 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.869963    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
May 29 02:27:13.870828 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.870809    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:13.870911 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:13.870890    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbj9n" podUID="f1c2fcb1-f203-4571-8cbe-eb01a190d63b"
May 29 02:27:13.871192 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.871176    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-5rz5l\""
May 29 02:27:13.871328 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.871306    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
May 29 02:27:13.871328 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.871323    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
May 29 02:27:13.871472 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.871329    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
May 29 02:27:13.871472 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.871347    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-45mz6\""
May 29 02:27:13.871472 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.871218    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
May 29 02:27:13.871472 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.871196    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
May 29 02:27:13.872974 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.872955    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:13.873061 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:13.873020    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bs6h" podUID="2f9d23cf-9350-4bd4-88f9-161206125b5e"
May 29 02:27:13.873870 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.873853    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h22rk\" (UniqueName: \"kubernetes.io/projected/3ff1be15-a11d-4659-84b9-b473b543db45-kube-api-access-h22rk\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.873960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.873880    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s48s7\" (UniqueName: \"kubernetes.io/projected/307a16db-de95-48bc-9404-bdcfff68ccdf-kube-api-access-s48s7\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.873960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.873895    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ec0a2cd5-5976-491c-b882-63e04f42a821-agent-certs\") pod \"konnectivity-agent-xjw8k\" (UID: \"ec0a2cd5-5976-491c-b882-63e04f42a821\") " pod="kube-system/konnectivity-agent-xjw8k"
May 29 02:27:13.873960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.873912    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-host\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.873960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.873939    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xnr5\" (UniqueName: \"kubernetes.io/projected/f980d368-27ce-4168-b05f-fa272e8c8e97-kube-api-access-6xnr5\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.874146 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.873966    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-host-var-lib-cni-multus\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.874553 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.874021    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-run-netns\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.874647 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.874573    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-multus-conf-dir\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.874647 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.874599    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d952dbb7-29ca-425c-b657-33c475f0834d-host-slash\") pod \"iptables-alerter-5pdp5\" (UID: \"d952dbb7-29ca-425c-b657-33c475f0834d\") " pod="openshift-network-operator/iptables-alerter-5pdp5"
May 29 02:27:13.874647 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.874622    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-sysconfig\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.874647 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.874644    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-host-run-netns\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.874849 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.874695    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-host-var-lib-kubelet\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.874849 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.874739    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-node-log\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.874849 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.874785    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/307a16db-de95-48bc-9404-bdcfff68ccdf-env-overrides\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.875529 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.874882    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/307a16db-de95-48bc-9404-bdcfff68ccdf-ovnkube-script-lib\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.875529 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.875397    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ec0a2cd5-5976-491c-b882-63e04f42a821-konnectivity-ca\") pod \"konnectivity-agent-xjw8k\" (UID: \"ec0a2cd5-5976-491c-b882-63e04f42a821\") " pod="kube-system/konnectivity-agent-xjw8k"
May 29 02:27:13.875529 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.875428    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-os-release\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.875716 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.875580    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-kubernetes\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.875716 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.875625    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.875716 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.875659    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ff1be15-a11d-4659-84b9-b473b543db45-multus-daemon-config\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.875716 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.875689    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-etc-kubernetes\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.875985 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.875719    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-systemd-units\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.875985 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.875744    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-modprobe-d\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.875985 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.875774    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f859eb41-2671-4f9a-b7a1-609ea44e19de-cnibin\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.875985 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.875818    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f859eb41-2671-4f9a-b7a1-609ea44e19de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.875985 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.875852    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d952dbb7-29ca-425c-b657-33c475f0834d-iptables-alerter-script\") pod \"iptables-alerter-5pdp5\" (UID: \"d952dbb7-29ca-425c-b657-33c475f0834d\") " pod="openshift-network-operator/iptables-alerter-5pdp5"
May 29 02:27:13.875985 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.875915    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-cni-netd\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.876287 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876001    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f859eb41-2671-4f9a-b7a1-609ea44e19de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.876287 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876042    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-cnibin\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.876287 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876074    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-systemd\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.876287 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876106    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f859eb41-2671-4f9a-b7a1-609ea44e19de-system-cni-dir\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.876287 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876146    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f859eb41-2671-4f9a-b7a1-609ea44e19de-cni-binary-copy\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.876287 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876183    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-multus-cni-dir\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.876287 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876214    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/307a16db-de95-48bc-9404-bdcfff68ccdf-ovnkube-config\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.876287 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876244    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-slash\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.876631 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876297    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-run-openvswitch\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.876631 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876323    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-sysctl-d\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.876631 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876357    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ff1be15-a11d-4659-84b9-b473b543db45-cni-binary-copy\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.876631 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876395    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-multus-socket-dir-parent\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.876631 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876425    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j6s5z\" (UniqueName: \"kubernetes.io/projected/d952dbb7-29ca-425c-b657-33c475f0834d-kube-api-access-j6s5z\") pod \"iptables-alerter-5pdp5\" (UID: \"d952dbb7-29ca-425c-b657-33c475f0834d\") " pod="openshift-network-operator/iptables-alerter-5pdp5"
May 29 02:27:13.876631 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876454    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-kubelet\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.876631 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876476    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-cni-bin\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.876631 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876505    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-run\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.876631 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876537    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmdtm\" (UniqueName: \"kubernetes.io/projected/f859eb41-2671-4f9a-b7a1-609ea44e19de-kube-api-access-xmdtm\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.876631 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876566    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-system-cni-dir\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.876631 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876596    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-log-socket\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.876631 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876625    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-etc-openvswitch\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.877120 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876649    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/307a16db-de95-48bc-9404-bdcfff68ccdf-ovn-node-metrics-cert\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.877120 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876681    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-var-lib-kubelet\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.877120 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876729    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-host-var-lib-cni-bin\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.877120 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876758    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-run-ovn-kubernetes\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.877120 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876786    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-tuned\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.877120 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876816    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-sys\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.877120 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876839    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f859eb41-2671-4f9a-b7a1-609ea44e19de-os-release\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.877120 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876870    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-run-systemd\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.877120 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876901    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-var-lib-openvswitch\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.877120 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876931    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-run-ovn\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.877120 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.876963    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-sysctl-conf\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.877120 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.877026    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-lib-modules\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.877120 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.877053    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f980d368-27ce-4168-b05f-fa272e8c8e97-tmp\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.877120 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.877113    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f859eb41-2671-4f9a-b7a1-609ea44e19de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.877803 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.877174    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-host-run-k8s-cni-cncf-io\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.877803 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.877210    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-hostroot\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.877803 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.877289    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-host-run-multus-certs\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.892772 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.892752    2573 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
May 29 02:27:13.904045 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.904013    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 02:22:12 +0000 UTC" deadline="2027-11-30 03:33:47.411902308 +0000 UTC"
May 29 02:27:13.904045 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.904043    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13201h6m33.507861567s"
May 29 02:27:13.963804 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.963775    2573 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
May 29 02:27:13.977648 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977618    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-modprobe-d\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.977815 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977657    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f859eb41-2671-4f9a-b7a1-609ea44e19de-cnibin\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.977815 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977684    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f859eb41-2671-4f9a-b7a1-609ea44e19de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.977815 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977709    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d952dbb7-29ca-425c-b657-33c475f0834d-iptables-alerter-script\") pod \"iptables-alerter-5pdp5\" (UID: \"d952dbb7-29ca-425c-b657-33c475f0834d\") " pod="openshift-network-operator/iptables-alerter-5pdp5"
May 29 02:27:13.977815 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977730    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-cni-netd\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.977815 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977749    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/f859eb41-2671-4f9a-b7a1-609ea44e19de-cnibin\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.977815 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977753    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f859eb41-2671-4f9a-b7a1-609ea44e19de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.977815 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977815    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-cnibin\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.978150 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977841    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-systemd\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.978150 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977867    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f859eb41-2671-4f9a-b7a1-609ea44e19de-system-cni-dir\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.978150 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977870    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-cni-netd\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.978150 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977884    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-cnibin\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.978150 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977892    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f859eb41-2671-4f9a-b7a1-609ea44e19de-cni-binary-copy\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.978150 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977841    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-modprobe-d\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.978150 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977909    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/f859eb41-2671-4f9a-b7a1-609ea44e19de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.978150 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977930    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-multus-cni-dir\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.978150 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977942    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-systemd\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.978150 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977952    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/f859eb41-2671-4f9a-b7a1-609ea44e19de-system-cni-dir\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.978150 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977965    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcqj4\" (UniqueName: \"kubernetes.io/projected/5fe35eb0-68ad-495c-b79a-a899da141e77-kube-api-access-jcqj4\") pod \"node-ca-jtmf8\" (UID: \"5fe35eb0-68ad-495c-b79a-a899da141e77\") " pod="openshift-image-registry/node-ca-jtmf8"
May 29 02:27:13.978150 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977993    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-multus-cni-dir\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.978150 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.977994    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/307a16db-de95-48bc-9404-bdcfff68ccdf-ovnkube-config\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.978150 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978031    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-slash\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.978150 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978065    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-run-openvswitch\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.978150 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978107    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-run-openvswitch\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.978150 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978137    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-sysctl-d\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.978950 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978138    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-slash\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.978950 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978175    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ff1be15-a11d-4659-84b9-b473b543db45-cni-binary-copy\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.978950 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978276    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/f859eb41-2671-4f9a-b7a1-609ea44e19de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.978950 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978291    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-sysctl-d\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.978950 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978325    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-multus-socket-dir-parent\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.978950 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978351    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j6s5z\" (UniqueName: \"kubernetes.io/projected/d952dbb7-29ca-425c-b657-33c475f0834d-kube-api-access-j6s5z\") pod \"iptables-alerter-5pdp5\" (UID: \"d952dbb7-29ca-425c-b657-33c475f0834d\") " pod="openshift-network-operator/iptables-alerter-5pdp5"
May 29 02:27:13.978950 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978379    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs\") pod \"network-metrics-daemon-bbj9n\" (UID: \"f1c2fcb1-f203-4571-8cbe-eb01a190d63b\") " pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:13.978950 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978395    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/d952dbb7-29ca-425c-b657-33c475f0834d-iptables-alerter-script\") pod \"iptables-alerter-5pdp5\" (UID: \"d952dbb7-29ca-425c-b657-33c475f0834d\") " pod="openshift-network-operator/iptables-alerter-5pdp5"
May 29 02:27:13.978950 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978406    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-kubelet\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.978950 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978425    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/f859eb41-2671-4f9a-b7a1-609ea44e19de-cni-binary-copy\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.978950 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978432    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-cni-bin\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.978950 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978443    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-multus-socket-dir-parent\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.978950 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978458    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-run\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.978950 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978460    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-kubelet\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.978950 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978478    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-cni-bin\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.978950 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978525    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xmdtm\" (UniqueName: \"kubernetes.io/projected/f859eb41-2671-4f9a-b7a1-609ea44e19de-kube-api-access-xmdtm\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.978950 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978553    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-system-cni-dir\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.979637 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978574    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d169bc1e-8a33-4408-9a72-28a209292f46-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:13.979637 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978591    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-log-socket\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.979637 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978602    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/307a16db-de95-48bc-9404-bdcfff68ccdf-ovnkube-config\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.979637 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978619    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-etc-openvswitch\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.979637 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978644    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-system-cni-dir\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.979637 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978655    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/307a16db-de95-48bc-9404-bdcfff68ccdf-ovn-node-metrics-cert\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.979637 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978653    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-etc-openvswitch\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.979637 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978687    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-log-socket\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.979637 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978698    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-var-lib-kubelet\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.979637 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978711    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3ff1be15-a11d-4659-84b9-b473b543db45-cni-binary-copy\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.979637 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978784    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-run\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.979637 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.978991    2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
May 29 02:27:13.979637 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979228    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-host-var-lib-cni-bin\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.979637 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979248    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-var-lib-kubelet\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.979637 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979356    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fe35eb0-68ad-495c-b79a-a899da141e77-host\") pod \"node-ca-jtmf8\" (UID: \"5fe35eb0-68ad-495c-b79a-a899da141e77\") " pod="openshift-image-registry/node-ca-jtmf8"
May 29 02:27:13.979637 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979373    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-host-var-lib-cni-bin\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.979637 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979412    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d169bc1e-8a33-4408-9a72-28a209292f46-registration-dir\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:13.979637 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979444    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-run-ovn-kubernetes\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.980462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979461    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-tuned\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.980462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979486    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d169bc1e-8a33-4408-9a72-28a209292f46-socket-dir\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:13.980462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979508    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-sys\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.980462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979557    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-sys\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.980462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979602    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-run-ovn-kubernetes\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.980462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979625    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f859eb41-2671-4f9a-b7a1-609ea44e19de-os-release\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.980462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979645    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-run-systemd\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.980462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979661    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-var-lib-openvswitch\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.980462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979677    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-run-ovn\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.980462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979695    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-sysctl-conf\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.980462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979709    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-lib-modules\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.980462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979723    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f980d368-27ce-4168-b05f-fa272e8c8e97-tmp\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.980462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979745    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f859eb41-2671-4f9a-b7a1-609ea44e19de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.980462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979767    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-host-run-k8s-cni-cncf-io\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.980462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979785    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-hostroot\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.980462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979801    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-run-ovn\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.980462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979851    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-run-systemd\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.981209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979889    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-var-lib-openvswitch\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.981209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979808    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-host-run-multus-certs\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.981209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979925    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-lib-modules\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.981209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979929    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h22rk\" (UniqueName: \"kubernetes.io/projected/3ff1be15-a11d-4659-84b9-b473b543db45-kube-api-access-h22rk\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.981209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979954    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcqqc\" (UniqueName: \"kubernetes.io/projected/d169bc1e-8a33-4408-9a72-28a209292f46-kube-api-access-gcqqc\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:13.981209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979986    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/f859eb41-2671-4f9a-b7a1-609ea44e19de-os-release\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.981209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980021    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-host-run-multus-certs\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.981209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980072    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-hostroot\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.981209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.979986    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s48s7\" (UniqueName: \"kubernetes.io/projected/307a16db-de95-48bc-9404-bdcfff68ccdf-kube-api-access-s48s7\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.981209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980187    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-sysctl-conf\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.981209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980186    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ec0a2cd5-5976-491c-b882-63e04f42a821-agent-certs\") pod \"konnectivity-agent-xjw8k\" (UID: \"ec0a2cd5-5976-491c-b882-63e04f42a821\") " pod="kube-system/konnectivity-agent-xjw8k"
May 29 02:27:13.981209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980235    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-host\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.981209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980282    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xnr5\" (UniqueName: \"kubernetes.io/projected/f980d368-27ce-4168-b05f-fa272e8c8e97-kube-api-access-6xnr5\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.981209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980290    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-host-run-k8s-cni-cncf-io\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.981209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980307    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-host-var-lib-cni-multus\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.981209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980344    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-host\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.981209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980335    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d169bc1e-8a33-4408-9a72-28a209292f46-device-dir\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:13.981960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980395    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-run-netns\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.981960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980440    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-multus-conf-dir\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.981960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980465    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d952dbb7-29ca-425c-b657-33c475f0834d-host-slash\") pod \"iptables-alerter-5pdp5\" (UID: \"d952dbb7-29ca-425c-b657-33c475f0834d\") " pod="openshift-network-operator/iptables-alerter-5pdp5"
May 29 02:27:13.981960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980489    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5fe35eb0-68ad-495c-b79a-a899da141e77-serviceca\") pod \"node-ca-jtmf8\" (UID: \"5fe35eb0-68ad-495c-b79a-a899da141e77\") " pod="openshift-image-registry/node-ca-jtmf8"
May 29 02:27:13.981960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980514    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-sysconfig\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.981960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980538    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-host-run-netns\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.981960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980563    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-host-var-lib-kubelet\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.981960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980605    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d169bc1e-8a33-4408-9a72-28a209292f46-etc-selinux\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:13.981960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980641    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d169bc1e-8a33-4408-9a72-28a209292f46-sys-fs\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:13.981960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980668    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cj9w\" (UniqueName: \"kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w\") pod \"network-check-target-6bs6h\" (UID: \"2f9d23cf-9350-4bd4-88f9-161206125b5e\") " pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:13.981960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980682    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/f859eb41-2671-4f9a-b7a1-609ea44e19de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:13.981960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980696    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-node-log\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.981960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980739    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/307a16db-de95-48bc-9404-bdcfff68ccdf-env-overrides\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.981960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980748    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-host-var-lib-cni-multus\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.981960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980766    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/307a16db-de95-48bc-9404-bdcfff68ccdf-ovnkube-script-lib\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.981960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980793    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ec0a2cd5-5976-491c-b882-63e04f42a821-konnectivity-ca\") pod \"konnectivity-agent-xjw8k\" (UID: \"ec0a2cd5-5976-491c-b882-63e04f42a821\") " pod="kube-system/konnectivity-agent-xjw8k"
May 29 02:27:13.981960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980807    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/d952dbb7-29ca-425c-b657-33c475f0834d-host-slash\") pod \"iptables-alerter-5pdp5\" (UID: \"d952dbb7-29ca-425c-b657-33c475f0834d\") " pod="openshift-network-operator/iptables-alerter-5pdp5"
May 29 02:27:13.982704 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980821    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sbmj\" (UniqueName: \"kubernetes.io/projected/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-kube-api-access-6sbmj\") pod \"network-metrics-daemon-bbj9n\" (UID: \"f1c2fcb1-f203-4571-8cbe-eb01a190d63b\") " pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:13.982704 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980843    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-run-netns\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.982704 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980853    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-os-release\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.982704 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980879    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-multus-conf-dir\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.982704 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980895    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-kubernetes\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.982704 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980926    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-sysconfig\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.982704 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980926    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.982704 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980962    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ff1be15-a11d-4659-84b9-b473b543db45-multus-daemon-config\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.982704 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980965    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.982704 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.980987    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-etc-kubernetes\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.982704 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.981008    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-node-log\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.982704 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.981014    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-systemd-units\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.982704 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.981077    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/307a16db-de95-48bc-9404-bdcfff68ccdf-systemd-units\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.982704 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.981386    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/307a16db-de95-48bc-9404-bdcfff68ccdf-env-overrides\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.982704 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.981485    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3ff1be15-a11d-4659-84b9-b473b543db45-multus-daemon-config\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.982704 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.981531    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-etc-kubernetes\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.982704 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.981570    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-host-run-netns\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.982704 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.981606    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-host-var-lib-kubelet\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.983502 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.981903    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/307a16db-de95-48bc-9404-bdcfff68ccdf-ovnkube-script-lib\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.983502 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.981983    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3ff1be15-a11d-4659-84b9-b473b543db45-os-release\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.983502 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.982042    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-kubernetes\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.983502 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.982062    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ec0a2cd5-5976-491c-b882-63e04f42a821-konnectivity-ca\") pod \"konnectivity-agent-xjw8k\" (UID: \"ec0a2cd5-5976-491c-b882-63e04f42a821\") " pod="kube-system/konnectivity-agent-xjw8k"
May 29 02:27:13.983502 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.982624    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f980d368-27ce-4168-b05f-fa272e8c8e97-etc-tuned\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.983502 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.982782    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/307a16db-de95-48bc-9404-bdcfff68ccdf-ovn-node-metrics-cert\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.983502 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.982973    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f980d368-27ce-4168-b05f-fa272e8c8e97-tmp\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.983502 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.983202    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ec0a2cd5-5976-491c-b882-63e04f42a821-agent-certs\") pod \"konnectivity-agent-xjw8k\" (UID: \"ec0a2cd5-5976-491c-b882-63e04f42a821\") " pod="kube-system/konnectivity-agent-xjw8k"
May 29 02:27:13.995022 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.994985    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s48s7\" (UniqueName: \"kubernetes.io/projected/307a16db-de95-48bc-9404-bdcfff68ccdf-kube-api-access-s48s7\") pod \"ovnkube-node-6wldp\" (UID: \"307a16db-de95-48bc-9404-bdcfff68ccdf\") " pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:13.995146 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.995079    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h22rk\" (UniqueName: \"kubernetes.io/projected/3ff1be15-a11d-4659-84b9-b473b543db45-kube-api-access-h22rk\") pod \"multus-rrpxl\" (UID: \"3ff1be15-a11d-4659-84b9-b473b543db45\") " pod="openshift-multus/multus-rrpxl"
May 29 02:27:13.995499 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.995459    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j6s5z\" (UniqueName: \"kubernetes.io/projected/d952dbb7-29ca-425c-b657-33c475f0834d-kube-api-access-j6s5z\") pod \"iptables-alerter-5pdp5\" (UID: \"d952dbb7-29ca-425c-b657-33c475f0834d\") " pod="openshift-network-operator/iptables-alerter-5pdp5"
May 29 02:27:13.996217 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.996193    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xnr5\" (UniqueName: \"kubernetes.io/projected/f980d368-27ce-4168-b05f-fa272e8c8e97-kube-api-access-6xnr5\") pod \"tuned-gbfkn\" (UID: \"f980d368-27ce-4168-b05f-fa272e8c8e97\") " pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:13.996625 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:13.996602    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmdtm\" (UniqueName: \"kubernetes.io/projected/f859eb41-2671-4f9a-b7a1-609ea44e19de-kube-api-access-xmdtm\") pod \"multus-additional-cni-plugins-v8vwt\" (UID: \"f859eb41-2671-4f9a-b7a1-609ea44e19de\") " pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:14.082073 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082045    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6sbmj\" (UniqueName: \"kubernetes.io/projected/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-kube-api-access-6sbmj\") pod \"network-metrics-daemon-bbj9n\" (UID: \"f1c2fcb1-f203-4571-8cbe-eb01a190d63b\") " pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:14.082215 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082087    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jcqj4\" (UniqueName: \"kubernetes.io/projected/5fe35eb0-68ad-495c-b79a-a899da141e77-kube-api-access-jcqj4\") pod \"node-ca-jtmf8\" (UID: \"5fe35eb0-68ad-495c-b79a-a899da141e77\") " pod="openshift-image-registry/node-ca-jtmf8"
May 29 02:27:14.082215 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082119    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs\") pod \"network-metrics-daemon-bbj9n\" (UID: \"f1c2fcb1-f203-4571-8cbe-eb01a190d63b\") " pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:14.082215 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082147    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d169bc1e-8a33-4408-9a72-28a209292f46-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:14.082215 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082178    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fe35eb0-68ad-495c-b79a-a899da141e77-host\") pod \"node-ca-jtmf8\" (UID: \"5fe35eb0-68ad-495c-b79a-a899da141e77\") " pod="openshift-image-registry/node-ca-jtmf8"
May 29 02:27:14.082215 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082202    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d169bc1e-8a33-4408-9a72-28a209292f46-registration-dir\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:14.082465 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082228    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d169bc1e-8a33-4408-9a72-28a209292f46-socket-dir\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:14.082465 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082289    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d169bc1e-8a33-4408-9a72-28a209292f46-kubelet-dir\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:14.082465 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082313    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gcqqc\" (UniqueName: \"kubernetes.io/projected/d169bc1e-8a33-4408-9a72-28a209292f46-kube-api-access-gcqqc\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:14.082465 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:14.082296    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:14.082465 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082333    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5fe35eb0-68ad-495c-b79a-a899da141e77-host\") pod \"node-ca-jtmf8\" (UID: \"5fe35eb0-68ad-495c-b79a-a899da141e77\") " pod="openshift-image-registry/node-ca-jtmf8"
May 29 02:27:14.082465 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082346    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d169bc1e-8a33-4408-9a72-28a209292f46-device-dir\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:14.082465 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082347    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d169bc1e-8a33-4408-9a72-28a209292f46-registration-dir\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:14.082465 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082372    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5fe35eb0-68ad-495c-b79a-a899da141e77-serviceca\") pod \"node-ca-jtmf8\" (UID: \"5fe35eb0-68ad-495c-b79a-a899da141e77\") " pod="openshift-image-registry/node-ca-jtmf8"
May 29 02:27:14.082465 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:14.082409    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs podName:f1c2fcb1-f203-4571-8cbe-eb01a190d63b nodeName:}" failed. No retries permitted until 2026-05-29 02:27:14.582375219 +0000 UTC m=+3.237382847 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs") pod "network-metrics-daemon-bbj9n" (UID: "f1c2fcb1-f203-4571-8cbe-eb01a190d63b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:14.082465 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082447    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d169bc1e-8a33-4408-9a72-28a209292f46-etc-selinux\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:14.082465 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082457    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d169bc1e-8a33-4408-9a72-28a209292f46-socket-dir\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:14.082465 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082472    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d169bc1e-8a33-4408-9a72-28a209292f46-sys-fs\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:14.082919 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082494    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d169bc1e-8a33-4408-9a72-28a209292f46-device-dir\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:14.082919 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082499    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cj9w\" (UniqueName: \"kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w\") pod \"network-check-target-6bs6h\" (UID: \"2f9d23cf-9350-4bd4-88f9-161206125b5e\") " pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:14.082919 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082592    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d169bc1e-8a33-4408-9a72-28a209292f46-sys-fs\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:14.082919 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082644    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d169bc1e-8a33-4408-9a72-28a209292f46-etc-selinux\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:14.082919 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.082735    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5fe35eb0-68ad-495c-b79a-a899da141e77-serviceca\") pod \"node-ca-jtmf8\" (UID: \"5fe35eb0-68ad-495c-b79a-a899da141e77\") " pod="openshift-image-registry/node-ca-jtmf8"
May 29 02:27:14.091606 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:14.091541    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 02:27:14.091606 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:14.091563    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 02:27:14.091606 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:14.091575    2573 projected.go:194] Error preparing data for projected volume kube-api-access-2cj9w for pod openshift-network-diagnostics/network-check-target-6bs6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:14.091823 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:14.091634    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w podName:2f9d23cf-9350-4bd4-88f9-161206125b5e nodeName:}" failed. No retries permitted until 2026-05-29 02:27:14.591617002 +0000 UTC m=+3.246624621 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-2cj9w" (UniqueName: "kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w") pod "network-check-target-6bs6h" (UID: "2f9d23cf-9350-4bd4-88f9-161206125b5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:14.093647 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.093623    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcqj4\" (UniqueName: \"kubernetes.io/projected/5fe35eb0-68ad-495c-b79a-a899da141e77-kube-api-access-jcqj4\") pod \"node-ca-jtmf8\" (UID: \"5fe35eb0-68ad-495c-b79a-a899da141e77\") " pod="openshift-image-registry/node-ca-jtmf8"
May 29 02:27:14.094020 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.094004    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sbmj\" (UniqueName: \"kubernetes.io/projected/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-kube-api-access-6sbmj\") pod \"network-metrics-daemon-bbj9n\" (UID: \"f1c2fcb1-f203-4571-8cbe-eb01a190d63b\") " pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:14.094420 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.094400    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcqqc\" (UniqueName: \"kubernetes.io/projected/d169bc1e-8a33-4408-9a72-28a209292f46-kube-api-access-gcqqc\") pod \"aws-ebs-csi-driver-node-mngb6\" (UID: \"d169bc1e-8a33-4408-9a72-28a209292f46\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:14.164261 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.164224    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-gbfkn"
May 29 02:27:14.171996 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.171977    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-v8vwt"
May 29 02:27:14.182588 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.182565    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rrpxl"
May 29 02:27:14.188168 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.188149    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-5pdp5"
May 29 02:27:14.194808 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.194790    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:14.201353 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.201333    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-xjw8k"
May 29 02:27:14.207942 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.207922    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6"
May 29 02:27:14.213506 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.213488    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jtmf8"
May 29 02:27:14.528662 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:14.528629    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ff1be15_a11d_4659_84b9_b473b543db45.slice/crio-76a596730d42c7cf0e9c475c0f098299011354e6d4c3cebdde760f31e7dbbcbc WatchSource:0}: Error finding container 76a596730d42c7cf0e9c475c0f098299011354e6d4c3cebdde760f31e7dbbcbc: Status 404 returned error can't find the container with id 76a596730d42c7cf0e9c475c0f098299011354e6d4c3cebdde760f31e7dbbcbc
May 29 02:27:14.529628 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:14.529606    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd169bc1e_8a33_4408_9a72_28a209292f46.slice/crio-4561e8c549f1ea18ec01bcf2ac8c4b1f6461502b412fd9827bf2f15379f47d89 WatchSource:0}: Error finding container 4561e8c549f1ea18ec01bcf2ac8c4b1f6461502b412fd9827bf2f15379f47d89: Status 404 returned error can't find the container with id 4561e8c549f1ea18ec01bcf2ac8c4b1f6461502b412fd9827bf2f15379f47d89
May 29 02:27:14.532926 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:14.532899    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod307a16db_de95_48bc_9404_bdcfff68ccdf.slice/crio-95f57e10ffc071309655891ae021b13f9d2154f9beb240fb18797a94e9a74cc5 WatchSource:0}: Error finding container 95f57e10ffc071309655891ae021b13f9d2154f9beb240fb18797a94e9a74cc5: Status 404 returned error can't find the container with id 95f57e10ffc071309655891ae021b13f9d2154f9beb240fb18797a94e9a74cc5
May 29 02:27:14.533819 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:14.533797    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf980d368_27ce_4168_b05f_fa272e8c8e97.slice/crio-29468175bb328d02f9fe34be58bddbfdac91a3902c09054c046c32873f0de50b WatchSource:0}: Error finding container 29468175bb328d02f9fe34be58bddbfdac91a3902c09054c046c32873f0de50b: Status 404 returned error can't find the container with id 29468175bb328d02f9fe34be58bddbfdac91a3902c09054c046c32873f0de50b
May 29 02:27:14.554872 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:14.554842    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd952dbb7_29ca_425c_b657_33c475f0834d.slice/crio-20925377b313419141cd3776b0cf4232a4ce4f073a8fc7969aad3769580aad48 WatchSource:0}: Error finding container 20925377b313419141cd3776b0cf4232a4ce4f073a8fc7969aad3769580aad48: Status 404 returned error can't find the container with id 20925377b313419141cd3776b0cf4232a4ce4f073a8fc7969aad3769580aad48
May 29 02:27:14.555802 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:14.555774    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf859eb41_2671_4f9a_b7a1_609ea44e19de.slice/crio-222abde6c8a03815b92f76bf2176878ed6128b47a976f72557660c7e67ca02e1 WatchSource:0}: Error finding container 222abde6c8a03815b92f76bf2176878ed6128b47a976f72557660c7e67ca02e1: Status 404 returned error can't find the container with id 222abde6c8a03815b92f76bf2176878ed6128b47a976f72557660c7e67ca02e1
May 29 02:27:14.557660 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:14.557635    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fe35eb0_68ad_495c_b79a_a899da141e77.slice/crio-ec5d2b076c1de6a02eb73380947b1a4427a3725e4ab9002f1b853169fd6e170c WatchSource:0}: Error finding container ec5d2b076c1de6a02eb73380947b1a4427a3725e4ab9002f1b853169fd6e170c: Status 404 returned error can't find the container with id ec5d2b076c1de6a02eb73380947b1a4427a3725e4ab9002f1b853169fd6e170c
May 29 02:27:14.558126 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:14.558108    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec0a2cd5_5976_491c_b882_63e04f42a821.slice/crio-397d6ce237b7bffa3c24b8d7f18b7235ad2a8a689e445fd3c550f41cf0a24908 WatchSource:0}: Error finding container 397d6ce237b7bffa3c24b8d7f18b7235ad2a8a689e445fd3c550f41cf0a24908: Status 404 returned error can't find the container with id 397d6ce237b7bffa3c24b8d7f18b7235ad2a8a689e445fd3c550f41cf0a24908
May 29 02:27:14.586334 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.586310    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs\") pod \"network-metrics-daemon-bbj9n\" (UID: \"f1c2fcb1-f203-4571-8cbe-eb01a190d63b\") " pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:14.586443 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:14.586431    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:14.586489 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:14.586481    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs podName:f1c2fcb1-f203-4571-8cbe-eb01a190d63b nodeName:}" failed. No retries permitted until 2026-05-29 02:27:15.586468845 +0000 UTC m=+4.241476458 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs") pod "network-metrics-daemon-bbj9n" (UID: "f1c2fcb1-f203-4571-8cbe-eb01a190d63b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:14.687167 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.687138    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cj9w\" (UniqueName: \"kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w\") pod \"network-check-target-6bs6h\" (UID: \"2f9d23cf-9350-4bd4-88f9-161206125b5e\") " pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:14.687352 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:14.687309    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 02:27:14.687352 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:14.687332    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 02:27:14.687352 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:14.687344    2573 projected.go:194] Error preparing data for projected volume kube-api-access-2cj9w for pod openshift-network-diagnostics/network-check-target-6bs6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:14.687462 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:14.687392    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w podName:2f9d23cf-9350-4bd4-88f9-161206125b5e nodeName:}" failed. No retries permitted until 2026-05-29 02:27:15.687378603 +0000 UTC m=+4.342386217 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cj9w" (UniqueName: "kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w") pod "network-check-target-6bs6h" (UID: "2f9d23cf-9350-4bd4-88f9-161206125b5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:14.904349 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.904273    2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-28 02:22:12 +0000 UTC" deadline="2027-11-16 23:01:19.237088086 +0000 UTC"
May 29 02:27:14.904349 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.904347    2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12884h34m4.332745976s"
May 29 02:27:14.982741 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.982699    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-109.ec2.internal" event={"ID":"070b9e105d9b4685ab2c760a71e155cd","Type":"ContainerStarted","Data":"3da416ee0fbb6d04e9ef1449d6743e538a21cb26ec972dd2fd975f1656a743a5"}
May 29 02:27:14.998302 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:14.997975    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xjw8k" event={"ID":"ec0a2cd5-5976-491c-b882-63e04f42a821","Type":"ContainerStarted","Data":"397d6ce237b7bffa3c24b8d7f18b7235ad2a8a689e445fd3c550f41cf0a24908"}
May 29 02:27:15.010168 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:15.010122    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jtmf8" event={"ID":"5fe35eb0-68ad-495c-b79a-a899da141e77","Type":"ContainerStarted","Data":"ec5d2b076c1de6a02eb73380947b1a4427a3725e4ab9002f1b853169fd6e170c"}
May 29 02:27:15.015146 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:15.015115    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v8vwt" event={"ID":"f859eb41-2671-4f9a-b7a1-609ea44e19de","Type":"ContainerStarted","Data":"222abde6c8a03815b92f76bf2176878ed6128b47a976f72557660c7e67ca02e1"}
May 29 02:27:15.029470 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:15.029434    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5pdp5" event={"ID":"d952dbb7-29ca-425c-b657-33c475f0834d","Type":"ContainerStarted","Data":"20925377b313419141cd3776b0cf4232a4ce4f073a8fc7969aad3769580aad48"}
May 29 02:27:15.035537 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:15.035508    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6" event={"ID":"d169bc1e-8a33-4408-9a72-28a209292f46","Type":"ContainerStarted","Data":"4561e8c549f1ea18ec01bcf2ac8c4b1f6461502b412fd9827bf2f15379f47d89"}
May 29 02:27:15.041281 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:15.040817    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rrpxl" event={"ID":"3ff1be15-a11d-4659-84b9-b473b543db45","Type":"ContainerStarted","Data":"76a596730d42c7cf0e9c475c0f098299011354e6d4c3cebdde760f31e7dbbcbc"}
May 29 02:27:15.045155 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:15.045126    2573 generic.go:358] "Generic (PLEG): container finished" podID="f7a531431cf6407f8b2b9581365ac5ff" containerID="0a986b71be0dbf220b134b7ce698e468c6778be4d0fe61ce6b5a3eeb357dcf60" exitCode=0
May 29 02:27:15.045293 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:15.045193    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal" event={"ID":"f7a531431cf6407f8b2b9581365ac5ff","Type":"ContainerDied","Data":"0a986b71be0dbf220b134b7ce698e468c6778be4d0fe61ce6b5a3eeb357dcf60"}
May 29 02:27:15.050772 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:15.050688    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gbfkn" event={"ID":"f980d368-27ce-4168-b05f-fa272e8c8e97","Type":"ContainerStarted","Data":"29468175bb328d02f9fe34be58bddbfdac91a3902c09054c046c32873f0de50b"}
May 29 02:27:15.054379 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:15.054091    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wldp" event={"ID":"307a16db-de95-48bc-9404-bdcfff68ccdf","Type":"ContainerStarted","Data":"95f57e10ffc071309655891ae021b13f9d2154f9beb240fb18797a94e9a74cc5"}
May 29 02:27:15.061292 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:15.061222    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-109.ec2.internal" podStartSLOduration=3.061206966 podStartE2EDuration="3.061206966s" podCreationTimestamp="2026-05-29 02:27:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:27:15.004055547 +0000 UTC m=+3.659063183" watchObservedRunningTime="2026-05-29 02:27:15.061206966 +0000 UTC m=+3.716214594"
May 29 02:27:15.597199 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:15.597158    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs\") pod \"network-metrics-daemon-bbj9n\" (UID: \"f1c2fcb1-f203-4571-8cbe-eb01a190d63b\") " pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:15.597409 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:15.597331    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:15.597409 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:15.597404    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs podName:f1c2fcb1-f203-4571-8cbe-eb01a190d63b nodeName:}" failed. No retries permitted until 2026-05-29 02:27:17.59738538 +0000 UTC m=+6.252392996 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs") pod "network-metrics-daemon-bbj9n" (UID: "f1c2fcb1-f203-4571-8cbe-eb01a190d63b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:15.699797 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:15.699758    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cj9w\" (UniqueName: \"kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w\") pod \"network-check-target-6bs6h\" (UID: \"2f9d23cf-9350-4bd4-88f9-161206125b5e\") " pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:15.699984 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:15.699958    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 02:27:15.700060 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:15.699987    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 02:27:15.700060 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:15.700000    2573 projected.go:194] Error preparing data for projected volume kube-api-access-2cj9w for pod openshift-network-diagnostics/network-check-target-6bs6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:15.700164 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:15.700061    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w podName:2f9d23cf-9350-4bd4-88f9-161206125b5e nodeName:}" failed. No retries permitted until 2026-05-29 02:27:17.700042709 +0000 UTC m=+6.355050337 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cj9w" (UniqueName: "kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w") pod "network-check-target-6bs6h" (UID: "2f9d23cf-9350-4bd4-88f9-161206125b5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:15.969134 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:15.969100    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:15.969608 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:15.969235    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbj9n" podUID="f1c2fcb1-f203-4571-8cbe-eb01a190d63b"
May 29 02:27:15.969673 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:15.969650    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:15.969809 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:15.969735    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bs6h" podUID="2f9d23cf-9350-4bd4-88f9-161206125b5e"
May 29 02:27:16.068493 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:16.068459    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal" event={"ID":"f7a531431cf6407f8b2b9581365ac5ff","Type":"ContainerStarted","Data":"0ec1a8bae06b48c3ad469172b14defb58f8dd1c7e3d2e472fec96ec8aa726da9"}
May 29 02:27:16.534906 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:16.534850    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-109.ec2.internal" podStartSLOduration=4.534828409 podStartE2EDuration="4.534828409s" podCreationTimestamp="2026-05-29 02:27:12 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:27:16.086209684 +0000 UTC m=+4.741217321" watchObservedRunningTime="2026-05-29 02:27:16.534828409 +0000 UTC m=+5.189836045"
May 29 02:27:16.535205 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:16.535185    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-2r9s2"]
May 29 02:27:16.539675 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:16.539651    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2r9s2"
May 29 02:27:16.542747 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:16.542719    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6qt46\""
May 29 02:27:16.542859 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:16.542764    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
May 29 02:27:16.543053 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:16.543037    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
May 29 02:27:16.606722 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:16.606669    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6499ac1-a799-4692-894c-b3f1bf59b369-hosts-file\") pod \"node-resolver-2r9s2\" (UID: \"a6499ac1-a799-4692-894c-b3f1bf59b369\") " pod="openshift-dns/node-resolver-2r9s2"
May 29 02:27:16.606901 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:16.606711    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jntst\" (UniqueName: \"kubernetes.io/projected/a6499ac1-a799-4692-894c-b3f1bf59b369-kube-api-access-jntst\") pod \"node-resolver-2r9s2\" (UID: \"a6499ac1-a799-4692-894c-b3f1bf59b369\") " pod="openshift-dns/node-resolver-2r9s2"
May 29 02:27:16.606901 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:16.606817    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6499ac1-a799-4692-894c-b3f1bf59b369-tmp-dir\") pod \"node-resolver-2r9s2\" (UID: \"a6499ac1-a799-4692-894c-b3f1bf59b369\") " pod="openshift-dns/node-resolver-2r9s2"
May 29 02:27:16.708300 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:16.707498    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6499ac1-a799-4692-894c-b3f1bf59b369-hosts-file\") pod \"node-resolver-2r9s2\" (UID: \"a6499ac1-a799-4692-894c-b3f1bf59b369\") " pod="openshift-dns/node-resolver-2r9s2"
May 29 02:27:16.708300 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:16.707537    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jntst\" (UniqueName: \"kubernetes.io/projected/a6499ac1-a799-4692-894c-b3f1bf59b369-kube-api-access-jntst\") pod \"node-resolver-2r9s2\" (UID: \"a6499ac1-a799-4692-894c-b3f1bf59b369\") " pod="openshift-dns/node-resolver-2r9s2"
May 29 02:27:16.708300 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:16.707589    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6499ac1-a799-4692-894c-b3f1bf59b369-tmp-dir\") pod \"node-resolver-2r9s2\" (UID: \"a6499ac1-a799-4692-894c-b3f1bf59b369\") " pod="openshift-dns/node-resolver-2r9s2"
May 29 02:27:16.708300 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:16.707937    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a6499ac1-a799-4692-894c-b3f1bf59b369-tmp-dir\") pod \"node-resolver-2r9s2\" (UID: \"a6499ac1-a799-4692-894c-b3f1bf59b369\") " pod="openshift-dns/node-resolver-2r9s2"
May 29 02:27:16.708300 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:16.708012    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a6499ac1-a799-4692-894c-b3f1bf59b369-hosts-file\") pod \"node-resolver-2r9s2\" (UID: \"a6499ac1-a799-4692-894c-b3f1bf59b369\") " pod="openshift-dns/node-resolver-2r9s2"
May 29 02:27:16.726139 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:16.726104    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jntst\" (UniqueName: \"kubernetes.io/projected/a6499ac1-a799-4692-894c-b3f1bf59b369-kube-api-access-jntst\") pod \"node-resolver-2r9s2\" (UID: \"a6499ac1-a799-4692-894c-b3f1bf59b369\") " pod="openshift-dns/node-resolver-2r9s2"
May 29 02:27:16.854095 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:16.854012    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-2r9s2"
May 29 02:27:17.617121 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:17.616914    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs\") pod \"network-metrics-daemon-bbj9n\" (UID: \"f1c2fcb1-f203-4571-8cbe-eb01a190d63b\") " pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:17.617121 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:17.617074    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:17.617576 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:17.617141    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs podName:f1c2fcb1-f203-4571-8cbe-eb01a190d63b nodeName:}" failed. No retries permitted until 2026-05-29 02:27:21.617122404 +0000 UTC m=+10.272130020 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs") pod "network-metrics-daemon-bbj9n" (UID: "f1c2fcb1-f203-4571-8cbe-eb01a190d63b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:17.718322 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:17.718283    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cj9w\" (UniqueName: \"kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w\") pod \"network-check-target-6bs6h\" (UID: \"2f9d23cf-9350-4bd4-88f9-161206125b5e\") " pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:17.718513 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:17.718496    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 02:27:17.718560 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:17.718524    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 02:27:17.718560 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:17.718537    2573 projected.go:194] Error preparing data for projected volume kube-api-access-2cj9w for pod openshift-network-diagnostics/network-check-target-6bs6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:17.718641 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:17.718600    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w podName:2f9d23cf-9350-4bd4-88f9-161206125b5e nodeName:}" failed. No retries permitted until 2026-05-29 02:27:21.718581469 +0000 UTC m=+10.373589087 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cj9w" (UniqueName: "kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w") pod "network-check-target-6bs6h" (UID: "2f9d23cf-9350-4bd4-88f9-161206125b5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:17.968612 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:17.968554    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:17.968612 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:17.968593    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:17.968865 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:17.968708    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbj9n" podUID="f1c2fcb1-f203-4571-8cbe-eb01a190d63b"
May 29 02:27:17.968865 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:17.968834    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bs6h" podUID="2f9d23cf-9350-4bd4-88f9-161206125b5e"
May 29 02:27:19.967134 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:19.966987    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:19.967134 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:19.966987    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:19.967134 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:19.967134    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbj9n" podUID="f1c2fcb1-f203-4571-8cbe-eb01a190d63b"
May 29 02:27:19.967708 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:19.967169    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bs6h" podUID="2f9d23cf-9350-4bd4-88f9-161206125b5e"
May 29 02:27:21.651158 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:21.651125    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs\") pod \"network-metrics-daemon-bbj9n\" (UID: \"f1c2fcb1-f203-4571-8cbe-eb01a190d63b\") " pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:21.651528 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:21.651281    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:21.651528 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:21.651350    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs podName:f1c2fcb1-f203-4571-8cbe-eb01a190d63b nodeName:}" failed. No retries permitted until 2026-05-29 02:27:29.651329612 +0000 UTC m=+18.306337228 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs") pod "network-metrics-daemon-bbj9n" (UID: "f1c2fcb1-f203-4571-8cbe-eb01a190d63b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:21.752219 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:21.752186    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cj9w\" (UniqueName: \"kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w\") pod \"network-check-target-6bs6h\" (UID: \"2f9d23cf-9350-4bd4-88f9-161206125b5e\") " pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:21.752437 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:21.752410    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 02:27:21.752502 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:21.752445    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 02:27:21.752502 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:21.752460    2573 projected.go:194] Error preparing data for projected volume kube-api-access-2cj9w for pod openshift-network-diagnostics/network-check-target-6bs6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:21.752607 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:21.752525    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w podName:2f9d23cf-9350-4bd4-88f9-161206125b5e nodeName:}" failed. No retries permitted until 2026-05-29 02:27:29.752507173 +0000 UTC m=+18.407514789 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cj9w" (UniqueName: "kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w") pod "network-check-target-6bs6h" (UID: "2f9d23cf-9350-4bd4-88f9-161206125b5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:21.967911 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:21.967876    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:21.968080 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:21.968024    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbj9n" podUID="f1c2fcb1-f203-4571-8cbe-eb01a190d63b"
May 29 02:27:21.968471 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:21.968443    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:21.968589 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:21.968555    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bs6h" podUID="2f9d23cf-9350-4bd4-88f9-161206125b5e"
May 29 02:27:23.967090 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:23.967049    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:23.967479 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:23.967103    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:23.967479 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:23.967190    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbj9n" podUID="f1c2fcb1-f203-4571-8cbe-eb01a190d63b"
May 29 02:27:23.967479 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:23.967327    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bs6h" podUID="2f9d23cf-9350-4bd4-88f9-161206125b5e"
May 29 02:27:25.966944 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:25.966808    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:25.966944 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:25.966856    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:25.967474 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:25.966956    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbj9n" podUID="f1c2fcb1-f203-4571-8cbe-eb01a190d63b"
May 29 02:27:25.967474 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:25.967110    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bs6h" podUID="2f9d23cf-9350-4bd4-88f9-161206125b5e"
May 29 02:27:27.966621 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:27.966580    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:27.967720 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:27.966630    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:27.967720 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:27.966712    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbj9n" podUID="f1c2fcb1-f203-4571-8cbe-eb01a190d63b"
May 29 02:27:27.967720 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:27.966836    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bs6h" podUID="2f9d23cf-9350-4bd4-88f9-161206125b5e"
May 29 02:27:29.707376 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:29.707334    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs\") pod \"network-metrics-daemon-bbj9n\" (UID: \"f1c2fcb1-f203-4571-8cbe-eb01a190d63b\") " pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:29.707791 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:29.707482    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:29.707791 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:29.707548    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs podName:f1c2fcb1-f203-4571-8cbe-eb01a190d63b nodeName:}" failed. No retries permitted until 2026-05-29 02:27:45.70753207 +0000 UTC m=+34.362539699 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs") pod "network-metrics-daemon-bbj9n" (UID: "f1c2fcb1-f203-4571-8cbe-eb01a190d63b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:29.808819 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:29.808774    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cj9w\" (UniqueName: \"kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w\") pod \"network-check-target-6bs6h\" (UID: \"2f9d23cf-9350-4bd4-88f9-161206125b5e\") " pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:29.809017 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:29.808973    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 02:27:29.809017 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:29.808999    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 02:27:29.809017 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:29.809011    2573 projected.go:194] Error preparing data for projected volume kube-api-access-2cj9w for pod openshift-network-diagnostics/network-check-target-6bs6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:29.809164 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:29.809080    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w podName:2f9d23cf-9350-4bd4-88f9-161206125b5e nodeName:}" failed. No retries permitted until 2026-05-29 02:27:45.80906101 +0000 UTC m=+34.464068638 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cj9w" (UniqueName: "kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w") pod "network-check-target-6bs6h" (UID: "2f9d23cf-9350-4bd4-88f9-161206125b5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:29.967214 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:29.967128    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:29.967214 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:29.967165    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:29.967423 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:29.967324    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbj9n" podUID="f1c2fcb1-f203-4571-8cbe-eb01a190d63b"
May 29 02:27:29.967423 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:29.967393    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bs6h" podUID="2f9d23cf-9350-4bd4-88f9-161206125b5e"
May 29 02:27:31.967307 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:31.967273    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:31.967826 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:31.967355    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbj9n" podUID="f1c2fcb1-f203-4571-8cbe-eb01a190d63b"
May 29 02:27:31.967826 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:31.967413    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:31.967826 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:31.967490    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bs6h" podUID="2f9d23cf-9350-4bd4-88f9-161206125b5e"
May 29 02:27:32.377005 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:32.376975    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6499ac1_a799_4692_894c_b3f1bf59b369.slice/crio-86056c5ec7f9131bc94f84ad168c2858ffa65fb1c751d9cc68ed4fc61b57e22a WatchSource:0}: Error finding container 86056c5ec7f9131bc94f84ad168c2858ffa65fb1c751d9cc68ed4fc61b57e22a: Status 404 returned error can't find the container with id 86056c5ec7f9131bc94f84ad168c2858ffa65fb1c751d9cc68ed4fc61b57e22a
May 29 02:27:33.095978 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.095757    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-xjw8k" event={"ID":"ec0a2cd5-5976-491c-b882-63e04f42a821","Type":"ContainerStarted","Data":"2764f5eafd6864abbb9c1e28d10be05f996a9f3381ef1fc8a8732df8012aea99"}
May 29 02:27:33.096916 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.096895    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jtmf8" event={"ID":"5fe35eb0-68ad-495c-b79a-a899da141e77","Type":"ContainerStarted","Data":"29c0183ba5023375f8b71936fa1c8ca085e82e16d945deb51077e774c4f12b4f"}
May 29 02:27:33.098041 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.098020    2573 generic.go:358] "Generic (PLEG): container finished" podID="f859eb41-2671-4f9a-b7a1-609ea44e19de" containerID="697c9b1711d0263e683f2ee44e7192a1eef37ebb34319055a2878bc1cdb90869" exitCode=0
May 29 02:27:33.098119 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.098090    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v8vwt" event={"ID":"f859eb41-2671-4f9a-b7a1-609ea44e19de","Type":"ContainerDied","Data":"697c9b1711d0263e683f2ee44e7192a1eef37ebb34319055a2878bc1cdb90869"}
May 29 02:27:33.099445 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.099420    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6" event={"ID":"d169bc1e-8a33-4408-9a72-28a209292f46","Type":"ContainerStarted","Data":"be657e3cd8683dff14b39d15d3c08a0547a1fe794a3b66906f245e9ed44675a0"}
May 29 02:27:33.100766 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.100740    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rrpxl" event={"ID":"3ff1be15-a11d-4659-84b9-b473b543db45","Type":"ContainerStarted","Data":"3a092fb9540189cb798cf3bda5d6d0857b710068b97a8300c0bec94ad37851d3"}
May 29 02:27:33.101912 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.101894    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-gbfkn" event={"ID":"f980d368-27ce-4168-b05f-fa272e8c8e97","Type":"ContainerStarted","Data":"a79de192453764a9f6548b0fedfd4e7cf8e0240ff968971c23646cefa681f52d"}
May 29 02:27:33.104566 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.104544    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wldp" event={"ID":"307a16db-de95-48bc-9404-bdcfff68ccdf","Type":"ContainerStarted","Data":"9af841fdc510e685b88fd77ac733a7516ff280280a6f563eb8e24f8ed5336379"}
May 29 02:27:33.104633 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.104571    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wldp" event={"ID":"307a16db-de95-48bc-9404-bdcfff68ccdf","Type":"ContainerStarted","Data":"b20d07dc4f2e4ee515b76212af7a0e7a577add1dae87ad7f6038ac52a0ad8b3e"}
May 29 02:27:33.104633 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.104580    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wldp" event={"ID":"307a16db-de95-48bc-9404-bdcfff68ccdf","Type":"ContainerStarted","Data":"ef690dd5c2f076c5a3be51ba0747d635c9d1a793878ce836adf01c7231725e56"}
May 29 02:27:33.104633 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.104589    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wldp" event={"ID":"307a16db-de95-48bc-9404-bdcfff68ccdf","Type":"ContainerStarted","Data":"3aedf27395505156463891ce4efb4331ac744dbddc382bf0a1eb8abbd88d87aa"}
May 29 02:27:33.104633 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.104597    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wldp" event={"ID":"307a16db-de95-48bc-9404-bdcfff68ccdf","Type":"ContainerStarted","Data":"9f9b269e863efb81e66b192767a8442ef6675f15b156f239abbaab2bfa117fda"}
May 29 02:27:33.104633 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.104605    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wldp" event={"ID":"307a16db-de95-48bc-9404-bdcfff68ccdf","Type":"ContainerStarted","Data":"d4e22b01694e7d4ae17f7d2708da211c530ba9055347033a68b3ca8e61ff10ad"}
May 29 02:27:33.105686 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.105667    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2r9s2" event={"ID":"a6499ac1-a799-4692-894c-b3f1bf59b369","Type":"ContainerStarted","Data":"1faea1ae8dc67237ccc5018205d57942690a4fac881b331f166352abc59bfa63"}
May 29 02:27:33.105758 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.105692    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-2r9s2" event={"ID":"a6499ac1-a799-4692-894c-b3f1bf59b369","Type":"ContainerStarted","Data":"86056c5ec7f9131bc94f84ad168c2858ffa65fb1c751d9cc68ed4fc61b57e22a"}
May 29 02:27:33.109427 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.109370    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-xjw8k" podStartSLOduration=3.258213503 podStartE2EDuration="21.109357075s" podCreationTimestamp="2026-05-29 02:27:12 +0000 UTC" firstStartedPulling="2026-05-29 02:27:14.561418533 +0000 UTC m=+3.216426150" lastFinishedPulling="2026-05-29 02:27:32.412562094 +0000 UTC m=+21.067569722" observedRunningTime="2026-05-29 02:27:33.108749637 +0000 UTC m=+21.763757272" watchObservedRunningTime="2026-05-29 02:27:33.109357075 +0000 UTC m=+21.764364711"
May 29 02:27:33.123952 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.123918    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-gbfkn" podStartSLOduration=3.263690041 podStartE2EDuration="21.123909622s" podCreationTimestamp="2026-05-29 02:27:12 +0000 UTC" firstStartedPulling="2026-05-29 02:27:14.553800376 +0000 UTC m=+3.208807990" lastFinishedPulling="2026-05-29 02:27:32.414019955 +0000 UTC m=+21.069027571" observedRunningTime="2026-05-29 02:27:33.123542119 +0000 UTC m=+21.778549749" watchObservedRunningTime="2026-05-29 02:27:33.123909622 +0000 UTC m=+21.778917300"
May 29 02:27:33.157972 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.157932    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jtmf8" podStartSLOduration=8.103429892 podStartE2EDuration="21.157919427s" podCreationTimestamp="2026-05-29 02:27:12 +0000 UTC" firstStartedPulling="2026-05-29 02:27:14.561793722 +0000 UTC m=+3.216801344" lastFinishedPulling="2026-05-29 02:27:27.61628325 +0000 UTC m=+16.271290879" observedRunningTime="2026-05-29 02:27:33.15767632 +0000 UTC m=+21.812683955" watchObservedRunningTime="2026-05-29 02:27:33.157919427 +0000 UTC m=+21.812927062"
May 29 02:27:33.172552 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.172513    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-2r9s2" podStartSLOduration=17.172499989 podStartE2EDuration="17.172499989s" podCreationTimestamp="2026-05-29 02:27:16 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:27:33.171710948 +0000 UTC m=+21.826718587" watchObservedRunningTime="2026-05-29 02:27:33.172499989 +0000 UTC m=+21.827507625"
May 29 02:27:33.187849 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.187799    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-rrpxl" podStartSLOduration=3.291537417 podStartE2EDuration="21.187784203s" podCreationTimestamp="2026-05-29 02:27:12 +0000 UTC" firstStartedPulling="2026-05-29 02:27:14.530621719 +0000 UTC m=+3.185629340" lastFinishedPulling="2026-05-29 02:27:32.426868513 +0000 UTC m=+21.081876126" observedRunningTime="2026-05-29 02:27:33.187302493 +0000 UTC m=+21.842310132" watchObservedRunningTime="2026-05-29 02:27:33.187784203 +0000 UTC m=+21.842791842"
May 29 02:27:33.942821 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.942776    2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
May 29 02:27:33.966989 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.966960    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:33.966989 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:33.966978    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:33.967207 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:33.967090    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbj9n" podUID="f1c2fcb1-f203-4571-8cbe-eb01a190d63b"
May 29 02:27:33.967283 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:33.967266    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bs6h" podUID="2f9d23cf-9350-4bd4-88f9-161206125b5e"
May 29 02:27:34.109161 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:34.109072    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-5pdp5" event={"ID":"d952dbb7-29ca-425c-b657-33c475f0834d","Type":"ContainerStarted","Data":"527afc567ed6655ba214180b5d28e4032dd376479197079bccb196dbe855753c"}
May 29 02:27:34.110933 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:34.110901    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6" event={"ID":"d169bc1e-8a33-4408-9a72-28a209292f46","Type":"ContainerStarted","Data":"a283b196182c331f9aeca2fa4d766a792aa5066e70b6f90a4dca86b98ce040d4"}
May 29 02:27:34.136822 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:34.136774    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-5pdp5" podStartSLOduration=4.285313916 podStartE2EDuration="22.136759817s" podCreationTimestamp="2026-05-29 02:27:12 +0000 UTC" firstStartedPulling="2026-05-29 02:27:14.56124857 +0000 UTC m=+3.216256184" lastFinishedPulling="2026-05-29 02:27:32.412694467 +0000 UTC m=+21.067702085" observedRunningTime="2026-05-29 02:27:34.136593421 +0000 UTC m=+22.791601054" watchObservedRunningTime="2026-05-29 02:27:34.136759817 +0000 UTC m=+22.791767452"
May 29 02:27:34.934971 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:34.934867    2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-05-29T02:27:33.942797483Z","UUID":"21e6640c-6402-43c9-9bce-ca69b23b973d","Handler":null,"Name":"","Endpoint":""}
May 29 02:27:34.936689 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:34.936654    2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
May 29 02:27:34.936689 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:34.936685    2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
May 29 02:27:35.119398 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:35.119375    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-xjw8k"
May 29 02:27:35.967626 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:35.967420    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:35.967794 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:35.967469    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:35.967794 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:35.967716    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbj9n" podUID="f1c2fcb1-f203-4571-8cbe-eb01a190d63b"
May 29 02:27:35.967794 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:35.967772    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bs6h" podUID="2f9d23cf-9350-4bd4-88f9-161206125b5e"
May 29 02:27:36.069504 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:36.069468    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-xjw8k"
May 29 02:27:36.070220 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:36.070200    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-xjw8k"
May 29 02:27:36.119311 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:36.119274    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wldp" event={"ID":"307a16db-de95-48bc-9404-bdcfff68ccdf","Type":"ContainerStarted","Data":"09dce28395fa7e6820ba49860f783b6ac32658e1182439a4fa7344833786fd5d"}
May 29 02:27:36.121066 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:36.121036    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6" event={"ID":"d169bc1e-8a33-4408-9a72-28a209292f46","Type":"ContainerStarted","Data":"b994b84d524a0c74c9ccadb30127a588e1d70d4c1770d7965b1fe48dd97e1a4a"}
May 29 02:27:36.121801 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:36.121783    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-xjw8k"
May 29 02:27:36.141138 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:36.141090    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-mngb6" podStartSLOduration=3.6347522679999997 podStartE2EDuration="24.141073208s" podCreationTimestamp="2026-05-29 02:27:12 +0000 UTC" firstStartedPulling="2026-05-29 02:27:14.531828321 +0000 UTC m=+3.186835937" lastFinishedPulling="2026-05-29 02:27:35.038149261 +0000 UTC m=+23.693156877" observedRunningTime="2026-05-29 02:27:36.140680994 +0000 UTC m=+24.795688630" watchObservedRunningTime="2026-05-29 02:27:36.141073208 +0000 UTC m=+24.796080848"
May 29 02:27:37.026984 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:37.026950    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-5cv7x"]
May 29 02:27:37.056436 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:37.056410    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:37.056580 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:37.056490    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cv7x" podUID="872e4aee-eabd-43ac-ad37-c6e0a4f918e8"
May 29 02:27:37.163408 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:37.163366    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-kubelet-config\") pod \"global-pull-secret-syncer-5cv7x\" (UID: \"872e4aee-eabd-43ac-ad37-c6e0a4f918e8\") " pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:37.163986 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:37.163437    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-original-pull-secret\") pod \"global-pull-secret-syncer-5cv7x\" (UID: \"872e4aee-eabd-43ac-ad37-c6e0a4f918e8\") " pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:37.163986 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:37.163486    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-dbus\") pod \"global-pull-secret-syncer-5cv7x\" (UID: \"872e4aee-eabd-43ac-ad37-c6e0a4f918e8\") " pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:37.264485 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:37.264456    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-original-pull-secret\") pod \"global-pull-secret-syncer-5cv7x\" (UID: \"872e4aee-eabd-43ac-ad37-c6e0a4f918e8\") " pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:37.264644 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:37.264512    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-dbus\") pod \"global-pull-secret-syncer-5cv7x\" (UID: \"872e4aee-eabd-43ac-ad37-c6e0a4f918e8\") " pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:37.264644 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:37.264570    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-kubelet-config\") pod \"global-pull-secret-syncer-5cv7x\" (UID: \"872e4aee-eabd-43ac-ad37-c6e0a4f918e8\") " pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:37.264644 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:37.264606    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 02:27:37.264802 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:37.264676    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-original-pull-secret podName:872e4aee-eabd-43ac-ad37-c6e0a4f918e8 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:37.764656773 +0000 UTC m=+26.419664389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-original-pull-secret") pod "global-pull-secret-syncer-5cv7x" (UID: "872e4aee-eabd-43ac-ad37-c6e0a4f918e8") : object "kube-system"/"original-pull-secret" not registered
May 29 02:27:37.264802 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:37.264692    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-kubelet-config\") pod \"global-pull-secret-syncer-5cv7x\" (UID: \"872e4aee-eabd-43ac-ad37-c6e0a4f918e8\") " pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:37.264882 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:37.264835    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-dbus\") pod \"global-pull-secret-syncer-5cv7x\" (UID: \"872e4aee-eabd-43ac-ad37-c6e0a4f918e8\") " pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:37.768868 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:37.768697    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-original-pull-secret\") pod \"global-pull-secret-syncer-5cv7x\" (UID: \"872e4aee-eabd-43ac-ad37-c6e0a4f918e8\") " pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:37.768980 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:37.768826    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 02:27:37.768980 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:37.768959    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-original-pull-secret podName:872e4aee-eabd-43ac-ad37-c6e0a4f918e8 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:38.768945333 +0000 UTC m=+27.423952947 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-original-pull-secret") pod "global-pull-secret-syncer-5cv7x" (UID: "872e4aee-eabd-43ac-ad37-c6e0a4f918e8") : object "kube-system"/"original-pull-secret" not registered
May 29 02:27:37.967267 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:37.967221    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:37.967267 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:37.967221    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:37.967464 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:37.967353    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbj9n" podUID="f1c2fcb1-f203-4571-8cbe-eb01a190d63b"
May 29 02:27:37.967464 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:37.967450    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bs6h" podUID="2f9d23cf-9350-4bd4-88f9-161206125b5e"
May 29 02:27:38.127616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:38.127577    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-6wldp" event={"ID":"307a16db-de95-48bc-9404-bdcfff68ccdf","Type":"ContainerStarted","Data":"14028db57b97addd9d120e52d44ab687b908a459a5754d1e71a5e9e1c03724f8"}
May 29 02:27:38.127931 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:38.127915    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:38.128025 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:38.127936    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:38.130754 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:38.130713    2573 generic.go:358] "Generic (PLEG): container finished" podID="f859eb41-2671-4f9a-b7a1-609ea44e19de" containerID="2ba66681dabbbb011a7ebbe26dc9c3b3d8ac59b5d642223c9de86872e74ea6d4" exitCode=0
May 29 02:27:38.130862 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:38.130768    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v8vwt" event={"ID":"f859eb41-2671-4f9a-b7a1-609ea44e19de","Type":"ContainerDied","Data":"2ba66681dabbbb011a7ebbe26dc9c3b3d8ac59b5d642223c9de86872e74ea6d4"}
May 29 02:27:38.144630 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:38.144611    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:38.144737 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:38.144695    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:38.159288 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:38.159235    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-6wldp" podStartSLOduration=8.181293344 podStartE2EDuration="26.159226036s" podCreationTimestamp="2026-05-29 02:27:12 +0000 UTC" firstStartedPulling="2026-05-29 02:27:14.553801234 +0000 UTC m=+3.208808851" lastFinishedPulling="2026-05-29 02:27:32.531733915 +0000 UTC m=+21.186741543" observedRunningTime="2026-05-29 02:27:38.159099298 +0000 UTC m=+26.814106933" watchObservedRunningTime="2026-05-29 02:27:38.159226036 +0000 UTC m=+26.814233681"
May 29 02:27:38.776514 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:38.776479    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-original-pull-secret\") pod \"global-pull-secret-syncer-5cv7x\" (UID: \"872e4aee-eabd-43ac-ad37-c6e0a4f918e8\") " pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:38.777109 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:38.776633    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 02:27:38.777109 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:38.776708    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-original-pull-secret podName:872e4aee-eabd-43ac-ad37-c6e0a4f918e8 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:40.776687142 +0000 UTC m=+29.431694757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-original-pull-secret") pod "global-pull-secret-syncer-5cv7x" (UID: "872e4aee-eabd-43ac-ad37-c6e0a4f918e8") : object "kube-system"/"original-pull-secret" not registered
May 29 02:27:38.967433 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:38.967402    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:38.967578 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:38.967531    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cv7x" podUID="872e4aee-eabd-43ac-ad37-c6e0a4f918e8"
May 29 02:27:39.134071 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:39.133145    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 29 02:27:39.404802 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:39.404723    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5cv7x"]
May 29 02:27:39.404959 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:39.404841    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:39.404959 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:39.404918    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cv7x" podUID="872e4aee-eabd-43ac-ad37-c6e0a4f918e8"
May 29 02:27:39.408389 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:39.408366    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bbj9n"]
May 29 02:27:39.408499 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:39.408480    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:39.408583 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:39.408567    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbj9n" podUID="f1c2fcb1-f203-4571-8cbe-eb01a190d63b"
May 29 02:27:39.416929 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:39.416905    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6bs6h"]
May 29 02:27:39.417013 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:39.417000    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:39.417112 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:39.417095    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bs6h" podUID="2f9d23cf-9350-4bd4-88f9-161206125b5e"
May 29 02:27:40.136898 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:40.136867    2573 generic.go:358] "Generic (PLEG): container finished" podID="f859eb41-2671-4f9a-b7a1-609ea44e19de" containerID="0f469d1c52c8edd821dd8fdd0e40e460249b1de43d51c3e88c779706fa2adfc6" exitCode=0
May 29 02:27:40.137410 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:40.136969    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v8vwt" event={"ID":"f859eb41-2671-4f9a-b7a1-609ea44e19de","Type":"ContainerDied","Data":"0f469d1c52c8edd821dd8fdd0e40e460249b1de43d51c3e88c779706fa2adfc6"}
May 29 02:27:40.137410 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:40.137026    2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
May 29 02:27:40.384288 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:40.384246    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:27:40.792999 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:40.792296    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-original-pull-secret\") pod \"global-pull-secret-syncer-5cv7x\" (UID: \"872e4aee-eabd-43ac-ad37-c6e0a4f918e8\") " pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:40.792999 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:40.792478    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 02:27:40.792999 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:40.792558    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-original-pull-secret podName:872e4aee-eabd-43ac-ad37-c6e0a4f918e8 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:44.79253481 +0000 UTC m=+33.447542438 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-original-pull-secret") pod "global-pull-secret-syncer-5cv7x" (UID: "872e4aee-eabd-43ac-ad37-c6e0a4f918e8") : object "kube-system"/"original-pull-secret" not registered
May 29 02:27:40.967048 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:40.967013    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:40.967205 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:40.967013    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:40.967205 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:40.967114    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cv7x" podUID="872e4aee-eabd-43ac-ad37-c6e0a4f918e8"
May 29 02:27:40.967325 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:40.967019    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:40.967325 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:40.967244    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbj9n" podUID="f1c2fcb1-f203-4571-8cbe-eb01a190d63b"
May 29 02:27:40.967411 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:40.967381    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bs6h" podUID="2f9d23cf-9350-4bd4-88f9-161206125b5e"
May 29 02:27:42.142557 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:42.142367    2573 generic.go:358] "Generic (PLEG): container finished" podID="f859eb41-2671-4f9a-b7a1-609ea44e19de" containerID="593bd379b9ba900eb489126eaaca33a3dece0a001388cabd684fc2a1f423a148" exitCode=0
May 29 02:27:42.142557 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:42.142436    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v8vwt" event={"ID":"f859eb41-2671-4f9a-b7a1-609ea44e19de","Type":"ContainerDied","Data":"593bd379b9ba900eb489126eaaca33a3dece0a001388cabd684fc2a1f423a148"}
May 29 02:27:42.967383 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:42.967343    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:42.967590 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:42.967453    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cv7x" podUID="872e4aee-eabd-43ac-ad37-c6e0a4f918e8"
May 29 02:27:42.967590 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:42.967467    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:42.967590 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:42.967493    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:42.967590 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:42.967559    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbj9n" podUID="f1c2fcb1-f203-4571-8cbe-eb01a190d63b"
May 29 02:27:42.967757 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:42.967631    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bs6h" podUID="2f9d23cf-9350-4bd4-88f9-161206125b5e"
May 29 02:27:44.823535 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:44.823495    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-original-pull-secret\") pod \"global-pull-secret-syncer-5cv7x\" (UID: \"872e4aee-eabd-43ac-ad37-c6e0a4f918e8\") " pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:44.824061 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:44.823630    2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
May 29 02:27:44.824061 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:44.823705    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-original-pull-secret podName:872e4aee-eabd-43ac-ad37-c6e0a4f918e8 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:52.823681584 +0000 UTC m=+41.478689205 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-original-pull-secret") pod "global-pull-secret-syncer-5cv7x" (UID: "872e4aee-eabd-43ac-ad37-c6e0a4f918e8") : object "kube-system"/"original-pull-secret" not registered
May 29 02:27:44.966974 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:44.966939    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:44.967092 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:44.966939    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:44.967092 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:44.967071    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-bbj9n" podUID="f1c2fcb1-f203-4571-8cbe-eb01a190d63b"
May 29 02:27:44.967210 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:44.966950    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:44.967210 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:44.967145    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6bs6h" podUID="2f9d23cf-9350-4bd4-88f9-161206125b5e"
May 29 02:27:44.967331 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:44.967230    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-5cv7x" podUID="872e4aee-eabd-43ac-ad37-c6e0a4f918e8"
May 29 02:27:45.161665 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.161592    2573 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-141-109.ec2.internal" event="NodeReady"
May 29 02:27:45.161802 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.161719    2573 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
May 29 02:27:45.206122 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.206092    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"]
May 29 02:27:45.209046 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.209021    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"
May 29 02:27:45.214436 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.214414    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cdlfg\""
May 29 02:27:45.215811 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.215787    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7f87c8b546-gkppc"]
May 29 02:27:45.216505 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.216410    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
May 29 02:27:45.216505 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.216468    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
May 29 02:27:45.218716 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.218697    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.221843 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.221617    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
May 29 02:27:45.221843 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.221650    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
May 29 02:27:45.222000 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.221977    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-bhxm6\""
May 29 02:27:45.222101 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.222079    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
May 29 02:27:45.222180 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.222161    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"]
May 29 02:27:45.228821 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.228515    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-kl8vc"]
May 29 02:27:45.231801 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.231783    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kl8vc"
May 29 02:27:45.240295 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.240276    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-8hx9n"]
May 29 02:27:45.240614 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.240589    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
May 29 02:27:45.240705 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.240612    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zl2l4\""
May 29 02:27:45.241009 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.240945    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
May 29 02:27:45.241722 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.241575    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
May 29 02:27:45.243194 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.243175    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7f87c8b546-gkppc"]
May 29 02:27:45.243320 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.243306    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8hx9n"
May 29 02:27:45.246136 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.246120    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jrg6b\""
May 29 02:27:45.246242 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.246138    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
May 29 02:27:45.246328 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.246271    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
May 29 02:27:45.246562 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.246539    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
May 29 02:27:45.252775 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.252758    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kl8vc"]
May 29 02:27:45.254496 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.254478    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8hx9n"]
May 29 02:27:45.328292 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.328242    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert\") pod \"ingress-canary-8hx9n\" (UID: \"c4d7d603-050b-4d0e-9802-4ba8d0bc4baa\") " pod="openshift-ingress-canary/ingress-canary-8hx9n"
May 29 02:27:45.328444 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.328304    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dn9r\" (UniqueName: \"kubernetes.io/projected/96254599-cc53-4384-9eca-b9bb8997cd02-kube-api-access-5dn9r\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:27:45.328444 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.328354    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a7061e3-3a99-4d53-ae20-0028a4950f5f-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-nw69w\" (UID: \"0a7061e3-3a99-4d53-ae20-0028a4950f5f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"
May 29 02:27:45.328444 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.328381    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58da8892-cc4a-4ebf-9563-f23b950b7dd6-ca-trust-extracted\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.328618 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.328467    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.328618 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.328502    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58da8892-cc4a-4ebf-9563-f23b950b7dd6-trusted-ca\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.328618 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.328536    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ndhn\" (UniqueName: \"kubernetes.io/projected/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-kube-api-access-4ndhn\") pod \"ingress-canary-8hx9n\" (UID: \"c4d7d603-050b-4d0e-9802-4ba8d0bc4baa\") " pod="openshift-ingress-canary/ingress-canary-8hx9n"
May 29 02:27:45.328618 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.328563    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58da8892-cc4a-4ebf-9563-f23b950b7dd6-installation-pull-secrets\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.328618 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.328594    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58da8892-cc4a-4ebf-9563-f23b950b7dd6-image-registry-private-configuration\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.328803 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.328632    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/96254599-cc53-4384-9eca-b9bb8997cd02-config-volume\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:27:45.328803 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.328692    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96254599-cc53-4384-9eca-b9bb8997cd02-tmp-dir\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:27:45.328803 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.328720    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-certificates\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.328803 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.328746    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:27:45.328803 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.328762    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jr98\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-kube-api-access-8jr98\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.328803 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.328794    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-bound-sa-token\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.329000 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.328820    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nw69w\" (UID: \"0a7061e3-3a99-4d53-ae20-0028a4950f5f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"
May 29 02:27:45.430177 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.430102    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a7061e3-3a99-4d53-ae20-0028a4950f5f-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-nw69w\" (UID: \"0a7061e3-3a99-4d53-ae20-0028a4950f5f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"
May 29 02:27:45.430177 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.430138    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58da8892-cc4a-4ebf-9563-f23b950b7dd6-ca-trust-extracted\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.430177 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.430168    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.430450 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.430194    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58da8892-cc4a-4ebf-9563-f23b950b7dd6-trusted-ca\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.430450 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.430220    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4ndhn\" (UniqueName: \"kubernetes.io/projected/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-kube-api-access-4ndhn\") pod \"ingress-canary-8hx9n\" (UID: \"c4d7d603-050b-4d0e-9802-4ba8d0bc4baa\") " pod="openshift-ingress-canary/ingress-canary-8hx9n"
May 29 02:27:45.430450 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.430239    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58da8892-cc4a-4ebf-9563-f23b950b7dd6-installation-pull-secrets\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.430450 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.430279    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58da8892-cc4a-4ebf-9563-f23b950b7dd6-image-registry-private-configuration\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.430450 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.430307    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/96254599-cc53-4384-9eca-b9bb8997cd02-config-volume\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:27:45.430450 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.430313    2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 02:27:45.430450 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.430331    2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f87c8b546-gkppc: secret "image-registry-tls" not found
May 29 02:27:45.430450 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.430361    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96254599-cc53-4384-9eca-b9bb8997cd02-tmp-dir\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:27:45.430450 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.430394    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-certificates\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.430450 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.430423    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls podName:58da8892-cc4a-4ebf-9563-f23b950b7dd6 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:45.930400058 +0000 UTC m=+34.585407689 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls") pod "image-registry-7f87c8b546-gkppc" (UID: "58da8892-cc4a-4ebf-9563-f23b950b7dd6") : secret "image-registry-tls" not found
May 29 02:27:45.430908 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.430467    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:27:45.430908 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.430498    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8jr98\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-kube-api-access-8jr98\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.430908 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.430529    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-bound-sa-token\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.430908 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.430587    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58da8892-cc4a-4ebf-9563-f23b950b7dd6-ca-trust-extracted\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.431105 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.430914    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 02:27:45.431105 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.430960    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls podName:96254599-cc53-4384-9eca-b9bb8997cd02 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:45.930944953 +0000 UTC m=+34.585952570 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls") pod "dns-default-kl8vc" (UID: "96254599-cc53-4384-9eca-b9bb8997cd02") : secret "dns-default-metrics-tls" not found
May 29 02:27:45.431105 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.430964    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-certificates\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.431314 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.431287    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0a7061e3-3a99-4d53-ae20-0028a4950f5f-nginx-conf\") pod \"networking-console-plugin-d4d8f94f9-nw69w\" (UID: \"0a7061e3-3a99-4d53-ae20-0028a4950f5f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"
May 29 02:27:45.431444 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.431355    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nw69w\" (UID: \"0a7061e3-3a99-4d53-ae20-0028a4950f5f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"
May 29 02:27:45.431444 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.431398    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58da8892-cc4a-4ebf-9563-f23b950b7dd6-trusted-ca\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.431444 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.431420    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert\") pod \"ingress-canary-8hx9n\" (UID: \"c4d7d603-050b-4d0e-9802-4ba8d0bc4baa\") " pod="openshift-ingress-canary/ingress-canary-8hx9n"
May 29 02:27:45.431605 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.431455    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5dn9r\" (UniqueName: \"kubernetes.io/projected/96254599-cc53-4384-9eca-b9bb8997cd02-kube-api-access-5dn9r\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:27:45.431605 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.431486    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 29 02:27:45.431605 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.431508    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/96254599-cc53-4384-9eca-b9bb8997cd02-config-volume\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:27:45.431605 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.431518    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 02:27:45.431605 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.431541    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert podName:0a7061e3-3a99-4d53-ae20-0028a4950f5f nodeName:}" failed. No retries permitted until 2026-05-29 02:27:45.931525701 +0000 UTC m=+34.586533326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-nw69w" (UID: "0a7061e3-3a99-4d53-ae20-0028a4950f5f") : secret "networking-console-plugin-cert" not found
May 29 02:27:45.431605 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.431545    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/96254599-cc53-4384-9eca-b9bb8997cd02-tmp-dir\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:27:45.431605 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.431564    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert podName:c4d7d603-050b-4d0e-9802-4ba8d0bc4baa nodeName:}" failed. No retries permitted until 2026-05-29 02:27:45.931549301 +0000 UTC m=+34.586556948 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert") pod "ingress-canary-8hx9n" (UID: "c4d7d603-050b-4d0e-9802-4ba8d0bc4baa") : secret "canary-serving-cert" not found
May 29 02:27:45.435229 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.435213    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58da8892-cc4a-4ebf-9563-f23b950b7dd6-installation-pull-secrets\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.435229 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.435220    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58da8892-cc4a-4ebf-9563-f23b950b7dd6-image-registry-private-configuration\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.453569 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.453549    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ndhn\" (UniqueName: \"kubernetes.io/projected/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-kube-api-access-4ndhn\") pod \"ingress-canary-8hx9n\" (UID: \"c4d7d603-050b-4d0e-9802-4ba8d0bc4baa\") " pod="openshift-ingress-canary/ingress-canary-8hx9n"
May 29 02:27:45.453653 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.453547    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-bound-sa-token\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.453750 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.453735    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jr98\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-kube-api-access-8jr98\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.453786 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.453749    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dn9r\" (UniqueName: \"kubernetes.io/projected/96254599-cc53-4384-9eca-b9bb8997cd02-kube-api-access-5dn9r\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:27:45.734489 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.734454    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs\") pod \"network-metrics-daemon-bbj9n\" (UID: \"f1c2fcb1-f203-4571-8cbe-eb01a190d63b\") " pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:45.734662 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.734620    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:45.734712 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.734697    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs podName:f1c2fcb1-f203-4571-8cbe-eb01a190d63b nodeName:}" failed. No retries permitted until 2026-05-29 02:28:17.734675832 +0000 UTC m=+66.389683447 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs") pod "network-metrics-daemon-bbj9n" (UID: "f1c2fcb1-f203-4571-8cbe-eb01a190d63b") : object "openshift-multus"/"metrics-daemon-secret" not registered
May 29 02:27:45.835038 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.835000    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cj9w\" (UniqueName: \"kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w\") pod \"network-check-target-6bs6h\" (UID: \"2f9d23cf-9350-4bd4-88f9-161206125b5e\") " pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:45.835635 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.835198    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
May 29 02:27:45.835635 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.835223    2573 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
May 29 02:27:45.835635 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.835236    2573 projected.go:194] Error preparing data for projected volume kube-api-access-2cj9w for pod openshift-network-diagnostics/network-check-target-6bs6h: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:45.835635 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.835305    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w podName:2f9d23cf-9350-4bd4-88f9-161206125b5e nodeName:}" failed. No retries permitted until 2026-05-29 02:28:17.835291518 +0000 UTC m=+66.490299131 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-2cj9w" (UniqueName: "kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w") pod "network-check-target-6bs6h" (UID: "2f9d23cf-9350-4bd4-88f9-161206125b5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
May 29 02:27:45.936161 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.936126    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:27:45.936363 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.936181    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nw69w\" (UID: \"0a7061e3-3a99-4d53-ae20-0028a4950f5f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"
May 29 02:27:45.936363 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.936245    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert\") pod \"ingress-canary-8hx9n\" (UID: \"c4d7d603-050b-4d0e-9802-4ba8d0bc4baa\") " pod="openshift-ingress-canary/ingress-canary-8hx9n"
May 29 02:27:45.936363 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:45.936318    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:45.936520 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.936417    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 02:27:45.936520 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.936506    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls podName:96254599-cc53-4384-9eca-b9bb8997cd02 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:46.936474599 +0000 UTC m=+35.591482213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls") pod "dns-default-kl8vc" (UID: "96254599-cc53-4384-9eca-b9bb8997cd02") : secret "dns-default-metrics-tls" not found
May 29 02:27:45.936520 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.936506    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 02:27:45.936666 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.936607    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert podName:c4d7d603-050b-4d0e-9802-4ba8d0bc4baa nodeName:}" failed. No retries permitted until 2026-05-29 02:27:46.936559212 +0000 UTC m=+35.591566846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert") pod "ingress-canary-8hx9n" (UID: "c4d7d603-050b-4d0e-9802-4ba8d0bc4baa") : secret "canary-serving-cert" not found
May 29 02:27:45.936776 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.936761    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 29 02:27:45.936823 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.936813    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert podName:0a7061e3-3a99-4d53-ae20-0028a4950f5f nodeName:}" failed. No retries permitted until 2026-05-29 02:27:46.936793591 +0000 UTC m=+35.591801225 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-nw69w" (UID: "0a7061e3-3a99-4d53-ae20-0028a4950f5f") : secret "networking-console-plugin-cert" not found
May 29 02:27:45.936960 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.936939    2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 02:27:45.937008 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.936967    2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f87c8b546-gkppc: secret "image-registry-tls" not found
May 29 02:27:45.937008 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:45.937007    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls podName:58da8892-cc4a-4ebf-9563-f23b950b7dd6 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:46.936989863 +0000 UTC m=+35.591997480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls") pod "image-registry-7f87c8b546-gkppc" (UID: "58da8892-cc4a-4ebf-9563-f23b950b7dd6") : secret "image-registry-tls" not found
May 29 02:27:46.945328 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:46.945295    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:27:46.945781 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:46.945338    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nw69w\" (UID: \"0a7061e3-3a99-4d53-ae20-0028a4950f5f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"
May 29 02:27:46.945781 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:46.945463    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert\") pod \"ingress-canary-8hx9n\" (UID: \"c4d7d603-050b-4d0e-9802-4ba8d0bc4baa\") " pod="openshift-ingress-canary/ingress-canary-8hx9n"
May 29 02:27:46.945781 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:46.945478    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 02:27:46.945781 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:46.945538    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:46.945781 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:46.945557    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls podName:96254599-cc53-4384-9eca-b9bb8997cd02 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:48.945536674 +0000 UTC m=+37.600544288 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls") pod "dns-default-kl8vc" (UID: "96254599-cc53-4384-9eca-b9bb8997cd02") : secret "dns-default-metrics-tls" not found
May 29 02:27:46.945781 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:46.945595    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 29 02:27:46.945781 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:46.945610    2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 02:27:46.945781 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:46.945624    2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f87c8b546-gkppc: secret "image-registry-tls" not found
May 29 02:27:46.945781 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:46.945648    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert podName:0a7061e3-3a99-4d53-ae20-0028a4950f5f nodeName:}" failed. No retries permitted until 2026-05-29 02:27:48.945632001 +0000 UTC m=+37.600639617 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-nw69w" (UID: "0a7061e3-3a99-4d53-ae20-0028a4950f5f") : secret "networking-console-plugin-cert" not found
May 29 02:27:46.945781 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:46.945668    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls podName:58da8892-cc4a-4ebf-9563-f23b950b7dd6 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:48.945658476 +0000 UTC m=+37.600666091 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls") pod "image-registry-7f87c8b546-gkppc" (UID: "58da8892-cc4a-4ebf-9563-f23b950b7dd6") : secret "image-registry-tls" not found
May 29 02:27:46.945781 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:46.945675    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 02:27:46.945781 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:46.945758    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert podName:c4d7d603-050b-4d0e-9802-4ba8d0bc4baa nodeName:}" failed. No retries permitted until 2026-05-29 02:27:48.945742196 +0000 UTC m=+37.600749813 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert") pod "ingress-canary-8hx9n" (UID: "c4d7d603-050b-4d0e-9802-4ba8d0bc4baa") : secret "canary-serving-cert" not found
May 29 02:27:46.966490 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:46.966457    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:46.966490 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:46.966481    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:27:46.966780 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:46.966759    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:27:46.970407 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:46.970386    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 29 02:27:46.970778 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:46.970724    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 29 02:27:46.970778 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:46.970745    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
May 29 02:27:46.970947 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:46.970796    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jrq9j\""
May 29 02:27:46.970947 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:46.970806    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 29 02:27:46.970947 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:46.970796    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t2rwn\""
May 29 02:27:48.157023 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:48.156996    2573 generic.go:358] "Generic (PLEG): container finished" podID="f859eb41-2671-4f9a-b7a1-609ea44e19de" containerID="d151f22d478495ce8335eca76ac1241a00f1306c50e75201299bee33fac9384f" exitCode=0
May 29 02:27:48.157450 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:48.157052    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v8vwt" event={"ID":"f859eb41-2671-4f9a-b7a1-609ea44e19de","Type":"ContainerDied","Data":"d151f22d478495ce8335eca76ac1241a00f1306c50e75201299bee33fac9384f"}
May 29 02:27:48.960666 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:48.960636    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:48.960791 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:48.960690    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:27:48.960791 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:48.960724    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nw69w\" (UID: \"0a7061e3-3a99-4d53-ae20-0028a4950f5f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"
May 29 02:27:48.960791 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:48.960772    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert\") pod \"ingress-canary-8hx9n\" (UID: \"c4d7d603-050b-4d0e-9802-4ba8d0bc4baa\") " pod="openshift-ingress-canary/ingress-canary-8hx9n"
May 29 02:27:48.960952 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:48.960804    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 29 02:27:48.960952 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:48.960854    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 02:27:48.960952 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:48.960804    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 02:27:48.960952 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:48.960870    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert podName:0a7061e3-3a99-4d53-ae20-0028a4950f5f nodeName:}" failed. No retries permitted until 2026-05-29 02:27:52.960855138 +0000 UTC m=+41.615862756 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-nw69w" (UID: "0a7061e3-3a99-4d53-ae20-0028a4950f5f") : secret "networking-console-plugin-cert" not found
May 29 02:27:48.960952 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:48.960891    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert podName:c4d7d603-050b-4d0e-9802-4ba8d0bc4baa nodeName:}" failed. No retries permitted until 2026-05-29 02:27:52.960880783 +0000 UTC m=+41.615888396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert") pod "ingress-canary-8hx9n" (UID: "c4d7d603-050b-4d0e-9802-4ba8d0bc4baa") : secret "canary-serving-cert" not found
May 29 02:27:48.960952 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:48.960807    2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 02:27:48.960952 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:48.960918    2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f87c8b546-gkppc: secret "image-registry-tls" not found
May 29 02:27:48.960952 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:48.960919    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls podName:96254599-cc53-4384-9eca-b9bb8997cd02 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:52.960900752 +0000 UTC m=+41.615908370 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls") pod "dns-default-kl8vc" (UID: "96254599-cc53-4384-9eca-b9bb8997cd02") : secret "dns-default-metrics-tls" not found
May 29 02:27:48.961197 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:48.960967    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls podName:58da8892-cc4a-4ebf-9563-f23b950b7dd6 nodeName:}" failed. No retries permitted until 2026-05-29 02:27:52.960954677 +0000 UTC m=+41.615962297 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls") pod "image-registry-7f87c8b546-gkppc" (UID: "58da8892-cc4a-4ebf-9563-f23b950b7dd6") : secret "image-registry-tls" not found
May 29 02:27:49.162421 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:49.162390    2573 generic.go:358] "Generic (PLEG): container finished" podID="f859eb41-2671-4f9a-b7a1-609ea44e19de" containerID="6fa4aaf1b67e3d0ed64bbd26a634084379a5273ee731de2158b201602824d7df" exitCode=0
May 29 02:27:49.162421 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:49.162423    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v8vwt" event={"ID":"f859eb41-2671-4f9a-b7a1-609ea44e19de","Type":"ContainerDied","Data":"6fa4aaf1b67e3d0ed64bbd26a634084379a5273ee731de2158b201602824d7df"}
May 29 02:27:50.166812 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:50.166634    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-v8vwt" event={"ID":"f859eb41-2671-4f9a-b7a1-609ea44e19de","Type":"ContainerStarted","Data":"503e9392351f4a725554ae4ec48321fb15d68b4c75035a99f79f94ecb064f421"}
May 29 02:27:50.215107 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:50.215065    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-v8vwt" podStartSLOduration=4.968668567 podStartE2EDuration="38.215053487s" podCreationTimestamp="2026-05-29 02:27:12 +0000 UTC" firstStartedPulling="2026-05-29 02:27:14.561303818 +0000 UTC m=+3.216311447" lastFinishedPulling="2026-05-29 02:27:47.807688738 +0000 UTC m=+36.462696367" observedRunningTime="2026-05-29 02:27:50.210612585 +0000 UTC m=+38.865620231" watchObservedRunningTime="2026-05-29 02:27:50.215053487 +0000 UTC m=+38.870061122"
May 29 02:27:52.888614 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:52.888582    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-original-pull-secret\") pod \"global-pull-secret-syncer-5cv7x\" (UID: \"872e4aee-eabd-43ac-ad37-c6e0a4f918e8\") " pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:52.891626 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:52.891601    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/872e4aee-eabd-43ac-ad37-c6e0a4f918e8-original-pull-secret\") pod \"global-pull-secret-syncer-5cv7x\" (UID: \"872e4aee-eabd-43ac-ad37-c6e0a4f918e8\") " pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:52.977949 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:52.977922    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-5cv7x"
May 29 02:27:52.989926 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:52.989898    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:27:52.990053 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:52.989979    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:27:52.990053 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:52.990017    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nw69w\" (UID: \"0a7061e3-3a99-4d53-ae20-0028a4950f5f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"
May 29 02:27:52.990053 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:52.990038    2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 02:27:52.990212 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:52.990056    2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f87c8b546-gkppc: secret "image-registry-tls" not found
May 29 02:27:52.990212 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:52.990076    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert\") pod \"ingress-canary-8hx9n\" (UID: \"c4d7d603-050b-4d0e-9802-4ba8d0bc4baa\") " pod="openshift-ingress-canary/ingress-canary-8hx9n"
May 29 02:27:52.990212 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:52.990109    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls podName:58da8892-cc4a-4ebf-9563-f23b950b7dd6 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:00.990090328 +0000 UTC m=+49.645097945 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls") pod "image-registry-7f87c8b546-gkppc" (UID: "58da8892-cc4a-4ebf-9563-f23b950b7dd6") : secret "image-registry-tls" not found
May 29 02:27:52.990212 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:52.990118    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 02:27:52.990212 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:52.990161    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 02:27:52.990212 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:52.990177    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls podName:96254599-cc53-4384-9eca-b9bb8997cd02 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:00.990159233 +0000 UTC m=+49.645166864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls") pod "dns-default-kl8vc" (UID: "96254599-cc53-4384-9eca-b9bb8997cd02") : secret "dns-default-metrics-tls" not found
May 29 02:27:52.990212 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:52.990198    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 29 02:27:52.990212 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:52.990204    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert podName:c4d7d603-050b-4d0e-9802-4ba8d0bc4baa nodeName:}" failed. No retries permitted until 2026-05-29 02:28:00.990188684 +0000 UTC m=+49.645196301 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert") pod "ingress-canary-8hx9n" (UID: "c4d7d603-050b-4d0e-9802-4ba8d0bc4baa") : secret "canary-serving-cert" not found
May 29 02:27:52.990504 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:27:52.990294    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert podName:0a7061e3-3a99-4d53-ae20-0028a4950f5f nodeName:}" failed. No retries permitted until 2026-05-29 02:28:00.990233947 +0000 UTC m=+49.645241564 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-nw69w" (UID: "0a7061e3-3a99-4d53-ae20-0028a4950f5f") : secret "networking-console-plugin-cert" not found
May 29 02:27:53.161014 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:53.160950    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-5cv7x"]
May 29 02:27:53.164165 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:27:53.164140    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod872e4aee_eabd_43ac_ad37_c6e0a4f918e8.slice/crio-7dccb07c905e1581c63363a7bb92084d9823ac100db7943a282089637aafe257 WatchSource:0}: Error finding container 7dccb07c905e1581c63363a7bb92084d9823ac100db7943a282089637aafe257: Status 404 returned error can't find the container with id 7dccb07c905e1581c63363a7bb92084d9823ac100db7943a282089637aafe257
May 29 02:27:53.173547 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:53.173520    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5cv7x" event={"ID":"872e4aee-eabd-43ac-ad37-c6e0a4f918e8","Type":"ContainerStarted","Data":"7dccb07c905e1581c63363a7bb92084d9823ac100db7943a282089637aafe257"}
May 29 02:27:58.184503 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:58.184465    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-5cv7x" event={"ID":"872e4aee-eabd-43ac-ad37-c6e0a4f918e8","Type":"ContainerStarted","Data":"b6801604a0ea942ab206fdaeafb8e86508fdeb885cc5e4abba3c917788b30be6"}
May 29 02:27:58.212145 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:27:58.212094    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-5cv7x" podStartSLOduration=17.00184341 podStartE2EDuration="21.212078977s" podCreationTimestamp="2026-05-29 02:27:37 +0000 UTC" firstStartedPulling="2026-05-29 02:27:53.165776071 +0000 UTC m=+41.820783685" lastFinishedPulling="2026-05-29 02:27:57.376011635 +0000 UTC m=+46.031019252" observedRunningTime="2026-05-29 02:27:58.211428127 +0000 UTC m=+46.866435763" watchObservedRunningTime="2026-05-29 02:27:58.212078977 +0000 UTC m=+46.867086615"
May 29 02:28:01.052144 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:01.052102    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:28:01.052144 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:01.052148    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nw69w\" (UID: \"0a7061e3-3a99-4d53-ae20-0028a4950f5f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"
May 29 02:28:01.052686 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:01.052282    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 29 02:28:01.052686 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:01.052298    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 02:28:01.052686 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:01.052336    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert podName:0a7061e3-3a99-4d53-ae20-0028a4950f5f nodeName:}" failed. No retries permitted until 2026-05-29 02:28:17.052321559 +0000 UTC m=+65.707329173 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-nw69w" (UID: "0a7061e3-3a99-4d53-ae20-0028a4950f5f") : secret "networking-console-plugin-cert" not found
May 29 02:28:01.052686 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:01.052385    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls podName:96254599-cc53-4384-9eca-b9bb8997cd02 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:17.052364612 +0000 UTC m=+65.707372266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls") pod "dns-default-kl8vc" (UID: "96254599-cc53-4384-9eca-b9bb8997cd02") : secret "dns-default-metrics-tls" not found
May 29 02:28:01.052686 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:01.052391    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 02:28:01.052686 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:01.052307    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert\") pod \"ingress-canary-8hx9n\" (UID: \"c4d7d603-050b-4d0e-9802-4ba8d0bc4baa\") " pod="openshift-ingress-canary/ingress-canary-8hx9n"
May 29 02:28:01.052686 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:01.052446    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert podName:c4d7d603-050b-4d0e-9802-4ba8d0bc4baa nodeName:}" failed. No retries permitted until 2026-05-29 02:28:17.052428735 +0000 UTC m=+65.707436349 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert") pod "ingress-canary-8hx9n" (UID: "c4d7d603-050b-4d0e-9802-4ba8d0bc4baa") : secret "canary-serving-cert" not found
May 29 02:28:01.052686 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:01.052533    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:28:01.052686 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:01.052626    2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 02:28:01.052686 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:01.052638    2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f87c8b546-gkppc: secret "image-registry-tls" not found
May 29 02:28:01.052686 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:01.052680    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls podName:58da8892-cc4a-4ebf-9563-f23b950b7dd6 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:17.052669435 +0000 UTC m=+65.707677048 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls") pod "image-registry-7f87c8b546-gkppc" (UID: "58da8892-cc4a-4ebf-9563-f23b950b7dd6") : secret "image-registry-tls" not found
May 29 02:28:11.158401 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:11.158373    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-6wldp"
May 29 02:28:17.062560 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:17.062526    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nw69w\" (UID: \"0a7061e3-3a99-4d53-ae20-0028a4950f5f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"
May 29 02:28:17.062995 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:17.062572    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert\") pod \"ingress-canary-8hx9n\" (UID: \"c4d7d603-050b-4d0e-9802-4ba8d0bc4baa\") " pod="openshift-ingress-canary/ingress-canary-8hx9n"
May 29 02:28:17.062995 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:17.062607    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:28:17.062995 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:17.062644    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:28:17.062995 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:17.062662    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 29 02:28:17.062995 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:17.062740    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 02:28:17.062995 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:17.062747    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert podName:0a7061e3-3a99-4d53-ae20-0028a4950f5f nodeName:}" failed. No retries permitted until 2026-05-29 02:28:49.062728223 +0000 UTC m=+97.717735837 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-nw69w" (UID: "0a7061e3-3a99-4d53-ae20-0028a4950f5f") : secret "networking-console-plugin-cert" not found
May 29 02:28:17.062995 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:17.062790    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls podName:96254599-cc53-4384-9eca-b9bb8997cd02 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:49.062778741 +0000 UTC m=+97.717786354 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls") pod "dns-default-kl8vc" (UID: "96254599-cc53-4384-9eca-b9bb8997cd02") : secret "dns-default-metrics-tls" not found
May 29 02:28:17.062995 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:17.062740    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 02:28:17.062995 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:17.062794    2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 02:28:17.062995 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:17.062817    2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f87c8b546-gkppc: secret "image-registry-tls" not found
May 29 02:28:17.062995 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:17.062821    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert podName:c4d7d603-050b-4d0e-9802-4ba8d0bc4baa nodeName:}" failed. No retries permitted until 2026-05-29 02:28:49.062812678 +0000 UTC m=+97.717820292 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert") pod "ingress-canary-8hx9n" (UID: "c4d7d603-050b-4d0e-9802-4ba8d0bc4baa") : secret "canary-serving-cert" not found
May 29 02:28:17.062995 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:17.062891    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls podName:58da8892-cc4a-4ebf-9563-f23b950b7dd6 nodeName:}" failed. No retries permitted until 2026-05-29 02:28:49.062876792 +0000 UTC m=+97.717884406 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls") pod "image-registry-7f87c8b546-gkppc" (UID: "58da8892-cc4a-4ebf-9563-f23b950b7dd6") : secret "image-registry-tls" not found
May 29 02:28:17.767703 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:17.767671    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs\") pod \"network-metrics-daemon-bbj9n\" (UID: \"f1c2fcb1-f203-4571-8cbe-eb01a190d63b\") " pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:28:17.770573 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:17.770553    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
May 29 02:28:17.778184 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:17.778167    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 29 02:28:17.778301 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:17.778229    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs podName:f1c2fcb1-f203-4571-8cbe-eb01a190d63b nodeName:}" failed. No retries permitted until 2026-05-29 02:29:21.778209992 +0000 UTC m=+130.433217608 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs") pod "network-metrics-daemon-bbj9n" (UID: "f1c2fcb1-f203-4571-8cbe-eb01a190d63b") : secret "metrics-daemon-secret" not found
May 29 02:28:17.868988 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:17.868950    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2cj9w\" (UniqueName: \"kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w\") pod \"network-check-target-6bs6h\" (UID: \"2f9d23cf-9350-4bd4-88f9-161206125b5e\") " pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:28:17.874995 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:17.874971    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
May 29 02:28:17.882393 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:17.882375    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
May 29 02:28:17.892304 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:17.892275    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cj9w\" (UniqueName: \"kubernetes.io/projected/2f9d23cf-9350-4bd4-88f9-161206125b5e-kube-api-access-2cj9w\") pod \"network-check-target-6bs6h\" (UID: \"2f9d23cf-9350-4bd4-88f9-161206125b5e\") " pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:28:18.188862 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:18.188834    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jrq9j\""
May 29 02:28:18.195495 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:18.195461    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:28:18.323384 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:18.323353    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6bs6h"]
May 29 02:28:18.326444 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:28:18.326412    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f9d23cf_9350_4bd4_88f9_161206125b5e.slice/crio-6d48424f61be455c6f0dd19ecc1fac64468ad46d04091f62edfffb39c329a511 WatchSource:0}: Error finding container 6d48424f61be455c6f0dd19ecc1fac64468ad46d04091f62edfffb39c329a511: Status 404 returned error can't find the container with id 6d48424f61be455c6f0dd19ecc1fac64468ad46d04091f62edfffb39c329a511
May 29 02:28:19.227603 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:19.227567    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6bs6h" event={"ID":"2f9d23cf-9350-4bd4-88f9-161206125b5e","Type":"ContainerStarted","Data":"6d48424f61be455c6f0dd19ecc1fac64468ad46d04091f62edfffb39c329a511"}
May 29 02:28:21.233344 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:21.233264    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6bs6h" event={"ID":"2f9d23cf-9350-4bd4-88f9-161206125b5e","Type":"ContainerStarted","Data":"5a94a6f851a73408bb77c94a6bc6cdc7a73b8bdc1ca1efb87ed76d85bdc15aef"}
May 29 02:28:21.233673 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:21.233372    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:28:21.251064 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:21.251020    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6bs6h" podStartSLOduration=66.595291617 podStartE2EDuration="1m9.251007097s" podCreationTimestamp="2026-05-29 02:27:12 +0000 UTC" firstStartedPulling="2026-05-29 02:28:18.328347522 +0000 UTC m=+66.983355143" lastFinishedPulling="2026-05-29 02:28:20.984063006 +0000 UTC m=+69.639070623" observedRunningTime="2026-05-29 02:28:21.250620205 +0000 UTC m=+69.905627844" watchObservedRunningTime="2026-05-29 02:28:21.251007097 +0000 UTC m=+69.906014730"
May 29 02:28:49.103609 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:49.103570    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:28:49.104014 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:49.103628    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:28:49.104014 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:49.103651    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nw69w\" (UID: \"0a7061e3-3a99-4d53-ae20-0028a4950f5f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"
May 29 02:28:49.104014 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:49.103681    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert\") pod \"ingress-canary-8hx9n\" (UID: \"c4d7d603-050b-4d0e-9802-4ba8d0bc4baa\") " pod="openshift-ingress-canary/ingress-canary-8hx9n"
May 29 02:28:49.104014 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:49.103750    2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 02:28:49.104014 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:49.103772    2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f87c8b546-gkppc: secret "image-registry-tls" not found
May 29 02:28:49.104014 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:49.103748    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 02:28:49.104014 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:49.103830    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls podName:58da8892-cc4a-4ebf-9563-f23b950b7dd6 nodeName:}" failed. No retries permitted until 2026-05-29 02:29:53.103810293 +0000 UTC m=+161.758817906 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls") pod "image-registry-7f87c8b546-gkppc" (UID: "58da8892-cc4a-4ebf-9563-f23b950b7dd6") : secret "image-registry-tls" not found
May 29 02:28:49.104014 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:49.103828    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 29 02:28:49.104014 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:49.103835    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 02:28:49.104014 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:49.103899    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert podName:0a7061e3-3a99-4d53-ae20-0028a4950f5f nodeName:}" failed. No retries permitted until 2026-05-29 02:29:53.103880434 +0000 UTC m=+161.758888048 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-nw69w" (UID: "0a7061e3-3a99-4d53-ae20-0028a4950f5f") : secret "networking-console-plugin-cert" not found
May 29 02:28:49.104014 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:49.103916    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls podName:96254599-cc53-4384-9eca-b9bb8997cd02 nodeName:}" failed. No retries permitted until 2026-05-29 02:29:53.10390725 +0000 UTC m=+161.758914864 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls") pod "dns-default-kl8vc" (UID: "96254599-cc53-4384-9eca-b9bb8997cd02") : secret "dns-default-metrics-tls" not found
May 29 02:28:49.104014 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:28:49.103930    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert podName:c4d7d603-050b-4d0e-9802-4ba8d0bc4baa nodeName:}" failed. No retries permitted until 2026-05-29 02:29:53.10392213 +0000 UTC m=+161.758929750 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert") pod "ingress-canary-8hx9n" (UID: "c4d7d603-050b-4d0e-9802-4ba8d0bc4baa") : secret "canary-serving-cert" not found
May 29 02:28:52.238084 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:28:52.238050    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6bs6h"
May 29 02:29:21.822140 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:21.822091    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs\") pod \"network-metrics-daemon-bbj9n\" (UID: \"f1c2fcb1-f203-4571-8cbe-eb01a190d63b\") " pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:29:21.822640 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:21.822248    2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
May 29 02:29:21.822640 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:21.822338    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs podName:f1c2fcb1-f203-4571-8cbe-eb01a190d63b nodeName:}" failed. No retries permitted until 2026-05-29 02:31:23.822321819 +0000 UTC m=+252.477329433 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs") pod "network-metrics-daemon-bbj9n" (UID: "f1c2fcb1-f203-4571-8cbe-eb01a190d63b") : secret "metrics-daemon-secret" not found
May 29 02:29:43.063196 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.063164    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb"]
May 29 02:29:43.066000 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.065978    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb"
May 29 02:29:43.066691 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.066669    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-f44c44d4b-x5cfm"]
May 29 02:29:43.068593 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.068569    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
May 29 02:29:43.069510 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.069490    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:43.071076 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.071053    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
May 29 02:29:43.071196 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.071117    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-r748c\""
May 29 02:29:43.071196 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.071065    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
May 29 02:29:43.071512 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.071493    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
May 29 02:29:43.072052 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.072032    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
May 29 02:29:43.072157 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.072066    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
May 29 02:29:43.072157 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.072082    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
May 29 02:29:43.072383 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.072366    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
May 29 02:29:43.072451 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.072394    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rzwnb\""
May 29 02:29:43.072526 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.072365    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
May 29 02:29:43.072526 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.072448    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
May 29 02:29:43.075656 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.075638    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb"]
May 29 02:29:43.092381 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.092358    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f44c44d4b-x5cfm"]
May 29 02:29:43.172926 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.172897    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-zqwt9"]
May 29 02:29:43.173067 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.173049    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jp2jb\" (UniqueName: \"kubernetes.io/projected/b587765d-eae8-4167-8607-b87aadb21258-kube-api-access-jp2jb\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:43.173124 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.173094    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7d35785d-8d36-4c47-8655-e0cfe696cf7b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-clzfb\" (UID: \"7d35785d-8d36-4c47-8655-e0cfe696cf7b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb"
May 29 02:29:43.173124 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.173115    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-clzfb\" (UID: \"7d35785d-8d36-4c47-8655-e0cfe696cf7b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb"
May 29 02:29:43.173209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.173134    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-default-certificate\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:43.173209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.173155    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-stats-auth\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:43.173209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.173204    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:43.173340 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.173239    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-metrics-certs\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:43.173340 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.173289    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7rxx\" (UniqueName: \"kubernetes.io/projected/7d35785d-8d36-4c47-8655-e0cfe696cf7b-kube-api-access-t7rxx\") pod \"cluster-monitoring-operator-6c75959455-clzfb\" (UID: \"7d35785d-8d36-4c47-8655-e0cfe696cf7b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb"
May 29 02:29:43.175584 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.175570    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-zqwt9"
May 29 02:29:43.179409 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.179392    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
May 29 02:29:43.179512 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.179393    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
May 29 02:29:43.179512 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.179396    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-4gpj4\""
May 29 02:29:43.179638 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.179603    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
May 29 02:29:43.179738 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.179635    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
May 29 02:29:43.185225 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.185206    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
May 29 02:29:43.188658 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.188632    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-zqwt9"]
May 29 02:29:43.274153 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.274126    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-clzfb\" (UID: \"7d35785d-8d36-4c47-8655-e0cfe696cf7b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb"
May 29 02:29:43.274305 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.274159    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-default-certificate\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:43.274305 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.274182    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-stats-auth\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:43.274305 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.274205    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/423a6fd1-7473-4c55-b0cb-a208d404ce05-config\") pod \"console-operator-76dff48d59-zqwt9\" (UID: \"423a6fd1-7473-4c55-b0cb-a208d404ce05\") " pod="openshift-console-operator/console-operator-76dff48d59-zqwt9"
May 29 02:29:43.274305 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.274228    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/423a6fd1-7473-4c55-b0cb-a208d404ce05-trusted-ca\") pod \"console-operator-76dff48d59-zqwt9\" (UID: \"423a6fd1-7473-4c55-b0cb-a208d404ce05\") " pod="openshift-console-operator/console-operator-76dff48d59-zqwt9"
May 29 02:29:43.274305 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.274276    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-metrics-certs\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:43.274305 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:43.274299    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 02:29:43.274585 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.274396    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7rxx\" (UniqueName: \"kubernetes.io/projected/7d35785d-8d36-4c47-8655-e0cfe696cf7b-kube-api-access-t7rxx\") pod \"cluster-monitoring-operator-6c75959455-clzfb\" (UID: \"7d35785d-8d36-4c47-8655-e0cfe696cf7b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb"
May 29 02:29:43.274585 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:43.274418    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 29 02:29:43.274585 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:43.274421    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls podName:7d35785d-8d36-4c47-8655-e0cfe696cf7b nodeName:}" failed. No retries permitted until 2026-05-29 02:29:43.774395439 +0000 UTC m=+152.429403053 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-clzfb" (UID: "7d35785d-8d36-4c47-8655-e0cfe696cf7b") : secret "cluster-monitoring-operator-tls" not found
May 29 02:29:43.274585 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:43.274493    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-metrics-certs podName:b587765d-eae8-4167-8607-b87aadb21258 nodeName:}" failed. No retries permitted until 2026-05-29 02:29:43.774475011 +0000 UTC m=+152.429482654 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-metrics-certs") pod "router-default-f44c44d4b-x5cfm" (UID: "b587765d-eae8-4167-8607-b87aadb21258") : secret "router-metrics-certs-default" not found
May 29 02:29:43.274585 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.274578    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/423a6fd1-7473-4c55-b0cb-a208d404ce05-serving-cert\") pod \"console-operator-76dff48d59-zqwt9\" (UID: \"423a6fd1-7473-4c55-b0cb-a208d404ce05\") " pod="openshift-console-operator/console-operator-76dff48d59-zqwt9"
May 29 02:29:43.274794 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.274689    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwv2d\" (UniqueName: \"kubernetes.io/projected/423a6fd1-7473-4c55-b0cb-a208d404ce05-kube-api-access-pwv2d\") pod \"console-operator-76dff48d59-zqwt9\" (UID: \"423a6fd1-7473-4c55-b0cb-a208d404ce05\") " pod="openshift-console-operator/console-operator-76dff48d59-zqwt9"
May 29 02:29:43.274794 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.274713    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jp2jb\" (UniqueName: \"kubernetes.io/projected/b587765d-eae8-4167-8607-b87aadb21258-kube-api-access-jp2jb\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:43.274794 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.274740    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7d35785d-8d36-4c47-8655-e0cfe696cf7b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-clzfb\" (UID: \"7d35785d-8d36-4c47-8655-e0cfe696cf7b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb"
May 29 02:29:43.274794 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.274764    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:43.274979 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:43.274871    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle podName:b587765d-eae8-4167-8607-b87aadb21258 nodeName:}" failed. No retries permitted until 2026-05-29 02:29:43.774860645 +0000 UTC m=+152.429868275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle") pod "router-default-f44c44d4b-x5cfm" (UID: "b587765d-eae8-4167-8607-b87aadb21258") : configmap references non-existent config key: service-ca.crt
May 29 02:29:43.275563 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.275539    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/7d35785d-8d36-4c47-8655-e0cfe696cf7b-telemetry-config\") pod \"cluster-monitoring-operator-6c75959455-clzfb\" (UID: \"7d35785d-8d36-4c47-8655-e0cfe696cf7b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb"
May 29 02:29:43.276590 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.276573    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-default-certificate\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:43.276873 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.276857    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-stats-auth\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:43.280117 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.280097    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7rr46"]
May 29 02:29:43.283030 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.283015    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-7rr46"
May 29 02:29:43.286750 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.286730    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-2t5tb\""
May 29 02:29:43.286988 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.286971    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
May 29 02:29:43.287052 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.286970    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
May 29 02:29:43.287512 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.287496    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
May 29 02:29:43.287512 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.287503    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
May 29 02:29:43.293877 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.293793    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
May 29 02:29:43.298545 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.298525    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7rxx\" (UniqueName: \"kubernetes.io/projected/7d35785d-8d36-4c47-8655-e0cfe696cf7b-kube-api-access-t7rxx\") pod \"cluster-monitoring-operator-6c75959455-clzfb\" (UID: \"7d35785d-8d36-4c47-8655-e0cfe696cf7b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb"
May 29 02:29:43.299072 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.299053    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7rr46"]
May 29 02:29:43.301742 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.301719    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jp2jb\" (UniqueName: \"kubernetes.io/projected/b587765d-eae8-4167-8607-b87aadb21258-kube-api-access-jp2jb\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:43.375734 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.375648    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/eaa52fdb-83a3-41fc-b731-a1d57c86f5e4-snapshots\") pod \"insights-operator-78bdfb888c-7rr46\" (UID: \"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4\") " pod="openshift-insights/insights-operator-78bdfb888c-7rr46"
May 29 02:29:43.375734 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.375701    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/423a6fd1-7473-4c55-b0cb-a208d404ce05-serving-cert\") pod \"console-operator-76dff48d59-zqwt9\" (UID: \"423a6fd1-7473-4c55-b0cb-a208d404ce05\") " pod="openshift-console-operator/console-operator-76dff48d59-zqwt9"
May 29 02:29:43.375921 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.375762    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eaa52fdb-83a3-41fc-b731-a1d57c86f5e4-tmp\") pod \"insights-operator-78bdfb888c-7rr46\" (UID: \"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4\") " pod="openshift-insights/insights-operator-78bdfb888c-7rr46"
May 29 02:29:43.375921 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.375817    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaa52fdb-83a3-41fc-b731-a1d57c86f5e4-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7rr46\" (UID: \"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4\") " pod="openshift-insights/insights-operator-78bdfb888c-7rr46"
May 29 02:29:43.375921 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.375874    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pwv2d\" (UniqueName: \"kubernetes.io/projected/423a6fd1-7473-4c55-b0cb-a208d404ce05-kube-api-access-pwv2d\") pod \"console-operator-76dff48d59-zqwt9\" (UID: \"423a6fd1-7473-4c55-b0cb-a208d404ce05\") " pod="openshift-console-operator/console-operator-76dff48d59-zqwt9"
May 29 02:29:43.375921 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.375905    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww78f\" (UniqueName: \"kubernetes.io/projected/eaa52fdb-83a3-41fc-b731-a1d57c86f5e4-kube-api-access-ww78f\") pod \"insights-operator-78bdfb888c-7rr46\" (UID: \"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4\") " pod="openshift-insights/insights-operator-78bdfb888c-7rr46"
May 29 02:29:43.376108 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.375933    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaa52fdb-83a3-41fc-b731-a1d57c86f5e4-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7rr46\" (UID: \"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4\") " pod="openshift-insights/insights-operator-78bdfb888c-7rr46"
May 29 02:29:43.376108 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.375961    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eaa52fdb-83a3-41fc-b731-a1d57c86f5e4-serving-cert\") pod \"insights-operator-78bdfb888c-7rr46\" (UID: \"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4\") " pod="openshift-insights/insights-operator-78bdfb888c-7rr46"
May 29 02:29:43.376108 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.376040    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/423a6fd1-7473-4c55-b0cb-a208d404ce05-config\") pod \"console-operator-76dff48d59-zqwt9\" (UID: \"423a6fd1-7473-4c55-b0cb-a208d404ce05\") " pod="openshift-console-operator/console-operator-76dff48d59-zqwt9"
May 29 02:29:43.376108 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.376072    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/423a6fd1-7473-4c55-b0cb-a208d404ce05-trusted-ca\") pod \"console-operator-76dff48d59-zqwt9\" (UID: \"423a6fd1-7473-4c55-b0cb-a208d404ce05\") " pod="openshift-console-operator/console-operator-76dff48d59-zqwt9"
May 29 02:29:43.376719 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.376696    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/423a6fd1-7473-4c55-b0cb-a208d404ce05-config\") pod \"console-operator-76dff48d59-zqwt9\" (UID: \"423a6fd1-7473-4c55-b0cb-a208d404ce05\") " pod="openshift-console-operator/console-operator-76dff48d59-zqwt9"
May 29 02:29:43.376865 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.376839    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/423a6fd1-7473-4c55-b0cb-a208d404ce05-trusted-ca\") pod \"console-operator-76dff48d59-zqwt9\" (UID: \"423a6fd1-7473-4c55-b0cb-a208d404ce05\") " pod="openshift-console-operator/console-operator-76dff48d59-zqwt9"
May 29 02:29:43.378086 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.378066    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/423a6fd1-7473-4c55-b0cb-a208d404ce05-serving-cert\") pod \"console-operator-76dff48d59-zqwt9\" (UID: \"423a6fd1-7473-4c55-b0cb-a208d404ce05\") " pod="openshift-console-operator/console-operator-76dff48d59-zqwt9"
May 29 02:29:43.382331 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.382314    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-nm8fs"]
May 29 02:29:43.385294 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.385281    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-nm8fs"
May 29 02:29:43.388125 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.388108    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-th8lr\""
May 29 02:29:43.391832 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.391814    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwv2d\" (UniqueName: \"kubernetes.io/projected/423a6fd1-7473-4c55-b0cb-a208d404ce05-kube-api-access-pwv2d\") pod \"console-operator-76dff48d59-zqwt9\" (UID: \"423a6fd1-7473-4c55-b0cb-a208d404ce05\") " pod="openshift-console-operator/console-operator-76dff48d59-zqwt9"
May 29 02:29:43.395964 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.395944    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-nm8fs"]
May 29 02:29:43.477035 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.477006    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr7bz\" (UniqueName: \"kubernetes.io/projected/1a83ac4f-2f12-4ef7-9fff-c66f952a57c9-kube-api-access-xr7bz\") pod \"network-check-source-7f44b6dd87-nm8fs\" (UID: \"1a83ac4f-2f12-4ef7-9fff-c66f952a57c9\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-nm8fs"
May 29 02:29:43.477167 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.477067    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/eaa52fdb-83a3-41fc-b731-a1d57c86f5e4-snapshots\") pod \"insights-operator-78bdfb888c-7rr46\" (UID: \"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4\") " pod="openshift-insights/insights-operator-78bdfb888c-7rr46"
May 29 02:29:43.477167 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.477124    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eaa52fdb-83a3-41fc-b731-a1d57c86f5e4-tmp\") pod \"insights-operator-78bdfb888c-7rr46\" (UID: \"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4\") " pod="openshift-insights/insights-operator-78bdfb888c-7rr46"
May 29 02:29:43.477310 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.477174    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaa52fdb-83a3-41fc-b731-a1d57c86f5e4-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7rr46\" (UID: \"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4\") " pod="openshift-insights/insights-operator-78bdfb888c-7rr46"
May 29 02:29:43.477310 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.477230    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ww78f\" (UniqueName: \"kubernetes.io/projected/eaa52fdb-83a3-41fc-b731-a1d57c86f5e4-kube-api-access-ww78f\") pod \"insights-operator-78bdfb888c-7rr46\" (UID: \"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4\") " pod="openshift-insights/insights-operator-78bdfb888c-7rr46"
May 29 02:29:43.477453 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.477423    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaa52fdb-83a3-41fc-b731-a1d57c86f5e4-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7rr46\" (UID: \"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4\") " pod="openshift-insights/insights-operator-78bdfb888c-7rr46"
May 29 02:29:43.477521 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.477503    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eaa52fdb-83a3-41fc-b731-a1d57c86f5e4-serving-cert\") pod \"insights-operator-78bdfb888c-7rr46\" (UID: \"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4\") " pod="openshift-insights/insights-operator-78bdfb888c-7rr46"
May 29 02:29:43.477590 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.477571    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/eaa52fdb-83a3-41fc-b731-a1d57c86f5e4-tmp\") pod \"insights-operator-78bdfb888c-7rr46\" (UID: \"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4\") " pod="openshift-insights/insights-operator-78bdfb888c-7rr46"
May 29 02:29:43.477693 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.477673    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/eaa52fdb-83a3-41fc-b731-a1d57c86f5e4-snapshots\") pod \"insights-operator-78bdfb888c-7rr46\" (UID: \"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4\") " pod="openshift-insights/insights-operator-78bdfb888c-7rr46"
May 29 02:29:43.477906 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.477890    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaa52fdb-83a3-41fc-b731-a1d57c86f5e4-service-ca-bundle\") pod \"insights-operator-78bdfb888c-7rr46\" (UID: \"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4\") " pod="openshift-insights/insights-operator-78bdfb888c-7rr46"
May 29 02:29:43.478402 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.478387    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eaa52fdb-83a3-41fc-b731-a1d57c86f5e4-trusted-ca-bundle\") pod \"insights-operator-78bdfb888c-7rr46\" (UID: \"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4\") " pod="openshift-insights/insights-operator-78bdfb888c-7rr46"
May 29 02:29:43.479616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.479597    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/eaa52fdb-83a3-41fc-b731-a1d57c86f5e4-serving-cert\") pod \"insights-operator-78bdfb888c-7rr46\" (UID: \"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4\") " pod="openshift-insights/insights-operator-78bdfb888c-7rr46"
May 29 02:29:43.483571 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.483559    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-76dff48d59-zqwt9"
May 29 02:29:43.486024 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.486006    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww78f\" (UniqueName: \"kubernetes.io/projected/eaa52fdb-83a3-41fc-b731-a1d57c86f5e4-kube-api-access-ww78f\") pod \"insights-operator-78bdfb888c-7rr46\" (UID: \"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4\") " pod="openshift-insights/insights-operator-78bdfb888c-7rr46"
May 29 02:29:43.578843 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.578810    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xr7bz\" (UniqueName: \"kubernetes.io/projected/1a83ac4f-2f12-4ef7-9fff-c66f952a57c9-kube-api-access-xr7bz\") pod \"network-check-source-7f44b6dd87-nm8fs\" (UID: \"1a83ac4f-2f12-4ef7-9fff-c66f952a57c9\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-nm8fs"
May 29 02:29:43.588458 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.588430    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr7bz\" (UniqueName: \"kubernetes.io/projected/1a83ac4f-2f12-4ef7-9fff-c66f952a57c9-kube-api-access-xr7bz\") pod \"network-check-source-7f44b6dd87-nm8fs\" (UID: \"1a83ac4f-2f12-4ef7-9fff-c66f952a57c9\") " pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-nm8fs"
May 29 02:29:43.592218 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.592198    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-78bdfb888c-7rr46"
May 29 02:29:43.606491 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.606470    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-76dff48d59-zqwt9"]
May 29 02:29:43.608113 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:29:43.608088    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod423a6fd1_7473_4c55_b0cb_a208d404ce05.slice/crio-7411e81a269e19780d837bcf1c7c675e3e904f1e750ba1402c93e6bcc9f5fc16 WatchSource:0}: Error finding container 7411e81a269e19780d837bcf1c7c675e3e904f1e750ba1402c93e6bcc9f5fc16: Status 404 returned error can't find the container with id 7411e81a269e19780d837bcf1c7c675e3e904f1e750ba1402c93e6bcc9f5fc16
May 29 02:29:43.694053 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.694022    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-nm8fs"
May 29 02:29:43.712963 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:29:43.712935    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeaa52fdb_83a3_41fc_b731_a1d57c86f5e4.slice/crio-5f03f21ae5a64f5a6d291cefd4490d8ff648f98c4846a9426790c4b2b7409dc8 WatchSource:0}: Error finding container 5f03f21ae5a64f5a6d291cefd4490d8ff648f98c4846a9426790c4b2b7409dc8: Status 404 returned error can't find the container with id 5f03f21ae5a64f5a6d291cefd4490d8ff648f98c4846a9426790c4b2b7409dc8
May 29 02:29:43.713620 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.713601    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-78bdfb888c-7rr46"]
May 29 02:29:43.780996 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.780952    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:43.781125 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.781005    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-clzfb\" (UID: \"7d35785d-8d36-4c47-8655-e0cfe696cf7b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb"
May 29 02:29:43.781125 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.781043    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-metrics-certs\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:43.781233 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:43.781166    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 29 02:29:43.781233 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:43.781230    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-metrics-certs podName:b587765d-eae8-4167-8607-b87aadb21258 nodeName:}" failed. No retries permitted until 2026-05-29 02:29:44.781210614 +0000 UTC m=+153.436218244 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-metrics-certs") pod "router-default-f44c44d4b-x5cfm" (UID: "b587765d-eae8-4167-8607-b87aadb21258") : secret "router-metrics-certs-default" not found
May 29 02:29:43.781659 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:43.781370    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle podName:b587765d-eae8-4167-8607-b87aadb21258 nodeName:}" failed. No retries permitted until 2026-05-29 02:29:44.781356666 +0000 UTC m=+153.436364295 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle") pod "router-default-f44c44d4b-x5cfm" (UID: "b587765d-eae8-4167-8607-b87aadb21258") : configmap references non-existent config key: service-ca.crt
May 29 02:29:43.781659 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:43.781440    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 02:29:43.781659 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:43.781476    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls podName:7d35785d-8d36-4c47-8655-e0cfe696cf7b nodeName:}" failed. No retries permitted until 2026-05-29 02:29:44.781464959 +0000 UTC m=+153.436472575 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-clzfb" (UID: "7d35785d-8d36-4c47-8655-e0cfe696cf7b") : secret "cluster-monitoring-operator-tls" not found
May 29 02:29:43.812024 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:43.812000    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7f44b6dd87-nm8fs"]
May 29 02:29:43.815221 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:29:43.815195    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a83ac4f_2f12_4ef7_9fff_c66f952a57c9.slice/crio-99c9a0e5954d83ff3e221c8a13ff5fb00ccfa799b3d2e8507739176b2c1c638f WatchSource:0}: Error finding container 99c9a0e5954d83ff3e221c8a13ff5fb00ccfa799b3d2e8507739176b2c1c638f: Status 404 returned error can't find the container with id 99c9a0e5954d83ff3e221c8a13ff5fb00ccfa799b3d2e8507739176b2c1c638f
May 29 02:29:44.381990 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:44.381951    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-nm8fs" event={"ID":"1a83ac4f-2f12-4ef7-9fff-c66f952a57c9","Type":"ContainerStarted","Data":"0fdb15384719ea11b97fe5f2d0ea60f1fae893daf798e16c834255091018e316"}
May 29 02:29:44.382469 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:44.381996    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-nm8fs" event={"ID":"1a83ac4f-2f12-4ef7-9fff-c66f952a57c9","Type":"ContainerStarted","Data":"99c9a0e5954d83ff3e221c8a13ff5fb00ccfa799b3d2e8507739176b2c1c638f"}
May 29 02:29:44.383565 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:44.383537    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-zqwt9" event={"ID":"423a6fd1-7473-4c55-b0cb-a208d404ce05","Type":"ContainerStarted","Data":"7411e81a269e19780d837bcf1c7c675e3e904f1e750ba1402c93e6bcc9f5fc16"}
May 29 02:29:44.384782 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:44.384756    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7rr46" event={"ID":"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4","Type":"ContainerStarted","Data":"5f03f21ae5a64f5a6d291cefd4490d8ff648f98c4846a9426790c4b2b7409dc8"}
May 29 02:29:44.789511 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:44.789475    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:44.789698 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:44.789532    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-clzfb\" (UID: \"7d35785d-8d36-4c47-8655-e0cfe696cf7b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb"
May 29 02:29:44.789698 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:44.789567    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-metrics-certs\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:44.789698 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:44.789664    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle podName:b587765d-eae8-4167-8607-b87aadb21258 nodeName:}" failed. No retries permitted until 2026-05-29 02:29:46.789642431 +0000 UTC m=+155.444650046 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle") pod "router-default-f44c44d4b-x5cfm" (UID: "b587765d-eae8-4167-8607-b87aadb21258") : configmap references non-existent config key: service-ca.crt
May 29 02:29:44.789698 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:44.789688    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 02:29:44.789942 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:44.789708    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 29 02:29:44.789942 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:44.789731    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls podName:7d35785d-8d36-4c47-8655-e0cfe696cf7b nodeName:}" failed. No retries permitted until 2026-05-29 02:29:46.789719708 +0000 UTC m=+155.444727339 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-clzfb" (UID: "7d35785d-8d36-4c47-8655-e0cfe696cf7b") : secret "cluster-monitoring-operator-tls" not found
May 29 02:29:44.789942 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:44.789748    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-metrics-certs podName:b587765d-eae8-4167-8607-b87aadb21258 nodeName:}" failed. No retries permitted until 2026-05-29 02:29:46.789740517 +0000 UTC m=+155.444748131 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-metrics-certs") pod "router-default-f44c44d4b-x5cfm" (UID: "b587765d-eae8-4167-8607-b87aadb21258") : secret "router-metrics-certs-default" not found
May 29 02:29:46.389737 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:46.389694    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7rr46" event={"ID":"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4","Type":"ContainerStarted","Data":"424fb8735c2c97b973e065e580eba05f1df3ca075c222fcd86160e39ca28a032"}
May 29 02:29:46.391164 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:46.391143    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/0.log"
May 29 02:29:46.391295 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:46.391179    2573 generic.go:358] "Generic (PLEG): container finished" podID="423a6fd1-7473-4c55-b0cb-a208d404ce05" containerID="5b644e80c4cd08e229e934fec28a0b5898c73091d53d3dcd30a25ed871c69d69" exitCode=255
May 29 02:29:46.391295 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:46.391210    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-zqwt9" event={"ID":"423a6fd1-7473-4c55-b0cb-a208d404ce05","Type":"ContainerDied","Data":"5b644e80c4cd08e229e934fec28a0b5898c73091d53d3dcd30a25ed871c69d69"}
May 29 02:29:46.391435 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:46.391421    2573 scope.go:117] "RemoveContainer" containerID="5b644e80c4cd08e229e934fec28a0b5898c73091d53d3dcd30a25ed871c69d69"
May 29 02:29:46.409687 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:46.409646    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7f44b6dd87-nm8fs" podStartSLOduration=3.409631607 podStartE2EDuration="3.409631607s" podCreationTimestamp="2026-05-29 02:29:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:29:44.399481413 +0000 UTC m=+153.054489050" watchObservedRunningTime="2026-05-29 02:29:46.409631607 +0000 UTC m=+155.064639243"
May 29 02:29:46.410789 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:46.410735    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-78bdfb888c-7rr46" podStartSLOduration=1.203213968 podStartE2EDuration="3.41072356s" podCreationTimestamp="2026-05-29 02:29:43 +0000 UTC" firstStartedPulling="2026-05-29 02:29:43.715523489 +0000 UTC m=+152.370531106" lastFinishedPulling="2026-05-29 02:29:45.923033071 +0000 UTC m=+154.578040698" observedRunningTime="2026-05-29 02:29:46.409453747 +0000 UTC m=+155.064461382" watchObservedRunningTime="2026-05-29 02:29:46.41072356 +0000 UTC m=+155.065731197"
May 29 02:29:46.806998 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:46.806963    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:46.807163 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:46.807005    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-clzfb\" (UID: \"7d35785d-8d36-4c47-8655-e0cfe696cf7b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb"
May 29 02:29:46.807163 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:46.807030    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-metrics-certs\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:46.807163 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:46.807128    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 02:29:46.807299 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:46.807165    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle podName:b587765d-eae8-4167-8607-b87aadb21258 nodeName:}" failed. No retries permitted until 2026-05-29 02:29:50.80714363 +0000 UTC m=+159.462151250 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle") pod "router-default-f44c44d4b-x5cfm" (UID: "b587765d-eae8-4167-8607-b87aadb21258") : configmap references non-existent config key: service-ca.crt
May 29 02:29:46.807299 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:46.807194    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls podName:7d35785d-8d36-4c47-8655-e0cfe696cf7b nodeName:}" failed. No retries permitted until 2026-05-29 02:29:50.807184707 +0000 UTC m=+159.462192328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-clzfb" (UID: "7d35785d-8d36-4c47-8655-e0cfe696cf7b") : secret "cluster-monitoring-operator-tls" not found
May 29 02:29:46.807299 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:46.807132    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 29 02:29:46.807299 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:46.807238    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-metrics-certs podName:b587765d-eae8-4167-8607-b87aadb21258 nodeName:}" failed. No retries permitted until 2026-05-29 02:29:50.807226661 +0000 UTC m=+159.462234276 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-metrics-certs") pod "router-default-f44c44d4b-x5cfm" (UID: "b587765d-eae8-4167-8607-b87aadb21258") : secret "router-metrics-certs-default" not found
May 29 02:29:47.394648 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:47.394622    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/1.log"
May 29 02:29:47.395018 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:47.394953    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/0.log"
May 29 02:29:47.395018 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:47.394981    2573 generic.go:358] "Generic (PLEG): container finished" podID="423a6fd1-7473-4c55-b0cb-a208d404ce05" containerID="2479b6dc7fef43574bb2460a17889d1b805937b6b4e12bd1d00f5ae2ecc73060" exitCode=255
May 29 02:29:47.395098 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:47.395081    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-zqwt9" event={"ID":"423a6fd1-7473-4c55-b0cb-a208d404ce05","Type":"ContainerDied","Data":"2479b6dc7fef43574bb2460a17889d1b805937b6b4e12bd1d00f5ae2ecc73060"}
May 29 02:29:47.395141 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:47.395128    2573 scope.go:117] "RemoveContainer" containerID="5b644e80c4cd08e229e934fec28a0b5898c73091d53d3dcd30a25ed871c69d69"
May 29 02:29:47.395392 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:47.395372    2573 scope.go:117] "RemoveContainer" containerID="2479b6dc7fef43574bb2460a17889d1b805937b6b4e12bd1d00f5ae2ecc73060"
May 29 02:29:47.395567 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:47.395550    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-zqwt9_openshift-console-operator(423a6fd1-7473-4c55-b0cb-a208d404ce05)\"" pod="openshift-console-operator/console-operator-76dff48d59-zqwt9" podUID="423a6fd1-7473-4c55-b0cb-a208d404ce05"
May 29 02:29:48.220244 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:48.220193    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w" podUID="0a7061e3-3a99-4d53-ae20-0028a4950f5f"
May 29 02:29:48.231437 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:48.231403    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-7f87c8b546-gkppc" podUID="58da8892-cc4a-4ebf-9563-f23b950b7dd6"
May 29 02:29:48.241079 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:48.241051    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kl8vc" podUID="96254599-cc53-4384-9eca-b9bb8997cd02"
May 29 02:29:48.254244 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:48.254210    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-8hx9n" podUID="c4d7d603-050b-4d0e-9802-4ba8d0bc4baa"
May 29 02:29:48.398039 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:48.398013    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/1.log"
May 29 02:29:48.398514 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:48.398114    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8hx9n"
May 29 02:29:48.398514 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:48.398124    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"
May 29 02:29:48.398514 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:48.398190    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:29:48.398514 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:48.398400    2573 scope.go:117] "RemoveContainer" containerID="2479b6dc7fef43574bb2460a17889d1b805937b6b4e12bd1d00f5ae2ecc73060"
May 29 02:29:48.398514 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:48.398446    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kl8vc"
May 29 02:29:48.398796 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:48.398604    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-zqwt9_openshift-console-operator(423a6fd1-7473-4c55-b0cb-a208d404ce05)\"" pod="openshift-console-operator/console-operator-76dff48d59-zqwt9" podUID="423a6fd1-7473-4c55-b0cb-a208d404ce05"
May 29 02:29:49.990321 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:49.990271    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-bbj9n" podUID="f1c2fcb1-f203-4571-8cbe-eb01a190d63b"
May 29 02:29:50.097161 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.097119    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-599vs"]
May 29 02:29:50.101579 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.101559    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-599vs"
May 29 02:29:50.104397 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.104378    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
May 29 02:29:50.104508 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.104490    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
May 29 02:29:50.105675 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.105657    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
May 29 02:29:50.105864 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.105850    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-vdcd4\""
May 29 02:29:50.105938 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.105924    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
May 29 02:29:50.109792 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.109772    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-599vs"]
May 29 02:29:50.235662 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.235624    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzhdz\" (UniqueName: \"kubernetes.io/projected/b8024077-315e-4a14-94da-a2be1d179bee-kube-api-access-zzhdz\") pod \"service-ca-67d667c7d-599vs\" (UID: \"b8024077-315e-4a14-94da-a2be1d179bee\") " pod="openshift-service-ca/service-ca-67d667c7d-599vs"
May 29 02:29:50.235834 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.235677    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b8024077-315e-4a14-94da-a2be1d179bee-signing-cabundle\") pod \"service-ca-67d667c7d-599vs\" (UID: \"b8024077-315e-4a14-94da-a2be1d179bee\") " pod="openshift-service-ca/service-ca-67d667c7d-599vs"
May 29 02:29:50.235880 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.235844    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b8024077-315e-4a14-94da-a2be1d179bee-signing-key\") pod \"service-ca-67d667c7d-599vs\" (UID: \"b8024077-315e-4a14-94da-a2be1d179bee\") " pod="openshift-service-ca/service-ca-67d667c7d-599vs"
May 29 02:29:50.336823 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.336742    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b8024077-315e-4a14-94da-a2be1d179bee-signing-key\") pod \"service-ca-67d667c7d-599vs\" (UID: \"b8024077-315e-4a14-94da-a2be1d179bee\") " pod="openshift-service-ca/service-ca-67d667c7d-599vs"
May 29 02:29:50.336823 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.336775    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzhdz\" (UniqueName: \"kubernetes.io/projected/b8024077-315e-4a14-94da-a2be1d179bee-kube-api-access-zzhdz\") pod \"service-ca-67d667c7d-599vs\" (UID: \"b8024077-315e-4a14-94da-a2be1d179bee\") " pod="openshift-service-ca/service-ca-67d667c7d-599vs"
May 29 02:29:50.336823 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.336806    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b8024077-315e-4a14-94da-a2be1d179bee-signing-cabundle\") pod \"service-ca-67d667c7d-599vs\" (UID: \"b8024077-315e-4a14-94da-a2be1d179bee\") " pod="openshift-service-ca/service-ca-67d667c7d-599vs"
May 29 02:29:50.337498 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.337477    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b8024077-315e-4a14-94da-a2be1d179bee-signing-cabundle\") pod \"service-ca-67d667c7d-599vs\" (UID: \"b8024077-315e-4a14-94da-a2be1d179bee\") " pod="openshift-service-ca/service-ca-67d667c7d-599vs"
May 29 02:29:50.339148 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.339125    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b8024077-315e-4a14-94da-a2be1d179bee-signing-key\") pod \"service-ca-67d667c7d-599vs\" (UID: \"b8024077-315e-4a14-94da-a2be1d179bee\") " pod="openshift-service-ca/service-ca-67d667c7d-599vs"
May 29 02:29:50.350186 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.350161    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzhdz\" (UniqueName: \"kubernetes.io/projected/b8024077-315e-4a14-94da-a2be1d179bee-kube-api-access-zzhdz\") pod \"service-ca-67d667c7d-599vs\" (UID: \"b8024077-315e-4a14-94da-a2be1d179bee\") " pod="openshift-service-ca/service-ca-67d667c7d-599vs"
May 29 02:29:50.410907 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.410884    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-67d667c7d-599vs"
May 29 02:29:50.517838 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.517815    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2r9s2_a6499ac1-a799-4692-894c-b3f1bf59b369/dns-node-resolver/0.log"
May 29 02:29:50.528713 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.528693    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-67d667c7d-599vs"]
May 29 02:29:50.530945 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:29:50.530918    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8024077_315e_4a14_94da_a2be1d179bee.slice/crio-9d209a895839593e116daa2c595ee8a87517e369c1ec64324bb909e79d4dbb45 WatchSource:0}: Error finding container 9d209a895839593e116daa2c595ee8a87517e369c1ec64324bb909e79d4dbb45: Status 404 returned error can't find the container with id 9d209a895839593e116daa2c595ee8a87517e369c1ec64324bb909e79d4dbb45
May 29 02:29:50.841642 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.841599    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:50.841851 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.841653    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-clzfb\" (UID: \"7d35785d-8d36-4c47-8655-e0cfe696cf7b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb"
May 29 02:29:50.841851 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:50.841686    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-metrics-certs\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:50.841851 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:50.841766    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle podName:b587765d-eae8-4167-8607-b87aadb21258 nodeName:}" failed. No retries permitted until 2026-05-29 02:29:58.841748824 +0000 UTC m=+167.496756438 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle") pod "router-default-f44c44d4b-x5cfm" (UID: "b587765d-eae8-4167-8607-b87aadb21258") : configmap references non-existent config key: service-ca.crt
May 29 02:29:50.841851 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:50.841813    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 02:29:50.842027 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:50.841865    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls podName:7d35785d-8d36-4c47-8655-e0cfe696cf7b nodeName:}" failed. No retries permitted until 2026-05-29 02:29:58.841852022 +0000 UTC m=+167.496859636 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-clzfb" (UID: "7d35785d-8d36-4c47-8655-e0cfe696cf7b") : secret "cluster-monitoring-operator-tls" not found
May 29 02:29:50.842027 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:50.841813    2573 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
May 29 02:29:50.842027 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:50.841897    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-metrics-certs podName:b587765d-eae8-4167-8607-b87aadb21258 nodeName:}" failed. No retries permitted until 2026-05-29 02:29:58.841889705 +0000 UTC m=+167.496897319 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-metrics-certs") pod "router-default-f44c44d4b-x5cfm" (UID: "b587765d-eae8-4167-8607-b87aadb21258") : secret "router-metrics-certs-default" not found
May 29 02:29:51.405024 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:51.404992    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-599vs" event={"ID":"b8024077-315e-4a14-94da-a2be1d179bee","Type":"ContainerStarted","Data":"9d209a895839593e116daa2c595ee8a87517e369c1ec64324bb909e79d4dbb45"}
May 29 02:29:51.717105 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:51.717081    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jtmf8_5fe35eb0-68ad-495c-b79a-a899da141e77/node-ca/0.log"
May 29 02:29:52.408375 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:52.408340    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-67d667c7d-599vs" event={"ID":"b8024077-315e-4a14-94da-a2be1d179bee","Type":"ContainerStarted","Data":"58a5a0cb7f0af5a531f893dad1926ce9053b18d99cafef7d0ad790e79da1ba1a"}
May 29 02:29:52.428612 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:52.428528    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-67d667c7d-599vs" podStartSLOduration=0.792927945 podStartE2EDuration="2.428514133s" podCreationTimestamp="2026-05-29 02:29:50 +0000 UTC" firstStartedPulling="2026-05-29 02:29:50.532563095 +0000 UTC m=+159.187570709" lastFinishedPulling="2026-05-29 02:29:52.16814927 +0000 UTC m=+160.823156897" observedRunningTime="2026-05-29 02:29:52.427204787 +0000 UTC m=+161.082212423" watchObservedRunningTime="2026-05-29 02:29:52.428514133 +0000 UTC m=+161.083521768"
May 29 02:29:53.163020 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:53.162979    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls\") pod \"image-registry-7f87c8b546-gkppc\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") " pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:29:53.163201 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:53.163029    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:29:53.163201 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:53.163053    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nw69w\" (UID: \"0a7061e3-3a99-4d53-ae20-0028a4950f5f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"
May 29 02:29:53.163201 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:53.163082    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert\") pod \"ingress-canary-8hx9n\" (UID: \"c4d7d603-050b-4d0e-9802-4ba8d0bc4baa\") " pod="openshift-ingress-canary/ingress-canary-8hx9n"
May 29 02:29:53.163201 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:53.163160    2573 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
May 29 02:29:53.163201 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:53.163177    2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
May 29 02:29:53.163201 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:53.163189    2573 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7f87c8b546-gkppc: secret "image-registry-tls" not found
May 29 02:29:53.163419 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:53.163171    2573 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
May 29 02:29:53.163419 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:53.163171    2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
May 29 02:29:53.163419 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:53.163284    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls podName:96254599-cc53-4384-9eca-b9bb8997cd02 nodeName:}" failed. No retries permitted until 2026-05-29 02:31:55.163241775 +0000 UTC m=+283.818249392 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls") pod "dns-default-kl8vc" (UID: "96254599-cc53-4384-9eca-b9bb8997cd02") : secret "dns-default-metrics-tls" not found
May 29 02:29:53.163419 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:53.163299    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls podName:58da8892-cc4a-4ebf-9563-f23b950b7dd6 nodeName:}" failed. No retries permitted until 2026-05-29 02:31:55.163293413 +0000 UTC m=+283.818301026 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls") pod "image-registry-7f87c8b546-gkppc" (UID: "58da8892-cc4a-4ebf-9563-f23b950b7dd6") : secret "image-registry-tls" not found
May 29 02:29:53.163419 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:53.163374    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert podName:c4d7d603-050b-4d0e-9802-4ba8d0bc4baa nodeName:}" failed. No retries permitted until 2026-05-29 02:31:55.163368098 +0000 UTC m=+283.818375712 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert") pod "ingress-canary-8hx9n" (UID: "c4d7d603-050b-4d0e-9802-4ba8d0bc4baa") : secret "canary-serving-cert" not found
May 29 02:29:53.163419 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:53.163387    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert podName:0a7061e3-3a99-4d53-ae20-0028a4950f5f nodeName:}" failed. No retries permitted until 2026-05-29 02:31:55.163381261 +0000 UTC m=+283.818388876 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert") pod "networking-console-plugin-d4d8f94f9-nw69w" (UID: "0a7061e3-3a99-4d53-ae20-0028a4950f5f") : secret "networking-console-plugin-cert" not found
May 29 02:29:53.483770 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:53.483734    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-zqwt9"
May 29 02:29:53.484249 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:53.483780    2573 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-zqwt9"
May 29 02:29:53.484249 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:53.484206    2573 scope.go:117] "RemoveContainer" containerID="2479b6dc7fef43574bb2460a17889d1b805937b6b4e12bd1d00f5ae2ecc73060"
May 29 02:29:53.484469 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:53.484446    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-76dff48d59-zqwt9_openshift-console-operator(423a6fd1-7473-4c55-b0cb-a208d404ce05)\"" pod="openshift-console-operator/console-operator-76dff48d59-zqwt9" podUID="423a6fd1-7473-4c55-b0cb-a208d404ce05"
May 29 02:29:58.911963 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:58.911924    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:58.911963 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:58.911968    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-clzfb\" (UID: \"7d35785d-8d36-4c47-8655-e0cfe696cf7b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb"
May 29 02:29:58.912409 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:58.912001    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-metrics-certs\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:29:58.912409 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:58.912098    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle podName:b587765d-eae8-4167-8607-b87aadb21258 nodeName:}" failed. No retries permitted until 2026-05-29 02:30:14.912079145 +0000 UTC m=+183.567086767 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle") pod "router-default-f44c44d4b-x5cfm" (UID: "b587765d-eae8-4167-8607-b87aadb21258") : configmap references non-existent config key: service-ca.crt
May 29 02:29:58.912409 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:58.912139    2573 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
May 29 02:29:58.912409 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:29:58.912210    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls podName:7d35785d-8d36-4c47-8655-e0cfe696cf7b nodeName:}" failed. No retries permitted until 2026-05-29 02:30:14.91219377 +0000 UTC m=+183.567201396 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-6c75959455-clzfb" (UID: "7d35785d-8d36-4c47-8655-e0cfe696cf7b") : secret "cluster-monitoring-operator-tls" not found
May 29 02:29:58.914364 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:29:58.914346    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b587765d-eae8-4167-8607-b87aadb21258-metrics-certs\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:30:03.967336 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:03.967237    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:30:08.967595 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:08.967563    2573 scope.go:117] "RemoveContainer" containerID="2479b6dc7fef43574bb2460a17889d1b805937b6b4e12bd1d00f5ae2ecc73060"
May 29 02:30:09.450070 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:09.450047    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/2.log"
May 29 02:30:09.450431 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:09.450416    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/1.log"
May 29 02:30:09.450489 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:09.450448    2573 generic.go:358] "Generic (PLEG): container finished" podID="423a6fd1-7473-4c55-b0cb-a208d404ce05" containerID="2912fe51ece9606ba0f50b9157469e77670a063145be7cff3250aebdad786389" exitCode=255
May 29 02:30:09.450489 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:09.450473    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-zqwt9" event={"ID":"423a6fd1-7473-4c55-b0cb-a208d404ce05","Type":"ContainerDied","Data":"2912fe51ece9606ba0f50b9157469e77670a063145be7cff3250aebdad786389"}
May 29 02:30:09.450566 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:09.450500    2573 scope.go:117] "RemoveContainer" containerID="2479b6dc7fef43574bb2460a17889d1b805937b6b4e12bd1d00f5ae2ecc73060"
May 29 02:30:09.450807 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:09.450790    2573 scope.go:117] "RemoveContainer" containerID="2912fe51ece9606ba0f50b9157469e77670a063145be7cff3250aebdad786389"
May 29 02:30:09.450975 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:30:09.450959    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-zqwt9_openshift-console-operator(423a6fd1-7473-4c55-b0cb-a208d404ce05)\"" pod="openshift-console-operator/console-operator-76dff48d59-zqwt9" podUID="423a6fd1-7473-4c55-b0cb-a208d404ce05"
May 29 02:30:10.454807 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:10.454780    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/2.log"
May 29 02:30:13.484136 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:13.484092    2573 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-76dff48d59-zqwt9"
May 29 02:30:13.484136 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:13.484140    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-zqwt9"
May 29 02:30:13.484577 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:13.484483    2573 scope.go:117] "RemoveContainer" containerID="2912fe51ece9606ba0f50b9157469e77670a063145be7cff3250aebdad786389"
May 29 02:30:13.484658 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:30:13.484641    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-zqwt9_openshift-console-operator(423a6fd1-7473-4c55-b0cb-a208d404ce05)\"" pod="openshift-console-operator/console-operator-76dff48d59-zqwt9" podUID="423a6fd1-7473-4c55-b0cb-a208d404ce05"
May 29 02:30:14.225994 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.225962    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kwt22"]
May 29 02:30:14.232075 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.232047    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kwt22"
May 29 02:30:14.235034 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.235016    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
May 29 02:30:14.236198 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.236175    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-zxmms\""
May 29 02:30:14.236198 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.236192    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
May 29 02:30:14.244914 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.244894    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kwt22"]
May 29 02:30:14.332409 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.332386    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5dec045a-2f57-4041-92fe-be3ca951ba85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kwt22\" (UID: \"5dec045a-2f57-4041-92fe-be3ca951ba85\") " pod="openshift-insights/insights-runtime-extractor-kwt22"
May 29 02:30:14.332492 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.332416    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nthkm\" (UniqueName: \"kubernetes.io/projected/5dec045a-2f57-4041-92fe-be3ca951ba85-kube-api-access-nthkm\") pod \"insights-runtime-extractor-kwt22\" (UID: \"5dec045a-2f57-4041-92fe-be3ca951ba85\") " pod="openshift-insights/insights-runtime-extractor-kwt22"
May 29 02:30:14.332492 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.332478    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5dec045a-2f57-4041-92fe-be3ca951ba85-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kwt22\" (UID: \"5dec045a-2f57-4041-92fe-be3ca951ba85\") " pod="openshift-insights/insights-runtime-extractor-kwt22"
May 29 02:30:14.332559 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.332528    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5dec045a-2f57-4041-92fe-be3ca951ba85-data-volume\") pod \"insights-runtime-extractor-kwt22\" (UID: \"5dec045a-2f57-4041-92fe-be3ca951ba85\") " pod="openshift-insights/insights-runtime-extractor-kwt22"
May 29 02:30:14.332592 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.332575    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5dec045a-2f57-4041-92fe-be3ca951ba85-crio-socket\") pod \"insights-runtime-extractor-kwt22\" (UID: \"5dec045a-2f57-4041-92fe-be3ca951ba85\") " pod="openshift-insights/insights-runtime-extractor-kwt22"
May 29 02:30:14.433044 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.433021    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5dec045a-2f57-4041-92fe-be3ca951ba85-crio-socket\") pod \"insights-runtime-extractor-kwt22\" (UID: \"5dec045a-2f57-4041-92fe-be3ca951ba85\") " pod="openshift-insights/insights-runtime-extractor-kwt22"
May 29 02:30:14.433137 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.433052    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5dec045a-2f57-4041-92fe-be3ca951ba85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kwt22\" (UID: \"5dec045a-2f57-4041-92fe-be3ca951ba85\") " pod="openshift-insights/insights-runtime-extractor-kwt22"
May 29 02:30:14.433137 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.433080    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nthkm\" (UniqueName: \"kubernetes.io/projected/5dec045a-2f57-4041-92fe-be3ca951ba85-kube-api-access-nthkm\") pod \"insights-runtime-extractor-kwt22\" (UID: \"5dec045a-2f57-4041-92fe-be3ca951ba85\") " pod="openshift-insights/insights-runtime-extractor-kwt22"
May 29 02:30:14.433137 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.433131    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5dec045a-2f57-4041-92fe-be3ca951ba85-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kwt22\" (UID: \"5dec045a-2f57-4041-92fe-be3ca951ba85\") " pod="openshift-insights/insights-runtime-extractor-kwt22"
May 29 02:30:14.433237 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.433136    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/5dec045a-2f57-4041-92fe-be3ca951ba85-crio-socket\") pod \"insights-runtime-extractor-kwt22\" (UID: \"5dec045a-2f57-4041-92fe-be3ca951ba85\") " pod="openshift-insights/insights-runtime-extractor-kwt22"
May 29 02:30:14.433237 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.433188    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5dec045a-2f57-4041-92fe-be3ca951ba85-data-volume\") pod \"insights-runtime-extractor-kwt22\" (UID: \"5dec045a-2f57-4041-92fe-be3ca951ba85\") " pod="openshift-insights/insights-runtime-extractor-kwt22"
May 29 02:30:14.433499 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.433471    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/5dec045a-2f57-4041-92fe-be3ca951ba85-data-volume\") pod \"insights-runtime-extractor-kwt22\" (UID: \"5dec045a-2f57-4041-92fe-be3ca951ba85\") " pod="openshift-insights/insights-runtime-extractor-kwt22"
May 29 02:30:14.433746 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.433726    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/5dec045a-2f57-4041-92fe-be3ca951ba85-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kwt22\" (UID: \"5dec045a-2f57-4041-92fe-be3ca951ba85\") " pod="openshift-insights/insights-runtime-extractor-kwt22"
May 29 02:30:14.435467 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.435440    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/5dec045a-2f57-4041-92fe-be3ca951ba85-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kwt22\" (UID: \"5dec045a-2f57-4041-92fe-be3ca951ba85\") " pod="openshift-insights/insights-runtime-extractor-kwt22"
May 29 02:30:14.446786 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.446765    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nthkm\" (UniqueName: \"kubernetes.io/projected/5dec045a-2f57-4041-92fe-be3ca951ba85-kube-api-access-nthkm\") pod \"insights-runtime-extractor-kwt22\" (UID: \"5dec045a-2f57-4041-92fe-be3ca951ba85\") " pod="openshift-insights/insights-runtime-extractor-kwt22"
May 29 02:30:14.541023 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.540957    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kwt22"
May 29 02:30:14.663592 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.663565    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kwt22"]
May 29 02:30:14.666784 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:30:14.666761    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dec045a_2f57_4041_92fe_be3ca951ba85.slice/crio-880fa0ba18c38ebb57abce568474a4e620c4ede4fce785885263e079f80befd3 WatchSource:0}: Error finding container 880fa0ba18c38ebb57abce568474a4e620c4ede4fce785885263e079f80befd3: Status 404 returned error can't find the container with id 880fa0ba18c38ebb57abce568474a4e620c4ede4fce785885263e079f80befd3
May 29 02:30:14.936522 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.936495    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:30:14.936653 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.936536    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-clzfb\" (UID: \"7d35785d-8d36-4c47-8655-e0cfe696cf7b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb"
May 29 02:30:14.937076 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.937055    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b587765d-eae8-4167-8607-b87aadb21258-service-ca-bundle\") pod \"router-default-f44c44d4b-x5cfm\" (UID: \"b587765d-eae8-4167-8607-b87aadb21258\") " pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:30:14.938703 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:14.938685    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/7d35785d-8d36-4c47-8655-e0cfe696cf7b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-6c75959455-clzfb\" (UID: \"7d35785d-8d36-4c47-8655-e0cfe696cf7b\") " pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb"
May 29 02:30:15.180190 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:15.180161    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-r748c\""
May 29 02:30:15.183800 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:15.183776    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-rzwnb\""
May 29 02:30:15.187956 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:15.187909    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb"
May 29 02:30:15.191560 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:15.191533    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:30:15.355608 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:15.355583    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb"]
May 29 02:30:15.357762 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:30:15.357738    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d35785d_8d36_4c47_8655_e0cfe696cf7b.slice/crio-e6418fc81eed4d7b2a59a69f9982dc4f0b66f14fd452e15572c4711024ecb815 WatchSource:0}: Error finding container e6418fc81eed4d7b2a59a69f9982dc4f0b66f14fd452e15572c4711024ecb815: Status 404 returned error can't find the container with id e6418fc81eed4d7b2a59a69f9982dc4f0b66f14fd452e15572c4711024ecb815
May 29 02:30:15.372810 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:15.372778    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-f44c44d4b-x5cfm"]
May 29 02:30:15.376449 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:30:15.376425    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb587765d_eae8_4167_8607_b87aadb21258.slice/crio-ed1625bf17e2ed6975d333800e87573d853a8466a25a961d29dd2a02b577ac2e WatchSource:0}: Error finding container ed1625bf17e2ed6975d333800e87573d853a8466a25a961d29dd2a02b577ac2e: Status 404 returned error can't find the container with id ed1625bf17e2ed6975d333800e87573d853a8466a25a961d29dd2a02b577ac2e
May 29 02:30:15.468564 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:15.468466    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb" event={"ID":"7d35785d-8d36-4c47-8655-e0cfe696cf7b","Type":"ContainerStarted","Data":"e6418fc81eed4d7b2a59a69f9982dc4f0b66f14fd452e15572c4711024ecb815"}
May 29 02:30:15.470555 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:15.470530    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kwt22" event={"ID":"5dec045a-2f57-4041-92fe-be3ca951ba85","Type":"ContainerStarted","Data":"10b832d62eb43d568eb1ceb2bae22bfc88edf8b37c710f3185e879915b76f714"}
May 29 02:30:15.470752 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:15.470561    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kwt22" event={"ID":"5dec045a-2f57-4041-92fe-be3ca951ba85","Type":"ContainerStarted","Data":"255ed20c74232648716aa558ffda1d86f3cdb3a656fa0a1cf6c842e10b69145a"}
May 29 02:30:15.470752 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:15.470576    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kwt22" event={"ID":"5dec045a-2f57-4041-92fe-be3ca951ba85","Type":"ContainerStarted","Data":"880fa0ba18c38ebb57abce568474a4e620c4ede4fce785885263e079f80befd3"}
May 29 02:30:15.471921 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:15.471899    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f44c44d4b-x5cfm" event={"ID":"b587765d-eae8-4167-8607-b87aadb21258","Type":"ContainerStarted","Data":"23e5c6442c669078f88a1b61db860eddc38d355b4e767dd5e3029121b3923cdf"}
May 29 02:30:15.472019 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:15.471925    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-f44c44d4b-x5cfm" event={"ID":"b587765d-eae8-4167-8607-b87aadb21258","Type":"ContainerStarted","Data":"ed1625bf17e2ed6975d333800e87573d853a8466a25a961d29dd2a02b577ac2e"}
May 29 02:30:15.491490 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:15.491443    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-f44c44d4b-x5cfm" podStartSLOduration=32.491432581 podStartE2EDuration="32.491432581s" podCreationTimestamp="2026-05-29 02:29:43 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:30:15.490019768 +0000 UTC m=+184.145027404" watchObservedRunningTime="2026-05-29 02:30:15.491432581 +0000 UTC m=+184.146440216"
May 29 02:30:16.192276 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:16.192205    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:30:16.194972 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:16.194948    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:30:16.475555 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:16.475404    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:30:16.477071 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:16.477043    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-f44c44d4b-x5cfm"
May 29 02:30:17.478984 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:17.478949    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kwt22" event={"ID":"5dec045a-2f57-4041-92fe-be3ca951ba85","Type":"ContainerStarted","Data":"1ab876b408abbddfef63086210ea67f10d3031882dff6651742ac99d659e582d"}
May 29 02:30:17.497403 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:17.497354    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kwt22" podStartSLOduration=1.5528 podStartE2EDuration="3.497337095s" podCreationTimestamp="2026-05-29 02:30:14 +0000 UTC" firstStartedPulling="2026-05-29 02:30:14.722997086 +0000 UTC m=+183.378004701" lastFinishedPulling="2026-05-29 02:30:16.667534163 +0000 UTC m=+185.322541796" observedRunningTime="2026-05-29 02:30:17.496710907 +0000 UTC m=+186.151718545" watchObservedRunningTime="2026-05-29 02:30:17.497337095 +0000 UTC m=+186.152344731"
May 29 02:30:18.001006 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:18.000974    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-47ltn"]
May 29 02:30:18.003925 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:18.003905    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-47ltn"
May 29 02:30:18.006656 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:18.006637    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-x5f7r\""
May 29 02:30:18.006916 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:18.006901    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
May 29 02:30:18.014787 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:18.014766    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-47ltn"]
May 29 02:30:18.164702 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:18.164662    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9ccc016d-cb96-43d8-9bfc-dce0cb8b8203-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-47ltn\" (UID: \"9ccc016d-cb96-43d8-9bfc-dce0cb8b8203\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-47ltn"
May 29 02:30:18.265875 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:18.265793    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9ccc016d-cb96-43d8-9bfc-dce0cb8b8203-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-47ltn\" (UID: \"9ccc016d-cb96-43d8-9bfc-dce0cb8b8203\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-47ltn"
May 29 02:30:18.268145 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:18.268117    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/9ccc016d-cb96-43d8-9bfc-dce0cb8b8203-tls-certificates\") pod \"prometheus-operator-admission-webhook-6c4bbc67b7-47ltn\" (UID: \"9ccc016d-cb96-43d8-9bfc-dce0cb8b8203\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-47ltn"
May 29 02:30:18.315196 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:18.315159    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-47ltn"
May 29 02:30:18.439291 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:18.439245    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-47ltn"]
May 29 02:30:18.442147 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:30:18.442119    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ccc016d_cb96_43d8_9bfc_dce0cb8b8203.slice/crio-ca0505816603a2e8a99834370ece072e770c66bb789f442722ecbd39bc5121a2 WatchSource:0}: Error finding container ca0505816603a2e8a99834370ece072e770c66bb789f442722ecbd39bc5121a2: Status 404 returned error can't find the container with id ca0505816603a2e8a99834370ece072e770c66bb789f442722ecbd39bc5121a2
May 29 02:30:18.482758 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:18.482720    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-47ltn" event={"ID":"9ccc016d-cb96-43d8-9bfc-dce0cb8b8203","Type":"ContainerStarted","Data":"ca0505816603a2e8a99834370ece072e770c66bb789f442722ecbd39bc5121a2"}
May 29 02:30:18.483973 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:18.483942    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb" event={"ID":"7d35785d-8d36-4c47-8655-e0cfe696cf7b","Type":"ContainerStarted","Data":"3c0557885309616a5a72a0998a5f69718e4dcd88e5c0f8673c797c0984b4be59"}
May 29 02:30:18.507216 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:18.507174    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-6c75959455-clzfb" podStartSLOduration=33.354746816 podStartE2EDuration="35.507161468s" podCreationTimestamp="2026-05-29 02:29:43 +0000 UTC" firstStartedPulling="2026-05-29 02:30:15.35955064 +0000 UTC m=+184.014558255" lastFinishedPulling="2026-05-29 02:30:17.51196529 +0000 UTC m=+186.166972907" observedRunningTime="2026-05-29 02:30:18.506807471 +0000 UTC m=+187.161815108" watchObservedRunningTime="2026-05-29 02:30:18.507161468 +0000 UTC m=+187.162169103"
May 29 02:30:19.488462 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:19.488428    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-47ltn" event={"ID":"9ccc016d-cb96-43d8-9bfc-dce0cb8b8203","Type":"ContainerStarted","Data":"1b5607bf9528fb6efd66c92969daf7d2fe33b6f50cde596fbc44ad819dcdf449"}
May 29 02:30:19.511725 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:19.511682    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-47ltn" podStartSLOduration=1.542399825 podStartE2EDuration="2.511668655s" podCreationTimestamp="2026-05-29 02:30:17 +0000 UTC" firstStartedPulling="2026-05-29 02:30:18.444049804 +0000 UTC m=+187.099057417" lastFinishedPulling="2026-05-29 02:30:19.413318632 +0000 UTC m=+188.068326247" observedRunningTime="2026-05-29 02:30:19.510557786 +0000 UTC m=+188.165565421" watchObservedRunningTime="2026-05-29 02:30:19.511668655 +0000 UTC m=+188.166676327"
May 29 02:30:20.490882 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:20.490836    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-47ltn"
May 29 02:30:20.495358 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:20.495334    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-6c4bbc67b7-47ltn"
May 29 02:30:21.076773 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.076736    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr"]
May 29 02:30:21.078821 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.078801    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr"
May 29 02:30:21.082774 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.082749    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
May 29 02:30:21.082774 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.082762    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
May 29 02:30:21.082946 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.082757    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
May 29 02:30:21.082946 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.082801    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-hl87z\""
May 29 02:30:21.087712 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.087691    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3945858-9d12-4843-a5fd-6867f525486a-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-fdzfr\" (UID: \"b3945858-9d12-4843-a5fd-6867f525486a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr"
May 29 02:30:21.087824 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.087756    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-77pbs\" (UniqueName: \"kubernetes.io/projected/b3945858-9d12-4843-a5fd-6867f525486a-kube-api-access-77pbs\") pod \"prometheus-operator-7779bbdd78-fdzfr\" (UID: \"b3945858-9d12-4843-a5fd-6867f525486a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr"
May 29 02:30:21.087896 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.087831    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3945858-9d12-4843-a5fd-6867f525486a-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-fdzfr\" (UID: \"b3945858-9d12-4843-a5fd-6867f525486a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr"
May 29 02:30:21.087955 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.087917    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3945858-9d12-4843-a5fd-6867f525486a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-fdzfr\" (UID: \"b3945858-9d12-4843-a5fd-6867f525486a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr"
May 29 02:30:21.089322 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.089301    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr"]
May 29 02:30:21.189329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.189286    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3945858-9d12-4843-a5fd-6867f525486a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-fdzfr\" (UID: \"b3945858-9d12-4843-a5fd-6867f525486a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr"
May 29 02:30:21.189531 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.189340    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3945858-9d12-4843-a5fd-6867f525486a-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-fdzfr\" (UID: \"b3945858-9d12-4843-a5fd-6867f525486a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr"
May 29 02:30:21.189531 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.189426    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-77pbs\" (UniqueName: \"kubernetes.io/projected/b3945858-9d12-4843-a5fd-6867f525486a-kube-api-access-77pbs\") pod \"prometheus-operator-7779bbdd78-fdzfr\" (UID: \"b3945858-9d12-4843-a5fd-6867f525486a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr"
May 29 02:30:21.189531 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.189463    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3945858-9d12-4843-a5fd-6867f525486a-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-fdzfr\" (UID: \"b3945858-9d12-4843-a5fd-6867f525486a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr"
May 29 02:30:21.189691 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:30:21.189584    2573 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
May 29 02:30:21.189691 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:30:21.189666    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b3945858-9d12-4843-a5fd-6867f525486a-prometheus-operator-tls podName:b3945858-9d12-4843-a5fd-6867f525486a nodeName:}" failed. No retries permitted until 2026-05-29 02:30:21.68964625 +0000 UTC m=+190.344653865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/b3945858-9d12-4843-a5fd-6867f525486a-prometheus-operator-tls") pod "prometheus-operator-7779bbdd78-fdzfr" (UID: "b3945858-9d12-4843-a5fd-6867f525486a") : secret "prometheus-operator-tls" not found
May 29 02:30:21.190132 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.190113    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b3945858-9d12-4843-a5fd-6867f525486a-metrics-client-ca\") pod \"prometheus-operator-7779bbdd78-fdzfr\" (UID: \"b3945858-9d12-4843-a5fd-6867f525486a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr"
May 29 02:30:21.191769 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.191752    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b3945858-9d12-4843-a5fd-6867f525486a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7779bbdd78-fdzfr\" (UID: \"b3945858-9d12-4843-a5fd-6867f525486a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr"
May 29 02:30:21.198782 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.198757    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-77pbs\" (UniqueName: \"kubernetes.io/projected/b3945858-9d12-4843-a5fd-6867f525486a-kube-api-access-77pbs\") pod \"prometheus-operator-7779bbdd78-fdzfr\" (UID: \"b3945858-9d12-4843-a5fd-6867f525486a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr"
May 29 02:30:21.693148 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.693098    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3945858-9d12-4843-a5fd-6867f525486a-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-fdzfr\" (UID: \"b3945858-9d12-4843-a5fd-6867f525486a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr"
May 29 02:30:21.695520 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.695488    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b3945858-9d12-4843-a5fd-6867f525486a-prometheus-operator-tls\") pod \"prometheus-operator-7779bbdd78-fdzfr\" (UID: \"b3945858-9d12-4843-a5fd-6867f525486a\") " pod="openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr"
May 29 02:30:21.989706 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:21.989600    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr"
May 29 02:30:22.118150 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:22.118096    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr"]
May 29 02:30:22.121618 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:30:22.121575    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3945858_9d12_4843_a5fd_6867f525486a.slice/crio-1e92267441190a05f8a2984334a9e8fcd2081979cc6f23645d1dd2c066b4d4d5 WatchSource:0}: Error finding container 1e92267441190a05f8a2984334a9e8fcd2081979cc6f23645d1dd2c066b4d4d5: Status 404 returned error can't find the container with id 1e92267441190a05f8a2984334a9e8fcd2081979cc6f23645d1dd2c066b4d4d5
May 29 02:30:22.496170 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:22.496132    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr" event={"ID":"b3945858-9d12-4843-a5fd-6867f525486a","Type":"ContainerStarted","Data":"1e92267441190a05f8a2984334a9e8fcd2081979cc6f23645d1dd2c066b4d4d5"}
May 29 02:30:23.500168 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:23.500130    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr" event={"ID":"b3945858-9d12-4843-a5fd-6867f525486a","Type":"ContainerStarted","Data":"303ef5162497eea7b859c0a9aa0356b1a430deb6c16d92b174b53c8fe6e4a8e3"}
May 29 02:30:23.500168 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:23.500169    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr" event={"ID":"b3945858-9d12-4843-a5fd-6867f525486a","Type":"ContainerStarted","Data":"55bc4a7deccb0b856d08739967465d77a7a5bd656b274abbc882a3cef350ec3b"}
May 29 02:30:23.518904 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:23.518852    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7779bbdd78-fdzfr" podStartSLOduration=1.370592802 podStartE2EDuration="2.518837144s" podCreationTimestamp="2026-05-29 02:30:21 +0000 UTC" firstStartedPulling="2026-05-29 02:30:22.123476102 +0000 UTC m=+190.778483716" lastFinishedPulling="2026-05-29 02:30:23.271720441 +0000 UTC m=+191.926728058" observedRunningTime="2026-05-29 02:30:23.516615343 +0000 UTC m=+192.171622979" watchObservedRunningTime="2026-05-29 02:30:23.518837144 +0000 UTC m=+192.173844779"
May 29 02:30:24.967223 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:24.967192    2573 scope.go:117] "RemoveContainer" containerID="2912fe51ece9606ba0f50b9157469e77670a063145be7cff3250aebdad786389"
May 29 02:30:24.967636 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:30:24.967389    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-76dff48d59-zqwt9_openshift-console-operator(423a6fd1-7473-4c55-b0cb-a208d404ce05)\"" pod="openshift-console-operator/console-operator-76dff48d59-zqwt9" podUID="423a6fd1-7473-4c55-b0cb-a208d404ce05"
May 29 02:30:25.477779 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.477746    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t"]
May 29 02:30:25.481427 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.481404    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t"
May 29 02:30:25.485676 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.485658    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-g2fvj\""
May 29 02:30:25.485887 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.485860    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
May 29 02:30:25.486010 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.485849    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
May 29 02:30:25.495232 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.495206    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"]
May 29 02:30:25.498564 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.498538    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t"]
May 29 02:30:25.498707 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.498690    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:25.501697 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.501672    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
May 29 02:30:25.501899 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.501874    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-7ccl5\""
May 29 02:30:25.502115 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.501888    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
May 29 02:30:25.502217 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.501965    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
May 29 02:30:25.515413 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.515387    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2dcr7"]
May 29 02:30:25.518989 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.518965    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"]
May 29 02:30:25.519118 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.519102    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.522100 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.522051    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-jnhk2\""
May 29 02:30:25.527486 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.525358    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cf497186-1c25-4339-92ec-3876c3a21670-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-9qp67\" (UID: \"cf497186-1c25-4339-92ec-3876c3a21670\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:25.527486 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.525410    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cf497186-1c25-4339-92ec-3876c3a21670-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-9qp67\" (UID: \"cf497186-1c25-4339-92ec-3876c3a21670\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:25.527486 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.525456    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64b8bbff-426f-4708-8161-974b20ad89ae-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-4xj5t\" (UID: \"64b8bbff-426f-4708-8161-974b20ad89ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t"
May 29 02:30:25.527486 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.525524    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57pk8\" (UniqueName: \"kubernetes.io/projected/cf497186-1c25-4339-92ec-3876c3a21670-kube-api-access-57pk8\") pod \"kube-state-metrics-54fd6bc5c4-9qp67\" (UID: \"cf497186-1c25-4339-92ec-3876c3a21670\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:25.527486 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.525560    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf497186-1c25-4339-92ec-3876c3a21670-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-9qp67\" (UID: \"cf497186-1c25-4339-92ec-3876c3a21670\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:25.527486 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.525607    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v796j\" (UniqueName: \"kubernetes.io/projected/64b8bbff-426f-4708-8161-974b20ad89ae-kube-api-access-v796j\") pod \"openshift-state-metrics-9c959559f-4xj5t\" (UID: \"64b8bbff-426f-4708-8161-974b20ad89ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t"
May 29 02:30:25.527486 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.525646    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64b8bbff-426f-4708-8161-974b20ad89ae-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-4xj5t\" (UID: \"64b8bbff-426f-4708-8161-974b20ad89ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t"
May 29 02:30:25.527486 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.525676    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf497186-1c25-4339-92ec-3876c3a21670-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-9qp67\" (UID: \"cf497186-1c25-4339-92ec-3876c3a21670\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:25.527486 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.525731    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf497186-1c25-4339-92ec-3876c3a21670-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-9qp67\" (UID: \"cf497186-1c25-4339-92ec-3876c3a21670\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:25.527486 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.525808    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/64b8bbff-426f-4708-8161-974b20ad89ae-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-4xj5t\" (UID: \"64b8bbff-426f-4708-8161-974b20ad89ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t"
May 29 02:30:25.528021 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.527499    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
May 29 02:30:25.528021 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.527633    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
May 29 02:30:25.528021 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.527691    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
May 29 02:30:25.626522 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.626488    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ef1449d9-a5ab-4829-8011-ea387bb155a8-node-exporter-textfile\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.626522 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.626523    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ef1449d9-a5ab-4829-8011-ea387bb155a8-node-exporter-wtmp\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.626786 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.626543    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ef1449d9-a5ab-4829-8011-ea387bb155a8-node-exporter-tls\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.626786 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.626560    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef1449d9-a5ab-4829-8011-ea387bb155a8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.626786 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.626589    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/64b8bbff-426f-4708-8161-974b20ad89ae-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-4xj5t\" (UID: \"64b8bbff-426f-4708-8161-974b20ad89ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t"
May 29 02:30:25.626786 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.626631    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cf497186-1c25-4339-92ec-3876c3a21670-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-9qp67\" (UID: \"cf497186-1c25-4339-92ec-3876c3a21670\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:25.626786 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.626652    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cf497186-1c25-4339-92ec-3876c3a21670-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-9qp67\" (UID: \"cf497186-1c25-4339-92ec-3876c3a21670\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:25.626786 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.626717    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64b8bbff-426f-4708-8161-974b20ad89ae-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-4xj5t\" (UID: \"64b8bbff-426f-4708-8161-974b20ad89ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t"
May 29 02:30:25.627087 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.626785    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-57pk8\" (UniqueName: \"kubernetes.io/projected/cf497186-1c25-4339-92ec-3876c3a21670-kube-api-access-57pk8\") pod \"kube-state-metrics-54fd6bc5c4-9qp67\" (UID: \"cf497186-1c25-4339-92ec-3876c3a21670\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:25.627087 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.626817    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzxws\" (UniqueName: \"kubernetes.io/projected/ef1449d9-a5ab-4829-8011-ea387bb155a8-kube-api-access-zzxws\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.627087 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.626860    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf497186-1c25-4339-92ec-3876c3a21670-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-9qp67\" (UID: \"cf497186-1c25-4339-92ec-3876c3a21670\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:25.627087 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.626905    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v796j\" (UniqueName: \"kubernetes.io/projected/64b8bbff-426f-4708-8161-974b20ad89ae-kube-api-access-v796j\") pod \"openshift-state-metrics-9c959559f-4xj5t\" (UID: \"64b8bbff-426f-4708-8161-974b20ad89ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t"
May 29 02:30:25.627087 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.626934    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ef1449d9-a5ab-4829-8011-ea387bb155a8-root\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.627087 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.626962    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef1449d9-a5ab-4829-8011-ea387bb155a8-metrics-client-ca\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.627087 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.626998    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64b8bbff-426f-4708-8161-974b20ad89ae-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-4xj5t\" (UID: \"64b8bbff-426f-4708-8161-974b20ad89ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t"
May 29 02:30:25.627087 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.627049    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/cf497186-1c25-4339-92ec-3876c3a21670-volume-directive-shadow\") pod \"kube-state-metrics-54fd6bc5c4-9qp67\" (UID: \"cf497186-1c25-4339-92ec-3876c3a21670\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:25.627087 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:30:25.627082    2573 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found
May 29 02:30:25.627571 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:30:25.627154    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cf497186-1c25-4339-92ec-3876c3a21670-kube-state-metrics-tls podName:cf497186-1c25-4339-92ec-3876c3a21670 nodeName:}" failed. No retries permitted until 2026-05-29 02:30:26.127135318 +0000 UTC m=+194.782142951 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/cf497186-1c25-4339-92ec-3876c3a21670-kube-state-metrics-tls") pod "kube-state-metrics-54fd6bc5c4-9qp67" (UID: "cf497186-1c25-4339-92ec-3876c3a21670") : secret "kube-state-metrics-tls" not found
May 29 02:30:25.627571 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.627305    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ef1449d9-a5ab-4829-8011-ea387bb155a8-node-exporter-accelerators-collector-config\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.627571 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.627346    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf497186-1c25-4339-92ec-3876c3a21670-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-9qp67\" (UID: \"cf497186-1c25-4339-92ec-3876c3a21670\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:25.627571 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.627394    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf497186-1c25-4339-92ec-3876c3a21670-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-9qp67\" (UID: \"cf497186-1c25-4339-92ec-3876c3a21670\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:25.627571 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.627422    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef1449d9-a5ab-4829-8011-ea387bb155a8-sys\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.627571 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.627454    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/64b8bbff-426f-4708-8161-974b20ad89ae-metrics-client-ca\") pod \"openshift-state-metrics-9c959559f-4xj5t\" (UID: \"64b8bbff-426f-4708-8161-974b20ad89ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t"
May 29 02:30:25.627571 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.627459    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/cf497186-1c25-4339-92ec-3876c3a21670-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-54fd6bc5c4-9qp67\" (UID: \"cf497186-1c25-4339-92ec-3876c3a21670\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:25.628008 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.627962    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/cf497186-1c25-4339-92ec-3876c3a21670-metrics-client-ca\") pod \"kube-state-metrics-54fd6bc5c4-9qp67\" (UID: \"cf497186-1c25-4339-92ec-3876c3a21670\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:25.629859 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.629836    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/64b8bbff-426f-4708-8161-974b20ad89ae-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-9c959559f-4xj5t\" (UID: \"64b8bbff-426f-4708-8161-974b20ad89ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t"
May 29 02:30:25.630044 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.630026    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/cf497186-1c25-4339-92ec-3876c3a21670-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-54fd6bc5c4-9qp67\" (UID: \"cf497186-1c25-4339-92ec-3876c3a21670\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:25.630112 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.630090    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/64b8bbff-426f-4708-8161-974b20ad89ae-openshift-state-metrics-tls\") pod \"openshift-state-metrics-9c959559f-4xj5t\" (UID: \"64b8bbff-426f-4708-8161-974b20ad89ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t"
May 29 02:30:25.640579 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.640534    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v796j\" (UniqueName: \"kubernetes.io/projected/64b8bbff-426f-4708-8161-974b20ad89ae-kube-api-access-v796j\") pod \"openshift-state-metrics-9c959559f-4xj5t\" (UID: \"64b8bbff-426f-4708-8161-974b20ad89ae\") " pod="openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t"
May 29 02:30:25.641480 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.641462    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57pk8\" (UniqueName: \"kubernetes.io/projected/cf497186-1c25-4339-92ec-3876c3a21670-kube-api-access-57pk8\") pod \"kube-state-metrics-54fd6bc5c4-9qp67\" (UID: \"cf497186-1c25-4339-92ec-3876c3a21670\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:25.728909 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.728806    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ef1449d9-a5ab-4829-8011-ea387bb155a8-node-exporter-textfile\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.728909 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.728863    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ef1449d9-a5ab-4829-8011-ea387bb155a8-node-exporter-wtmp\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.728909 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.728893    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ef1449d9-a5ab-4829-8011-ea387bb155a8-node-exporter-tls\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.729189 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.728919    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef1449d9-a5ab-4829-8011-ea387bb155a8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.729189 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.729003    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zzxws\" (UniqueName: \"kubernetes.io/projected/ef1449d9-a5ab-4829-8011-ea387bb155a8-kube-api-access-zzxws\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.729189 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.729069    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ef1449d9-a5ab-4829-8011-ea387bb155a8-root\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.729189 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.729099    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef1449d9-a5ab-4829-8011-ea387bb155a8-metrics-client-ca\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.729189 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.729134    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ef1449d9-a5ab-4829-8011-ea387bb155a8-node-exporter-accelerators-collector-config\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.729458 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.729204    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef1449d9-a5ab-4829-8011-ea387bb155a8-sys\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.729458 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.729216    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ef1449d9-a5ab-4829-8011-ea387bb155a8-node-exporter-textfile\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.729458 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.729066    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ef1449d9-a5ab-4829-8011-ea387bb155a8-node-exporter-wtmp\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.729616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.729570    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ef1449d9-a5ab-4829-8011-ea387bb155a8-sys\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.729686 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.729671    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ef1449d9-a5ab-4829-8011-ea387bb155a8-root\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.730105 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.730072    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ef1449d9-a5ab-4829-8011-ea387bb155a8-node-exporter-accelerators-collector-config\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.730228 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.730124    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef1449d9-a5ab-4829-8011-ea387bb155a8-metrics-client-ca\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.731442 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.731422    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef1449d9-a5ab-4829-8011-ea387bb155a8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.731978 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.731959    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ef1449d9-a5ab-4829-8011-ea387bb155a8-node-exporter-tls\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.739634 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.739609    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzxws\" (UniqueName: \"kubernetes.io/projected/ef1449d9-a5ab-4829-8011-ea387bb155a8-kube-api-access-zzxws\") pod \"node-exporter-2dcr7\" (UID: \"ef1449d9-a5ab-4829-8011-ea387bb155a8\") " pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.791014 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.790985    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t"
May 29 02:30:25.836173 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.836137    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2dcr7"
May 29 02:30:25.845902 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:30:25.845868    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef1449d9_a5ab_4829_8011_ea387bb155a8.slice/crio-771562a039c2441e9cc8fde8e77419d5b414fa117ae987697dedf39d09f8161e WatchSource:0}: Error finding container 771562a039c2441e9cc8fde8e77419d5b414fa117ae987697dedf39d09f8161e: Status 404 returned error can't find the container with id 771562a039c2441e9cc8fde8e77419d5b414fa117ae987697dedf39d09f8161e
May 29 02:30:25.932302 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:25.932275    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t"]
May 29 02:30:25.934596 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:30:25.934569    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64b8bbff_426f_4708_8161_974b20ad89ae.slice/crio-9a03ae0411b90f957461263fde7d44a55b434a8f8cd3949d64ee9c9cc9f5fe99 WatchSource:0}: Error finding container 9a03ae0411b90f957461263fde7d44a55b434a8f8cd3949d64ee9c9cc9f5fe99: Status 404 returned error can't find the container with id 9a03ae0411b90f957461263fde7d44a55b434a8f8cd3949d64ee9c9cc9f5fe99
May 29 02:30:26.133602 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:26.133565    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf497186-1c25-4339-92ec-3876c3a21670-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-9qp67\" (UID: \"cf497186-1c25-4339-92ec-3876c3a21670\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:26.136126 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:26.136105    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/cf497186-1c25-4339-92ec-3876c3a21670-kube-state-metrics-tls\") pod \"kube-state-metrics-54fd6bc5c4-9qp67\" (UID: \"cf497186-1c25-4339-92ec-3876c3a21670\") " pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:26.411769 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:26.411674    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"
May 29 02:30:26.513651 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:26.513089    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2dcr7" event={"ID":"ef1449d9-a5ab-4829-8011-ea387bb155a8","Type":"ContainerStarted","Data":"771562a039c2441e9cc8fde8e77419d5b414fa117ae987697dedf39d09f8161e"}
May 29 02:30:26.516149 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:26.516070    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t" event={"ID":"64b8bbff-426f-4708-8161-974b20ad89ae","Type":"ContainerStarted","Data":"c850f8ab72e5efa1577a260f06749792fafd2fffa5f2ed22611597403c039330"}
May 29 02:30:26.516149 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:26.516105    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t" event={"ID":"64b8bbff-426f-4708-8161-974b20ad89ae","Type":"ContainerStarted","Data":"3da456b4702560a8355dba6e5b967a664f7095b41d99bf5f5931bb5f3977e231"}
May 29 02:30:26.516149 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:26.516121    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t" event={"ID":"64b8bbff-426f-4708-8161-974b20ad89ae","Type":"ContainerStarted","Data":"9a03ae0411b90f957461263fde7d44a55b434a8f8cd3949d64ee9c9cc9f5fe99"}
May 29 02:30:26.596815 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:26.596706    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67"]
May 29 02:30:26.782961 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:30:26.782904    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf497186_1c25_4339_92ec_3876c3a21670.slice/crio-e50f1f7a89e96941be5524429278b11a12524b0fc3d4ab611c3df931807266f3 WatchSource:0}: Error finding container e50f1f7a89e96941be5524429278b11a12524b0fc3d4ab611c3df931807266f3: Status 404 returned error can't find the container with id e50f1f7a89e96941be5524429278b11a12524b0fc3d4ab611c3df931807266f3
May 29 02:30:27.521122 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:27.521087    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t" event={"ID":"64b8bbff-426f-4708-8161-974b20ad89ae","Type":"ContainerStarted","Data":"07aeb83d2b8f4788ca849cbda403bfc083847d1585b029d048a9aeebe3f6f2c9"}
May 29 02:30:27.522314 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:27.522286    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67" event={"ID":"cf497186-1c25-4339-92ec-3876c3a21670","Type":"ContainerStarted","Data":"e50f1f7a89e96941be5524429278b11a12524b0fc3d4ab611c3df931807266f3"}
May 29 02:30:27.523715 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:27.523691    2573 generic.go:358] "Generic (PLEG): container finished" podID="ef1449d9-a5ab-4829-8011-ea387bb155a8" containerID="6a1056ed8f5763f3d1241d48a57667f296a379a2cec80da64b8d124e3b4ce44c" exitCode=0
May 29 02:30:27.523801 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:27.523732    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2dcr7" event={"ID":"ef1449d9-a5ab-4829-8011-ea387bb155a8","Type":"ContainerDied","Data":"6a1056ed8f5763f3d1241d48a57667f296a379a2cec80da64b8d124e3b4ce44c"}
May 29 02:30:27.578725 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:27.578684    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-9c959559f-4xj5t" podStartSLOduration=1.507993742 podStartE2EDuration="2.578665175s" podCreationTimestamp="2026-05-29 02:30:25 +0000 UTC" firstStartedPulling="2026-05-29 02:30:26.046502204 +0000 UTC m=+194.701509817" lastFinishedPulling="2026-05-29 02:30:27.117173633 +0000 UTC m=+195.772181250" observedRunningTime="2026-05-29 02:30:27.576760561 +0000 UTC m=+196.231768198" watchObservedRunningTime="2026-05-29 02:30:27.578665175 +0000 UTC m=+196.233672812"
May 29 02:30:28.534483 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:28.534445    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67" event={"ID":"cf497186-1c25-4339-92ec-3876c3a21670","Type":"ContainerStarted","Data":"52e13b7a6d2b1bc2960ed808a0957f1d30c2939b6c119a824988f2faf9a91ace"}
May 29 02:30:28.534483 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:28.534486    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67" event={"ID":"cf497186-1c25-4339-92ec-3876c3a21670","Type":"ContainerStarted","Data":"fb840e0ce79efa5213aeb088e705ceb77af83fd47f498d7247cdc680999a6c15"}
May 29 02:30:28.534975 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:28.534501    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67" event={"ID":"cf497186-1c25-4339-92ec-3876c3a21670","Type":"ContainerStarted","Data":"d5045e2226e46e8acfad7b18acf9050250b08ba3c252b96dc292ab751a4b4e74"}
May 29 02:30:28.536396 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:28.536366    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2dcr7" event={"ID":"ef1449d9-a5ab-4829-8011-ea387bb155a8","Type":"ContainerStarted","Data":"f5859023b6625ec73bd41138cbf39425805a0ade26aeb80eda155f86d8e4f76b"}
May 29 02:30:28.536515 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:28.536404    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2dcr7" event={"ID":"ef1449d9-a5ab-4829-8011-ea387bb155a8","Type":"ContainerStarted","Data":"3fce8e46f44ada5ffe73d2c2827e913e4439347144b7b72414bc388614489d3e"}
May 29 02:30:28.558002 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:28.557942    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-54fd6bc5c4-9qp67" podStartSLOduration=2.406645794 podStartE2EDuration="3.557926757s" podCreationTimestamp="2026-05-29 02:30:25 +0000 UTC" firstStartedPulling="2026-05-29 02:30:26.786115352 +0000 UTC m=+195.441122969" lastFinishedPulling="2026-05-29 02:30:27.937396315 +0000 UTC m=+196.592403932" observedRunningTime="2026-05-29 02:30:28.554962766 +0000 UTC m=+197.209970449" watchObservedRunningTime="2026-05-29 02:30:28.557926757 +0000 UTC m=+197.212934394"
May 29 02:30:28.576108 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:28.576029    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2dcr7" podStartSLOduration=2.347640569 podStartE2EDuration="3.576017035s" podCreationTimestamp="2026-05-29 02:30:25 +0000 UTC" firstStartedPulling="2026-05-29 02:30:25.847594775 +0000 UTC m=+194.502602402" lastFinishedPulling="2026-05-29 02:30:27.075971245 +0000 UTC m=+195.730978868" observedRunningTime="2026-05-29 02:30:28.574755736 +0000 UTC m=+197.229763374" watchObservedRunningTime="2026-05-29 02:30:28.576017035 +0000 UTC m=+197.231024671"
May 29 02:30:36.431554 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.431520    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f87c8b546-gkppc"]
May 29 02:30:36.432011 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:30:36.431683    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-7f87c8b546-gkppc" podUID="58da8892-cc4a-4ebf-9563-f23b950b7dd6"
May 29 02:30:36.560893 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.560861    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:30:36.566354 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.566331    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:30:36.625056 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.625022    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58da8892-cc4a-4ebf-9563-f23b950b7dd6-image-registry-private-configuration\") pod \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") "
May 29 02:30:36.625202 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.625071    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8jr98\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-kube-api-access-8jr98\") pod \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") "
May 29 02:30:36.625202 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.625109    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58da8892-cc4a-4ebf-9563-f23b950b7dd6-ca-trust-extracted\") pod \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") "
May 29 02:30:36.625202 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.625157    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58da8892-cc4a-4ebf-9563-f23b950b7dd6-installation-pull-secrets\") pod \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") "
May 29 02:30:36.625202 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.625179    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-certificates\") pod \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") "
May 29 02:30:36.625447 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.625238    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-bound-sa-token\") pod \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") "
May 29 02:30:36.625447 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.625285    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58da8892-cc4a-4ebf-9563-f23b950b7dd6-trusted-ca\") pod \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\" (UID: \"58da8892-cc4a-4ebf-9563-f23b950b7dd6\") "
May 29 02:30:36.625447 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.625421    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/58da8892-cc4a-4ebf-9563-f23b950b7dd6-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "58da8892-cc4a-4ebf-9563-f23b950b7dd6" (UID: "58da8892-cc4a-4ebf-9563-f23b950b7dd6"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
May 29 02:30:36.625593 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.625567    2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/58da8892-cc4a-4ebf-9563-f23b950b7dd6-ca-trust-extracted\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:30:36.625732 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.625700    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "58da8892-cc4a-4ebf-9563-f23b950b7dd6" (UID: "58da8892-cc4a-4ebf-9563-f23b950b7dd6"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:30:36.625972 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.625945    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58da8892-cc4a-4ebf-9563-f23b950b7dd6-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "58da8892-cc4a-4ebf-9563-f23b950b7dd6" (UID: "58da8892-cc4a-4ebf-9563-f23b950b7dd6"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:30:36.627698 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.627673    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58da8892-cc4a-4ebf-9563-f23b950b7dd6-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "58da8892-cc4a-4ebf-9563-f23b950b7dd6" (UID: "58da8892-cc4a-4ebf-9563-f23b950b7dd6"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:30:36.627807 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.627749    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-kube-api-access-8jr98" (OuterVolumeSpecName: "kube-api-access-8jr98") pod "58da8892-cc4a-4ebf-9563-f23b950b7dd6" (UID: "58da8892-cc4a-4ebf-9563-f23b950b7dd6"). InnerVolumeSpecName "kube-api-access-8jr98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:30:36.627807 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.627752    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/58da8892-cc4a-4ebf-9563-f23b950b7dd6-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "58da8892-cc4a-4ebf-9563-f23b950b7dd6" (UID: "58da8892-cc4a-4ebf-9563-f23b950b7dd6"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:30:36.627900 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.627801    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "58da8892-cc4a-4ebf-9563-f23b950b7dd6" (UID: "58da8892-cc4a-4ebf-9563-f23b950b7dd6"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:30:36.726737 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.726710    2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/58da8892-cc4a-4ebf-9563-f23b950b7dd6-installation-pull-secrets\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:30:36.726737 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.726735    2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-certificates\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:30:36.726891 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.726745    2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-bound-sa-token\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:30:36.726891 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.726754    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/58da8892-cc4a-4ebf-9563-f23b950b7dd6-trusted-ca\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:30:36.726891 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.726763    2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/58da8892-cc4a-4ebf-9563-f23b950b7dd6-image-registry-private-configuration\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:30:36.726891 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.726772    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8jr98\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-kube-api-access-8jr98\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:30:36.967024 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:36.966997    2573 scope.go:117] "RemoveContainer" containerID="2912fe51ece9606ba0f50b9157469e77670a063145be7cff3250aebdad786389"
May 29 02:30:37.564328 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:37.564301    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/2.log"
May 29 02:30:37.564686 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:37.564422    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7f87c8b546-gkppc"
May 29 02:30:37.564686 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:37.564419    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-76dff48d59-zqwt9" event={"ID":"423a6fd1-7473-4c55-b0cb-a208d404ce05","Type":"ContainerStarted","Data":"2fd51b0dfd0d248c0aa007b56897061ff2a87ecbd9a8d2b0ed9f57a31088d1d2"}
May 29 02:30:37.564837 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:37.564814    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-76dff48d59-zqwt9"
May 29 02:30:37.626995 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:37.626946    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-76dff48d59-zqwt9" podStartSLOduration=52.315872102 podStartE2EDuration="54.626933314s" podCreationTimestamp="2026-05-29 02:29:43 +0000 UTC" firstStartedPulling="2026-05-29 02:29:43.610080663 +0000 UTC m=+152.265088278" lastFinishedPulling="2026-05-29 02:29:45.921141873 +0000 UTC m=+154.576149490" observedRunningTime="2026-05-29 02:30:37.601788432 +0000 UTC m=+206.256796078" watchObservedRunningTime="2026-05-29 02:30:37.626933314 +0000 UTC m=+206.281940950"
May 29 02:30:37.637578 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:37.637556    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7f87c8b546-gkppc"]
May 29 02:30:37.640342 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:37.640322    2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7f87c8b546-gkppc"]
May 29 02:30:37.736311 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:37.736283    2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/58da8892-cc4a-4ebf-9563-f23b950b7dd6-registry-tls\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:30:37.970599 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:37.970571    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58da8892-cc4a-4ebf-9563-f23b950b7dd6" path="/var/lib/kubelet/pods/58da8892-cc4a-4ebf-9563-f23b950b7dd6/volumes"
May 29 02:30:38.005625 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:38.005596    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-76dff48d59-zqwt9"
May 29 02:30:38.220340 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:38.220298    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-57bd96b888-bbqkl"]
May 29 02:30:38.223672 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:38.223617    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-bbqkl"
May 29 02:30:38.227165 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:38.227143    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6rqb9\""
May 29 02:30:38.227985 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:38.227962    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
May 29 02:30:38.228096 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:38.228011    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
May 29 02:30:38.241260 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:38.241231    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-bbqkl"]
May 29 02:30:38.340666 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:38.340637    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2qrj\" (UniqueName: \"kubernetes.io/projected/7e4b0d69-d012-4b33-93eb-6293ec90c4a2-kube-api-access-w2qrj\") pod \"downloads-57bd96b888-bbqkl\" (UID: \"7e4b0d69-d012-4b33-93eb-6293ec90c4a2\") " pod="openshift-console/downloads-57bd96b888-bbqkl"
May 29 02:30:38.441652 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:38.441627    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-w2qrj\" (UniqueName: \"kubernetes.io/projected/7e4b0d69-d012-4b33-93eb-6293ec90c4a2-kube-api-access-w2qrj\") pod \"downloads-57bd96b888-bbqkl\" (UID: \"7e4b0d69-d012-4b33-93eb-6293ec90c4a2\") " pod="openshift-console/downloads-57bd96b888-bbqkl"
May 29 02:30:38.450518 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:38.450493    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2qrj\" (UniqueName: \"kubernetes.io/projected/7e4b0d69-d012-4b33-93eb-6293ec90c4a2-kube-api-access-w2qrj\") pod \"downloads-57bd96b888-bbqkl\" (UID: \"7e4b0d69-d012-4b33-93eb-6293ec90c4a2\") " pod="openshift-console/downloads-57bd96b888-bbqkl"
May 29 02:30:38.534183 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:38.534125    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-57bd96b888-bbqkl"
May 29 02:30:38.678427 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:38.678394    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-57bd96b888-bbqkl"]
May 29 02:30:38.680668 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:30:38.680639    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e4b0d69_d012_4b33_93eb_6293ec90c4a2.slice/crio-38376601bb11dadbbbfd6085f9e659af79fba8cb68f936fdb6b9c817a30153b2 WatchSource:0}: Error finding container 38376601bb11dadbbbfd6085f9e659af79fba8cb68f936fdb6b9c817a30153b2: Status 404 returned error can't find the container with id 38376601bb11dadbbbfd6085f9e659af79fba8cb68f936fdb6b9c817a30153b2
May 29 02:30:39.571778 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:39.571704    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-bbqkl" event={"ID":"7e4b0d69-d012-4b33-93eb-6293ec90c4a2","Type":"ContainerStarted","Data":"38376601bb11dadbbbfd6085f9e659af79fba8cb68f936fdb6b9c817a30153b2"}
May 29 02:30:48.787694 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:48.787655    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-fdbbd6c4f-trncz"]
May 29 02:30:48.790934 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:48.790911    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:48.794775 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:48.794100    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 29 02:30:48.794775 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:48.794152    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-468rk\""
May 29 02:30:48.798632 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:48.795087    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 29 02:30:48.798632 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:48.795434    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 29 02:30:48.798632 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:48.795472    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 29 02:30:48.798632 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:48.795806    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 29 02:30:48.802619 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:48.802558    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fdbbd6c4f-trncz"]
May 29 02:30:48.942171 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:48.942136    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f40dbade-dd25-446e-a37f-1c71ab37549a-console-oauth-config\") pod \"console-fdbbd6c4f-trncz\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") " pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:48.942365 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:48.942180    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f40dbade-dd25-446e-a37f-1c71ab37549a-console-serving-cert\") pod \"console-fdbbd6c4f-trncz\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") " pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:48.942365 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:48.942214    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f40dbade-dd25-446e-a37f-1c71ab37549a-oauth-serving-cert\") pod \"console-fdbbd6c4f-trncz\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") " pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:48.942365 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:48.942296    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f40dbade-dd25-446e-a37f-1c71ab37549a-console-config\") pod \"console-fdbbd6c4f-trncz\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") " pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:48.942365 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:48.942337    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f40dbade-dd25-446e-a37f-1c71ab37549a-service-ca\") pod \"console-fdbbd6c4f-trncz\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") " pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:48.942609 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:48.942409    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zlzdl\" (UniqueName: \"kubernetes.io/projected/f40dbade-dd25-446e-a37f-1c71ab37549a-kube-api-access-zlzdl\") pod \"console-fdbbd6c4f-trncz\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") " pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:49.042871 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:49.042797    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zlzdl\" (UniqueName: \"kubernetes.io/projected/f40dbade-dd25-446e-a37f-1c71ab37549a-kube-api-access-zlzdl\") pod \"console-fdbbd6c4f-trncz\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") " pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:49.043054 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:49.042887    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f40dbade-dd25-446e-a37f-1c71ab37549a-console-oauth-config\") pod \"console-fdbbd6c4f-trncz\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") " pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:49.043054 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:49.042914    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f40dbade-dd25-446e-a37f-1c71ab37549a-console-serving-cert\") pod \"console-fdbbd6c4f-trncz\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") " pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:49.043054 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:49.042947    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f40dbade-dd25-446e-a37f-1c71ab37549a-oauth-serving-cert\") pod \"console-fdbbd6c4f-trncz\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") " pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:49.043054 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:49.042996    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f40dbade-dd25-446e-a37f-1c71ab37549a-console-config\") pod \"console-fdbbd6c4f-trncz\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") " pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:49.043054 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:49.043034    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f40dbade-dd25-446e-a37f-1c71ab37549a-service-ca\") pod \"console-fdbbd6c4f-trncz\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") " pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:49.043841 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:49.043814    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f40dbade-dd25-446e-a37f-1c71ab37549a-service-ca\") pod \"console-fdbbd6c4f-trncz\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") " pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:49.043959 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:49.043818    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f40dbade-dd25-446e-a37f-1c71ab37549a-oauth-serving-cert\") pod \"console-fdbbd6c4f-trncz\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") " pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:49.043959 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:49.043935    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f40dbade-dd25-446e-a37f-1c71ab37549a-console-config\") pod \"console-fdbbd6c4f-trncz\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") " pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:49.045724 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:49.045700    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f40dbade-dd25-446e-a37f-1c71ab37549a-console-serving-cert\") pod \"console-fdbbd6c4f-trncz\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") " pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:49.046015 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:49.045993    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f40dbade-dd25-446e-a37f-1c71ab37549a-console-oauth-config\") pod \"console-fdbbd6c4f-trncz\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") " pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:49.052526 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:49.052481    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zlzdl\" (UniqueName: \"kubernetes.io/projected/f40dbade-dd25-446e-a37f-1c71ab37549a-kube-api-access-zlzdl\") pod \"console-fdbbd6c4f-trncz\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") " pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:49.108922 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:49.108879    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:54.020802 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:54.020777    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fdbbd6c4f-trncz"]
May 29 02:30:54.029452 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:30:54.029425    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf40dbade_dd25_446e_a37f_1c71ab37549a.slice/crio-9c38d81553f62068e7406a6591f1dc153147c0ce9c3ab57499a64854139f411f WatchSource:0}: Error finding container 9c38d81553f62068e7406a6591f1dc153147c0ce9c3ab57499a64854139f411f: Status 404 returned error can't find the container with id 9c38d81553f62068e7406a6591f1dc153147c0ce9c3ab57499a64854139f411f
May 29 02:30:54.617355 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:54.617316    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-57bd96b888-bbqkl" event={"ID":"7e4b0d69-d012-4b33-93eb-6293ec90c4a2","Type":"ContainerStarted","Data":"4cbd83ea519d0efae44d37a8c4ee850fded38e0fda6db845cf7996028421adb2"}
May 29 02:30:54.617586 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:54.617567    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-57bd96b888-bbqkl"
May 29 02:30:54.620301 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:54.620239    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdbbd6c4f-trncz" event={"ID":"f40dbade-dd25-446e-a37f-1c71ab37549a","Type":"ContainerStarted","Data":"9c38d81553f62068e7406a6591f1dc153147c0ce9c3ab57499a64854139f411f"}
May 29 02:30:54.632075 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:54.632044    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-57bd96b888-bbqkl"
May 29 02:30:54.640464 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:54.640414    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/downloads-57bd96b888-bbqkl" podStartSLOduration=1.330021755 podStartE2EDuration="16.640398542s" podCreationTimestamp="2026-05-29 02:30:38 +0000 UTC" firstStartedPulling="2026-05-29 02:30:38.682653789 +0000 UTC m=+207.337661408" lastFinishedPulling="2026-05-29 02:30:53.993030576 +0000 UTC m=+222.648038195" observedRunningTime="2026-05-29 02:30:54.639901189 +0000 UTC m=+223.294908826" watchObservedRunningTime="2026-05-29 02:30:54.640398542 +0000 UTC m=+223.295406184"
May 29 02:30:57.635981 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:57.635177    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdbbd6c4f-trncz" event={"ID":"f40dbade-dd25-446e-a37f-1c71ab37549a","Type":"ContainerStarted","Data":"e9915a9c566aff3cdd986e152996ad6588864827f28a9e17b97cf87b37feb040"}
May 29 02:30:57.653411 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:57.653353    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-fdbbd6c4f-trncz" podStartSLOduration=6.201515607 podStartE2EDuration="9.653247518s" podCreationTimestamp="2026-05-29 02:30:48 +0000 UTC" firstStartedPulling="2026-05-29 02:30:54.031403605 +0000 UTC m=+222.686411220" lastFinishedPulling="2026-05-29 02:30:57.483135517 +0000 UTC m=+226.138143131" observedRunningTime="2026-05-29 02:30:57.652729149 +0000 UTC m=+226.307736796" watchObservedRunningTime="2026-05-29 02:30:57.653247518 +0000 UTC m=+226.308255157"
May 29 02:30:59.109870 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:59.109838    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:59.110345 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:59.109892    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:59.115475 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:59.115449    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:30:59.646081 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:30:59.646052    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:31:08.626523 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:08.626489    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fdbbd6c4f-trncz"]
May 29 02:31:12.678464 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:12.678431    2573 generic.go:358] "Generic (PLEG): container finished" podID="eaa52fdb-83a3-41fc-b731-a1d57c86f5e4" containerID="424fb8735c2c97b973e065e580eba05f1df3ca075c222fcd86160e39ca28a032" exitCode=0
May 29 02:31:12.678897 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:12.678506    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7rr46" event={"ID":"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4","Type":"ContainerDied","Data":"424fb8735c2c97b973e065e580eba05f1df3ca075c222fcd86160e39ca28a032"}
May 29 02:31:12.678897 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:12.678861    2573 scope.go:117] "RemoveContainer" containerID="424fb8735c2c97b973e065e580eba05f1df3ca075c222fcd86160e39ca28a032"
May 29 02:31:13.682552 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:13.682516    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-78bdfb888c-7rr46" event={"ID":"eaa52fdb-83a3-41fc-b731-a1d57c86f5e4","Type":"ContainerStarted","Data":"218f8553bd0494d774f7b83bc35b01249ff4c4955616956aa1e7086ddd486db8"}
May 29 02:31:23.862090 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:23.862050    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs\") pod \"network-metrics-daemon-bbj9n\" (UID: \"f1c2fcb1-f203-4571-8cbe-eb01a190d63b\") " pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:31:23.864541 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:23.864514    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f1c2fcb1-f203-4571-8cbe-eb01a190d63b-metrics-certs\") pod \"network-metrics-daemon-bbj9n\" (UID: \"f1c2fcb1-f203-4571-8cbe-eb01a190d63b\") " pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:31:24.071390 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:24.071355    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t2rwn\""
May 29 02:31:24.079065 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:24.079037    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-bbj9n"
May 29 02:31:24.212983 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:24.212959    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-bbj9n"]
May 29 02:31:24.215084 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:31:24.215052    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1c2fcb1_f203_4571_8cbe_eb01a190d63b.slice/crio-6fe0a53dc13e0caf2cc879174d98d9f2fa044adb95fe6aa0e442e6e3f0dd0f4d WatchSource:0}: Error finding container 6fe0a53dc13e0caf2cc879174d98d9f2fa044adb95fe6aa0e442e6e3f0dd0f4d: Status 404 returned error can't find the container with id 6fe0a53dc13e0caf2cc879174d98d9f2fa044adb95fe6aa0e442e6e3f0dd0f4d
May 29 02:31:24.712083 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:24.712051    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bbj9n" event={"ID":"f1c2fcb1-f203-4571-8cbe-eb01a190d63b","Type":"ContainerStarted","Data":"6fe0a53dc13e0caf2cc879174d98d9f2fa044adb95fe6aa0e442e6e3f0dd0f4d"}
May 29 02:31:26.722117 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:26.722086    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bbj9n" event={"ID":"f1c2fcb1-f203-4571-8cbe-eb01a190d63b","Type":"ContainerStarted","Data":"fb301e3840f0df834fdbbaf952bb7beb5262e208446a96d986c3b425f822a83b"}
May 29 02:31:26.722506 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:26.722124    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-bbj9n" event={"ID":"f1c2fcb1-f203-4571-8cbe-eb01a190d63b","Type":"ContainerStarted","Data":"27a01fe17b0a3b12ef817f6950e733f87e8a7972d8a61ef623fb428942255f23"}
May 29 02:31:33.647686 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:33.647606    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-fdbbd6c4f-trncz" podUID="f40dbade-dd25-446e-a37f-1c71ab37549a" containerName="console" containerID="cri-o://e9915a9c566aff3cdd986e152996ad6588864827f28a9e17b97cf87b37feb040" gracePeriod=15
May 29 02:31:33.896733 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:33.896710    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-fdbbd6c4f-trncz_f40dbade-dd25-446e-a37f-1c71ab37549a/console/0.log"
May 29 02:31:33.896843 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:33.896770    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:31:33.919453 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:33.919360    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-bbj9n" podStartSLOduration=260.230764092 podStartE2EDuration="4m21.91934279s" podCreationTimestamp="2026-05-29 02:27:12 +0000 UTC" firstStartedPulling="2026-05-29 02:31:24.217017547 +0000 UTC m=+252.872025166" lastFinishedPulling="2026-05-29 02:31:25.905596235 +0000 UTC m=+254.560603864" observedRunningTime="2026-05-29 02:31:26.740707131 +0000 UTC m=+255.395714768" watchObservedRunningTime="2026-05-29 02:31:33.91934279 +0000 UTC m=+262.574350430"
May 29 02:31:34.056162 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.056136    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f40dbade-dd25-446e-a37f-1c71ab37549a-service-ca\") pod \"f40dbade-dd25-446e-a37f-1c71ab37549a\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") "
May 29 02:31:34.056353 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.056178    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f40dbade-dd25-446e-a37f-1c71ab37549a-console-config\") pod \"f40dbade-dd25-446e-a37f-1c71ab37549a\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") "
May 29 02:31:34.056353 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.056220    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zlzdl\" (UniqueName: \"kubernetes.io/projected/f40dbade-dd25-446e-a37f-1c71ab37549a-kube-api-access-zlzdl\") pod \"f40dbade-dd25-446e-a37f-1c71ab37549a\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") "
May 29 02:31:34.056353 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.056247    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f40dbade-dd25-446e-a37f-1c71ab37549a-console-oauth-config\") pod \"f40dbade-dd25-446e-a37f-1c71ab37549a\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") "
May 29 02:31:34.056467 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.056425    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f40dbade-dd25-446e-a37f-1c71ab37549a-oauth-serving-cert\") pod \"f40dbade-dd25-446e-a37f-1c71ab37549a\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") "
May 29 02:31:34.056521 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.056477    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f40dbade-dd25-446e-a37f-1c71ab37549a-console-serving-cert\") pod \"f40dbade-dd25-446e-a37f-1c71ab37549a\" (UID: \"f40dbade-dd25-446e-a37f-1c71ab37549a\") "
May 29 02:31:34.056614 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.056592    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f40dbade-dd25-446e-a37f-1c71ab37549a-service-ca" (OuterVolumeSpecName: "service-ca") pod "f40dbade-dd25-446e-a37f-1c71ab37549a" (UID: "f40dbade-dd25-446e-a37f-1c71ab37549a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:31:34.056721 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.056690    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f40dbade-dd25-446e-a37f-1c71ab37549a-console-config" (OuterVolumeSpecName: "console-config") pod "f40dbade-dd25-446e-a37f-1c71ab37549a" (UID: "f40dbade-dd25-446e-a37f-1c71ab37549a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:31:34.056870 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.056842    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f40dbade-dd25-446e-a37f-1c71ab37549a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "f40dbade-dd25-446e-a37f-1c71ab37549a" (UID: "f40dbade-dd25-446e-a37f-1c71ab37549a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:31:34.056921 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.056853    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f40dbade-dd25-446e-a37f-1c71ab37549a-service-ca\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:31:34.056921 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.056902    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f40dbade-dd25-446e-a37f-1c71ab37549a-console-config\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:31:34.058547 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.058525    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f40dbade-dd25-446e-a37f-1c71ab37549a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "f40dbade-dd25-446e-a37f-1c71ab37549a" (UID: "f40dbade-dd25-446e-a37f-1c71ab37549a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:31:34.058637 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.058585    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f40dbade-dd25-446e-a37f-1c71ab37549a-kube-api-access-zlzdl" (OuterVolumeSpecName: "kube-api-access-zlzdl") pod "f40dbade-dd25-446e-a37f-1c71ab37549a" (UID: "f40dbade-dd25-446e-a37f-1c71ab37549a"). InnerVolumeSpecName "kube-api-access-zlzdl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:31:34.058637 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.058592    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f40dbade-dd25-446e-a37f-1c71ab37549a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "f40dbade-dd25-446e-a37f-1c71ab37549a" (UID: "f40dbade-dd25-446e-a37f-1c71ab37549a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:31:34.157982 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.157943    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f40dbade-dd25-446e-a37f-1c71ab37549a-console-serving-cert\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:31:34.157982 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.157972    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zlzdl\" (UniqueName: \"kubernetes.io/projected/f40dbade-dd25-446e-a37f-1c71ab37549a-kube-api-access-zlzdl\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:31:34.157982 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.157982    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f40dbade-dd25-446e-a37f-1c71ab37549a-console-oauth-config\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:31:34.157982 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.157995    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f40dbade-dd25-446e-a37f-1c71ab37549a-oauth-serving-cert\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:31:34.745285 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.745229    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-fdbbd6c4f-trncz_f40dbade-dd25-446e-a37f-1c71ab37549a/console/0.log"
May 29 02:31:34.745690 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.745287    2573 generic.go:358] "Generic (PLEG): container finished" podID="f40dbade-dd25-446e-a37f-1c71ab37549a" containerID="e9915a9c566aff3cdd986e152996ad6588864827f28a9e17b97cf87b37feb040" exitCode=2
May 29 02:31:34.745690 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.745320    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdbbd6c4f-trncz" event={"ID":"f40dbade-dd25-446e-a37f-1c71ab37549a","Type":"ContainerDied","Data":"e9915a9c566aff3cdd986e152996ad6588864827f28a9e17b97cf87b37feb040"}
May 29 02:31:34.745690 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.745358    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdbbd6c4f-trncz" event={"ID":"f40dbade-dd25-446e-a37f-1c71ab37549a","Type":"ContainerDied","Data":"9c38d81553f62068e7406a6591f1dc153147c0ce9c3ab57499a64854139f411f"}
May 29 02:31:34.745690 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.745375    2573 scope.go:117] "RemoveContainer" containerID="e9915a9c566aff3cdd986e152996ad6588864827f28a9e17b97cf87b37feb040"
May 29 02:31:34.745690 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.745375    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdbbd6c4f-trncz"
May 29 02:31:34.763748 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.763729    2573 scope.go:117] "RemoveContainer" containerID="e9915a9c566aff3cdd986e152996ad6588864827f28a9e17b97cf87b37feb040"
May 29 02:31:34.764012 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:31:34.763989    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9915a9c566aff3cdd986e152996ad6588864827f28a9e17b97cf87b37feb040\": container with ID starting with e9915a9c566aff3cdd986e152996ad6588864827f28a9e17b97cf87b37feb040 not found: ID does not exist" containerID="e9915a9c566aff3cdd986e152996ad6588864827f28a9e17b97cf87b37feb040"
May 29 02:31:34.764049 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.764021    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9915a9c566aff3cdd986e152996ad6588864827f28a9e17b97cf87b37feb040"} err="failed to get container status \"e9915a9c566aff3cdd986e152996ad6588864827f28a9e17b97cf87b37feb040\": rpc error: code = NotFound desc = could not find container \"e9915a9c566aff3cdd986e152996ad6588864827f28a9e17b97cf87b37feb040\": container with ID starting with e9915a9c566aff3cdd986e152996ad6588864827f28a9e17b97cf87b37feb040 not found: ID does not exist"
May 29 02:31:34.766408 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.766387    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fdbbd6c4f-trncz"]
May 29 02:31:34.769894 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:34.769874    2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fdbbd6c4f-trncz"]
May 29 02:31:35.971212 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:35.971181    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f40dbade-dd25-446e-a37f-1c71ab37549a" path="/var/lib/kubelet/pods/f40dbade-dd25-446e-a37f-1c71ab37549a/volumes"
May 29 02:31:47.255577 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.255547    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-668cdd958c-xsn49"]
May 29 02:31:47.256421 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.255984    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f40dbade-dd25-446e-a37f-1c71ab37549a" containerName="console"
May 29 02:31:47.256421 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.256002    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="f40dbade-dd25-446e-a37f-1c71ab37549a" containerName="console"
May 29 02:31:47.256421 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.256170    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="f40dbade-dd25-446e-a37f-1c71ab37549a" containerName="console"
May 29 02:31:47.259011 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.258990    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.263203 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.263162    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
May 29 02:31:47.263361 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.263217    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
May 29 02:31:47.263361 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.263221    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-468rk\""
May 29 02:31:47.263865 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.263843    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
May 29 02:31:47.264096 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.264076    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
May 29 02:31:47.264440 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.264421    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
May 29 02:31:47.271566 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.271544    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
May 29 02:31:47.271679 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.271627    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-668cdd958c-xsn49"]
May 29 02:31:47.372383 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.372357    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-trusted-ca-bundle\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.372537 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.372389    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvf92\" (UniqueName: \"kubernetes.io/projected/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-kube-api-access-gvf92\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.372537 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.372409    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-console-oauth-config\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.372537 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.372456    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-console-serving-cert\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.372537 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.372523    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-oauth-serving-cert\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.372713 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.372569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-service-ca\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.372713 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.372607    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-console-config\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.473633 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.473601    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-trusted-ca-bundle\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.473768 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.473639    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gvf92\" (UniqueName: \"kubernetes.io/projected/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-kube-api-access-gvf92\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.473768 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.473667    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-console-oauth-config\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.473872 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.473779    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-console-serving-cert\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.473872 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.473817    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-oauth-serving-cert\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.473872 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.473857    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-service-ca\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.474012 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.473905    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-console-config\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.474569 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.474542    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-oauth-serving-cert\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.474683 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.474569    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-trusted-ca-bundle\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.474683 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.474602    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-console-config\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.474683 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.474602    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-service-ca\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.476093 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.476077    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-console-serving-cert\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.476169 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.476128    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-console-oauth-config\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.483032 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.483013    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvf92\" (UniqueName: \"kubernetes.io/projected/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-kube-api-access-gvf92\") pod \"console-668cdd958c-xsn49\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") " pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.570473 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.570424    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:47.701286 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.701244    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-668cdd958c-xsn49"]
May 29 02:31:47.703468 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:31:47.703445    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2fcbfe9b_1a5c_44eb_8512_72f4865ff2c5.slice/crio-b698b1fb74d8bdaa2cc07461ed594115ce7543e0aded24b797ef37086cb97038 WatchSource:0}: Error finding container b698b1fb74d8bdaa2cc07461ed594115ce7543e0aded24b797ef37086cb97038: Status 404 returned error can't find the container with id b698b1fb74d8bdaa2cc07461ed594115ce7543e0aded24b797ef37086cb97038
May 29 02:31:47.789397 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.789366    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668cdd958c-xsn49" event={"ID":"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5","Type":"ContainerStarted","Data":"03f95e215736b368df3a85d2a19f0dd92c30ce57aa3994b025a7da939333ff5e"}
May 29 02:31:47.789542 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.789408    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668cdd958c-xsn49" event={"ID":"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5","Type":"ContainerStarted","Data":"b698b1fb74d8bdaa2cc07461ed594115ce7543e0aded24b797ef37086cb97038"}
May 29 02:31:47.809828 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:47.809784    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-668cdd958c-xsn49" podStartSLOduration=0.809770165 podStartE2EDuration="809.770165ms" podCreationTimestamp="2026-05-29 02:31:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:31:47.808059749 +0000 UTC m=+276.463067385" watchObservedRunningTime="2026-05-29 02:31:47.809770165 +0000 UTC m=+276.464777801"
May 29 02:31:51.399707 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:31:51.399666    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w" podUID="0a7061e3-3a99-4d53-ae20-0028a4950f5f"
May 29 02:31:51.399707 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:31:51.399664    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-kl8vc" podUID="96254599-cc53-4384-9eca-b9bb8997cd02"
May 29 02:31:51.399707 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:31:51.399666    2573 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-8hx9n" podUID="c4d7d603-050b-4d0e-9802-4ba8d0bc4baa"
May 29 02:31:51.802609 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:51.802580    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"
May 29 02:31:51.802777 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:51.802585    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8hx9n"
May 29 02:31:51.802777 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:51.802587    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kl8vc"
May 29 02:31:55.240942 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:55.240912    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:31:55.241423 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:55.240951    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nw69w\" (UID: \"0a7061e3-3a99-4d53-ae20-0028a4950f5f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"
May 29 02:31:55.241423 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:55.240983    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert\") pod \"ingress-canary-8hx9n\" (UID: \"c4d7d603-050b-4d0e-9802-4ba8d0bc4baa\") " pod="openshift-ingress-canary/ingress-canary-8hx9n"
May 29 02:31:55.243410 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:55.243386    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/96254599-cc53-4384-9eca-b9bb8997cd02-metrics-tls\") pod \"dns-default-kl8vc\" (UID: \"96254599-cc53-4384-9eca-b9bb8997cd02\") " pod="openshift-dns/dns-default-kl8vc"
May 29 02:31:55.243508 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:55.243468    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c4d7d603-050b-4d0e-9802-4ba8d0bc4baa-cert\") pod \"ingress-canary-8hx9n\" (UID: \"c4d7d603-050b-4d0e-9802-4ba8d0bc4baa\") " pod="openshift-ingress-canary/ingress-canary-8hx9n"
May 29 02:31:55.243578 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:55.243554    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0a7061e3-3a99-4d53-ae20-0028a4950f5f-networking-console-plugin-cert\") pod \"networking-console-plugin-d4d8f94f9-nw69w\" (UID: \"0a7061e3-3a99-4d53-ae20-0028a4950f5f\") " pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"
May 29 02:31:55.407898 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:55.407862    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-zl2l4\""
May 29 02:31:55.407898 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:55.407876    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-cdlfg\""
May 29 02:31:55.407898 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:55.407871    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jrg6b\""
May 29 02:31:55.414031 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:55.414005    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-8hx9n"
May 29 02:31:55.414106 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:55.414082    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"
May 29 02:31:55.414106 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:55.414092    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-kl8vc"
May 29 02:31:55.578624 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:55.578592    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w"]
May 29 02:31:55.583219 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:31:55.583191    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a7061e3_3a99_4d53_ae20_0028a4950f5f.slice/crio-12952a4da0b801c2db6af56324ea802353962563d90d3b9fc53e533cc0e83df6 WatchSource:0}: Error finding container 12952a4da0b801c2db6af56324ea802353962563d90d3b9fc53e533cc0e83df6: Status 404 returned error can't find the container with id 12952a4da0b801c2db6af56324ea802353962563d90d3b9fc53e533cc0e83df6
May 29 02:31:55.813923 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:55.813890    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-8hx9n"]
May 29 02:31:55.817209 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:55.817180    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-kl8vc"]
May 29 02:31:55.818568 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:31:55.818541    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96254599_cc53_4384_9eca_b9bb8997cd02.slice/crio-9001ce45fa0b7808213c7f074bd80dca28354f5e18d4006d3cdda257c16f122b WatchSource:0}: Error finding container 9001ce45fa0b7808213c7f074bd80dca28354f5e18d4006d3cdda257c16f122b: Status 404 returned error can't find the container with id 9001ce45fa0b7808213c7f074bd80dca28354f5e18d4006d3cdda257c16f122b
May 29 02:31:55.818754 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:55.818729    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w" event={"ID":"0a7061e3-3a99-4d53-ae20-0028a4950f5f","Type":"ContainerStarted","Data":"12952a4da0b801c2db6af56324ea802353962563d90d3b9fc53e533cc0e83df6"}
May 29 02:31:55.819843 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:55.819822    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8hx9n" event={"ID":"c4d7d603-050b-4d0e-9802-4ba8d0bc4baa","Type":"ContainerStarted","Data":"b0243380a318877bf0f3f648bf17a857d209edf640ae937e62cca4d97abe1d59"}
May 29 02:31:56.824890 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:56.824802    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w" event={"ID":"0a7061e3-3a99-4d53-ae20-0028a4950f5f","Type":"ContainerStarted","Data":"8306f0b83e988b3974642862823beb29b140d335f60d87130aa2b3edfca7198b"}
May 29 02:31:56.826039 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:56.826002    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kl8vc" event={"ID":"96254599-cc53-4384-9eca-b9bb8997cd02","Type":"ContainerStarted","Data":"9001ce45fa0b7808213c7f074bd80dca28354f5e18d4006d3cdda257c16f122b"}
May 29 02:31:56.844133 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:56.844079    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d4d8f94f9-nw69w" podStartSLOduration=279.892598873 podStartE2EDuration="4m40.844061917s" podCreationTimestamp="2026-05-29 02:27:16 +0000 UTC" firstStartedPulling="2026-05-29 02:31:55.586228779 +0000 UTC m=+284.241236393" lastFinishedPulling="2026-05-29 02:31:56.537691807 +0000 UTC m=+285.192699437" observedRunningTime="2026-05-29 02:31:56.84356718 +0000 UTC m=+285.498574818" watchObservedRunningTime="2026-05-29 02:31:56.844061917 +0000 UTC m=+285.499069554"
May 29 02:31:57.570742 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:57.570698    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:57.570929 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:57.570787    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:57.576077 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:57.576052    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:57.831079 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:57.831051    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kl8vc" event={"ID":"96254599-cc53-4384-9eca-b9bb8997cd02","Type":"ContainerStarted","Data":"4858e3135efbf44eca54c02e55056ec2840fb8396438820e66f82fc4152d2d7b"}
May 29 02:31:57.834550 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:57.834509    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-8hx9n" event={"ID":"c4d7d603-050b-4d0e-9802-4ba8d0bc4baa","Type":"ContainerStarted","Data":"5ac13575ec23d79eff94ab94a1b70091e067b7494ef0c15bb10f4aaa7c905755"}
May 29 02:31:57.839329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:57.839296    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:31:57.852755 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:57.852697    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-8hx9n" podStartSLOduration=250.937274531 podStartE2EDuration="4m12.852676789s" podCreationTimestamp="2026-05-29 02:27:45 +0000 UTC" firstStartedPulling="2026-05-29 02:31:55.816724132 +0000 UTC m=+284.471731763" lastFinishedPulling="2026-05-29 02:31:57.732126406 +0000 UTC m=+286.387134021" observedRunningTime="2026-05-29 02:31:57.85181541 +0000 UTC m=+286.506823047" watchObservedRunningTime="2026-05-29 02:31:57.852676789 +0000 UTC m=+286.507684425"
May 29 02:31:58.838590 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:58.838557    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-kl8vc" event={"ID":"96254599-cc53-4384-9eca-b9bb8997cd02","Type":"ContainerStarted","Data":"d079a0d84d135284c55425852010af4221050180fe492ff2f1c941f8b0666827"}
May 29 02:31:58.857477 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:58.857296    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-kl8vc" podStartSLOduration=251.948081858 podStartE2EDuration="4m13.857276819s" podCreationTimestamp="2026-05-29 02:27:45 +0000 UTC" firstStartedPulling="2026-05-29 02:31:55.820267577 +0000 UTC m=+284.475275194" lastFinishedPulling="2026-05-29 02:31:57.729462539 +0000 UTC m=+286.384470155" observedRunningTime="2026-05-29 02:31:58.856626384 +0000 UTC m=+287.511634021" watchObservedRunningTime="2026-05-29 02:31:58.857276819 +0000 UTC m=+287.512284455"
May 29 02:31:59.841841 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:31:59.841800    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-kl8vc"
May 29 02:32:09.846577 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:32:09.846546    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-kl8vc"
May 29 02:32:11.873851 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:32:11.873827    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/2.log"
May 29 02:32:11.874350 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:32:11.874332    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/2.log"
May 29 02:32:11.883359 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:32:11.883339    2573 kubelet.go:1628] "Image garbage collection succeeded"
May 29 02:33:26.691311 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:26.691278    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-45xxl"]
May 29 02:33:26.693557 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:26.693541    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-45xxl"
May 29 02:33:26.696503 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:26.696479    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
May 29 02:33:26.696631 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:26.696521    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
May 29 02:33:26.696631 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:26.696530    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9zbsj\""
May 29 02:33:26.703202 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:26.703176    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-45xxl"]
May 29 02:33:26.793719 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:26.793683    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6fdc101-74bc-443e-a08b-e4aacb24fa53-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-45xxl\" (UID: \"d6fdc101-74bc-443e-a08b-e4aacb24fa53\") " pod="cert-manager/cert-manager-cainjector-68b757865b-45xxl"
May 29 02:33:26.793719 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:26.793720    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpq2q\" (UniqueName: \"kubernetes.io/projected/d6fdc101-74bc-443e-a08b-e4aacb24fa53-kube-api-access-bpq2q\") pod \"cert-manager-cainjector-68b757865b-45xxl\" (UID: \"d6fdc101-74bc-443e-a08b-e4aacb24fa53\") " pod="cert-manager/cert-manager-cainjector-68b757865b-45xxl"
May 29 02:33:26.894413 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:26.894381    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6fdc101-74bc-443e-a08b-e4aacb24fa53-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-45xxl\" (UID: \"d6fdc101-74bc-443e-a08b-e4aacb24fa53\") " pod="cert-manager/cert-manager-cainjector-68b757865b-45xxl"
May 29 02:33:26.894413 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:26.894415    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bpq2q\" (UniqueName: \"kubernetes.io/projected/d6fdc101-74bc-443e-a08b-e4aacb24fa53-kube-api-access-bpq2q\") pod \"cert-manager-cainjector-68b757865b-45xxl\" (UID: \"d6fdc101-74bc-443e-a08b-e4aacb24fa53\") " pod="cert-manager/cert-manager-cainjector-68b757865b-45xxl"
May 29 02:33:26.903156 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:26.903122    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d6fdc101-74bc-443e-a08b-e4aacb24fa53-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-45xxl\" (UID: \"d6fdc101-74bc-443e-a08b-e4aacb24fa53\") " pod="cert-manager/cert-manager-cainjector-68b757865b-45xxl"
May 29 02:33:26.903347 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:26.903330    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpq2q\" (UniqueName: \"kubernetes.io/projected/d6fdc101-74bc-443e-a08b-e4aacb24fa53-kube-api-access-bpq2q\") pod \"cert-manager-cainjector-68b757865b-45xxl\" (UID: \"d6fdc101-74bc-443e-a08b-e4aacb24fa53\") " pod="cert-manager/cert-manager-cainjector-68b757865b-45xxl"
May 29 02:33:27.017707 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:27.017627    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-45xxl"
May 29 02:33:27.141688 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:27.141661    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-45xxl"]
May 29 02:33:27.144103 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:33:27.144076    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd6fdc101_74bc_443e_a08b_e4aacb24fa53.slice/crio-b7afcfbe6ee6cfbfdff3710727ede3ac757ab3bd542cb51d841c1b1165f09029 WatchSource:0}: Error finding container b7afcfbe6ee6cfbfdff3710727ede3ac757ab3bd542cb51d841c1b1165f09029: Status 404 returned error can't find the container with id b7afcfbe6ee6cfbfdff3710727ede3ac757ab3bd542cb51d841c1b1165f09029
May 29 02:33:27.145894 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:27.145880    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 02:33:27.198689 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:27.198660    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-725lz"]
May 29 02:33:27.201379 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:27.201360    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-725lz"
May 29 02:33:27.204045 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:27.204024    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-wk5gg\""
May 29 02:33:27.212631 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:27.212611    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-725lz"]
May 29 02:33:27.298339 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:27.298240    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9465\" (UniqueName: \"kubernetes.io/projected/fb1611e0-5253-42b2-bb8d-6ec8b75038f9-kube-api-access-v9465\") pod \"cert-manager-79c8d999ff-725lz\" (UID: \"fb1611e0-5253-42b2-bb8d-6ec8b75038f9\") " pod="cert-manager/cert-manager-79c8d999ff-725lz"
May 29 02:33:27.298339 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:27.298304    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb1611e0-5253-42b2-bb8d-6ec8b75038f9-bound-sa-token\") pod \"cert-manager-79c8d999ff-725lz\" (UID: \"fb1611e0-5253-42b2-bb8d-6ec8b75038f9\") " pod="cert-manager/cert-manager-79c8d999ff-725lz"
May 29 02:33:27.399202 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:27.399167    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v9465\" (UniqueName: \"kubernetes.io/projected/fb1611e0-5253-42b2-bb8d-6ec8b75038f9-kube-api-access-v9465\") pod \"cert-manager-79c8d999ff-725lz\" (UID: \"fb1611e0-5253-42b2-bb8d-6ec8b75038f9\") " pod="cert-manager/cert-manager-79c8d999ff-725lz"
May 29 02:33:27.399396 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:27.399224    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb1611e0-5253-42b2-bb8d-6ec8b75038f9-bound-sa-token\") pod \"cert-manager-79c8d999ff-725lz\" (UID: \"fb1611e0-5253-42b2-bb8d-6ec8b75038f9\") " pod="cert-manager/cert-manager-79c8d999ff-725lz"
May 29 02:33:27.407721 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:27.407692    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fb1611e0-5253-42b2-bb8d-6ec8b75038f9-bound-sa-token\") pod \"cert-manager-79c8d999ff-725lz\" (UID: \"fb1611e0-5253-42b2-bb8d-6ec8b75038f9\") " pod="cert-manager/cert-manager-79c8d999ff-725lz"
May 29 02:33:27.407912 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:27.407895    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9465\" (UniqueName: \"kubernetes.io/projected/fb1611e0-5253-42b2-bb8d-6ec8b75038f9-kube-api-access-v9465\") pod \"cert-manager-79c8d999ff-725lz\" (UID: \"fb1611e0-5253-42b2-bb8d-6ec8b75038f9\") " pod="cert-manager/cert-manager-79c8d999ff-725lz"
May 29 02:33:27.510075 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:27.510041    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-725lz"
May 29 02:33:27.644277 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:27.644234    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-725lz"]
May 29 02:33:27.647150 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:33:27.647125    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfb1611e0_5253_42b2_bb8d_6ec8b75038f9.slice/crio-23d915bbc44e3bb829ecc26b8178b4785b10fd02235230340d5df016bae24bc6 WatchSource:0}: Error finding container 23d915bbc44e3bb829ecc26b8178b4785b10fd02235230340d5df016bae24bc6: Status 404 returned error can't find the container with id 23d915bbc44e3bb829ecc26b8178b4785b10fd02235230340d5df016bae24bc6
May 29 02:33:28.086214 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:28.086166    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-725lz" event={"ID":"fb1611e0-5253-42b2-bb8d-6ec8b75038f9","Type":"ContainerStarted","Data":"23d915bbc44e3bb829ecc26b8178b4785b10fd02235230340d5df016bae24bc6"}
May 29 02:33:28.087756 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:28.087727    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-45xxl" event={"ID":"d6fdc101-74bc-443e-a08b-e4aacb24fa53","Type":"ContainerStarted","Data":"b7afcfbe6ee6cfbfdff3710727ede3ac757ab3bd542cb51d841c1b1165f09029"}
May 29 02:33:31.098668 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:31.098630    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-725lz" event={"ID":"fb1611e0-5253-42b2-bb8d-6ec8b75038f9","Type":"ContainerStarted","Data":"c0e2812948217a2a020fe5b867cccd965a200fcffdfa65351e309e6aa7b2e7ee"}
May 29 02:33:31.099952 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:31.099932    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-45xxl" event={"ID":"d6fdc101-74bc-443e-a08b-e4aacb24fa53","Type":"ContainerStarted","Data":"4023898c9b906e0b254ca0d52bc01c3c3eafc5c4c81b728f2e46930c68d445ae"}
May 29 02:33:31.117243 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:31.117199    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-725lz" podStartSLOduration=1.2675994990000001 podStartE2EDuration="4.1171863s" podCreationTimestamp="2026-05-29 02:33:27 +0000 UTC" firstStartedPulling="2026-05-29 02:33:27.648870606 +0000 UTC m=+376.303878221" lastFinishedPulling="2026-05-29 02:33:30.498457405 +0000 UTC m=+379.153465022" observedRunningTime="2026-05-29 02:33:31.1171407 +0000 UTC m=+379.772148337" watchObservedRunningTime="2026-05-29 02:33:31.1171863 +0000 UTC m=+379.772193935"
May 29 02:33:31.136137 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:31.135516    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-45xxl" podStartSLOduration=1.789010948 podStartE2EDuration="5.135498765s" podCreationTimestamp="2026-05-29 02:33:26 +0000 UTC" firstStartedPulling="2026-05-29 02:33:27.146005838 +0000 UTC m=+375.801013452" lastFinishedPulling="2026-05-29 02:33:30.492493647 +0000 UTC m=+379.147501269" observedRunningTime="2026-05-29 02:33:31.133610505 +0000 UTC m=+379.788618197" watchObservedRunningTime="2026-05-29 02:33:31.135498765 +0000 UTC m=+379.790506402"
May 29 02:33:51.349596 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.349557    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"]
May 29 02:33:51.352350 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.352322    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"
May 29 02:33:51.355046 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.355023    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
May 29 02:33:51.355154 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.355102    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kf466\""
May 29 02:33:51.355154 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.355118    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
May 29 02:33:51.355154 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.355113    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
May 29 02:33:51.355297 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.355023    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
May 29 02:33:51.362435 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.362411    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"]
May 29 02:33:51.503053 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.503013    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/687c9e96-eab0-4d33-b96a-799530225c58-manifests\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-6tb29\" (UID: \"687c9e96-eab0-4d33-b96a-799530225c58\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"
May 29 02:33:51.503053 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.503054    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/687c9e96-eab0-4d33-b96a-799530225c58-webhook-cert\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-6tb29\" (UID: \"687c9e96-eab0-4d33-b96a-799530225c58\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"
May 29 02:33:51.503323 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.503170    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qh6n\" (UniqueName: \"kubernetes.io/projected/687c9e96-eab0-4d33-b96a-799530225c58-kube-api-access-8qh6n\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-6tb29\" (UID: \"687c9e96-eab0-4d33-b96a-799530225c58\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"
May 29 02:33:51.503323 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.503209    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/687c9e96-eab0-4d33-b96a-799530225c58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-6tb29\" (UID: \"687c9e96-eab0-4d33-b96a-799530225c58\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"
May 29 02:33:51.503323 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.503277    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/687c9e96-eab0-4d33-b96a-799530225c58-tmp\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-6tb29\" (UID: \"687c9e96-eab0-4d33-b96a-799530225c58\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"
May 29 02:33:51.604082 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.604001    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/687c9e96-eab0-4d33-b96a-799530225c58-manifests\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-6tb29\" (UID: \"687c9e96-eab0-4d33-b96a-799530225c58\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"
May 29 02:33:51.604082 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.604036    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/687c9e96-eab0-4d33-b96a-799530225c58-webhook-cert\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-6tb29\" (UID: \"687c9e96-eab0-4d33-b96a-799530225c58\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"
May 29 02:33:51.604245 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.604095    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8qh6n\" (UniqueName: \"kubernetes.io/projected/687c9e96-eab0-4d33-b96a-799530225c58-kube-api-access-8qh6n\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-6tb29\" (UID: \"687c9e96-eab0-4d33-b96a-799530225c58\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"
May 29 02:33:51.604245 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.604146    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/687c9e96-eab0-4d33-b96a-799530225c58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-6tb29\" (UID: \"687c9e96-eab0-4d33-b96a-799530225c58\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"
May 29 02:33:51.604245 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.604181    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/687c9e96-eab0-4d33-b96a-799530225c58-tmp\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-6tb29\" (UID: \"687c9e96-eab0-4d33-b96a-799530225c58\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"
May 29 02:33:51.604544 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.604516    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/687c9e96-eab0-4d33-b96a-799530225c58-manifests\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-6tb29\" (UID: \"687c9e96-eab0-4d33-b96a-799530225c58\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"
May 29 02:33:51.606565 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.606536    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/687c9e96-eab0-4d33-b96a-799530225c58-tmp\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-6tb29\" (UID: \"687c9e96-eab0-4d33-b96a-799530225c58\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"
May 29 02:33:51.606666 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.606617    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/687c9e96-eab0-4d33-b96a-799530225c58-apiservice-cert\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-6tb29\" (UID: \"687c9e96-eab0-4d33-b96a-799530225c58\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"
May 29 02:33:51.606705 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.606662    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/687c9e96-eab0-4d33-b96a-799530225c58-webhook-cert\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-6tb29\" (UID: \"687c9e96-eab0-4d33-b96a-799530225c58\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"
May 29 02:33:51.613879 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.613845    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qh6n\" (UniqueName: \"kubernetes.io/projected/687c9e96-eab0-4d33-b96a-799530225c58-kube-api-access-8qh6n\") pod \"opendatahub-operator-controller-manager-784f8c8bfd-6tb29\" (UID: \"687c9e96-eab0-4d33-b96a-799530225c58\") " pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"
May 29 02:33:51.663764 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.663736    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"
May 29 02:33:51.800895 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:51.800861    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"]
May 29 02:33:51.805513 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:33:51.805486    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod687c9e96_eab0_4d33_b96a_799530225c58.slice/crio-d87b6e07a92534abfadf614fb7b410ee274a85b21c1fca3374481bd94a1abf8a WatchSource:0}: Error finding container d87b6e07a92534abfadf614fb7b410ee274a85b21c1fca3374481bd94a1abf8a: Status 404 returned error can't find the container with id d87b6e07a92534abfadf614fb7b410ee274a85b21c1fca3374481bd94a1abf8a
May 29 02:33:52.159558 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:52.159520    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29" event={"ID":"687c9e96-eab0-4d33-b96a-799530225c58","Type":"ContainerStarted","Data":"d87b6e07a92534abfadf614fb7b410ee274a85b21c1fca3374481bd94a1abf8a"}
May 29 02:33:55.174081 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:55.173998    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29" event={"ID":"687c9e96-eab0-4d33-b96a-799530225c58","Type":"ContainerStarted","Data":"a8b4b1725ee870a2d42c3549e84047fa36951e2428c5dc0f0615eaa6710cf49a"}
May 29 02:33:56.178919 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:56.178826    2573 generic.go:358] "Generic (PLEG): container finished" podID="687c9e96-eab0-4d33-b96a-799530225c58" containerID="a8b4b1725ee870a2d42c3549e84047fa36951e2428c5dc0f0615eaa6710cf49a" exitCode=0
May 29 02:33:56.179297 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:56.178918    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29" event={"ID":"687c9e96-eab0-4d33-b96a-799530225c58","Type":"ContainerDied","Data":"a8b4b1725ee870a2d42c3549e84047fa36951e2428c5dc0f0615eaa6710cf49a"}
May 29 02:33:57.184077 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:57.184037    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29" event={"ID":"687c9e96-eab0-4d33-b96a-799530225c58","Type":"ContainerStarted","Data":"a2e55fd454d2595f7c9a3bd9dc1d59c7e378dd68a6a1314256f08aaddb4baa85"}
May 29 02:33:57.184572 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:57.184124    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"
May 29 02:33:57.209700 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:33:57.209645    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29" podStartSLOduration=1.5647106659999999 podStartE2EDuration="6.209628649s" podCreationTimestamp="2026-05-29 02:33:51 +0000 UTC" firstStartedPulling="2026-05-29 02:33:51.807305591 +0000 UTC m=+400.462313219" lastFinishedPulling="2026-05-29 02:33:56.452223585 +0000 UTC m=+405.107231202" observedRunningTime="2026-05-29 02:33:57.207794524 +0000 UTC m=+405.862802162" watchObservedRunningTime="2026-05-29 02:33:57.209628649 +0000 UTC m=+405.864636284"
May 29 02:34:08.189724 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:08.189693    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-784f8c8bfd-6tb29"
May 29 02:34:11.530318 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.530283    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-784859b99c-55b2j"]
May 29 02:34:11.535828 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.535791    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-784859b99c-55b2j"
May 29 02:34:11.539642 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.539620    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
May 29 02:34:11.539818 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.539621    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
May 29 02:34:11.539880 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.539654    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tgrth\""
May 29 02:34:11.539880 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.539660    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
May 29 02:34:11.539988 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.539716    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
May 29 02:34:11.539988 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.539720    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
May 29 02:34:11.545200 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.545180    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-784859b99c-55b2j"]
May 29 02:34:11.573413 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.573379    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8c244f8-e968-4ce4-82d7-b73bdfabfef9-cert\") pod \"lws-controller-manager-784859b99c-55b2j\" (UID: \"c8c244f8-e968-4ce4-82d7-b73bdfabfef9\") " pod="openshift-lws-operator/lws-controller-manager-784859b99c-55b2j"
May 29 02:34:11.573581 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.573449    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8c244f8-e968-4ce4-82d7-b73bdfabfef9-metrics-cert\") pod \"lws-controller-manager-784859b99c-55b2j\" (UID: \"c8c244f8-e968-4ce4-82d7-b73bdfabfef9\") " pod="openshift-lws-operator/lws-controller-manager-784859b99c-55b2j"
May 29 02:34:11.573581 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.573490    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwd5k\" (UniqueName: \"kubernetes.io/projected/c8c244f8-e968-4ce4-82d7-b73bdfabfef9-kube-api-access-qwd5k\") pod \"lws-controller-manager-784859b99c-55b2j\" (UID: \"c8c244f8-e968-4ce4-82d7-b73bdfabfef9\") " pod="openshift-lws-operator/lws-controller-manager-784859b99c-55b2j"
May 29 02:34:11.573689 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.573568    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c8c244f8-e968-4ce4-82d7-b73bdfabfef9-manager-config\") pod \"lws-controller-manager-784859b99c-55b2j\" (UID: \"c8c244f8-e968-4ce4-82d7-b73bdfabfef9\") " pod="openshift-lws-operator/lws-controller-manager-784859b99c-55b2j"
May 29 02:34:11.674492 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.674454    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8c244f8-e968-4ce4-82d7-b73bdfabfef9-metrics-cert\") pod \"lws-controller-manager-784859b99c-55b2j\" (UID: \"c8c244f8-e968-4ce4-82d7-b73bdfabfef9\") " pod="openshift-lws-operator/lws-controller-manager-784859b99c-55b2j"
May 29 02:34:11.674668 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.674504    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwd5k\" (UniqueName: \"kubernetes.io/projected/c8c244f8-e968-4ce4-82d7-b73bdfabfef9-kube-api-access-qwd5k\") pod \"lws-controller-manager-784859b99c-55b2j\" (UID: \"c8c244f8-e968-4ce4-82d7-b73bdfabfef9\") " pod="openshift-lws-operator/lws-controller-manager-784859b99c-55b2j"
May 29 02:34:11.674668 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.674548    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c8c244f8-e968-4ce4-82d7-b73bdfabfef9-manager-config\") pod \"lws-controller-manager-784859b99c-55b2j\" (UID: \"c8c244f8-e968-4ce4-82d7-b73bdfabfef9\") " pod="openshift-lws-operator/lws-controller-manager-784859b99c-55b2j"
May 29 02:34:11.674668 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.674604    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8c244f8-e968-4ce4-82d7-b73bdfabfef9-cert\") pod \"lws-controller-manager-784859b99c-55b2j\" (UID: \"c8c244f8-e968-4ce4-82d7-b73bdfabfef9\") " pod="openshift-lws-operator/lws-controller-manager-784859b99c-55b2j"
May 29 02:34:11.675276 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.675225    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/c8c244f8-e968-4ce4-82d7-b73bdfabfef9-manager-config\") pod \"lws-controller-manager-784859b99c-55b2j\" (UID: \"c8c244f8-e968-4ce4-82d7-b73bdfabfef9\") " pod="openshift-lws-operator/lws-controller-manager-784859b99c-55b2j"
May 29 02:34:11.676855 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.676828    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/c8c244f8-e968-4ce4-82d7-b73bdfabfef9-metrics-cert\") pod \"lws-controller-manager-784859b99c-55b2j\" (UID: \"c8c244f8-e968-4ce4-82d7-b73bdfabfef9\") " pod="openshift-lws-operator/lws-controller-manager-784859b99c-55b2j"
May 29 02:34:11.676961 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.676904    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c8c244f8-e968-4ce4-82d7-b73bdfabfef9-cert\") pod \"lws-controller-manager-784859b99c-55b2j\" (UID: \"c8c244f8-e968-4ce4-82d7-b73bdfabfef9\") " pod="openshift-lws-operator/lws-controller-manager-784859b99c-55b2j"
May 29 02:34:11.682737 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.682715    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwd5k\" (UniqueName: \"kubernetes.io/projected/c8c244f8-e968-4ce4-82d7-b73bdfabfef9-kube-api-access-qwd5k\") pod \"lws-controller-manager-784859b99c-55b2j\" (UID: \"c8c244f8-e968-4ce4-82d7-b73bdfabfef9\") " pod="openshift-lws-operator/lws-controller-manager-784859b99c-55b2j"
May 29 02:34:11.849950 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.849869    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tgrth\""
May 29 02:34:11.858165 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:11.858135    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-784859b99c-55b2j"
May 29 02:34:12.015627 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:12.015599    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-784859b99c-55b2j"]
May 29 02:34:12.018612 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:34:12.018584    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8c244f8_e968_4ce4_82d7_b73bdfabfef9.slice/crio-8d14601045669a9f8be2ecf106aadee84e958de5197cecffc3129f64a71a610b WatchSource:0}: Error finding container 8d14601045669a9f8be2ecf106aadee84e958de5197cecffc3129f64a71a610b: Status 404 returned error can't find the container with id 8d14601045669a9f8be2ecf106aadee84e958de5197cecffc3129f64a71a610b
May 29 02:34:12.232614 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:12.232576    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-784859b99c-55b2j" event={"ID":"c8c244f8-e968-4ce4-82d7-b73bdfabfef9","Type":"ContainerStarted","Data":"8d14601045669a9f8be2ecf106aadee84e958de5197cecffc3129f64a71a610b"}
May 29 02:34:12.620374 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:12.620286    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-79cf786587-zvskf"]
May 29 02:34:12.623616 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:12.623598    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79cf786587-zvskf"
May 29 02:34:12.626329 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:12.626309    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-r8frr\""
May 29 02:34:12.626436 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:12.626346    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
May 29 02:34:12.626436 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:12.626368    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
May 29 02:34:12.633277 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:12.632820    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79cf786587-zvskf"]
May 29 02:34:12.684610 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:12.684574    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e49f478-a3fb-4d57-a28b-3cac0dccba5c-tls-certs\") pod \"kube-auth-proxy-79cf786587-zvskf\" (UID: \"6e49f478-a3fb-4d57-a28b-3cac0dccba5c\") " pod="openshift-ingress/kube-auth-proxy-79cf786587-zvskf"
May 29 02:34:12.684799 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:12.684638    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e49f478-a3fb-4d57-a28b-3cac0dccba5c-tmp\") pod \"kube-auth-proxy-79cf786587-zvskf\" (UID: \"6e49f478-a3fb-4d57-a28b-3cac0dccba5c\") " pod="openshift-ingress/kube-auth-proxy-79cf786587-zvskf"
May 29 02:34:12.684799 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:12.684728    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg2c8\" (UniqueName: \"kubernetes.io/projected/6e49f478-a3fb-4d57-a28b-3cac0dccba5c-kube-api-access-xg2c8\") pod \"kube-auth-proxy-79cf786587-zvskf\" (UID: \"6e49f478-a3fb-4d57-a28b-3cac0dccba5c\") " pod="openshift-ingress/kube-auth-proxy-79cf786587-zvskf"
May 29 02:34:12.785856 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:12.785821    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e49f478-a3fb-4d57-a28b-3cac0dccba5c-tls-certs\") pod \"kube-auth-proxy-79cf786587-zvskf\" (UID: \"6e49f478-a3fb-4d57-a28b-3cac0dccba5c\") " pod="openshift-ingress/kube-auth-proxy-79cf786587-zvskf"
May 29 02:34:12.786038 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:12.785874    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e49f478-a3fb-4d57-a28b-3cac0dccba5c-tmp\") pod \"kube-auth-proxy-79cf786587-zvskf\" (UID: \"6e49f478-a3fb-4d57-a28b-3cac0dccba5c\") " pod="openshift-ingress/kube-auth-proxy-79cf786587-zvskf"
May 29 02:34:12.786038 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:12.785919    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xg2c8\" (UniqueName: \"kubernetes.io/projected/6e49f478-a3fb-4d57-a28b-3cac0dccba5c-kube-api-access-xg2c8\") pod \"kube-auth-proxy-79cf786587-zvskf\" (UID: \"6e49f478-a3fb-4d57-a28b-3cac0dccba5c\") " pod="openshift-ingress/kube-auth-proxy-79cf786587-zvskf"
May 29 02:34:12.786038 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:34:12.785977    2573 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
May 29 02:34:12.786208 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:34:12.786051    2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e49f478-a3fb-4d57-a28b-3cac0dccba5c-tls-certs podName:6e49f478-a3fb-4d57-a28b-3cac0dccba5c nodeName:}" failed. No retries permitted until 2026-05-29 02:34:13.28603069 +0000 UTC m=+421.941038305 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/6e49f478-a3fb-4d57-a28b-3cac0dccba5c-tls-certs") pod "kube-auth-proxy-79cf786587-zvskf" (UID: "6e49f478-a3fb-4d57-a28b-3cac0dccba5c") : secret "kube-auth-proxy-tls" not found
May 29 02:34:12.787999 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:12.787980    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e49f478-a3fb-4d57-a28b-3cac0dccba5c-tmp\") pod \"kube-auth-proxy-79cf786587-zvskf\" (UID: \"6e49f478-a3fb-4d57-a28b-3cac0dccba5c\") " pod="openshift-ingress/kube-auth-proxy-79cf786587-zvskf"
May 29 02:34:12.796775 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:12.796744    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg2c8\" (UniqueName: \"kubernetes.io/projected/6e49f478-a3fb-4d57-a28b-3cac0dccba5c-kube-api-access-xg2c8\") pod \"kube-auth-proxy-79cf786587-zvskf\" (UID: \"6e49f478-a3fb-4d57-a28b-3cac0dccba5c\") " pod="openshift-ingress/kube-auth-proxy-79cf786587-zvskf"
May 29 02:34:13.291770 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:13.291469    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e49f478-a3fb-4d57-a28b-3cac0dccba5c-tls-certs\") pod \"kube-auth-proxy-79cf786587-zvskf\" (UID: \"6e49f478-a3fb-4d57-a28b-3cac0dccba5c\") " pod="openshift-ingress/kube-auth-proxy-79cf786587-zvskf"
May 29 02:34:13.294851 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:13.294799    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6e49f478-a3fb-4d57-a28b-3cac0dccba5c-tls-certs\") pod \"kube-auth-proxy-79cf786587-zvskf\" (UID: \"6e49f478-a3fb-4d57-a28b-3cac0dccba5c\") " pod="openshift-ingress/kube-auth-proxy-79cf786587-zvskf"
May 29 02:34:13.536077 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:13.536041    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-79cf786587-zvskf"
May 29 02:34:13.689953 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:13.689896    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-79cf786587-zvskf"]
May 29 02:34:14.667950 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:34:14.667907    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e49f478_a3fb_4d57_a28b_3cac0dccba5c.slice/crio-8759c9001e8be715dca39b7008a2de339fd36f90322624cde63347b16f6aebbb WatchSource:0}: Error finding container 8759c9001e8be715dca39b7008a2de339fd36f90322624cde63347b16f6aebbb: Status 404 returned error can't find the container with id 8759c9001e8be715dca39b7008a2de339fd36f90322624cde63347b16f6aebbb
May 29 02:34:15.247704 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:15.247666    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79cf786587-zvskf" event={"ID":"6e49f478-a3fb-4d57-a28b-3cac0dccba5c","Type":"ContainerStarted","Data":"8759c9001e8be715dca39b7008a2de339fd36f90322624cde63347b16f6aebbb"}
May 29 02:34:15.249658 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:15.249627    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-784859b99c-55b2j" event={"ID":"c8c244f8-e968-4ce4-82d7-b73bdfabfef9","Type":"ContainerStarted","Data":"e5757f746c3e727b118220ef290098965d41b960fe572fd8120a63c5adcf5f1b"}
May 29 02:34:15.250409 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:15.250374    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-784859b99c-55b2j"
May 29 02:34:15.267643 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:15.267591    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-784859b99c-55b2j" podStartSLOduration=1.560502963 podStartE2EDuration="4.267571396s" podCreationTimestamp="2026-05-29 02:34:11 +0000 UTC" firstStartedPulling="2026-05-29 02:34:12.020431164 +0000 UTC m=+420.675438791" lastFinishedPulling="2026-05-29 02:34:14.727499595 +0000 UTC m=+423.382507224" observedRunningTime="2026-05-29 02:34:15.266996822 +0000 UTC m=+423.922004459" watchObservedRunningTime="2026-05-29 02:34:15.267571396 +0000 UTC m=+423.922579033"
May 29 02:34:18.267886 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:18.267843    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-79cf786587-zvskf" event={"ID":"6e49f478-a3fb-4d57-a28b-3cac0dccba5c","Type":"ContainerStarted","Data":"8afeca2bf74b47a41c676aa4fbe79f0b0500d8e4f04338aa0a47069490bd1839"}
May 29 02:34:18.292771 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:18.292721    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-79cf786587-zvskf" podStartSLOduration=3.606799831 podStartE2EDuration="6.292708382s" podCreationTimestamp="2026-05-29 02:34:12 +0000 UTC" firstStartedPulling="2026-05-29 02:34:14.669890887 +0000 UTC m=+423.324898500" lastFinishedPulling="2026-05-29 02:34:17.355799425 +0000 UTC m=+426.010807051" observedRunningTime="2026-05-29 02:34:18.290013301 +0000 UTC m=+426.945020937" watchObservedRunningTime="2026-05-29 02:34:18.292708382 +0000 UTC m=+426.947716018"
May 29 02:34:27.265477 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:34:27.265447    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-784859b99c-55b2j"
May 29 02:35:50.314809 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.314775    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6949cbf474-rmgp5"]
May 29 02:35:50.318048 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.318020    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.333348 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.333313    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6949cbf474-rmgp5"]
May 29 02:35:50.396097 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.396056    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/caf24f48-9950-4219-ab46-00061245d240-oauth-serving-cert\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.396275 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.396113    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/caf24f48-9950-4219-ab46-00061245d240-service-ca\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.396275 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.396197    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxtbp\" (UniqueName: \"kubernetes.io/projected/caf24f48-9950-4219-ab46-00061245d240-kube-api-access-sxtbp\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.396275 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.396218    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/caf24f48-9950-4219-ab46-00061245d240-console-serving-cert\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.396275 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.396237    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/caf24f48-9950-4219-ab46-00061245d240-console-oauth-config\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.396476 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.396286    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/caf24f48-9950-4219-ab46-00061245d240-console-config\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.396476 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.396338    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caf24f48-9950-4219-ab46-00061245d240-trusted-ca-bundle\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.497461 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.497431    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sxtbp\" (UniqueName: \"kubernetes.io/projected/caf24f48-9950-4219-ab46-00061245d240-kube-api-access-sxtbp\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.497461 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.497465    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/caf24f48-9950-4219-ab46-00061245d240-console-serving-cert\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.497693 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.497483    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/caf24f48-9950-4219-ab46-00061245d240-console-oauth-config\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.497693 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.497502    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/caf24f48-9950-4219-ab46-00061245d240-console-config\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.497693 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.497545    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caf24f48-9950-4219-ab46-00061245d240-trusted-ca-bundle\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.497693 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.497575    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/caf24f48-9950-4219-ab46-00061245d240-oauth-serving-cert\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.497693 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.497614    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/caf24f48-9950-4219-ab46-00061245d240-service-ca\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.498348 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.498323    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/caf24f48-9950-4219-ab46-00061245d240-service-ca\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.498476 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.498389    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/caf24f48-9950-4219-ab46-00061245d240-console-config\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.498541 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.498496    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/caf24f48-9950-4219-ab46-00061245d240-oauth-serving-cert\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.498598 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.498538    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/caf24f48-9950-4219-ab46-00061245d240-trusted-ca-bundle\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.500011 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.499989    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/caf24f48-9950-4219-ab46-00061245d240-console-oauth-config\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.500138 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.500073    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/caf24f48-9950-4219-ab46-00061245d240-console-serving-cert\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.507292 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.507243    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxtbp\" (UniqueName: \"kubernetes.io/projected/caf24f48-9950-4219-ab46-00061245d240-kube-api-access-sxtbp\") pod \"console-6949cbf474-rmgp5\" (UID: \"caf24f48-9950-4219-ab46-00061245d240\") " pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.627811 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.627739    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:35:50.767102 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:50.767076    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6949cbf474-rmgp5"]
May 29 02:35:50.769231 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:35:50.769201    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf24f48_9950_4219_ab46_00061245d240.slice/crio-34da106c1f99cc153bbd471c775df324b36c6e9e1d2de01232ec5c493d953160 WatchSource:0}: Error finding container 34da106c1f99cc153bbd471c775df324b36c6e9e1d2de01232ec5c493d953160: Status 404 returned error can't find the container with id 34da106c1f99cc153bbd471c775df324b36c6e9e1d2de01232ec5c493d953160
May 29 02:35:51.562844 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:51.562808    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6949cbf474-rmgp5" event={"ID":"caf24f48-9950-4219-ab46-00061245d240","Type":"ContainerStarted","Data":"3809eff0603d9958e45a87bf20096e087ebc476ee5d5e27c03f5e8b545d57646"}
May 29 02:35:51.562844 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:51.562842    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6949cbf474-rmgp5" event={"ID":"caf24f48-9950-4219-ab46-00061245d240","Type":"ContainerStarted","Data":"34da106c1f99cc153bbd471c775df324b36c6e9e1d2de01232ec5c493d953160"}
May 29 02:35:51.610494 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:51.610451    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6949cbf474-rmgp5" podStartSLOduration=1.610436788 podStartE2EDuration="1.610436788s" podCreationTimestamp="2026-05-29 02:35:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 02:35:51.608033471 +0000 UTC m=+520.263041119" watchObservedRunningTime="2026-05-29 02:35:51.610436788 +0000 UTC m=+520.265444423"
May 29 02:35:55.077553 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:55.077514    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-mn9c8"]
May 29 02:35:55.081318 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:55.081299    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mn9c8"
May 29 02:35:55.086223 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:55.086197    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
May 29 02:35:55.088090 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:55.088071    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
May 29 02:35:55.088563 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:55.088548    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-r8fqv\""
May 29 02:35:55.088944 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:55.088930    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
May 29 02:35:55.094967 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:55.094952    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-mn9c8"]
May 29 02:35:55.233755 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:55.233717    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zrls\" (UniqueName: \"kubernetes.io/projected/d25871e0-f6a1-49a5-a406-61d8dddebbc8-kube-api-access-9zrls\") pod \"dns-operator-controller-manager-648d5c98bc-mn9c8\" (UID: \"d25871e0-f6a1-49a5-a406-61d8dddebbc8\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mn9c8"
May 29 02:35:55.335315 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:55.335194    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9zrls\" (UniqueName: \"kubernetes.io/projected/d25871e0-f6a1-49a5-a406-61d8dddebbc8-kube-api-access-9zrls\") pod \"dns-operator-controller-manager-648d5c98bc-mn9c8\" (UID: \"d25871e0-f6a1-49a5-a406-61d8dddebbc8\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mn9c8"
May 29 02:35:55.344760 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:55.344734    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zrls\" (UniqueName: \"kubernetes.io/projected/d25871e0-f6a1-49a5-a406-61d8dddebbc8-kube-api-access-9zrls\") pod \"dns-operator-controller-manager-648d5c98bc-mn9c8\" (UID: \"d25871e0-f6a1-49a5-a406-61d8dddebbc8\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mn9c8"
May 29 02:35:55.402335 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:55.402313    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mn9c8"
May 29 02:35:55.528020 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:55.527933    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-mn9c8"]
May 29 02:35:55.530241 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:35:55.530217    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd25871e0_f6a1_49a5_a406_61d8dddebbc8.slice/crio-c5d566cc06ce3e7e7a3b56c793957a73a542959fd4ad64506de7817d9b474c34 WatchSource:0}: Error finding container c5d566cc06ce3e7e7a3b56c793957a73a542959fd4ad64506de7817d9b474c34: Status 404 returned error can't find the container with id c5d566cc06ce3e7e7a3b56c793957a73a542959fd4ad64506de7817d9b474c34
May 29 02:35:55.576182 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:55.576154    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mn9c8" event={"ID":"d25871e0-f6a1-49a5-a406-61d8dddebbc8","Type":"ContainerStarted","Data":"c5d566cc06ce3e7e7a3b56c793957a73a542959fd4ad64506de7817d9b474c34"}
May 29 02:35:56.801836 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:56.801808    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bt4rr"]
May 29 02:35:56.804974 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:56.804958    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bt4rr"
May 29 02:35:56.808570 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:56.808546    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
May 29 02:35:56.809040 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:56.809025    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-c5vts\""
May 29 02:35:56.809741 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:56.809728    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
May 29 02:35:56.821142 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:56.821095    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bt4rr"]
May 29 02:35:56.950474 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:56.950441    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1ff5906b-e5fc-4bc8-bf20-497518748605-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-bt4rr\" (UID: \"1ff5906b-e5fc-4bc8-bf20-497518748605\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bt4rr"
May 29 02:35:56.950654 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:56.950489    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vc77\" (UniqueName: \"kubernetes.io/projected/1ff5906b-e5fc-4bc8-bf20-497518748605-kube-api-access-7vc77\") pod \"kuadrant-console-plugin-6cb54b5c86-bt4rr\" (UID: \"1ff5906b-e5fc-4bc8-bf20-497518748605\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bt4rr"
May 29 02:35:56.950654 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:56.950629    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ff5906b-e5fc-4bc8-bf20-497518748605-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-bt4rr\" (UID: \"1ff5906b-e5fc-4bc8-bf20-497518748605\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bt4rr"
May 29 02:35:57.051655 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:57.051621    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vc77\" (UniqueName: \"kubernetes.io/projected/1ff5906b-e5fc-4bc8-bf20-497518748605-kube-api-access-7vc77\") pod \"kuadrant-console-plugin-6cb54b5c86-bt4rr\" (UID: \"1ff5906b-e5fc-4bc8-bf20-497518748605\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bt4rr"
May 29 02:35:57.051821 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:57.051738    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ff5906b-e5fc-4bc8-bf20-497518748605-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-bt4rr\" (UID: \"1ff5906b-e5fc-4bc8-bf20-497518748605\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bt4rr"
May 29 02:35:57.051821 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:57.051774    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1ff5906b-e5fc-4bc8-bf20-497518748605-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-bt4rr\" (UID: \"1ff5906b-e5fc-4bc8-bf20-497518748605\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bt4rr"
May 29 02:35:57.052740 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:57.052663    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/1ff5906b-e5fc-4bc8-bf20-497518748605-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-bt4rr\" (UID: \"1ff5906b-e5fc-4bc8-bf20-497518748605\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bt4rr"
May 29 02:35:57.054617 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:57.054590    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/1ff5906b-e5fc-4bc8-bf20-497518748605-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-bt4rr\" (UID: \"1ff5906b-e5fc-4bc8-bf20-497518748605\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bt4rr"
May 29 02:35:57.060145 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:57.060119    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vc77\" (UniqueName: \"kubernetes.io/projected/1ff5906b-e5fc-4bc8-bf20-497518748605-kube-api-access-7vc77\") pod \"kuadrant-console-plugin-6cb54b5c86-bt4rr\" (UID: \"1ff5906b-e5fc-4bc8-bf20-497518748605\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bt4rr"
May 29 02:35:57.114808 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:57.114760    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bt4rr"
May 29 02:35:57.246742 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:57.246718    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bt4rr"]
May 29 02:35:57.248731 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:35:57.248702    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ff5906b_e5fc_4bc8_bf20_497518748605.slice/crio-90fafc11634bf2f39c00dfdb4e7e118267436f55d592518571a70122888e0f86 WatchSource:0}: Error finding container 90fafc11634bf2f39c00dfdb4e7e118267436f55d592518571a70122888e0f86: Status 404 returned error can't find the container with id 90fafc11634bf2f39c00dfdb4e7e118267436f55d592518571a70122888e0f86
May 29 02:35:57.585244 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:57.585209    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bt4rr" event={"ID":"1ff5906b-e5fc-4bc8-bf20-497518748605","Type":"ContainerStarted","Data":"90fafc11634bf2f39c00dfdb4e7e118267436f55d592518571a70122888e0f86"}
May 29 02:35:58.591207 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:58.591168    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mn9c8" event={"ID":"d25871e0-f6a1-49a5-a406-61d8dddebbc8","Type":"ContainerStarted","Data":"438d347c198eb7c1226664da8105c158e4e37e24a6f08a334843129c2cccc51b"}
May 29 02:35:58.591739 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:58.591409    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mn9c8"
May 29 02:35:58.610770 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:35:58.610722    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mn9c8" podStartSLOduration=1.129753357 podStartE2EDuration="3.610709187s" podCreationTimestamp="2026-05-29 02:35:55 +0000 UTC" firstStartedPulling="2026-05-29 02:35:55.532209639 +0000 UTC m=+524.187217253" lastFinishedPulling="2026-05-29 02:35:58.013165455 +0000 UTC m=+526.668173083" observedRunningTime="2026-05-29 02:35:58.609914485 +0000 UTC m=+527.264922137" watchObservedRunningTime="2026-05-29 02:35:58.610709187 +0000 UTC m=+527.265716822"
May 29 02:36:00.628871 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:00.628767    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:36:00.628871 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:00.628821    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:36:00.634032 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:00.633996    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:36:01.605973 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:01.605942    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6949cbf474-rmgp5"
May 29 02:36:01.660182 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:01.660139    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-668cdd958c-xsn49"]
May 29 02:36:09.598288 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:09.598237    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-mn9c8"
May 29 02:36:20.675860 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:20.675771    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bt4rr" event={"ID":"1ff5906b-e5fc-4bc8-bf20-497518748605","Type":"ContainerStarted","Data":"fee8258f160ee269b4bc5790f709195a60d6e46ae0dfa0df5cabf3702f3a0dfd"}
May 29 02:36:20.693350 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:20.693271    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-bt4rr" podStartSLOduration=1.696143924 podStartE2EDuration="24.693236694s" podCreationTimestamp="2026-05-29 02:35:56 +0000 UTC" firstStartedPulling="2026-05-29 02:35:57.250022069 +0000 UTC m=+525.905029683" lastFinishedPulling="2026-05-29 02:36:20.247114837 +0000 UTC m=+548.902122453" observedRunningTime="2026-05-29 02:36:20.692228075 +0000 UTC m=+549.347235710" watchObservedRunningTime="2026-05-29 02:36:20.693236694 +0000 UTC m=+549.348244332"
May 29 02:36:26.690487 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:26.690445    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-668cdd958c-xsn49" podUID="2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5" containerName="console" containerID="cri-o://03f95e215736b368df3a85d2a19f0dd92c30ce57aa3994b025a7da939333ff5e" gracePeriod=15
May 29 02:36:26.935030 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:26.935007    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-668cdd958c-xsn49_2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5/console/0.log"
May 29 02:36:26.935153 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:26.935067    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:36:27.034992 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.034902    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-service-ca\") pod \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") "
May 29 02:36:27.034992 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.034960    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-console-oauth-config\") pod \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") "
May 29 02:36:27.034992 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.034990    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gvf92\" (UniqueName: \"kubernetes.io/projected/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-kube-api-access-gvf92\") pod \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") "
May 29 02:36:27.035304 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.035009    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-oauth-serving-cert\") pod \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") "
May 29 02:36:27.035304 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.035025    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-console-config\") pod \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") "
May 29 02:36:27.035304 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.035057    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-console-serving-cert\") pod \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") "
May 29 02:36:27.035304 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.035132    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-trusted-ca-bundle\") pod \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\" (UID: \"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5\") "
May 29 02:36:27.035529 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.035350    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-service-ca" (OuterVolumeSpecName: "service-ca") pod "2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5" (UID: "2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:36:27.035529 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.035469    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-console-config" (OuterVolumeSpecName: "console-config") pod "2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5" (UID: "2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:36:27.035647 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.035622    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5" (UID: "2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:36:27.035705 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.035686    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5" (UID: "2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
May 29 02:36:27.037317 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.037289    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-kube-api-access-gvf92" (OuterVolumeSpecName: "kube-api-access-gvf92") pod "2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5" (UID: "2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5"). InnerVolumeSpecName "kube-api-access-gvf92". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:36:27.037620 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.037593    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5" (UID: "2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:36:27.037715 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.037639    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5" (UID: "2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
May 29 02:36:27.136836 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.136796    2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-trusted-ca-bundle\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:36:27.136836 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.136831    2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-service-ca\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:36:27.136836 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.136840    2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-console-oauth-config\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:36:27.137077 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.136849    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gvf92\" (UniqueName: \"kubernetes.io/projected/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-kube-api-access-gvf92\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:36:27.137077 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.136858    2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-oauth-serving-cert\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:36:27.137077 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.136867    2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-console-config\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:36:27.137077 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.136875    2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5-console-serving-cert\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:36:27.700483 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.700452    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-668cdd958c-xsn49_2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5/console/0.log"
May 29 02:36:27.700896 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.700499    2573 generic.go:358] "Generic (PLEG): container finished" podID="2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5" containerID="03f95e215736b368df3a85d2a19f0dd92c30ce57aa3994b025a7da939333ff5e" exitCode=2
May 29 02:36:27.700896 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.700570    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-668cdd958c-xsn49"
May 29 02:36:27.700896 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.700589    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668cdd958c-xsn49" event={"ID":"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5","Type":"ContainerDied","Data":"03f95e215736b368df3a85d2a19f0dd92c30ce57aa3994b025a7da939333ff5e"}
May 29 02:36:27.700896 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.700630    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-668cdd958c-xsn49" event={"ID":"2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5","Type":"ContainerDied","Data":"b698b1fb74d8bdaa2cc07461ed594115ce7543e0aded24b797ef37086cb97038"}
May 29 02:36:27.700896 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.700646    2573 scope.go:117] "RemoveContainer" containerID="03f95e215736b368df3a85d2a19f0dd92c30ce57aa3994b025a7da939333ff5e"
May 29 02:36:27.709860 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.709839    2573 scope.go:117] "RemoveContainer" containerID="03f95e215736b368df3a85d2a19f0dd92c30ce57aa3994b025a7da939333ff5e"
May 29 02:36:27.710145 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:36:27.710126    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"03f95e215736b368df3a85d2a19f0dd92c30ce57aa3994b025a7da939333ff5e\": container with ID starting with 03f95e215736b368df3a85d2a19f0dd92c30ce57aa3994b025a7da939333ff5e not found: ID does not exist" containerID="03f95e215736b368df3a85d2a19f0dd92c30ce57aa3994b025a7da939333ff5e"
May 29 02:36:27.710219 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.710153    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"03f95e215736b368df3a85d2a19f0dd92c30ce57aa3994b025a7da939333ff5e"} err="failed to get container status \"03f95e215736b368df3a85d2a19f0dd92c30ce57aa3994b025a7da939333ff5e\": rpc error: code = NotFound desc = could not find container \"03f95e215736b368df3a85d2a19f0dd92c30ce57aa3994b025a7da939333ff5e\": container with ID starting with 03f95e215736b368df3a85d2a19f0dd92c30ce57aa3994b025a7da939333ff5e not found: ID does not exist"
May 29 02:36:27.724560 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.724524    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-668cdd958c-xsn49"]
May 29 02:36:27.727516 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.727493    2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-668cdd958c-xsn49"]
May 29 02:36:27.971640 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:27.971560    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5" path="/var/lib/kubelet/pods/2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5/volumes"
May 29 02:36:41.612203 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:41.612172    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:36:41.612630 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:41.612531    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5" containerName="console"
May 29 02:36:41.612630 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:41.612543    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5" containerName="console"
May 29 02:36:41.612630 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:41.612603    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="2fcbfe9b-1a5c-44eb-8512-72f4865ff2c5" containerName="console"
May 29 02:36:41.654891 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:41.654862    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:36:41.654891 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:41.654890    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:36:41.655093 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:41.654986    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-qtb5x"
May 29 02:36:41.657999 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:41.657976    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
May 29 02:36:41.765449 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:41.765413    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f8570381-fb0f-4838-a846-dff76dbd5a03-config-file\") pod \"limitador-limitador-78c99df468-qtb5x\" (UID: \"f8570381-fb0f-4838-a846-dff76dbd5a03\") " pod="kuadrant-system/limitador-limitador-78c99df468-qtb5x"
May 29 02:36:41.765617 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:41.765467    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgkhf\" (UniqueName: \"kubernetes.io/projected/f8570381-fb0f-4838-a846-dff76dbd5a03-kube-api-access-bgkhf\") pod \"limitador-limitador-78c99df468-qtb5x\" (UID: \"f8570381-fb0f-4838-a846-dff76dbd5a03\") " pod="kuadrant-system/limitador-limitador-78c99df468-qtb5x"
May 29 02:36:41.867005 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:41.866928    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bgkhf\" (UniqueName: \"kubernetes.io/projected/f8570381-fb0f-4838-a846-dff76dbd5a03-kube-api-access-bgkhf\") pod \"limitador-limitador-78c99df468-qtb5x\" (UID: \"f8570381-fb0f-4838-a846-dff76dbd5a03\") " pod="kuadrant-system/limitador-limitador-78c99df468-qtb5x"
May 29 02:36:41.867156 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:41.867041    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f8570381-fb0f-4838-a846-dff76dbd5a03-config-file\") pod \"limitador-limitador-78c99df468-qtb5x\" (UID: \"f8570381-fb0f-4838-a846-dff76dbd5a03\") " pod="kuadrant-system/limitador-limitador-78c99df468-qtb5x"
May 29 02:36:41.867697 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:41.867677    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/f8570381-fb0f-4838-a846-dff76dbd5a03-config-file\") pod \"limitador-limitador-78c99df468-qtb5x\" (UID: \"f8570381-fb0f-4838-a846-dff76dbd5a03\") " pod="kuadrant-system/limitador-limitador-78c99df468-qtb5x"
May 29 02:36:41.877574 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:41.877551    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgkhf\" (UniqueName: \"kubernetes.io/projected/f8570381-fb0f-4838-a846-dff76dbd5a03-kube-api-access-bgkhf\") pod \"limitador-limitador-78c99df468-qtb5x\" (UID: \"f8570381-fb0f-4838-a846-dff76dbd5a03\") " pod="kuadrant-system/limitador-limitador-78c99df468-qtb5x"
May 29 02:36:41.965585 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:41.965544    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-78c99df468-qtb5x"
May 29 02:36:42.098399 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:42.098369    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:36:42.101972 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:36:42.101938    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8570381_fb0f_4838_a846_dff76dbd5a03.slice/crio-39d58dca8c822067b502b283adc493d46ed8082c9a6e2365f12912f55a274f7d WatchSource:0}: Error finding container 39d58dca8c822067b502b283adc493d46ed8082c9a6e2365f12912f55a274f7d: Status 404 returned error can't find the container with id 39d58dca8c822067b502b283adc493d46ed8082c9a6e2365f12912f55a274f7d
May 29 02:36:42.447935 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:42.447903    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-6fvb8"]
May 29 02:36:42.492155 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:42.492117    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-6fvb8"]
May 29 02:36:42.492155 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:42.492144    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-6fvb8"
May 29 02:36:42.495073 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:42.495054    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-l9kwg\""
May 29 02:36:42.675632 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:42.675596    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85p4g\" (UniqueName: \"kubernetes.io/projected/73ab8e5c-1270-4ab8-b70d-793a51a5432e-kube-api-access-85p4g\") pod \"authorino-7498df8756-6fvb8\" (UID: \"73ab8e5c-1270-4ab8-b70d-793a51a5432e\") " pod="kuadrant-system/authorino-7498df8756-6fvb8"
May 29 02:36:42.750173 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:42.750091    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-qtb5x" event={"ID":"f8570381-fb0f-4838-a846-dff76dbd5a03","Type":"ContainerStarted","Data":"39d58dca8c822067b502b283adc493d46ed8082c9a6e2365f12912f55a274f7d"}
May 29 02:36:42.776352 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:42.776311    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-85p4g\" (UniqueName: \"kubernetes.io/projected/73ab8e5c-1270-4ab8-b70d-793a51a5432e-kube-api-access-85p4g\") pod \"authorino-7498df8756-6fvb8\" (UID: \"73ab8e5c-1270-4ab8-b70d-793a51a5432e\") " pod="kuadrant-system/authorino-7498df8756-6fvb8"
May 29 02:36:42.786094 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:42.786063    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85p4g\" (UniqueName: \"kubernetes.io/projected/73ab8e5c-1270-4ab8-b70d-793a51a5432e-kube-api-access-85p4g\") pod \"authorino-7498df8756-6fvb8\" (UID: \"73ab8e5c-1270-4ab8-b70d-793a51a5432e\") " pod="kuadrant-system/authorino-7498df8756-6fvb8"
May 29 02:36:42.801713 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:42.801682    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-6fvb8"
May 29 02:36:42.934353 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:42.934313    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-6fvb8"]
May 29 02:36:42.936397 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:36:42.936353    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod73ab8e5c_1270_4ab8_b70d_793a51a5432e.slice/crio-87fa99deb7416cdedefcf0daf4de0c68d2b49f1144eb7daeb564ae3811445f1a WatchSource:0}: Error finding container 87fa99deb7416cdedefcf0daf4de0c68d2b49f1144eb7daeb564ae3811445f1a: Status 404 returned error can't find the container with id 87fa99deb7416cdedefcf0daf4de0c68d2b49f1144eb7daeb564ae3811445f1a
May 29 02:36:43.755836 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:43.755798    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-6fvb8" event={"ID":"73ab8e5c-1270-4ab8-b70d-793a51a5432e","Type":"ContainerStarted","Data":"87fa99deb7416cdedefcf0daf4de0c68d2b49f1144eb7daeb564ae3811445f1a"}
May 29 02:36:48.775536 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:48.775501    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-78c99df468-qtb5x" event={"ID":"f8570381-fb0f-4838-a846-dff76dbd5a03","Type":"ContainerStarted","Data":"a00d06602adedfa2ab052ebe78efafa2f0b083b729732d3324bae3ce9d03c96e"}
May 29 02:36:48.775969 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:48.775582    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-78c99df468-qtb5x"
May 29 02:36:48.776882 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:48.776855    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-6fvb8" event={"ID":"73ab8e5c-1270-4ab8-b70d-793a51a5432e","Type":"ContainerStarted","Data":"9f650d29b1d54cacdc7cbce461f021227617d933bc0e2122f9e1a158d4754193"}
May 29 02:36:48.796871 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:48.796822    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-78c99df468-qtb5x" podStartSLOduration=1.720271775 podStartE2EDuration="7.796808362s" podCreationTimestamp="2026-05-29 02:36:41 +0000 UTC" firstStartedPulling="2026-05-29 02:36:42.104421638 +0000 UTC m=+570.759429252" lastFinishedPulling="2026-05-29 02:36:48.180958221 +0000 UTC m=+576.835965839" observedRunningTime="2026-05-29 02:36:48.795286954 +0000 UTC m=+577.450294587" watchObservedRunningTime="2026-05-29 02:36:48.796808362 +0000 UTC m=+577.451816018"
May 29 02:36:48.811363 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:48.811312    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-6fvb8" podStartSLOduration=1.57518187 podStartE2EDuration="6.811295164s" podCreationTimestamp="2026-05-29 02:36:42 +0000 UTC" firstStartedPulling="2026-05-29 02:36:42.937999648 +0000 UTC m=+571.593007265" lastFinishedPulling="2026-05-29 02:36:48.174112942 +0000 UTC m=+576.829120559" observedRunningTime="2026-05-29 02:36:48.810687212 +0000 UTC m=+577.465694849" watchObservedRunningTime="2026-05-29 02:36:48.811295164 +0000 UTC m=+577.466302832"
May 29 02:36:59.782602 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:36:59.782566    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-78c99df468-qtb5x"
May 29 02:37:11.904626 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:37:11.904599    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/2.log"
May 29 02:37:11.905012 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:37:11.904753    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/2.log"
May 29 02:37:14.598782 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:37:14.598752    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-6fvb8"]
May 29 02:37:14.599166 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:37:14.598949    2573 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-6fvb8" podUID="73ab8e5c-1270-4ab8-b70d-793a51a5432e" containerName="authorino" containerID="cri-o://9f650d29b1d54cacdc7cbce461f021227617d933bc0e2122f9e1a158d4754193" gracePeriod=30
May 29 02:37:14.850758 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:37:14.850709    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-6fvb8"
May 29 02:37:14.875009 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:37:14.874979    2573 generic.go:358] "Generic (PLEG): container finished" podID="73ab8e5c-1270-4ab8-b70d-793a51a5432e" containerID="9f650d29b1d54cacdc7cbce461f021227617d933bc0e2122f9e1a158d4754193" exitCode=0
May 29 02:37:14.875141 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:37:14.875022    2573 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-6fvb8"
May 29 02:37:14.875141 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:37:14.875065    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-6fvb8" event={"ID":"73ab8e5c-1270-4ab8-b70d-793a51a5432e","Type":"ContainerDied","Data":"9f650d29b1d54cacdc7cbce461f021227617d933bc0e2122f9e1a158d4754193"}
May 29 02:37:14.875141 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:37:14.875106    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-6fvb8" event={"ID":"73ab8e5c-1270-4ab8-b70d-793a51a5432e","Type":"ContainerDied","Data":"87fa99deb7416cdedefcf0daf4de0c68d2b49f1144eb7daeb564ae3811445f1a"}
May 29 02:37:14.875141 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:37:14.875127    2573 scope.go:117] "RemoveContainer" containerID="9f650d29b1d54cacdc7cbce461f021227617d933bc0e2122f9e1a158d4754193"
May 29 02:37:14.883140 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:37:14.883124    2573 scope.go:117] "RemoveContainer" containerID="9f650d29b1d54cacdc7cbce461f021227617d933bc0e2122f9e1a158d4754193"
May 29 02:37:14.883419 ip-10-0-141-109 kubenswrapper[2573]: E0529 02:37:14.883402    2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9f650d29b1d54cacdc7cbce461f021227617d933bc0e2122f9e1a158d4754193\": container with ID starting with 9f650d29b1d54cacdc7cbce461f021227617d933bc0e2122f9e1a158d4754193 not found: ID does not exist" containerID="9f650d29b1d54cacdc7cbce461f021227617d933bc0e2122f9e1a158d4754193"
May 29 02:37:14.883486 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:37:14.883428    2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9f650d29b1d54cacdc7cbce461f021227617d933bc0e2122f9e1a158d4754193"} err="failed to get container status \"9f650d29b1d54cacdc7cbce461f021227617d933bc0e2122f9e1a158d4754193\": rpc error: code = NotFound desc = could not find container \"9f650d29b1d54cacdc7cbce461f021227617d933bc0e2122f9e1a158d4754193\": container with ID starting with 9f650d29b1d54cacdc7cbce461f021227617d933bc0e2122f9e1a158d4754193 not found: ID does not exist"
May 29 02:37:14.953444 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:37:14.953412    2573 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85p4g\" (UniqueName: \"kubernetes.io/projected/73ab8e5c-1270-4ab8-b70d-793a51a5432e-kube-api-access-85p4g\") pod \"73ab8e5c-1270-4ab8-b70d-793a51a5432e\" (UID: \"73ab8e5c-1270-4ab8-b70d-793a51a5432e\") "
May 29 02:37:14.955652 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:37:14.955621    2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/73ab8e5c-1270-4ab8-b70d-793a51a5432e-kube-api-access-85p4g" (OuterVolumeSpecName: "kube-api-access-85p4g") pod "73ab8e5c-1270-4ab8-b70d-793a51a5432e" (UID: "73ab8e5c-1270-4ab8-b70d-793a51a5432e"). InnerVolumeSpecName "kube-api-access-85p4g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
May 29 02:37:15.054806 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:37:15.054777    2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85p4g\" (UniqueName: \"kubernetes.io/projected/73ab8e5c-1270-4ab8-b70d-793a51a5432e-kube-api-access-85p4g\") on node \"ip-10-0-141-109.ec2.internal\" DevicePath \"\""
May 29 02:37:15.206338 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:37:15.206302    2573 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-6fvb8"]
May 29 02:37:15.210671 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:37:15.210649    2573 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-6fvb8"]
May 29 02:37:15.971033 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:37:15.971003    2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73ab8e5c-1270-4ab8-b70d-793a51a5432e" path="/var/lib/kubelet/pods/73ab8e5c-1270-4ab8-b70d-793a51a5432e/volumes"
May 29 02:37:52.137127 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:37:52.137083    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:38:09.821633 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:09.821596    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:38:17.008912 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.008877    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"]
May 29 02:38:17.009431 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.009410    2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ab8e5c-1270-4ab8-b70d-793a51a5432e" containerName="authorino"
May 29 02:38:17.009507 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.009434    2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ab8e5c-1270-4ab8-b70d-793a51a5432e" containerName="authorino"
May 29 02:38:17.009563 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.009528    2573 memory_manager.go:356] "RemoveStaleState removing state" podUID="73ab8e5c-1270-4ab8-b70d-793a51a5432e" containerName="authorino"
May 29 02:38:17.012144 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.012120    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:17.018613 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.018585    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
May 29 02:38:17.019287 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.019247    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qbjgj\""
May 29 02:38:17.019369 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.019247    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
May 29 02:38:17.019428 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.019402    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
May 29 02:38:17.041625 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.041586    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"]
May 29 02:38:17.092470 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.092431    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d\" (UID: \"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:17.092470 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.092473    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d\" (UID: \"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:17.092695 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.092506    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkz72\" (UniqueName: \"kubernetes.io/projected/1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941-kube-api-access-vkz72\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d\" (UID: \"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:17.092695 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.092547    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d\" (UID: \"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:17.092695 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.092623    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d\" (UID: \"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:17.092695 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.092666    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d\" (UID: \"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:17.193566 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.193510    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d\" (UID: \"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:17.193566 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.193571    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d\" (UID: \"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:17.193832 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.193595    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vkz72\" (UniqueName: \"kubernetes.io/projected/1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941-kube-api-access-vkz72\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d\" (UID: \"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:17.193832 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.193626    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d\" (UID: \"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:17.193832 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.193776    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d\" (UID: \"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:17.193979 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.193840    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d\" (UID: \"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:17.193979 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.193962    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d\" (UID: \"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:17.194094 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.193995    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d\" (UID: \"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:17.194186 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.194094    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d\" (UID: \"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:17.195921 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.195892    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d\" (UID: \"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:17.196151 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.196133    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d\" (UID: \"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:17.203063 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.203037    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkz72\" (UniqueName: \"kubernetes.io/projected/1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941-kube-api-access-vkz72\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d\" (UID: \"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:17.323595 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.323502    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:17.454608 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.454574    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"]
May 29 02:38:17.457172 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:38:17.457139    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea8fed8_01e2_4bdc_bee4_85f0e0a9c941.slice/crio-490af0e4298e420cfb8fc655c49154b8cb6ffdbf59bc5d0154b09c223bed6035 WatchSource:0}: Error finding container 490af0e4298e420cfb8fc655c49154b8cb6ffdbf59bc5d0154b09c223bed6035: Status 404 returned error can't find the container with id 490af0e4298e420cfb8fc655c49154b8cb6ffdbf59bc5d0154b09c223bed6035
May 29 02:38:17.701266 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:17.701219    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:38:18.087139 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:18.087053    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d" event={"ID":"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941","Type":"ContainerStarted","Data":"490af0e4298e420cfb8fc655c49154b8cb6ffdbf59bc5d0154b09c223bed6035"}
May 29 02:38:21.100720 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:21.100684    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d" event={"ID":"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941","Type":"ContainerStarted","Data":"adc53b851aa17805fe86757dc3d7adad5d36a4f738415cc781a4f608432c92bd"}
May 29 02:38:22.105448 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:22.105349    2573 generic.go:358] "Generic (PLEG): container finished" podID="1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941" containerID="adc53b851aa17805fe86757dc3d7adad5d36a4f738415cc781a4f608432c92bd" exitCode=0
May 29 02:38:22.105448 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:22.105433    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d" event={"ID":"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941","Type":"ContainerDied","Data":"adc53b851aa17805fe86757dc3d7adad5d36a4f738415cc781a4f608432c92bd"}
May 29 02:38:24.113824 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:24.113787    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d" event={"ID":"1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941","Type":"ContainerStarted","Data":"4c4048ce79ce8ec263828febccceb3d9dd9482856be787383e4371f2f721f56e"}
May 29 02:38:24.136038 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:24.135976    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d" podStartSLOduration=2.519750712 podStartE2EDuration="8.135955833s" podCreationTimestamp="2026-05-29 02:38:16 +0000 UTC" firstStartedPulling="2026-05-29 02:38:17.459120532 +0000 UTC m=+666.114128156" lastFinishedPulling="2026-05-29 02:38:23.075325657 +0000 UTC m=+671.730333277" observedRunningTime="2026-05-29 02:38:24.133998347 +0000 UTC m=+672.789005983" watchObservedRunningTime="2026-05-29 02:38:24.135955833 +0000 UTC m=+672.790963470"
May 29 02:38:27.323871 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:27.323831    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:27.323871 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:27.323877    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:27.336423 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:27.336399    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:28.138561 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:28.138532    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d"
May 29 02:38:29.889945 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:29.889907    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:38:58.408421 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:38:58.408376    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:39:16.802023 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:16.801989    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:39:22.092394 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.092354    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"]
May 29 02:39:22.096170 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.096147    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:22.098830 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.098809    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
May 29 02:39:22.110486 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.110463    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"]
May 29 02:39:22.178609 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.178569    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae1d978e-2810-44d0-bf76-ef30190acdfa-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx\" (UID: \"ae1d978e-2810-44d0-bf76-ef30190acdfa\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:22.178609 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.178614    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae1d978e-2810-44d0-bf76-ef30190acdfa-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx\" (UID: \"ae1d978e-2810-44d0-bf76-ef30190acdfa\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:22.178831 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.178644    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbf7c\" (UniqueName: \"kubernetes.io/projected/ae1d978e-2810-44d0-bf76-ef30190acdfa-kube-api-access-sbf7c\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx\" (UID: \"ae1d978e-2810-44d0-bf76-ef30190acdfa\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:22.178831 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.178773    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae1d978e-2810-44d0-bf76-ef30190acdfa-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx\" (UID: \"ae1d978e-2810-44d0-bf76-ef30190acdfa\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:22.178831 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.178801    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae1d978e-2810-44d0-bf76-ef30190acdfa-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx\" (UID: \"ae1d978e-2810-44d0-bf76-ef30190acdfa\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:22.178831 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.178822    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae1d978e-2810-44d0-bf76-ef30190acdfa-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx\" (UID: \"ae1d978e-2810-44d0-bf76-ef30190acdfa\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:22.279947 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.279911    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae1d978e-2810-44d0-bf76-ef30190acdfa-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx\" (UID: \"ae1d978e-2810-44d0-bf76-ef30190acdfa\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:22.279947 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.279945    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae1d978e-2810-44d0-bf76-ef30190acdfa-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx\" (UID: \"ae1d978e-2810-44d0-bf76-ef30190acdfa\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:22.280208 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.279966    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae1d978e-2810-44d0-bf76-ef30190acdfa-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx\" (UID: \"ae1d978e-2810-44d0-bf76-ef30190acdfa\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:22.280208 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.279996    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae1d978e-2810-44d0-bf76-ef30190acdfa-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx\" (UID: \"ae1d978e-2810-44d0-bf76-ef30190acdfa\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:22.280208 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.280018    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae1d978e-2810-44d0-bf76-ef30190acdfa-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx\" (UID: \"ae1d978e-2810-44d0-bf76-ef30190acdfa\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:22.280208 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.280047    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sbf7c\" (UniqueName: \"kubernetes.io/projected/ae1d978e-2810-44d0-bf76-ef30190acdfa-kube-api-access-sbf7c\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx\" (UID: \"ae1d978e-2810-44d0-bf76-ef30190acdfa\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:22.280460 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.280431    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae1d978e-2810-44d0-bf76-ef30190acdfa-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx\" (UID: \"ae1d978e-2810-44d0-bf76-ef30190acdfa\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:22.280507 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.280469    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae1d978e-2810-44d0-bf76-ef30190acdfa-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx\" (UID: \"ae1d978e-2810-44d0-bf76-ef30190acdfa\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:22.280543 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.280524    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ae1d978e-2810-44d0-bf76-ef30190acdfa-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx\" (UID: \"ae1d978e-2810-44d0-bf76-ef30190acdfa\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:22.282354 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.282325    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae1d978e-2810-44d0-bf76-ef30190acdfa-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx\" (UID: \"ae1d978e-2810-44d0-bf76-ef30190acdfa\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:22.282619 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.282601    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae1d978e-2810-44d0-bf76-ef30190acdfa-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx\" (UID: \"ae1d978e-2810-44d0-bf76-ef30190acdfa\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:22.288389 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.288366    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbf7c\" (UniqueName: \"kubernetes.io/projected/ae1d978e-2810-44d0-bf76-ef30190acdfa-kube-api-access-sbf7c\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx\" (UID: \"ae1d978e-2810-44d0-bf76-ef30190acdfa\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:22.407407 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.407294    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:22.540959 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.540923    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"]
May 29 02:39:22.544146 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:39:22.544115    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae1d978e_2810_44d0_bf76_ef30190acdfa.slice/crio-4bc35186bfd72ad208183579dc53a00d68ff163e80d3fc22d00d9f9ca41f131f WatchSource:0}: Error finding container 4bc35186bfd72ad208183579dc53a00d68ff163e80d3fc22d00d9f9ca41f131f: Status 404 returned error can't find the container with id 4bc35186bfd72ad208183579dc53a00d68ff163e80d3fc22d00d9f9ca41f131f
May 29 02:39:22.545951 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:22.545933    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 02:39:23.307662 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:23.307619    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx" event={"ID":"ae1d978e-2810-44d0-bf76-ef30190acdfa","Type":"ContainerStarted","Data":"ba8bfc6c5e85d1986af35a0d2d98ab5c23b08bcfa227a5969c121f82af756970"}
May 29 02:39:23.308119 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:23.307669    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx" event={"ID":"ae1d978e-2810-44d0-bf76-ef30190acdfa","Type":"ContainerStarted","Data":"4bc35186bfd72ad208183579dc53a00d68ff163e80d3fc22d00d9f9ca41f131f"}
May 29 02:39:23.495168 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:23.495131    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:39:27.328818 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:27.328722    2573 generic.go:358] "Generic (PLEG): container finished" podID="ae1d978e-2810-44d0-bf76-ef30190acdfa" containerID="ba8bfc6c5e85d1986af35a0d2d98ab5c23b08bcfa227a5969c121f82af756970" exitCode=0
May 29 02:39:27.328818 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:27.328759    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx" event={"ID":"ae1d978e-2810-44d0-bf76-ef30190acdfa","Type":"ContainerDied","Data":"ba8bfc6c5e85d1986af35a0d2d98ab5c23b08bcfa227a5969c121f82af756970"}
May 29 02:39:28.333821 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:28.333786    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx" event={"ID":"ae1d978e-2810-44d0-bf76-ef30190acdfa","Type":"ContainerStarted","Data":"0ce4f184af81ec01cd3b409da26eef1ca70813dce9149881d046be0c39a02bf5"}
May 29 02:39:28.359874 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:28.359823    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx" podStartSLOduration=6.155587115 podStartE2EDuration="6.359809019s" podCreationTimestamp="2026-05-29 02:39:22 +0000 UTC" firstStartedPulling="2026-05-29 02:39:27.329581621 +0000 UTC m=+735.984589239" lastFinishedPulling="2026-05-29 02:39:27.533803528 +0000 UTC m=+736.188811143" observedRunningTime="2026-05-29 02:39:28.356560223 +0000 UTC m=+737.011567858" watchObservedRunningTime="2026-05-29 02:39:28.359809019 +0000 UTC m=+737.014816654"
May 29 02:39:32.407567 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:32.407506    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:32.408053 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:32.407581    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:32.420575 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:32.420544    2573 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:39:33.363771 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:39:33.363743    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx"
May 29 02:40:48.820668 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:40:48.820585    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6467647bfd-cx9fd"]
May 29 02:40:48.822877 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:40:48.822860    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6467647bfd-cx9fd"
May 29 02:40:48.826661 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:40:48.826631    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-l9kwg\""
May 29 02:40:48.826786 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:40:48.826666    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
May 29 02:40:48.832728 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:40:48.832702    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6467647bfd-cx9fd"]
May 29 02:40:48.862357 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:40:48.862332    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wxp2\" (UniqueName: \"kubernetes.io/projected/dff405dd-922f-4014-b4c1-9cd9b4f8d1ec-kube-api-access-7wxp2\") pod \"authorino-6467647bfd-cx9fd\" (UID: \"dff405dd-922f-4014-b4c1-9cd9b4f8d1ec\") " pod="kuadrant-system/authorino-6467647bfd-cx9fd"
May 29 02:40:48.862483 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:40:48.862375    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dff405dd-922f-4014-b4c1-9cd9b4f8d1ec-tls-cert\") pod \"authorino-6467647bfd-cx9fd\" (UID: \"dff405dd-922f-4014-b4c1-9cd9b4f8d1ec\") " pod="kuadrant-system/authorino-6467647bfd-cx9fd"
May 29 02:40:48.963440 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:40:48.963402    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7wxp2\" (UniqueName: \"kubernetes.io/projected/dff405dd-922f-4014-b4c1-9cd9b4f8d1ec-kube-api-access-7wxp2\") pod \"authorino-6467647bfd-cx9fd\" (UID: \"dff405dd-922f-4014-b4c1-9cd9b4f8d1ec\") " pod="kuadrant-system/authorino-6467647bfd-cx9fd"
May 29 02:40:48.963654 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:40:48.963456    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dff405dd-922f-4014-b4c1-9cd9b4f8d1ec-tls-cert\") pod \"authorino-6467647bfd-cx9fd\" (UID: \"dff405dd-922f-4014-b4c1-9cd9b4f8d1ec\") " pod="kuadrant-system/authorino-6467647bfd-cx9fd"
May 29 02:40:48.965913 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:40:48.965886    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/dff405dd-922f-4014-b4c1-9cd9b4f8d1ec-tls-cert\") pod \"authorino-6467647bfd-cx9fd\" (UID: \"dff405dd-922f-4014-b4c1-9cd9b4f8d1ec\") " pod="kuadrant-system/authorino-6467647bfd-cx9fd"
May 29 02:40:48.972386 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:40:48.972346    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wxp2\" (UniqueName: \"kubernetes.io/projected/dff405dd-922f-4014-b4c1-9cd9b4f8d1ec-kube-api-access-7wxp2\") pod \"authorino-6467647bfd-cx9fd\" (UID: \"dff405dd-922f-4014-b4c1-9cd9b4f8d1ec\") " pod="kuadrant-system/authorino-6467647bfd-cx9fd"
May 29 02:40:49.132350 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:40:49.132268    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6467647bfd-cx9fd"
May 29 02:40:49.286069 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:40:49.286037    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6467647bfd-cx9fd"]
May 29 02:40:49.288680 ip-10-0-141-109 kubenswrapper[2573]: W0529 02:40:49.288648    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddff405dd_922f_4014_b4c1_9cd9b4f8d1ec.slice/crio-6fcde1399f05fb6921d47255c259e35b689e02114c6d085d6a2386783b9438e0 WatchSource:0}: Error finding container 6fcde1399f05fb6921d47255c259e35b689e02114c6d085d6a2386783b9438e0: Status 404 returned error can't find the container with id 6fcde1399f05fb6921d47255c259e35b689e02114c6d085d6a2386783b9438e0
May 29 02:40:49.632681 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:40:49.632644    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6467647bfd-cx9fd" event={"ID":"dff405dd-922f-4014-b4c1-9cd9b4f8d1ec","Type":"ContainerStarted","Data":"6fcde1399f05fb6921d47255c259e35b689e02114c6d085d6a2386783b9438e0"}
May 29 02:40:50.636995 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:40:50.636958    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6467647bfd-cx9fd" event={"ID":"dff405dd-922f-4014-b4c1-9cd9b4f8d1ec","Type":"ContainerStarted","Data":"eeb44dba64fc60cbb7f49b3f487b4fe46c9a67c2b988cea83975bdcad956c8eb"}
May 29 02:40:50.662016 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:40:50.661962    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-6467647bfd-cx9fd" podStartSLOduration=2.325203985 podStartE2EDuration="2.661946587s" podCreationTimestamp="2026-05-29 02:40:48 +0000 UTC" firstStartedPulling="2026-05-29 02:40:49.290303339 +0000 UTC m=+817.945310954" lastFinishedPulling="2026-05-29 02:40:49.627045939 +0000 UTC m=+818.282053556" observedRunningTime="2026-05-29 02:40:50.659669576 +0000 UTC m=+819.314677213" watchObservedRunningTime="2026-05-29 02:40:50.661946587 +0000 UTC m=+819.316954223"
May 29 02:41:18.196534 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:41:18.196501    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:41:29.232457 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:41:29.232419    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:41:37.689161 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:41:37.689121    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:41:48.193896 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:41:48.193861    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:41:56.180219 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:41:56.180183    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:42:06.703376 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:42:06.703218    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:42:11.932166 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:42:11.932135    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/2.log"
May 29 02:42:11.933141 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:42:11.933110    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/2.log"
May 29 02:42:38.094367 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:42:38.094332    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:42:45.783473 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:42:45.783435    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:43:21.686054 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:43:21.686019    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:43:37.885265 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:43:37.885161    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:44:16.989203 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:44:16.989169    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:44:32.487223 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:44:32.487186    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:44:48.193860 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:44:48.193828    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:45:03.984744 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:45:03.984661    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:46:00.397288 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:46:00.397236    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:46:10.584591 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:46:10.584548    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:46:27.183065 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:46:27.183025    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:46:36.300792 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:46:36.300755    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:46:52.282884 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:46:52.282847    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:47:00.892870 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:47:00.892832    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:47:11.955153 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:47:11.955126    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/2.log"
May 29 02:47:11.957405 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:47:11.957382    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/2.log"
May 29 02:47:33.516819 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:47:33.516780    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:47:41.482364 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:47:41.482326    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:47:50.885300 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:47:50.885265    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:47:58.185422 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:47:58.185389    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:48:07.485509 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:48:07.485471    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:48:24.482465 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:48:24.482427    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:48:34.788172 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:48:34.788135    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:49:22.377922 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:49:22.377882    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:49:30.178957 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:49:30.178879    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:49:35.880959 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:49:35.880919    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:49:44.477877 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:49:44.477842    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:49:52.491826 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:49:52.491781    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:50:01.379632 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:50:01.379595    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:50:10.280719 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:50:10.280680    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:50:18.788571 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:50:18.788521    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:50:27.589432 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:50:27.589393    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:50:36.390749 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:50:36.390709    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:50:44.998313 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:50:44.998274    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:50:55.194421 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:50:55.194387    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:51:03.888042 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:51:03.887957    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:51:10.299042 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:51:10.299001    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:51:21.085506 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:51:21.085466    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:51:29.397350 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:51:29.397297    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:51:38.084430 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:51:38.084393    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:51:47.487077 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:51:47.487030    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:52:11.979061 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:52:11.979030    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/2.log"
May 29 02:52:11.982854 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:52:11.982833    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/2.log"
May 29 02:54:02.987588 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:54:02.987497    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:54:09.336079 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:54:09.336041    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:54:35.350474 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:54:35.350431    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:54:43.935063 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:54:43.935025    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:54:52.334350 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:54:52.334310    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:55:03.489666 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:55:03.489632    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:55:12.591477 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:55:12.591434    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:55:23.295692 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:55:23.295645    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:55:31.535661 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:55:31.535571    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:55:42.590777 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:55:42.590738    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:55:51.188398 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:55:51.188353    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:56:00.787960 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:56:00.787919    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:56:11.393190 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:56:11.393150    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:56:44.785005 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:56:44.784969    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:57:12.001152 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:57:12.001107    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/2.log"
May 29 02:57:12.006801 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:57:12.006777    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/2.log"
May 29 02:57:28.827246 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:57:28.827210    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:57:38.094847 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:57:38.094816    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:57:45.097452 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:57:45.097407    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:57:53.593842 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:57:53.593800    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:58:01.692677 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:58:01.692641    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:58:15.704969 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:58:15.704928    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:58:24.383644 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:58:24.383604    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:58:32.290815 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:58:32.290729    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:58:43.092912 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:58:43.092876    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:58:50.106107 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:58:50.106070    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:59:01.288713 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:59:01.288675    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:59:13.887682 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:59:13.887647    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:59:31.400514 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:59:31.400477    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:59:41.086884 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:59:41.086844    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:59:49.691892 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:59:49.691843    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 02:59:57.110500 ip-10-0-141-109 kubenswrapper[2573]: I0529 02:59:57.110463    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:00:14.499034 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:00:14.498996    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:00:23.206535 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:00:23.206489    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:00:32.201316 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:00:32.201272    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:00:39.206843 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:00:39.206805    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:00:48.237147 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:00:48.237104    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:00:56.701959 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:00:56.701919    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:01:07.785897 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:01:07.785861    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:01:21.792781 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:01:21.792739    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:01:31.596089 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:01:31.596004    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:01:44.791646 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:01:44.791608    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:01:53.694881 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:01:53.694841    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:02:05.190455 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:02:05.190417    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:02:11.491409 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:02:11.491371    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:02:12.023863 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:02:12.023837    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/2.log"
May 29 03:02:12.030379 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:02:12.030358    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/2.log"
May 29 03:02:24.881387 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:02:24.881346    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:02:39.691094 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:02:39.691061    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:02:49.291964 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:02:49.291933    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:02:58.880630 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:02:58.880588    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:03:09.192054 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:03:09.192015    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:03:32.486131 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:03:32.486093    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:03:44.181972 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:03:44.181936    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-78c99df468-qtb5x"]
May 29 03:03:47.440982 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:03:47.440950    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6467647bfd-cx9fd_dff405dd-922f-4014-b4c1-9cd9b4f8d1ec/authorino/0.log"
May 29 03:03:53.026156 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:03:53.026125    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-784f8c8bfd-6tb29_687c9e96-eab0-4d33-b96a-799530225c58/copy-manifests/0.log"
May 29 03:03:53.039883 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:03:53.039855    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-784f8c8bfd-6tb29_687c9e96-eab0-4d33-b96a-799530225c58/manager/0.log"
May 29 03:03:54.640943 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:03:54.640909    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6467647bfd-cx9fd_dff405dd-922f-4014-b4c1-9cd9b4f8d1ec/authorino/0.log"
May 29 03:03:54.866245 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:03:54.866214    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-mn9c8_d25871e0-f6a1-49a5-a406-61d8dddebbc8/manager/0.log"
May 29 03:03:54.982324 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:03:54.982298    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-bt4rr_1ff5906b-e5fc-4bc8-bf20-497518748605/kuadrant-console-plugin/0.log"
May 29 03:03:55.337587 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:03:55.337494    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-qtb5x_f8570381-fb0f-4838-a846-dff76dbd5a03/limitador/0.log"
May 29 03:03:56.132543 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:03:56.132512    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79cf786587-zvskf_6e49f478-a3fb-4d57-a28b-3cac0dccba5c/kube-auth-proxy/0.log"
May 29 03:03:56.467491 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:03:56.467466    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f44c44d4b-x5cfm_b587765d-eae8-4167-8607-b87aadb21258/router/0.log"
May 29 03:03:56.911751 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:03:56.911679    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d_1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941/storage-initializer/0.log"
May 29 03:03:56.918738 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:03:56.918714    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-nrk9d_1ea8fed8-01e2-4bdc-bee4-85f0e0a9c941/main/0.log"
May 29 03:03:57.398369 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:03:57.398335    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx_ae1d978e-2810-44d0-bf76-ef30190acdfa/storage-initializer/0.log"
May 29 03:03:57.405535 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:03:57.405505    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-ftvmx_ae1d978e-2810-44d0-bf76-ef30190acdfa/main/0.log"
May 29 03:04:01.138142 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:01.138109    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-btflc/must-gather-h9xzc"]
May 29 03:04:01.141744 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:01.141724    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-btflc/must-gather-h9xzc"
May 29 03:04:01.146020 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:01.145999    2573 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-btflc\"/\"default-dockercfg-md4gp\""
May 29 03:04:01.146975 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:01.146946    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-btflc\"/\"openshift-service-ca.crt\""
May 29 03:04:01.147112 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:01.146950    2573 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-btflc\"/\"kube-root-ca.crt\""
May 29 03:04:01.164852 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:01.164817    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-btflc/must-gather-h9xzc"]
May 29 03:04:01.307739 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:01.307701    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6a48f3d5-3932-420f-84b5-509b6a8012de-must-gather-output\") pod \"must-gather-h9xzc\" (UID: \"6a48f3d5-3932-420f-84b5-509b6a8012de\") " pod="openshift-must-gather-btflc/must-gather-h9xzc"
May 29 03:04:01.307920 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:01.307749    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkbrh\" (UniqueName: \"kubernetes.io/projected/6a48f3d5-3932-420f-84b5-509b6a8012de-kube-api-access-nkbrh\") pod \"must-gather-h9xzc\" (UID: \"6a48f3d5-3932-420f-84b5-509b6a8012de\") " pod="openshift-must-gather-btflc/must-gather-h9xzc"
May 29 03:04:01.408454 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:01.408366    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6a48f3d5-3932-420f-84b5-509b6a8012de-must-gather-output\") pod \"must-gather-h9xzc\" (UID: \"6a48f3d5-3932-420f-84b5-509b6a8012de\") " pod="openshift-must-gather-btflc/must-gather-h9xzc"
May 29 03:04:01.408454 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:01.408424    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nkbrh\" (UniqueName: \"kubernetes.io/projected/6a48f3d5-3932-420f-84b5-509b6a8012de-kube-api-access-nkbrh\") pod \"must-gather-h9xzc\" (UID: \"6a48f3d5-3932-420f-84b5-509b6a8012de\") " pod="openshift-must-gather-btflc/must-gather-h9xzc"
May 29 03:04:01.408719 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:01.408699    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/6a48f3d5-3932-420f-84b5-509b6a8012de-must-gather-output\") pod \"must-gather-h9xzc\" (UID: \"6a48f3d5-3932-420f-84b5-509b6a8012de\") " pod="openshift-must-gather-btflc/must-gather-h9xzc"
May 29 03:04:01.416524 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:01.416498    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkbrh\" (UniqueName: \"kubernetes.io/projected/6a48f3d5-3932-420f-84b5-509b6a8012de-kube-api-access-nkbrh\") pod \"must-gather-h9xzc\" (UID: \"6a48f3d5-3932-420f-84b5-509b6a8012de\") " pod="openshift-must-gather-btflc/must-gather-h9xzc"
May 29 03:04:01.450978 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:01.450941    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-btflc/must-gather-h9xzc"
May 29 03:04:01.586415 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:01.586316    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-btflc/must-gather-h9xzc"]
May 29 03:04:01.589411 ip-10-0-141-109 kubenswrapper[2573]: W0529 03:04:01.589379    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6a48f3d5_3932_420f_84b5_509b6a8012de.slice/crio-bc5cfa1416096b752a8e66fea91cf7891eb55dfaba9e2ace36584bc81a5cdd7a WatchSource:0}: Error finding container bc5cfa1416096b752a8e66fea91cf7891eb55dfaba9e2ace36584bc81a5cdd7a: Status 404 returned error can't find the container with id bc5cfa1416096b752a8e66fea91cf7891eb55dfaba9e2ace36584bc81a5cdd7a
May 29 03:04:01.591546 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:01.591528    2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
May 29 03:04:02.441388 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:02.441343    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-btflc/must-gather-h9xzc" event={"ID":"6a48f3d5-3932-420f-84b5-509b6a8012de","Type":"ContainerStarted","Data":"bc5cfa1416096b752a8e66fea91cf7891eb55dfaba9e2ace36584bc81a5cdd7a"}
May 29 03:04:03.449745 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:03.449700    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-btflc/must-gather-h9xzc" event={"ID":"6a48f3d5-3932-420f-84b5-509b6a8012de","Type":"ContainerStarted","Data":"a11956f3e1806ee903a417df148fac1d069053c8deeb033c05d8ccf83d32ce5b"}
May 29 03:04:03.450274 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:03.449755    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-btflc/must-gather-h9xzc" event={"ID":"6a48f3d5-3932-420f-84b5-509b6a8012de","Type":"ContainerStarted","Data":"4a8f689242a7fb497e44844dd752ad0a36d38e1d45d8648a19c2642da1533e22"}
May 29 03:04:03.465987 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:03.465931    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-btflc/must-gather-h9xzc" podStartSLOduration=1.466785025 podStartE2EDuration="2.465914553s" podCreationTimestamp="2026-05-29 03:04:01 +0000 UTC" firstStartedPulling="2026-05-29 03:04:01.591679243 +0000 UTC m=+2210.246686856" lastFinishedPulling="2026-05-29 03:04:02.59080877 +0000 UTC m=+2211.245816384" observedRunningTime="2026-05-29 03:04:03.465153216 +0000 UTC m=+2212.120160854" watchObservedRunningTime="2026-05-29 03:04:03.465914553 +0000 UTC m=+2212.120922170"
May 29 03:04:04.522071 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:04.522043    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-5cv7x_872e4aee-eabd-43ac-ad37-c6e0a4f918e8/global-pull-secret-syncer/0.log"
May 29 03:04:04.716234 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:04.716202    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-xjw8k_ec0a2cd5-5976-491c-b882-63e04f42a821/konnectivity-agent/0.log"
May 29 03:04:04.785193 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:04.785118    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-109.ec2.internal_070b9e105d9b4685ab2c760a71e155cd/haproxy/0.log"
May 29 03:04:08.978652 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:08.978565    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6467647bfd-cx9fd_dff405dd-922f-4014-b4c1-9cd9b4f8d1ec/authorino/0.log"
May 29 03:04:09.046816 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:09.046781    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-mn9c8_d25871e0-f6a1-49a5-a406-61d8dddebbc8/manager/0.log"
May 29 03:04:09.076205 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:09.076177    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-bt4rr_1ff5906b-e5fc-4bc8-bf20-497518748605/kuadrant-console-plugin/0.log"
May 29 03:04:09.230356 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:09.230275    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-78c99df468-qtb5x_f8570381-fb0f-4838-a846-dff76dbd5a03/limitador/0.log"
May 29 03:04:10.759742 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:10.759707    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-6c75959455-clzfb_7d35785d-8d36-4c47-8655-e0cfe696cf7b/cluster-monitoring-operator/0.log"
May 29 03:04:10.788955 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:10.788921    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-9qp67_cf497186-1c25-4339-92ec-3876c3a21670/kube-state-metrics/0.log"
May 29 03:04:10.810721 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:10.810653    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-9qp67_cf497186-1c25-4339-92ec-3876c3a21670/kube-rbac-proxy-main/0.log"
May 29 03:04:10.837642 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:10.837610    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-54fd6bc5c4-9qp67_cf497186-1c25-4339-92ec-3876c3a21670/kube-rbac-proxy-self/0.log"
May 29 03:04:10.936759 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:10.936721    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2dcr7_ef1449d9-a5ab-4829-8011-ea387bb155a8/node-exporter/0.log"
May 29 03:04:10.961528 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:10.961472    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2dcr7_ef1449d9-a5ab-4829-8011-ea387bb155a8/kube-rbac-proxy/0.log"
May 29 03:04:10.986418 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:10.986389    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2dcr7_ef1449d9-a5ab-4829-8011-ea387bb155a8/init-textfile/0.log"
May 29 03:04:11.188735 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:11.188569    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-4xj5t_64b8bbff-426f-4708-8161-974b20ad89ae/kube-rbac-proxy-main/0.log"
May 29 03:04:11.222133 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:11.222092    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-4xj5t_64b8bbff-426f-4708-8161-974b20ad89ae/kube-rbac-proxy-self/0.log"
May 29 03:04:11.283653 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:11.283446    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-9c959559f-4xj5t_64b8bbff-426f-4708-8161-974b20ad89ae/openshift-state-metrics/0.log"
May 29 03:04:11.551481 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:11.551433    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-fdzfr_b3945858-9d12-4843-a5fd-6867f525486a/prometheus-operator/0.log"
May 29 03:04:11.590647 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:11.590602    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7779bbdd78-fdzfr_b3945858-9d12-4843-a5fd-6867f525486a/kube-rbac-proxy/0.log"
May 29 03:04:11.612596 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:11.612539    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-6c4bbc67b7-47ltn_9ccc016d-cb96-43d8-9bfc-dce0cb8b8203/prometheus-operator-admission-webhook/0.log"
May 29 03:04:13.000046 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:13.000018    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d4d8f94f9-nw69w_0a7061e3-3a99-4d53-ae20-0028a4950f5f/networking-console-plugin/0.log"
May 29 03:04:13.575371 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:13.575342    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/2.log"
May 29 03:04:13.582240 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:13.582207    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-76dff48d59-zqwt9_423a6fd1-7473-4c55-b0cb-a208d404ce05/console-operator/3.log"
May 29 03:04:14.098758 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:14.098728    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6949cbf474-rmgp5_caf24f48-9950-4219-ab46-00061245d240/console/0.log"
May 29 03:04:14.131867 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:14.131832    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-57bd96b888-bbqkl_7e4b0d69-d012-4b33-93eb-6293ec90c4a2/download-server/0.log"
May 29 03:04:15.261802 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.261763    2573 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"]
May 29 03:04:15.266920 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.266890    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"
May 29 03:04:15.276650 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.276622    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"]
May 29 03:04:15.377372 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.377286    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e8fd91dc-0433-49ed-95f4-a9ecea2c0457-proc\") pod \"perf-node-gather-daemonset-bkg46\" (UID: \"e8fd91dc-0433-49ed-95f4-a9ecea2c0457\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"
May 29 03:04:15.377561 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.377377    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtsbq\" (UniqueName: \"kubernetes.io/projected/e8fd91dc-0433-49ed-95f4-a9ecea2c0457-kube-api-access-jtsbq\") pod \"perf-node-gather-daemonset-bkg46\" (UID: \"e8fd91dc-0433-49ed-95f4-a9ecea2c0457\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"
May 29 03:04:15.377561 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.377447    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8fd91dc-0433-49ed-95f4-a9ecea2c0457-lib-modules\") pod \"perf-node-gather-daemonset-bkg46\" (UID: \"e8fd91dc-0433-49ed-95f4-a9ecea2c0457\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"
May 29 03:04:15.377561 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.377542    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8fd91dc-0433-49ed-95f4-a9ecea2c0457-sys\") pod \"perf-node-gather-daemonset-bkg46\" (UID: \"e8fd91dc-0433-49ed-95f4-a9ecea2c0457\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"
May 29 03:04:15.377717 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.377581    2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e8fd91dc-0433-49ed-95f4-a9ecea2c0457-podres\") pod \"perf-node-gather-daemonset-bkg46\" (UID: \"e8fd91dc-0433-49ed-95f4-a9ecea2c0457\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"
May 29 03:04:15.478943 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.478897    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e8fd91dc-0433-49ed-95f4-a9ecea2c0457-proc\") pod \"perf-node-gather-daemonset-bkg46\" (UID: \"e8fd91dc-0433-49ed-95f4-a9ecea2c0457\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"
May 29 03:04:15.479237 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.479196    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jtsbq\" (UniqueName: \"kubernetes.io/projected/e8fd91dc-0433-49ed-95f4-a9ecea2c0457-kube-api-access-jtsbq\") pod \"perf-node-gather-daemonset-bkg46\" (UID: \"e8fd91dc-0433-49ed-95f4-a9ecea2c0457\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"
May 29 03:04:15.480233 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.479398    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8fd91dc-0433-49ed-95f4-a9ecea2c0457-lib-modules\") pod \"perf-node-gather-daemonset-bkg46\" (UID: \"e8fd91dc-0433-49ed-95f4-a9ecea2c0457\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"
May 29 03:04:15.480233 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.479457    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8fd91dc-0433-49ed-95f4-a9ecea2c0457-sys\") pod \"perf-node-gather-daemonset-bkg46\" (UID: \"e8fd91dc-0433-49ed-95f4-a9ecea2c0457\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"
May 29 03:04:15.480233 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.479489    2573 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e8fd91dc-0433-49ed-95f4-a9ecea2c0457-podres\") pod \"perf-node-gather-daemonset-bkg46\" (UID: \"e8fd91dc-0433-49ed-95f4-a9ecea2c0457\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"
May 29 03:04:15.480233 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.479708    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e8fd91dc-0433-49ed-95f4-a9ecea2c0457-podres\") pod \"perf-node-gather-daemonset-bkg46\" (UID: \"e8fd91dc-0433-49ed-95f4-a9ecea2c0457\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"
May 29 03:04:15.480233 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.479030    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e8fd91dc-0433-49ed-95f4-a9ecea2c0457-proc\") pod \"perf-node-gather-daemonset-bkg46\" (UID: \"e8fd91dc-0433-49ed-95f4-a9ecea2c0457\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"
May 29 03:04:15.480233 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.480146    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e8fd91dc-0433-49ed-95f4-a9ecea2c0457-lib-modules\") pod \"perf-node-gather-daemonset-bkg46\" (UID: \"e8fd91dc-0433-49ed-95f4-a9ecea2c0457\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"
May 29 03:04:15.480233 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.480203    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e8fd91dc-0433-49ed-95f4-a9ecea2c0457-sys\") pod \"perf-node-gather-daemonset-bkg46\" (UID: \"e8fd91dc-0433-49ed-95f4-a9ecea2c0457\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"
May 29 03:04:15.488114 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.488092    2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtsbq\" (UniqueName: \"kubernetes.io/projected/e8fd91dc-0433-49ed-95f4-a9ecea2c0457-kube-api-access-jtsbq\") pod \"perf-node-gather-daemonset-bkg46\" (UID: \"e8fd91dc-0433-49ed-95f4-a9ecea2c0457\") " pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"
May 29 03:04:15.579734 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.579642    2573 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"
May 29 03:04:15.647722 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.647691    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kl8vc_96254599-cc53-4384-9eca-b9bb8997cd02/dns/0.log"
May 29 03:04:15.672912 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.672863    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-kl8vc_96254599-cc53-4384-9eca-b9bb8997cd02/kube-rbac-proxy/0.log"
May 29 03:04:15.696874 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.696848    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-2r9s2_a6499ac1-a799-4692-894c-b3f1bf59b369/dns-node-resolver/0.log"
May 29 03:04:15.721539 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:15.721482    2573 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"]
May 29 03:04:15.723902 ip-10-0-141-109 kubenswrapper[2573]: W0529 03:04:15.723876    2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode8fd91dc_0433_49ed_95f4_a9ecea2c0457.slice/crio-4f83c6006f7d12f8eac3e051b6ad495d5a1045dcb081b9d0e2bad7575c52a5ab WatchSource:0}: Error finding container 4f83c6006f7d12f8eac3e051b6ad495d5a1045dcb081b9d0e2bad7575c52a5ab: Status 404 returned error can't find the container with id 4f83c6006f7d12f8eac3e051b6ad495d5a1045dcb081b9d0e2bad7575c52a5ab
May 29 03:04:16.259132 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:16.259104    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jtmf8_5fe35eb0-68ad-495c-b79a-a899da141e77/node-ca/0.log"
May 29 03:04:16.510568 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:16.510474    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46" event={"ID":"e8fd91dc-0433-49ed-95f4-a9ecea2c0457","Type":"ContainerStarted","Data":"9788fe826ef285e7fefa263573a5fa90bc4db943a9baa927f18ac7bdb78d249b"}
May 29 03:04:16.510568 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:16.510522    2573 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46" event={"ID":"e8fd91dc-0433-49ed-95f4-a9ecea2c0457","Type":"ContainerStarted","Data":"4f83c6006f7d12f8eac3e051b6ad495d5a1045dcb081b9d0e2bad7575c52a5ab"}
May 29 03:04:16.510568 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:16.510563    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"
May 29 03:04:16.528318 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:16.528229    2573 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46" podStartSLOduration=1.528211698 podStartE2EDuration="1.528211698s" podCreationTimestamp="2026-05-29 03:04:15 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-05-29 03:04:16.527572738 +0000 UTC m=+2225.182580375" watchObservedRunningTime="2026-05-29 03:04:16.528211698 +0000 UTC m=+2225.183219338"
May 29 03:04:17.258888 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:17.258850    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-79cf786587-zvskf_6e49f478-a3fb-4d57-a28b-3cac0dccba5c/kube-auth-proxy/0.log"
May 29 03:04:17.391850 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:17.391814    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-f44c44d4b-x5cfm_b587765d-eae8-4167-8607-b87aadb21258/router/0.log"
May 29 03:04:17.909566 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:17.909534    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-8hx9n_c4d7d603-050b-4d0e-9802-4ba8d0bc4baa/serve-healthcheck-canary/0.log"
May 29 03:04:18.414547 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:18.414517    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-7rr46_eaa52fdb-83a3-41fc-b731-a1d57c86f5e4/insights-operator/0.log"
May 29 03:04:18.414788 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:18.414768    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-78bdfb888c-7rr46_eaa52fdb-83a3-41fc-b731-a1d57c86f5e4/insights-operator/1.log"
May 29 03:04:18.512052 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:18.512023    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kwt22_5dec045a-2f57-4041-92fe-be3ca951ba85/kube-rbac-proxy/0.log"
May 29 03:04:18.533379 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:18.533348    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kwt22_5dec045a-2f57-4041-92fe-be3ca951ba85/exporter/0.log"
May 29 03:04:18.554526 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:18.554501    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kwt22_5dec045a-2f57-4041-92fe-be3ca951ba85/extractor/0.log"
May 29 03:04:21.226900 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:21.226864    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-784f8c8bfd-6tb29_687c9e96-eab0-4d33-b96a-799530225c58/manager/0.log"
May 29 03:04:21.246413 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:21.246385    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-784f8c8bfd-6tb29_687c9e96-eab0-4d33-b96a-799530225c58/copy-manifests/0.log"
May 29 03:04:22.524061 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:22.524025    2573 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-btflc/perf-node-gather-daemonset-bkg46"
May 29 03:04:22.609476 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:22.609444    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-784859b99c-55b2j_c8c244f8-e968-4ce4-82d7-b73bdfabfef9/manager/0.log"
May 29 03:04:29.553378 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:29.553347    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v8vwt_f859eb41-2671-4f9a-b7a1-609ea44e19de/kube-multus-additional-cni-plugins/0.log"
May 29 03:04:29.575196 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:29.575162    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v8vwt_f859eb41-2671-4f9a-b7a1-609ea44e19de/egress-router-binary-copy/0.log"
May 29 03:04:29.595954 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:29.595924    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v8vwt_f859eb41-2671-4f9a-b7a1-609ea44e19de/cni-plugins/0.log"
May 29 03:04:29.616210 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:29.616178    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v8vwt_f859eb41-2671-4f9a-b7a1-609ea44e19de/bond-cni-plugin/0.log"
May 29 03:04:29.639365 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:29.639331    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v8vwt_f859eb41-2671-4f9a-b7a1-609ea44e19de/routeoverride-cni/0.log"
May 29 03:04:29.665898 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:29.665863    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v8vwt_f859eb41-2671-4f9a-b7a1-609ea44e19de/whereabouts-cni-bincopy/0.log"
May 29 03:04:29.692559 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:29.692531    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-v8vwt_f859eb41-2671-4f9a-b7a1-609ea44e19de/whereabouts-cni/0.log"
May 29 03:04:29.725188 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:29.725155    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rrpxl_3ff1be15-a11d-4659-84b9-b473b543db45/kube-multus/0.log"
May 29 03:04:29.831270 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:29.831170    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bbj9n_f1c2fcb1-f203-4571-8cbe-eb01a190d63b/network-metrics-daemon/0.log"
May 29 03:04:29.852701 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:29.852677    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-bbj9n_f1c2fcb1-f203-4571-8cbe-eb01a190d63b/kube-rbac-proxy/0.log"
May 29 03:04:31.108496 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:31.108457    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wldp_307a16db-de95-48bc-9404-bdcfff68ccdf/ovn-controller/0.log"
May 29 03:04:31.140162 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:31.140127    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wldp_307a16db-de95-48bc-9404-bdcfff68ccdf/ovn-acl-logging/0.log"
May 29 03:04:31.162377 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:31.162345    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wldp_307a16db-de95-48bc-9404-bdcfff68ccdf/kube-rbac-proxy-node/0.log"
May 29 03:04:31.186536 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:31.186500    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wldp_307a16db-de95-48bc-9404-bdcfff68ccdf/kube-rbac-proxy-ovn-metrics/0.log"
May 29 03:04:31.207380 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:31.207353    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wldp_307a16db-de95-48bc-9404-bdcfff68ccdf/northd/0.log"
May 29 03:04:31.228124 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:31.228097    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wldp_307a16db-de95-48bc-9404-bdcfff68ccdf/nbdb/0.log"
May 29 03:04:31.250407 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:31.250384    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wldp_307a16db-de95-48bc-9404-bdcfff68ccdf/sbdb/0.log"
May 29 03:04:31.369154 ip-10-0-141-109 kubenswrapper[2573]: I0529 03:04:31.369066    2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-6wldp_307a16db-de95-48bc-9404-bdcfff68ccdf/ovnkube-controller/0.log"