Sep 13 20:12:48.670783 ip-10-0-141-59 systemd[1]: Starting Kubernetes Kubelet... Sep 13 20:12:49.076821 ip-10-0-141-59 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 13 20:12:49.076821 ip-10-0-141-59 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 13 20:12:49.076821 ip-10-0-141-59 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 13 20:12:49.076821 ip-10-0-141-59 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 13 20:12:49.076821 ip-10-0-141-59 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 13 20:12:49.079671 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.079561 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 13 20:12:49.084965 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.084948 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 20:12:49.084965 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.084964 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 20:12:49.084965 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.084967 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 20:12:49.085076 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.084971 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 20:12:49.085076 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.084974 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 20:12:49.085076 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.084977 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 20:12:49.085076 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.084980 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 20:12:49.085076 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.084983 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 13 20:12:49.085076 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.084985 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 20:12:49.085076 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.084989 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 20:12:49.085076 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.084992 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 20:12:49.085076 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.084995 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 20:12:49.085076 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.084998 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 20:12:49.085076 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085000 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 20:12:49.085076 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085003 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 20:12:49.085076 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085006 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 20:12:49.085076 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085009 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 20:12:49.085076 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085011 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 20:12:49.085076 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085014 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 20:12:49.085076 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085016 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 20:12:49.085076 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085019 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 20:12:49.085076 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085022 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 20:12:49.085076 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085024 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 20:12:49.085610 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085027 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 20:12:49.085610 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085030 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 20:12:49.085610 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085032 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 20:12:49.085610 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085035 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 20:12:49.085610 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085037 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 20:12:49.085610 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085040 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 20:12:49.085610 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085042 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 20:12:49.085610 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085045 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 20:12:49.085610 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085048 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 20:12:49.085610 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085050 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 20:12:49.085610 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085053 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 20:12:49.085610 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085057 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 20:12:49.085610 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085061 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 20:12:49.085610 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085064 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 20:12:49.085610 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085069 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 20:12:49.085610 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085072 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 20:12:49.085610 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085075 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 20:12:49.085610 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085078 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 20:12:49.085610 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085081 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 20:12:49.086354 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085084 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 20:12:49.086354 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085087 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 20:12:49.086354 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085090 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 20:12:49.086354 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085092 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 20:12:49.086354 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085095 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 20:12:49.086354 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085097 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 20:12:49.086354 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085101 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 20:12:49.086354 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085104 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 20:12:49.086354 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085107 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 20:12:49.086354 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085109 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 20:12:49.086354 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085112 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 20:12:49.086354 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085115 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 20:12:49.086354 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085117 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 20:12:49.086354 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085120 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 20:12:49.086354 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085123 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 20:12:49.086354 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085125 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 20:12:49.086354 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085128 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 20:12:49.086354 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085130 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 20:12:49.086354 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085133 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 20:12:49.086354 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085135 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 20:12:49.086960 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085138 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 20:12:49.086960 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085140 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 20:12:49.086960 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085143 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 20:12:49.086960 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085145 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 20:12:49.086960 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085148 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 20:12:49.086960 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085150 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 20:12:49.086960 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085154 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 20:12:49.086960 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085157 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 20:12:49.086960 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085159 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 20:12:49.086960 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085162 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 20:12:49.086960 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085165 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 20:12:49.086960 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085167 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 20:12:49.086960 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085170 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 20:12:49.086960 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085173 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 20:12:49.086960 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085175 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 20:12:49.086960 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085179 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 20:12:49.086960 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085182 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 20:12:49.086960 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085186 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 20:12:49.086960 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085189 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 20:12:49.087430 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085192 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 20:12:49.087430 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085195 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 20:12:49.087430 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085198 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 20:12:49.087430 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085200 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 20:12:49.087430 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085203 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 20:12:49.087430 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085205 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 20:12:49.087430 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085209 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 20:12:49.087430 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085211 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 20:12:49.087430 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085214 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 20:12:49.087430 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085216 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 20:12:49.087430 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085219 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 20:12:49.087430 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085222 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 20:12:49.087430 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085224 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 20:12:49.087430 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085227 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 20:12:49.087430 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085230 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 20:12:49.087430 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085232 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 20:12:49.087430 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085235 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 20:12:49.087430 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.085238 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 20:12:49.087430 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087304 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 20:12:49.087430 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087314 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 20:12:49.087935 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087318 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 20:12:49.087935 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087321 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 20:12:49.087935 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087324 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 20:12:49.087935 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087327 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 20:12:49.087935 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087330 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 20:12:49.087935 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087332 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 20:12:49.087935 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087335 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 20:12:49.087935 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087337 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 20:12:49.087935 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087340 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 20:12:49.087935 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087342 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 20:12:49.087935 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087345 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 20:12:49.087935 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087347 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 20:12:49.087935 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087350 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 20:12:49.087935 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087354 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 20:12:49.087935 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087356 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 20:12:49.087935 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087359 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 20:12:49.087935 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087362 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 20:12:49.087935 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087364 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 20:12:49.087935 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087368 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 20:12:49.087935 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087370 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 20:12:49.088432 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087373 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 20:12:49.088432 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087375 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 20:12:49.088432 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087378 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 20:12:49.088432 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087380 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 20:12:49.088432 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087383 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 20:12:49.088432 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087386 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 20:12:49.088432 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087388 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 20:12:49.088432 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087391 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 13 20:12:49.088432 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087393 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 20:12:49.088432 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087396 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 20:12:49.088432 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087398 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 20:12:49.088432 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087401 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 20:12:49.088432 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087403 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 20:12:49.088432 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087407 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 20:12:49.088432 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087409 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 20:12:49.088432 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087412 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 20:12:49.088432 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087414 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 20:12:49.088432 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087417 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 20:12:49.088432 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087419 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 20:12:49.088432 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087423 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 20:12:49.088970 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087427 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 20:12:49.088970 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087429 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 20:12:49.088970 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087432 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 20:12:49.088970 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087435 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 20:12:49.088970 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087437 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 20:12:49.088970 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087441 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 20:12:49.088970 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087444 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 20:12:49.088970 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087447 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 20:12:49.088970 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087450 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 20:12:49.088970 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087453 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 20:12:49.088970 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087455 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 20:12:49.088970 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087458 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 20:12:49.088970 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087462 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 20:12:49.088970 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087466 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 20:12:49.088970 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087469 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 20:12:49.088970 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087488 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 20:12:49.088970 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087491 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 20:12:49.088970 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087494 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 20:12:49.088970 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087497 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 20:12:49.089440 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087501 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 20:12:49.089440 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087504 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 20:12:49.089440 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087507 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 20:12:49.089440 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087510 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 20:12:49.089440 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087513 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 20:12:49.089440 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087516 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 20:12:49.089440 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087519 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 20:12:49.089440 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087521 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 20:12:49.089440 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087524 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 20:12:49.089440 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087526 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 20:12:49.089440 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087529 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 20:12:49.089440 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087532 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 20:12:49.089440 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087534 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 20:12:49.089440 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087536 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 20:12:49.089440 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087539 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 20:12:49.089440 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087542 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 20:12:49.089440 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087544 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 20:12:49.089440 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087547 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 20:12:49.089440 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087550 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 20:12:49.089927 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087554 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 20:12:49.089927 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087558 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 20:12:49.089927 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087561 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 20:12:49.089927 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087564 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 20:12:49.089927 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087567 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 20:12:49.089927 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087570 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 20:12:49.089927 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087572 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 20:12:49.089927 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087575 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 20:12:49.089927 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087577 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 20:12:49.089927 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087580 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 20:12:49.089927 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087582 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 20:12:49.089927 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087585 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 20:12:49.089927 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087587 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 20:12:49.089927 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087590 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 20:12:49.089927 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087593 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 20:12:49.089927 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087595 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 20:12:49.089927 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087597 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 20:12:49.089927 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087600 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 20:12:49.089927 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087603 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 20:12:49.090385 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087989 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 20:12:49.090385 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087994 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 20:12:49.090385 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.087997 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 20:12:49.090385 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088000 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 20:12:49.090385 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088003 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 20:12:49.090385 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088006 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 20:12:49.090385 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088010 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 20:12:49.090385 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088012 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 20:12:49.090385 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088015 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 20:12:49.090385 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088017 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 20:12:49.090385 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088020 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 20:12:49.090385 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088024 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 20:12:49.090385 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088026 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 20:12:49.090385 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088030 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 20:12:49.090385 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088032 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 20:12:49.090385 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088035 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 20:12:49.090385 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088040 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 20:12:49.090385 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088043 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 20:12:49.090385 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088046 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 20:12:49.090385 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088049 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 20:12:49.090893 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088051 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 20:12:49.090893 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088054 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 20:12:49.090893 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088057 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 20:12:49.090893 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088059 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 20:12:49.090893 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088061 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 20:12:49.090893 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088064 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 20:12:49.090893 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088066 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 20:12:49.090893 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088069 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 20:12:49.090893 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088073 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 20:12:49.090893 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088077 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 20:12:49.090893 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088079 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 20:12:49.090893 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088082 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 20:12:49.090893 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088085 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 20:12:49.090893 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088087 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 20:12:49.090893 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088090 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 20:12:49.090893 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088092 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 20:12:49.090893 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088094 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 20:12:49.090893 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088097 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 20:12:49.090893 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088099 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 20:12:49.091363 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088102 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 20:12:49.091363 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088104 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 20:12:49.091363 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088107 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 20:12:49.091363 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088109 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 20:12:49.091363 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088112 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 20:12:49.091363 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088115 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 20:12:49.091363 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088118 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 20:12:49.091363 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088120 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 20:12:49.091363 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088123 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 20:12:49.091363 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088126 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 20:12:49.091363 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088130 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 20:12:49.091363 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088133 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 20:12:49.091363 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088136 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 20:12:49.091363 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088138 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 20:12:49.091363 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088141 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 20:12:49.091363 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088143 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 20:12:49.091363 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088146 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 20:12:49.091363 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088148 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 20:12:49.091363 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088151 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 20:12:49.091823 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088153 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 20:12:49.091823 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088155 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 20:12:49.091823 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088158 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 20:12:49.091823 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088160 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 20:12:49.091823 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088163 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 20:12:49.091823 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088165 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 20:12:49.091823 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088168 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 20:12:49.091823 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088170 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 20:12:49.091823 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088173 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 20:12:49.091823 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088175 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 20:12:49.091823 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088178 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 20:12:49.091823 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088180 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 20:12:49.091823 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088182 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 20:12:49.091823 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088185 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 20:12:49.091823 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088187 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 20:12:49.091823 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088190 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 20:12:49.091823 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088192 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 20:12:49.091823 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088196 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 20:12:49.091823 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088199 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 20:12:49.092275 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088201 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 20:12:49.092275 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088204 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 20:12:49.092275 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088207 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 20:12:49.092275 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088209 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 20:12:49.092275 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088212 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 20:12:49.092275 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088215 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 20:12:49.092275 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088217 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 20:12:49.092275 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088220 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 20:12:49.092275 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088222 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 20:12:49.092275 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088225 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 20:12:49.092275 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088228 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 20:12:49.092275 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088231 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 20:12:49.092275 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088233 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 20:12:49.092275 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088236 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 20:12:49.092275 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088238 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 20:12:49.092275 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088240 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 20:12:49.092275 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088243 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 20:12:49.092275 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088246 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 20:12:49.092275 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088248 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 20:12:49.092275 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088250 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088253 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088255 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088321 2561 flags.go:64] FLAG: --address="0.0.0.0" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088360 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088367 2561 flags.go:64] FLAG: --anonymous-auth="true" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088371 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088376 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088380 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088384 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088388 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088391 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088394 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088398 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088401 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088404 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088408 2561 flags.go:64] FLAG: --cgroup-root="" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088411 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088414 2561 flags.go:64] FLAG: --client-ca-file="" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088417 2561 flags.go:64] FLAG: --cloud-provider="external" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088420 2561 flags.go:64] FLAG: --cluster-dns="[]" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088425 2561 flags.go:64] FLAG: --cluster-domain="" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088427 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088431 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 13 20:12:49.092779 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088434 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088437 2561 flags.go:64] FLAG: --container-log-max-files="5" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088445 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088448 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088451 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088455 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088458 2561 flags.go:64] FLAG: --contention-profiling="false" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088460 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088463 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088466 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088469 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088485 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088489 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088491 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088494 2561 flags.go:64] FLAG: --enable-load-reader="false" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088497 2561 flags.go:64] FLAG: --enable-server="true" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088500 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088504 2561 flags.go:64] FLAG: --event-burst="100" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088507 2561 flags.go:64] FLAG: --event-qps="50" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088510 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088513 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088516 2561 flags.go:64] FLAG: --eviction-hard="" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088519 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088522 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088525 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 13 20:12:49.093356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088527 2561 flags.go:64] FLAG: --eviction-soft="" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088530 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088533 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088537 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088540 2561 flags.go:64] FLAG: --experimental-mounter-path="" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088543 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088546 2561 flags.go:64] FLAG: --fail-swap-on="true" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088549 2561 flags.go:64] FLAG: --feature-gates="" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088553 2561 flags.go:64] FLAG: --file-check-frequency="20s" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088556 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088559 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088562 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088564 2561 flags.go:64] FLAG: --healthz-port="10248" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088567 2561 flags.go:64] FLAG: --help="false" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088570 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-141-59.ec2.internal" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088573 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088576 2561 flags.go:64] FLAG: --http-check-frequency="20s" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088579 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088582 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088585 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088588 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088591 2561 flags.go:64] FLAG: --image-service-endpoint="" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088594 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 13 20:12:49.093975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088596 2561 flags.go:64] FLAG: --kube-api-burst="100" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088599 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088603 2561 flags.go:64] FLAG: --kube-api-qps="50" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088605 2561 flags.go:64] FLAG: --kube-reserved="" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088610 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088613 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088616 2561 flags.go:64] FLAG: --kubelet-cgroups="" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088619 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088622 2561 flags.go:64] FLAG: --lock-file="" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088625 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088627 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088630 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088636 2561 flags.go:64] FLAG: --log-json-split-stream="false" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088639 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088642 2561 flags.go:64] FLAG: --log-text-split-stream="false" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088645 2561 flags.go:64] FLAG: --logging-format="text" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088648 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088651 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088654 2561 flags.go:64] FLAG: --manifest-url="" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088657 2561 flags.go:64] FLAG: --manifest-url-header="" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088661 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088664 2561 flags.go:64] FLAG: --max-open-files="1000000" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088667 2561 flags.go:64] FLAG: --max-pods="110" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088670 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088673 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 13 20:12:49.094612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088676 2561 flags.go:64] FLAG: --memory-manager-policy="None" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088679 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088682 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088685 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088687 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088694 2561 flags.go:64] FLAG: --node-status-max-images="50" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088697 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088700 2561 flags.go:64] FLAG: --oom-score-adj="-999" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088703 2561 flags.go:64] FLAG: --pod-cidr="" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088706 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088712 2561 flags.go:64] FLAG: --pod-manifest-path="" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088716 2561 flags.go:64] FLAG: --pod-max-pids="-1" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088719 2561 flags.go:64] FLAG: --pods-per-core="0" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088722 2561 flags.go:64] FLAG: --port="10250" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088725 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088728 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e06b01234abd7a8b" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088732 2561 flags.go:64] FLAG: --qos-reserved="" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088735 2561 flags.go:64] FLAG: --read-only-port="10255" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088738 2561 flags.go:64] FLAG: --register-node="true" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088741 2561 flags.go:64] FLAG: --register-with-taints="" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088745 2561 flags.go:64] FLAG: --registry-burst="10" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088748 2561 flags.go:64] FLAG: --registry-qps="5" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088751 2561 flags.go:64] FLAG: --reserved-cpus="" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088754 2561 flags.go:64] FLAG: --reserved-memory="" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088758 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 13 20:12:49.095230 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088761 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088763 2561 flags.go:64] FLAG: --rotate-certificates="false" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088766 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088773 2561 flags.go:64] FLAG: --runonce="false" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088776 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088779 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088781 2561 flags.go:64] FLAG: --seccomp-default="false" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088784 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088787 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088790 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088793 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088796 2561 flags.go:64] FLAG: --storage-driver-password="root" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088799 2561 flags.go:64] FLAG: --storage-driver-secure="false" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088802 2561 flags.go:64] FLAG: --storage-driver-table="stats" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088805 2561 flags.go:64] FLAG: --storage-driver-user="root" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088808 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088811 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088814 2561 flags.go:64] FLAG: --system-cgroups="" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088818 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088823 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088826 2561 flags.go:64] FLAG: --tls-cert-file="" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088829 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088833 2561 flags.go:64] FLAG: --tls-min-version="" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088836 2561 flags.go:64] FLAG: --tls-private-key-file="" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088839 2561 flags.go:64] FLAG: --topology-manager-policy="none" Sep 13 20:12:49.095861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088842 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088844 2561 flags.go:64] FLAG: --topology-manager-scope="container" Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088847 2561 flags.go:64] FLAG: --v="2" Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088851 2561 flags.go:64] FLAG: --version="false" Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088856 2561 flags.go:64] FLAG: --vmodule="" Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088860 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.088864 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088978 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088982 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088986 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088990 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088994 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.088997 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089000 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089003 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089006 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089008 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089011 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089014 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089017 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089019 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 20:12:49.096486 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089022 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 20:12:49.096999 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089025 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 20:12:49.096999 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089027 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 20:12:49.096999 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089030 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 20:12:49.096999 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089034 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 20:12:49.096999 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089036 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 20:12:49.096999 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089039 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 20:12:49.096999 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089041 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 20:12:49.096999 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089044 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 20:12:49.096999 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089047 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 20:12:49.096999 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089049 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 20:12:49.096999 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089052 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 20:12:49.096999 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089055 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 20:12:49.096999 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089057 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 20:12:49.096999 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089059 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 20:12:49.096999 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089062 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 20:12:49.096999 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089065 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 20:12:49.096999 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089068 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 20:12:49.096999 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089070 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 20:12:49.096999 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089073 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 20:12:49.096999 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089077 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 20:12:49.097507 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089082 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 20:12:49.097507 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089085 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 20:12:49.097507 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089088 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 20:12:49.097507 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089091 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 20:12:49.097507 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089094 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 20:12:49.097507 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089097 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 20:12:49.097507 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089100 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 20:12:49.097507 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089103 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 20:12:49.097507 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089106 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 20:12:49.097507 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089108 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 20:12:49.097507 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089111 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 20:12:49.097507 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089113 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 20:12:49.097507 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089116 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 20:12:49.097507 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089120 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 20:12:49.097507 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089123 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 13 20:12:49.097507 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089128 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 20:12:49.097507 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089130 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 20:12:49.097507 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089133 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 20:12:49.097507 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089136 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 20:12:49.098010 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089140 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 20:12:49.098010 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089144 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 20:12:49.098010 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089147 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 20:12:49.098010 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089150 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 20:12:49.098010 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089152 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 20:12:49.098010 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089156 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 20:12:49.098010 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089158 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 20:12:49.098010 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089161 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 20:12:49.098010 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089164 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 20:12:49.098010 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089168 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 20:12:49.098010 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089170 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 20:12:49.098010 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089173 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 20:12:49.098010 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089176 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 20:12:49.098010 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089180 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 20:12:49.098010 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089183 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 20:12:49.098010 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089185 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 20:12:49.098010 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089188 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 20:12:49.098010 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089191 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 20:12:49.098010 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089195 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 20:12:49.098010 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089199 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 20:12:49.098617 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089202 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 20:12:49.098617 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089206 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 20:12:49.098617 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089208 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 20:12:49.098617 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089211 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 20:12:49.098617 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089213 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 20:12:49.098617 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089216 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 20:12:49.098617 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089219 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 20:12:49.098617 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089221 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 20:12:49.098617 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089228 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 20:12:49.098617 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089230 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 20:12:49.098617 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089233 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 20:12:49.098617 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089236 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 20:12:49.098617 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089238 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 20:12:49.098617 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089241 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 20:12:49.098617 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089244 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 20:12:49.098617 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089246 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 20:12:49.098617 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089249 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 20:12:49.098617 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089251 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 20:12:49.098617 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089254 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 20:12:49.098617 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089256 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 20:12:49.099143 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089259 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 20:12:49.099143 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089262 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 20:12:49.099143 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089265 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 20:12:49.099143 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089268 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 20:12:49.099143 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.089271 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 20:12:49.099143 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.089990 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 13 20:12:49.099143 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.097397 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 13 20:12:49.099143 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.097411 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 13 20:12:49.099143 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.098252 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 13 20:12:49.099143 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.098259 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 13 20:12:49.099143 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098314 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 20:12:49.099143 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098319 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 20:12:49.099143 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098323 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 20:12:49.099143 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098326 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 20:12:49.099524 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098329 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 20:12:49.099524 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098332 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 20:12:49.099524 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098335 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 20:12:49.099524 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098338 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 20:12:49.099524 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098340 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 20:12:49.099524 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098343 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 20:12:49.099524 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098346 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 20:12:49.099524 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098348 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 20:12:49.099524 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098351 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 20:12:49.099524 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098354 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 20:12:49.099524 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098357 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 20:12:49.099524 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098360 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 20:12:49.099524 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098363 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 20:12:49.099524 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098365 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 20:12:49.099524 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098368 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 20:12:49.099524 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098371 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 20:12:49.099524 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098373 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 20:12:49.099524 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098376 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 20:12:49.099524 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098379 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 20:12:49.099524 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098381 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 20:12:49.100017 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098385 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 20:12:49.100017 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098388 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 20:12:49.100017 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098390 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 20:12:49.100017 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098393 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 20:12:49.100017 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098396 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 20:12:49.100017 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098399 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 20:12:49.100017 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098402 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 20:12:49.100017 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098404 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 20:12:49.100017 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098407 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 20:12:49.100017 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098410 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 20:12:49.100017 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098412 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 20:12:49.100017 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098415 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 20:12:49.100017 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098417 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 20:12:49.100017 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098421 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 20:12:49.100017 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098423 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 20:12:49.100017 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098426 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 20:12:49.100017 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098428 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 20:12:49.100017 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098431 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 20:12:49.100017 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098434 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 20:12:49.100017 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098436 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 20:12:49.100520 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098439 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 20:12:49.100520 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098441 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 20:12:49.100520 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098444 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 20:12:49.100520 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098447 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 20:12:49.100520 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098451 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 20:12:49.100520 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098454 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 20:12:49.100520 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098457 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 20:12:49.100520 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098459 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 20:12:49.100520 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098462 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 20:12:49.100520 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098464 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 20:12:49.100520 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098467 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 20:12:49.100520 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098470 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 20:12:49.100520 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098488 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 20:12:49.100520 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098492 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 20:12:49.100520 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098495 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 20:12:49.100520 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098498 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 20:12:49.100520 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098502 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 20:12:49.100520 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098506 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 20:12:49.100520 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098510 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 20:12:49.100986 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098513 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 20:12:49.100986 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098517 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 20:12:49.100986 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098520 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 20:12:49.100986 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098523 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 20:12:49.100986 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098526 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 20:12:49.100986 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098529 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 13 20:12:49.100986 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098532 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 20:12:49.100986 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098535 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 20:12:49.100986 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098538 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 20:12:49.100986 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098541 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 20:12:49.100986 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098544 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 20:12:49.100986 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098546 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 20:12:49.100986 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098549 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 20:12:49.100986 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098552 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 20:12:49.100986 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098555 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 20:12:49.100986 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098557 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 20:12:49.100986 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098560 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 20:12:49.100986 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098563 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 20:12:49.100986 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098565 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 20:12:49.100986 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098568 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 20:12:49.101517 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098570 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 20:12:49.101517 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098573 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 20:12:49.101517 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098576 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 20:12:49.101517 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098579 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 20:12:49.101517 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098581 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 20:12:49.101517 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098584 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 20:12:49.101517 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098587 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 20:12:49.101517 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098591 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 20:12:49.101517 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098593 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 20:12:49.101517 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098596 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 20:12:49.101517 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098598 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 20:12:49.101517 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098601 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 20:12:49.101517 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098604 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 20:12:49.101517 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098606 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 20:12:49.101517 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098609 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 20:12:49.101517 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098611 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 20:12:49.101910 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.098616 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 13 20:12:49.101910 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098731 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 13 20:12:49.101910 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098736 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 13 20:12:49.101910 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098739 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 13 20:12:49.101910 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098742 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 13 20:12:49.101910 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098745 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 13 20:12:49.101910 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098748 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 13 20:12:49.101910 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098751 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 13 20:12:49.101910 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098754 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 13 20:12:49.101910 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098756 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 13 20:12:49.101910 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098759 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 13 20:12:49.101910 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098761 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 13 20:12:49.101910 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098764 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 13 20:12:49.101910 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098767 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 13 20:12:49.101910 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098770 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 13 20:12:49.102292 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098773 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 13 20:12:49.102292 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098775 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 13 20:12:49.102292 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098778 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 13 20:12:49.102292 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098781 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 13 20:12:49.102292 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098783 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 13 20:12:49.102292 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098786 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 13 20:12:49.102292 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098788 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 13 20:12:49.102292 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098791 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 13 20:12:49.102292 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098795 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 13 20:12:49.102292 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098800 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 13 20:12:49.102292 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098803 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 13 20:12:49.102292 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098806 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 13 20:12:49.102292 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098809 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 13 20:12:49.102292 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098811 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 13 20:12:49.102292 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098814 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 13 20:12:49.102292 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098817 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 13 20:12:49.102292 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098819 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 13 20:12:49.102292 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098822 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 13 20:12:49.102292 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098825 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 13 20:12:49.102803 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098827 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 13 20:12:49.102803 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098830 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 13 20:12:49.102803 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098832 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 13 20:12:49.102803 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098835 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 13 20:12:49.102803 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098837 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 13 20:12:49.102803 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098840 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 13 20:12:49.102803 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098843 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 13 20:12:49.102803 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098845 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 13 20:12:49.102803 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098848 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 13 20:12:49.102803 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098851 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 13 20:12:49.102803 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098853 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 13 20:12:49.102803 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098856 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 13 20:12:49.102803 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098858 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 13 20:12:49.102803 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098861 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 13 20:12:49.102803 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098863 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 13 20:12:49.102803 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098866 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 13 20:12:49.102803 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098868 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 13 20:12:49.102803 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098871 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 13 20:12:49.102803 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098873 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 13 20:12:49.103242 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098877 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 13 20:12:49.103242 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098881 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 13 20:12:49.103242 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098885 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 13 20:12:49.103242 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098888 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 13 20:12:49.103242 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098891 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 13 20:12:49.103242 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098894 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 13 20:12:49.103242 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098896 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 13 20:12:49.103242 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098899 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 13 20:12:49.103242 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098902 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 13 20:12:49.103242 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098904 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 13 20:12:49.103242 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098907 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 13 20:12:49.103242 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098909 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 13 20:12:49.103242 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098912 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 13 20:12:49.103242 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098915 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 13 20:12:49.103242 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098917 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 13 20:12:49.103242 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098920 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 13 20:12:49.103242 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098922 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 13 20:12:49.103242 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098925 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 13 20:12:49.103242 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098927 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 13 20:12:49.103720 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098930 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 13 20:12:49.103720 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098932 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 13 20:12:49.103720 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098935 2561 feature_gate.go:328] unrecognized feature gate: Example Sep 13 20:12:49.103720 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098938 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 13 20:12:49.103720 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098941 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 13 20:12:49.103720 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098943 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 13 20:12:49.103720 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098946 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 13 20:12:49.103720 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098948 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 13 20:12:49.103720 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098951 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 13 20:12:49.103720 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098953 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 13 20:12:49.103720 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098956 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 13 20:12:49.103720 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098958 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 13 20:12:49.103720 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098961 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 13 20:12:49.103720 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098963 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 13 20:12:49.103720 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098966 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 13 20:12:49.103720 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098969 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 13 20:12:49.103720 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098971 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 13 20:12:49.103720 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098974 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 13 20:12:49.103720 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098977 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 13 20:12:49.103720 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098980 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 13 20:12:49.104198 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098982 2561 feature_gate.go:328] unrecognized feature gate: Example2 Sep 13 20:12:49.104198 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098985 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 13 20:12:49.104198 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098987 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 13 20:12:49.104198 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098990 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 13 20:12:49.104198 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098992 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 13 20:12:49.104198 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098995 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 13 20:12:49.104198 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.098998 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 13 20:12:49.104198 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:49.099000 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 13 20:12:49.104198 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.099005 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 13 20:12:49.104198 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.099098 2561 server.go:962] "Client rotation is on, will bootstrap in background" Sep 13 20:12:49.104198 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.102268 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 13 20:12:49.104198 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.103270 2561 server.go:1019] "Starting client certificate rotation" Sep 13 20:12:49.104198 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.103368 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 13 20:12:49.104198 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.103401 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 13 20:12:49.106234 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.106220 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 13 20:12:49.107384 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.107367 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 13 20:12:49.119612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.119590 2561 log.go:25] "Validated CRI v1 runtime API" Sep 13 20:12:49.123715 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.123698 2561 log.go:25] "Validated CRI v1 image API" Sep 13 20:12:49.124579 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.124561 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 13 20:12:49.128795 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.128770 2561 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b1ea5751-6136-405e-97cd-e7b18ce0e603:/dev/nvme0n1p3 d1be735e-f8d6-4672-be1b-3ac7987acc83:/dev/nvme0n1p4] Sep 13 20:12:49.128870 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.128793 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 13 20:12:49.133114 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.133094 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 13 20:12:49.134177 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.134078 2561 manager.go:216] Machine: {Timestamp:2026-09-13 20:12:49.133621093 +0000 UTC m=+0.361781577 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096974 MemoryCapacity:33164464128 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cb94023d045fb86876b746428952f SystemUUID:ec2cb940-23d0-45fb-8687-6b746428952f BootID:38209ad6-0b71-411f-b4ec-2d8e0b2ba323 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582230016 Type:vfs Inodes:4048396 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582234112 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:f7:60:a0:ab Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:f7:60:a0:ab Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7e:46:35:19:58:d6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164464128 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 13 20:12:49.134177 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.134172 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 13 20:12:49.134282 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.134242 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 13 20:12:49.138045 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.138023 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 13 20:12:49.138168 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.138047 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-59.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 13 20:12:49.138925 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.138914 2561 topology_manager.go:138] "Creating topology manager with none policy" Sep 13 20:12:49.138964 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.138927 2561 container_manager_linux.go:309] "Creating device plugin manager" Sep 13 20:12:49.138964 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.138934 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 13 20:12:49.138964 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.138948 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 13 20:12:49.140120 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.140110 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 13 20:12:49.145131 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.145120 2561 state_mem.go:36] "Initialized new in-memory state store" Sep 13 20:12:49.145237 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.145228 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 13 20:12:49.145270 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.145260 2561 kubelet.go:486] "Attempting to sync node with API server" Sep 13 20:12:49.145301 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.145272 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 13 20:12:49.145301 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.145287 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 13 20:12:49.145301 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.145296 2561 kubelet.go:398] "Adding apiserver pod source" Sep 13 20:12:49.145407 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.145326 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 13 20:12:49.145731 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.145719 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 13 20:12:49.145769 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.145744 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 13 20:12:49.148062 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.148045 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 13 20:12:49.149736 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.149716 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cvk4b" Sep 13 20:12:49.150397 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.150384 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 13 20:12:49.150450 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.150414 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 13 20:12:49.152295 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.152283 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 13 20:12:49.152295 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.152298 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 13 20:12:49.152368 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.152305 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 13 20:12:49.152368 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.152310 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 13 20:12:49.152368 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.152318 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 13 20:12:49.152368 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.152324 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 13 20:12:49.152368 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.152339 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 13 20:12:49.152368 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.152345 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 13 20:12:49.152368 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.152351 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 13 20:12:49.152368 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.152357 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 13 20:12:49.152368 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.152370 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 13 20:12:49.152624 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.152376 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 13 20:12:49.154077 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.154066 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 13 20:12:49.154077 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.154076 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 13 20:12:49.155188 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:49.155166 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 13 20:12:49.155247 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:49.155208 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-59.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 13 20:12:49.156889 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.156876 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cvk4b" Sep 13 20:12:49.158296 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.158281 2561 server.go:1268] "Started kubelet" Sep 13 20:12:49.158404 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.158377 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 13 20:12:49.158458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.158365 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 13 20:12:49.158528 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.158505 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 13 20:12:49.159042 ip-10-0-141-59 systemd[1]: Started Kubernetes Kubelet. Sep 13 20:12:49.160061 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.160045 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 13 20:12:49.160357 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.160342 2561 server.go:310] "Adding debug handlers to kubelet server" Sep 13 20:12:49.164558 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.164542 2561 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-59.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 13 20:12:49.165437 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:49.165421 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 13 20:12:49.166007 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:49.164574 2561 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-59.ec2.internal.18d4fa7d8f7f1c27 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-59.ec2.internal,UID:ip-10-0-141-59.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-59.ec2.internal,},FirstTimestamp:2026-09-13 20:12:49.158257703 +0000 UTC m=+0.386418186,LastTimestamp:2026-09-13 20:12:49.158257703 +0000 UTC m=+0.386418186,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-59.ec2.internal,}" Sep 13 20:12:49.168282 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.168263 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 13 20:12:49.169512 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.168917 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 13 20:12:49.169913 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.169853 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 13 20:12:49.169913 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.169916 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 13 20:12:49.170071 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:49.169898 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" Sep 13 20:12:49.170148 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.170135 2561 reconstruct.go:97] "Volume reconstruction finished" Sep 13 20:12:49.170148 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.170148 2561 reconciler.go:29] "Reconciler: start to sync state" Sep 13 20:12:49.170875 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.170440 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 13 20:12:49.173418 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.173399 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 20:12:49.173512 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.173436 2561 factory.go:55] Registering systemd factory Sep 13 20:12:49.173512 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.173494 2561 factory.go:223] Registration of the systemd container factory successfully Sep 13 20:12:49.173942 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.173927 2561 factory.go:153] Registering CRI-O factory Sep 13 20:12:49.174002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.173947 2561 factory.go:223] Registration of the crio container factory successfully Sep 13 20:12:49.174063 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.174000 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 13 20:12:49.174063 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.174020 2561 factory.go:103] Registering Raw factory Sep 13 20:12:49.174063 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.174037 2561 manager.go:1196] Started watching for new ooms in manager Sep 13 20:12:49.174489 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.174460 2561 manager.go:349] Starting recovery of all containers Sep 13 20:12:49.175049 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:49.175027 2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-59.ec2.internal\" not found" node="ip-10-0-141-59.ec2.internal" Sep 13 20:12:49.184706 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.183877 2561 manager.go:354] Recovery completed Sep 13 20:12:49.188065 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.188053 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 20:12:49.189813 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.189794 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientMemory" Sep 13 20:12:49.189883 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.189831 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 20:12:49.189883 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.189843 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientPID" Sep 13 20:12:49.190379 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.190362 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 13 20:12:49.190379 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.190374 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 20:12:49.190379 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.190378 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 13 20:12:49.190554 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.190396 2561 state_mem.go:36] "Initialized new in-memory state store" Sep 13 20:12:49.191070 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.191055 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientMemory" Sep 13 20:12:49.191123 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.191082 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 20:12:49.191123 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.191091 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientPID" Sep 13 20:12:49.192604 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.192591 2561 policy_none.go:49] "None policy: Start" Sep 13 20:12:49.192659 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.192607 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 13 20:12:49.192659 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.192616 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 13 20:12:49.194551 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.194540 2561 policy_none.go:47] "Start" Sep 13 20:12:49.218146 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.218130 2561 manager.go:337] "Starting Device Plugin manager" Sep 13 20:12:49.218228 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:49.218162 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 13 20:12:49.218228 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.218171 2561 server.go:87] "Starting device plugin registration server" Sep 13 20:12:49.218401 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.218386 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 13 20:12:49.218453 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.218404 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 13 20:12:49.218512 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.218484 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 13 20:12:49.218582 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.218569 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 13 20:12:49.218644 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.218585 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 13 20:12:49.219499 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:49.219056 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 13 20:12:49.219499 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:49.219126 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-59.ec2.internal\" not found" Sep 13 20:12:49.277668 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.277649 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 13 20:12:49.279560 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.278763 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 13 20:12:49.279560 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.278807 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 13 20:12:49.279560 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.278831 2561 kubelet.go:2448] "Starting kubelet main sync loop" Sep 13 20:12:49.279560 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:49.278873 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 13 20:12:49.280661 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.280639 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 20:12:49.319360 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.319341 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 20:12:49.320156 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.320141 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientMemory" Sep 13 20:12:49.320220 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.320177 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 20:12:49.320220 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.320207 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientPID" Sep 13 20:12:49.320289 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.320253 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-59.ec2.internal" Sep 13 20:12:49.327243 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.327208 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-59.ec2.internal" Sep 13 20:12:49.327243 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:49.327228 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-59.ec2.internal\": node \"ip-10-0-141-59.ec2.internal\" not found" Sep 13 20:12:49.342858 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:49.342840 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" Sep 13 20:12:49.379511 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.378923 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal"] Sep 13 20:12:49.379605 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.379555 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 20:12:49.380306 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.380292 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientMemory" Sep 13 20:12:49.380357 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.380316 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 20:12:49.380357 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.380330 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientPID" Sep 13 20:12:49.382464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.382451 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 20:12:49.382598 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.382584 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" Sep 13 20:12:49.382657 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.382612 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 20:12:49.383333 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.383319 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientMemory" Sep 13 20:12:49.383395 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.383338 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 20:12:49.383395 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.383347 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientPID" Sep 13 20:12:49.383395 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.383323 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientMemory" Sep 13 20:12:49.383395 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.383376 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 20:12:49.383395 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.383387 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientPID" Sep 13 20:12:49.385446 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.385431 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" Sep 13 20:12:49.385503 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.385463 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 13 20:12:49.386186 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.386170 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientMemory" Sep 13 20:12:49.386272 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.386198 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasNoDiskPressure" Sep 13 20:12:49.386272 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.386212 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeHasSufficientPID" Sep 13 20:12:49.403057 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:49.403039 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-59.ec2.internal\" not found" node="ip-10-0-141-59.ec2.internal" Sep 13 20:12:49.407246 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:49.407232 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-59.ec2.internal\" not found" node="ip-10-0-141-59.ec2.internal" Sep 13 20:12:49.443937 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:49.443918 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" Sep 13 20:12:49.544943 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:49.544926 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" Sep 13 20:12:49.571109 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.571092 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcb7cd3b90b7caa77496ef09bdb65921-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal\" (UID: \"bcb7cd3b90b7caa77496ef09bdb65921\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" Sep 13 20:12:49.571161 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.571115 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/adb95b757af8a0d6b709ad0e466205b6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-59.ec2.internal\" (UID: \"adb95b757af8a0d6b709ad0e466205b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" Sep 13 20:12:49.571161 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.571132 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bcb7cd3b90b7caa77496ef09bdb65921-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal\" (UID: \"bcb7cd3b90b7caa77496ef09bdb65921\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" Sep 13 20:12:49.645395 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:49.645339 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" Sep 13 20:12:49.671696 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.671669 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bcb7cd3b90b7caa77496ef09bdb65921-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal\" (UID: \"bcb7cd3b90b7caa77496ef09bdb65921\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" Sep 13 20:12:49.671771 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.671702 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcb7cd3b90b7caa77496ef09bdb65921-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal\" (UID: \"bcb7cd3b90b7caa77496ef09bdb65921\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" Sep 13 20:12:49.671771 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.671720 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/adb95b757af8a0d6b709ad0e466205b6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-59.ec2.internal\" (UID: \"adb95b757af8a0d6b709ad0e466205b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" Sep 13 20:12:49.671861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.671779 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/adb95b757af8a0d6b709ad0e466205b6-config\") pod \"kube-apiserver-proxy-ip-10-0-141-59.ec2.internal\" (UID: \"adb95b757af8a0d6b709ad0e466205b6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" Sep 13 20:12:49.671861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.671790 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bcb7cd3b90b7caa77496ef09bdb65921-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal\" (UID: \"bcb7cd3b90b7caa77496ef09bdb65921\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" Sep 13 20:12:49.671861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.671779 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/bcb7cd3b90b7caa77496ef09bdb65921-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal\" (UID: \"bcb7cd3b90b7caa77496ef09bdb65921\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" Sep 13 20:12:49.704743 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.704722 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" Sep 13 20:12:49.709969 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:49.709664 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" Sep 13 20:12:49.746359 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:49.746324 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" Sep 13 20:12:49.846784 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:49.846760 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" Sep 13 20:12:51.358815 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:51.358792 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" Sep 13 20:12:51.459436 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:51.459409 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" Sep 13 20:12:51.514895 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:51.514875 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 13 20:12:51.515289 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:51.515007 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 13 20:12:51.515289 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:51.515037 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 13 20:12:51.560373 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:51.560317 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" Sep 13 20:12:51.575493 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:51.575447 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-12 20:07:50 +0000 UTC" deadline="2028-05-29 18:59:10.382969028 +0000 UTC" Sep 13 20:12:51.575493 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:51.575492 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14974h46m18.807479854s" Sep 13 20:12:51.638048 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:51.637427 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb95b757af8a0d6b709ad0e466205b6.slice/crio-79b2e1993bcd5ed6c49d9522084c6f2abec8adf7757afbdcb2b39b2f9be6b36a WatchSource:0}: Error finding container 79b2e1993bcd5ed6c49d9522084c6f2abec8adf7757afbdcb2b39b2f9be6b36a: Status 404 returned error can't find the container with id 79b2e1993bcd5ed6c49d9522084c6f2abec8adf7757afbdcb2b39b2f9be6b36a Sep 13 20:12:51.638179 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:51.638147 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcb7cd3b90b7caa77496ef09bdb65921.slice/crio-c9b5bd0523e287e5e135ae7ff148be06552874c17f0ab491b8433852bba06164 WatchSource:0}: Error finding container c9b5bd0523e287e5e135ae7ff148be06552874c17f0ab491b8433852bba06164: Status 404 returned error can't find the container with id c9b5bd0523e287e5e135ae7ff148be06552874c17f0ab491b8433852bba06164 Sep 13 20:12:51.644832 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:51.644818 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 13 20:12:51.661188 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:51.661166 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-59.ec2.internal\" not found" Sep 13 20:12:51.693691 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:51.693651 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" event={"ID":"adb95b757af8a0d6b709ad0e466205b6","Type":"ContainerStarted","Data":"79b2e1993bcd5ed6c49d9522084c6f2abec8adf7757afbdcb2b39b2f9be6b36a"} Sep 13 20:12:51.694702 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:51.694681 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" event={"ID":"bcb7cd3b90b7caa77496ef09bdb65921","Type":"ContainerStarted","Data":"c9b5bd0523e287e5e135ae7ff148be06552874c17f0ab491b8433852bba06164"} Sep 13 20:12:51.760562 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:51.760539 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 20:12:51.781951 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:51.781933 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" Sep 13 20:12:51.793525 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:51.793508 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 13 20:12:51.795247 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:51.795235 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" Sep 13 20:12:51.800742 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:51.800728 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 13 20:12:51.983320 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:51.983263 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 20:12:52.341116 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.341010 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 20:12:52.558052 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.558016 2561 apiserver.go:52] "Watching apiserver" Sep 13 20:12:52.565211 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.565187 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 13 20:12:52.566418 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.566387 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal","openshift-cluster-node-tuning-operator/tuned-n5hgm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal","openshift-multus/multus-additional-cni-plugins-h4zf8","openshift-multus/multus-nbqnk","openshift-multus/network-metrics-daemon-8bbtk","openshift-network-diagnostics/network-check-target-r7xjr","openshift-network-operator/iptables-alerter-nn8pp","kube-system/global-pull-secret-syncer-tqzd4","kube-system/konnectivity-agent-rj2v7","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9","openshift-dns/node-resolver-lj9m7","openshift-image-registry/node-ca-ffvkb","openshift-ovn-kubernetes/ovnkube-node-g54wf"] Sep 13 20:12:52.568754 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.568736 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:12:52.568849 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:52.568805 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7xjr" podUID="ffb004f5-2003-4db1-a1a9-33520224afda" Sep 13 20:12:52.570923 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.570907 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ffvkb" Sep 13 20:12:52.573334 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.573271 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 13 20:12:52.573413 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.573396 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.574539 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.573965 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 13 20:12:52.574539 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.574019 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4q8xq\"" Sep 13 20:12:52.576233 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.574880 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 13 20:12:52.576233 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.576002 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.576233 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.576152 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 13 20:12:52.576954 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.576708 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 13 20:12:52.577414 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.577399 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 13 20:12:52.578002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.577983 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 13 20:12:52.578181 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.578162 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6zk24\"" Sep 13 20:12:52.578269 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.578204 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 13 20:12:52.578332 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.578302 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.578621 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.578600 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 13 20:12:52.578686 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.578640 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 13 20:12:52.578737 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.578687 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 13 20:12:52.578737 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.578696 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9hhzd\"" Sep 13 20:12:52.578989 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.578891 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 13 20:12:52.578989 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.578911 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 13 20:12:52.579149 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.579116 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 13 20:12:52.579149 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.579116 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 13 20:12:52.579952 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.579930 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 13 20:12:52.580648 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.580459 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:12:52.580648 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:52.580533 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8bbtk" podUID="3a23dc7b-d272-4973-8fa8-439c8db80153" Sep 13 20:12:52.580648 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.580613 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-p7tpt\"" Sep 13 20:12:52.581406 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.580998 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 13 20:12:52.582770 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.582692 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:12:52.582770 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:52.582752 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqzd4" podUID="599cb3c5-7fb7-4f7c-bacc-e500d844967e" Sep 13 20:12:52.585080 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.585031 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nn8pp" Sep 13 20:12:52.587174 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.587155 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 13 20:12:52.587436 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.587404 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5mkw8\"" Sep 13 20:12:52.587527 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.587474 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.587527 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.587505 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 13 20:12:52.587628 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.587533 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 13 20:12:52.589755 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.589737 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rlbhp\"" Sep 13 20:12:52.589894 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.589878 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 13 20:12:52.589982 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.589893 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 13 20:12:52.590029 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.589980 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rj2v7" Sep 13 20:12:52.592190 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.592142 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-twtks\"" Sep 13 20:12:52.592317 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.592300 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 13 20:12:52.592317 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.592284 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 13 20:12:52.592453 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.592332 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.592514 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.592461 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 13 20:12:52.593107 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.592817 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-cnibin\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.593107 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.592852 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-host-run-netns\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.593107 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.592876 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-host-var-lib-kubelet\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.593107 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.592898 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjsdt\" (UniqueName: \"kubernetes.io/projected/ab1d9571-0fb7-43a9-83b1-3980310e1650-kube-api-access-bjsdt\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.593107 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.592920 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-multus-socket-dir-parent\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.593107 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.592936 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-host-var-lib-cni-bin\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.593107 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.592954 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-hostroot\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.593107 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.592987 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-multus-conf-dir\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.593107 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593027 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs\") pod \"network-metrics-daemon-8bbtk\" (UID: \"3a23dc7b-d272-4973-8fa8-439c8db80153\") " pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:12:52.593107 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593054 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b39db385-6547-430c-894e-4976abd54196-serviceca\") pod \"node-ca-ffvkb\" (UID: \"b39db385-6547-430c-894e-4976abd54196\") " pod="openshift-image-registry/node-ca-ffvkb" Sep 13 20:12:52.593530 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593120 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-run-systemd\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.593530 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593172 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-system-cni-dir\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.593530 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593199 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hs6jn\" (UniqueName: \"kubernetes.io/projected/b39db385-6547-430c-894e-4976abd54196-kube-api-access-hs6jn\") pod \"node-ca-ffvkb\" (UID: \"b39db385-6547-430c-894e-4976abd54196\") " pod="openshift-image-registry/node-ca-ffvkb" Sep 13 20:12:52.593530 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593222 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-kubelet\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.593530 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593245 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-run-ovn\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.593530 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593268 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43f60dd5-273c-43c1-8c93-e8d20b6e8540-cni-binary-copy\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.593530 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593290 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab1d9571-0fb7-43a9-83b1-3980310e1650-cni-binary-copy\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.593530 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593333 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/599cb3c5-7fb7-4f7c-bacc-e500d844967e-dbus\") pod \"global-pull-secret-syncer-tqzd4\" (UID: \"599cb3c5-7fb7-4f7c-bacc-e500d844967e\") " pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:12:52.593530 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593374 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-var-lib-openvswitch\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.593530 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593407 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-run-openvswitch\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.593530 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593453 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/915e7743-2942-46c6-9484-b79f4b96a918-ovnkube-config\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.593530 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593493 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/915e7743-2942-46c6-9484-b79f4b96a918-ovn-node-metrics-cert\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.593966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593559 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43f60dd5-273c-43c1-8c93-e8d20b6e8540-system-cni-dir\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.593966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593627 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43f60dd5-273c-43c1-8c93-e8d20b6e8540-cnibin\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.593966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593667 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf27l\" (UniqueName: \"kubernetes.io/projected/3a23dc7b-d272-4973-8fa8-439c8db80153-kube-api-access-bf27l\") pod \"network-metrics-daemon-8bbtk\" (UID: \"3a23dc7b-d272-4973-8fa8-439c8db80153\") " pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:12:52.593966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593691 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab1d9571-0fb7-43a9-83b1-3980310e1650-multus-daemon-config\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.593966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593725 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-host-run-multus-certs\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.593966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593748 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-node-log\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.593966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593771 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43f60dd5-273c-43c1-8c93-e8d20b6e8540-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.593966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593796 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/43f60dd5-273c-43c1-8c93-e8d20b6e8540-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.593966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593821 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-host-var-lib-cni-multus\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.593966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593875 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-etc-kubernetes\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.593966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593904 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-systemd-units\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.593966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593939 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-slash\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.593966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593967 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-etc-openvswitch\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.594594 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.593989 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-log-socket\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.594594 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594011 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-cni-netd\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.594594 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594049 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-run-netns\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.594594 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594084 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-cni-bin\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.594594 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594111 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.594594 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594140 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/915e7743-2942-46c6-9484-b79f4b96a918-ovnkube-script-lib\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.594594 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594176 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glp9q\" (UniqueName: \"kubernetes.io/projected/915e7743-2942-46c6-9484-b79f4b96a918-kube-api-access-glp9q\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.594594 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594197 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/43f60dd5-273c-43c1-8c93-e8d20b6e8540-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.594594 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594213 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdfgz\" (UniqueName: \"kubernetes.io/projected/43f60dd5-273c-43c1-8c93-e8d20b6e8540-kube-api-access-gdfgz\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.594594 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594244 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-host-run-k8s-cni-cncf-io\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.594594 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594282 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-run-ovn-kubernetes\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.594594 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594307 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/915e7743-2942-46c6-9484-b79f4b96a918-env-overrides\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.594594 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594331 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v9qm\" (UniqueName: \"kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm\") pod \"network-check-target-r7xjr\" (UID: \"ffb004f5-2003-4db1-a1a9-33520224afda\") " pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:12:52.594594 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594352 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/599cb3c5-7fb7-4f7c-bacc-e500d844967e-kubelet-config\") pod \"global-pull-secret-syncer-tqzd4\" (UID: \"599cb3c5-7fb7-4f7c-bacc-e500d844967e\") " pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:12:52.594594 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594389 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret\") pod \"global-pull-secret-syncer-tqzd4\" (UID: \"599cb3c5-7fb7-4f7c-bacc-e500d844967e\") " pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:12:52.594594 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594412 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b39db385-6547-430c-894e-4976abd54196-host\") pod \"node-ca-ffvkb\" (UID: \"b39db385-6547-430c-894e-4976abd54196\") " pod="openshift-image-registry/node-ca-ffvkb" Sep 13 20:12:52.595272 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594435 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-multus-cni-dir\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.595272 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594458 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 13 20:12:52.595272 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594507 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 13 20:12:52.595272 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594600 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 13 20:12:52.595272 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594666 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lj9m7" Sep 13 20:12:52.595272 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.594600 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-hvcxw\"" Sep 13 20:12:52.596649 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.596632 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 13 20:12:52.596751 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.596662 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 13 20:12:52.596984 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.596969 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qgr8f\"" Sep 13 20:12:52.612231 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.612208 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ms8cv" Sep 13 20:12:52.619179 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.619147 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ms8cv" Sep 13 20:12:52.683177 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.683153 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 13 20:12:52.695638 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.695599 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdfgz\" (UniqueName: \"kubernetes.io/projected/43f60dd5-273c-43c1-8c93-e8d20b6e8540-kube-api-access-gdfgz\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.695638 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.695639 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret\") pod \"global-pull-secret-syncer-tqzd4\" (UID: \"599cb3c5-7fb7-4f7c-bacc-e500d844967e\") " pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:12:52.695833 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.695667 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-multus-cni-dir\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.695833 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.695689 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-host-run-netns\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.695833 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.695712 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-host-var-lib-kubelet\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.695833 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.695734 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjsdt\" (UniqueName: \"kubernetes.io/projected/ab1d9571-0fb7-43a9-83b1-3980310e1650-kube-api-access-bjsdt\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.695833 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.695755 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-host-var-lib-cni-bin\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.695833 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.695777 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs\") pod \"network-metrics-daemon-8bbtk\" (UID: \"3a23dc7b-d272-4973-8fa8-439c8db80153\") " pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:12:52.695833 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.695803 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b39db385-6547-430c-894e-4976abd54196-serviceca\") pod \"node-ca-ffvkb\" (UID: \"b39db385-6547-430c-894e-4976abd54196\") " pod="openshift-image-registry/node-ca-ffvkb" Sep 13 20:12:52.695833 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.695829 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99516c6f-8366-4e37-9e2f-dadcc15b75e3-socket-dir\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.696223 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:52.695832 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 20:12:52.696223 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.695851 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99516c6f-8366-4e37-9e2f-dadcc15b75e3-device-dir\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.696223 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.695874 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-etc-kubernetes\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.696223 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.695905 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-var-lib-kubelet\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.696223 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:52.695918 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret podName:599cb3c5-7fb7-4f7c-bacc-e500d844967e nodeName:}" failed. No retries permitted until 2026-09-13 20:12:53.195893949 +0000 UTC m=+3.012469493 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret") pod "global-pull-secret-syncer-tqzd4" (UID: "599cb3c5-7fb7-4f7c-bacc-e500d844967e") : object "kube-system"/"original-pull-secret" not registered Sep 13 20:12:52.696223 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.695944 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-host-var-lib-cni-bin\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.696223 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.695987 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-host-run-netns\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.696223 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:52.696024 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:12:52.696223 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:52.696112 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs podName:3a23dc7b-d272-4973-8fa8-439c8db80153 nodeName:}" failed. No retries permitted until 2026-09-13 20:12:53.196096341 +0000 UTC m=+3.012671892 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs") pod "network-metrics-daemon-8bbtk" (UID: "3a23dc7b-d272-4973-8fa8-439c8db80153") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:12:52.696223 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696222 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-multus-cni-dir\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.696687 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696245 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4025fa18-2c8c-470e-9754-18789bc510d6-tmp\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.696687 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696256 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-host-var-lib-kubelet\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.696687 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696284 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-kubelet\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.696687 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696312 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/428ee95f-1def-45a2-9238-552a99aa32f2-hosts-file\") pod \"node-resolver-lj9m7\" (UID: \"428ee95f-1def-45a2-9238-552a99aa32f2\") " pod="openshift-dns/node-resolver-lj9m7" Sep 13 20:12:52.696687 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696315 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-kubelet\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.696687 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696336 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae6e4a30-1019-4b10-980a-2938365bdc5f-agent-certs\") pod \"konnectivity-agent-rj2v7\" (UID: \"ae6e4a30-1019-4b10-980a-2938365bdc5f\") " pod="kube-system/konnectivity-agent-rj2v7" Sep 13 20:12:52.696687 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696374 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab1d9571-0fb7-43a9-83b1-3980310e1650-cni-binary-copy\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.696687 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696401 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-var-lib-openvswitch\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.696687 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696429 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae6e4a30-1019-4b10-980a-2938365bdc5f-konnectivity-ca\") pod \"konnectivity-agent-rj2v7\" (UID: \"ae6e4a30-1019-4b10-980a-2938365bdc5f\") " pod="kube-system/konnectivity-agent-rj2v7" Sep 13 20:12:52.696687 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696455 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf27l\" (UniqueName: \"kubernetes.io/projected/3a23dc7b-d272-4973-8fa8-439c8db80153-kube-api-access-bf27l\") pod \"network-metrics-daemon-8bbtk\" (UID: \"3a23dc7b-d272-4973-8fa8-439c8db80153\") " pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:12:52.696687 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696458 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-var-lib-openvswitch\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.696687 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696478 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab1d9571-0fb7-43a9-83b1-3980310e1650-multus-daemon-config\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.696687 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696506 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-host-run-multus-certs\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.696687 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696527 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-node-log\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.696687 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696583 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43f60dd5-273c-43c1-8c93-e8d20b6e8540-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.696687 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696608 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-etc-sysctl-d\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.696687 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696622 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-host-run-multus-certs\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.697464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696632 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/428ee95f-1def-45a2-9238-552a99aa32f2-tmp-dir\") pod \"node-resolver-lj9m7\" (UID: \"428ee95f-1def-45a2-9238-552a99aa32f2\") " pod="openshift-dns/node-resolver-lj9m7" Sep 13 20:12:52.697464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696679 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-etc-kubernetes\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.697464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696684 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-node-log\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.697464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696715 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-slash\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.697464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696735 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-etc-kubernetes\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.697464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696771 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-cni-netd\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.697464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696795 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/43f60dd5-273c-43c1-8c93-e8d20b6e8540-tuning-conf-dir\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.697464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696806 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-slash\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.697464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696842 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glp9q\" (UniqueName: \"kubernetes.io/projected/915e7743-2942-46c6-9484-b79f4b96a918-kube-api-access-glp9q\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.697464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696846 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-cni-netd\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.697464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696872 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-etc-sysconfig\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.697464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696898 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq9lk\" (UniqueName: \"kubernetes.io/projected/4025fa18-2c8c-470e-9754-18789bc510d6-kube-api-access-kq9lk\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.697464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696925 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-run-netns\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.697464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696951 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-cni-bin\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.697464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696958 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-run-netns\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.697464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.696976 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99516c6f-8366-4e37-9e2f-dadcc15b75e3-sys-fs\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.697464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697003 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v9qm\" (UniqueName: \"kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm\") pod \"network-check-target-r7xjr\" (UID: \"ffb004f5-2003-4db1-a1a9-33520224afda\") " pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:12:52.698176 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697019 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-cni-bin\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.698176 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697029 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab1d9571-0fb7-43a9-83b1-3980310e1650-cni-binary-copy\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.698176 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697071 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-etc-sysctl-conf\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.698176 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697105 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1333ff89-11cb-4c73-b911-73172880232c-host-slash\") pod \"iptables-alerter-nn8pp\" (UID: \"1333ff89-11cb-4c73-b911-73172880232c\") " pod="openshift-network-operator/iptables-alerter-nn8pp" Sep 13 20:12:52.698176 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697136 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-run-openvswitch\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.698176 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697155 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ab1d9571-0fb7-43a9-83b1-3980310e1650-multus-daemon-config\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.698176 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697159 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43f60dd5-273c-43c1-8c93-e8d20b6e8540-cnibin\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.698176 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697193 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/43f60dd5-273c-43c1-8c93-e8d20b6e8540-cnibin\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.698176 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697216 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-run-openvswitch\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.698176 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697215 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/43f60dd5-273c-43c1-8c93-e8d20b6e8540-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.698176 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697319 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/599cb3c5-7fb7-4f7c-bacc-e500d844967e-kubelet-config\") pod \"global-pull-secret-syncer-tqzd4\" (UID: \"599cb3c5-7fb7-4f7c-bacc-e500d844967e\") " pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:12:52.698176 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697349 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b39db385-6547-430c-894e-4976abd54196-host\") pod \"node-ca-ffvkb\" (UID: \"b39db385-6547-430c-894e-4976abd54196\") " pod="openshift-image-registry/node-ca-ffvkb" Sep 13 20:12:52.698176 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697373 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-cnibin\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.698176 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697377 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b39db385-6547-430c-894e-4976abd54196-serviceca\") pod \"node-ca-ffvkb\" (UID: \"b39db385-6547-430c-894e-4976abd54196\") " pod="openshift-image-registry/node-ca-ffvkb" Sep 13 20:12:52.698176 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697383 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/599cb3c5-7fb7-4f7c-bacc-e500d844967e-kubelet-config\") pod \"global-pull-secret-syncer-tqzd4\" (UID: \"599cb3c5-7fb7-4f7c-bacc-e500d844967e\") " pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:12:52.698176 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697397 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99516c6f-8366-4e37-9e2f-dadcc15b75e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.698176 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697427 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b39db385-6547-430c-894e-4976abd54196-host\") pod \"node-ca-ffvkb\" (UID: \"b39db385-6547-430c-894e-4976abd54196\") " pod="openshift-image-registry/node-ca-ffvkb" Sep 13 20:12:52.698794 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697448 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-multus-socket-dir-parent\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.698794 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697468 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-cnibin\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.698794 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-hostroot\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.698794 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697533 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-multus-conf-dir\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.698794 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697536 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-multus-socket-dir-parent\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.698794 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697557 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-run-systemd\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.698794 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697577 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-hostroot\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.698794 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697582 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43f60dd5-273c-43c1-8c93-e8d20b6e8540-cni-binary-copy\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.698794 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697608 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99516c6f-8366-4e37-9e2f-dadcc15b75e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.698794 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697615 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-multus-conf-dir\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.698794 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697637 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-lib-modules\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.698794 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697660 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-host\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.698794 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697685 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-system-cni-dir\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.698794 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697714 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/43f60dd5-273c-43c1-8c93-e8d20b6e8540-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.698794 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697725 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hs6jn\" (UniqueName: \"kubernetes.io/projected/b39db385-6547-430c-894e-4976abd54196-kube-api-access-hs6jn\") pod \"node-ca-ffvkb\" (UID: \"b39db385-6547-430c-894e-4976abd54196\") " pod="openshift-image-registry/node-ca-ffvkb" Sep 13 20:12:52.698794 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697751 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-run-ovn\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.698794 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697768 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-run-systemd\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.698794 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697773 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4025fa18-2c8c-470e-9754-18789bc510d6-etc-tuned\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.699458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697798 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8758\" (UniqueName: \"kubernetes.io/projected/428ee95f-1def-45a2-9238-552a99aa32f2-kube-api-access-l8758\") pod \"node-resolver-lj9m7\" (UID: \"428ee95f-1def-45a2-9238-552a99aa32f2\") " pod="openshift-dns/node-resolver-lj9m7" Sep 13 20:12:52.699458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697824 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gf84\" (UniqueName: \"kubernetes.io/projected/1333ff89-11cb-4c73-b911-73172880232c-kube-api-access-5gf84\") pod \"iptables-alerter-nn8pp\" (UID: \"1333ff89-11cb-4c73-b911-73172880232c\") " pod="openshift-network-operator/iptables-alerter-nn8pp" Sep 13 20:12:52.699458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697849 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/599cb3c5-7fb7-4f7c-bacc-e500d844967e-dbus\") pod \"global-pull-secret-syncer-tqzd4\" (UID: \"599cb3c5-7fb7-4f7c-bacc-e500d844967e\") " pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:12:52.699458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697887 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43f60dd5-273c-43c1-8c93-e8d20b6e8540-system-cni-dir\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.699458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697911 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-etc-systemd\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.699458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697935 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-sys\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.699458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697982 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/43f60dd5-273c-43c1-8c93-e8d20b6e8540-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.699458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.697998 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-system-cni-dir\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.699458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698008 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1333ff89-11cb-4c73-b911-73172880232c-iptables-alerter-script\") pod \"iptables-alerter-nn8pp\" (UID: \"1333ff89-11cb-4c73-b911-73172880232c\") " pod="openshift-network-operator/iptables-alerter-nn8pp" Sep 13 20:12:52.699458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698037 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-host-var-lib-cni-multus\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.699458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698044 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-run-ovn\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.699458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698075 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/43f60dd5-273c-43c1-8c93-e8d20b6e8540-cni-binary-copy\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.699458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698081 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-systemd-units\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.699458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698114 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-etc-openvswitch\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.699458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698142 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-log-socket\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.699458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698144 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/43f60dd5-273c-43c1-8c93-e8d20b6e8540-system-cni-dir\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.699458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698149 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-host-var-lib-cni-multus\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.700020 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698168 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s56zw\" (UniqueName: \"kubernetes.io/projected/99516c6f-8366-4e37-9e2f-dadcc15b75e3-kube-api-access-s56zw\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.700020 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698188 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-systemd-units\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.700020 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.700020 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698237 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-log-socket\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.700020 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698262 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/915e7743-2942-46c6-9484-b79f4b96a918-ovnkube-script-lib\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.700020 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698275 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-etc-openvswitch\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.700020 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698284 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99516c6f-8366-4e37-9e2f-dadcc15b75e3-registration-dir\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.700020 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698301 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-host-run-k8s-cni-cncf-io\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.700020 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698313 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.700020 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698323 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-run-ovn-kubernetes\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.700020 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698344 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/915e7743-2942-46c6-9484-b79f4b96a918-env-overrides\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.700020 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698366 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-etc-modprobe-d\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.700020 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698388 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-run\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.700020 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698410 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/915e7743-2942-46c6-9484-b79f4b96a918-ovnkube-config\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.700020 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698435 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/915e7743-2942-46c6-9484-b79f4b96a918-ovn-node-metrics-cert\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.700020 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698591 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/43f60dd5-273c-43c1-8c93-e8d20b6e8540-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.700020 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698670 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/599cb3c5-7fb7-4f7c-bacc-e500d844967e-dbus\") pod \"global-pull-secret-syncer-tqzd4\" (UID: \"599cb3c5-7fb7-4f7c-bacc-e500d844967e\") " pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:12:52.700584 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698771 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 13 20:12:52.700584 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698844 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/915e7743-2942-46c6-9484-b79f4b96a918-ovnkube-script-lib\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.700584 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698900 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ab1d9571-0fb7-43a9-83b1-3980310e1650-host-run-k8s-cni-cncf-io\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.700584 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.698951 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/915e7743-2942-46c6-9484-b79f4b96a918-host-run-ovn-kubernetes\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.700584 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.699002 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/915e7743-2942-46c6-9484-b79f4b96a918-env-overrides\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.700584 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.699321 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/915e7743-2942-46c6-9484-b79f4b96a918-ovnkube-config\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.702168 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.702149 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/915e7743-2942-46c6-9484-b79f4b96a918-ovn-node-metrics-cert\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.706135 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.706111 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdfgz\" (UniqueName: \"kubernetes.io/projected/43f60dd5-273c-43c1-8c93-e8d20b6e8540-kube-api-access-gdfgz\") pod \"multus-additional-cni-plugins-h4zf8\" (UID: \"43f60dd5-273c-43c1-8c93-e8d20b6e8540\") " pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.714119 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.714099 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf27l\" (UniqueName: \"kubernetes.io/projected/3a23dc7b-d272-4973-8fa8-439c8db80153-kube-api-access-bf27l\") pod \"network-metrics-daemon-8bbtk\" (UID: \"3a23dc7b-d272-4973-8fa8-439c8db80153\") " pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:12:52.714265 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.714246 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjsdt\" (UniqueName: \"kubernetes.io/projected/ab1d9571-0fb7-43a9-83b1-3980310e1650-kube-api-access-bjsdt\") pod \"multus-nbqnk\" (UID: \"ab1d9571-0fb7-43a9-83b1-3980310e1650\") " pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.714810 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:52.714786 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 20:12:52.714914 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:52.714818 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 20:12:52.714914 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:52.714834 2561 projected.go:196] Error preparing data for projected volume kube-api-access-5v9qm for pod openshift-network-diagnostics/network-check-target-r7xjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:12:52.714914 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:52.714896 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm podName:ffb004f5-2003-4db1-a1a9-33520224afda nodeName:}" failed. No retries permitted until 2026-09-13 20:12:53.214879517 +0000 UTC m=+3.031455079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-5v9qm" (UniqueName: "kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm") pod "network-check-target-r7xjr" (UID: "ffb004f5-2003-4db1-a1a9-33520224afda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:12:52.716933 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.716912 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hs6jn\" (UniqueName: \"kubernetes.io/projected/b39db385-6547-430c-894e-4976abd54196-kube-api-access-hs6jn\") pod \"node-ca-ffvkb\" (UID: \"b39db385-6547-430c-894e-4976abd54196\") " pod="openshift-image-registry/node-ca-ffvkb" Sep 13 20:12:52.717412 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.717390 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glp9q\" (UniqueName: \"kubernetes.io/projected/915e7743-2942-46c6-9484-b79f4b96a918-kube-api-access-glp9q\") pod \"ovnkube-node-g54wf\" (UID: \"915e7743-2942-46c6-9484-b79f4b96a918\") " pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.799429 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.799378 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/428ee95f-1def-45a2-9238-552a99aa32f2-hosts-file\") pod \"node-resolver-lj9m7\" (UID: \"428ee95f-1def-45a2-9238-552a99aa32f2\") " pod="openshift-dns/node-resolver-lj9m7" Sep 13 20:12:52.799429 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.799427 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae6e4a30-1019-4b10-980a-2938365bdc5f-agent-certs\") pod \"konnectivity-agent-rj2v7\" (UID: \"ae6e4a30-1019-4b10-980a-2938365bdc5f\") " pod="kube-system/konnectivity-agent-rj2v7" Sep 13 20:12:52.799667 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.799529 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/428ee95f-1def-45a2-9238-552a99aa32f2-hosts-file\") pod \"node-resolver-lj9m7\" (UID: \"428ee95f-1def-45a2-9238-552a99aa32f2\") " pod="openshift-dns/node-resolver-lj9m7" Sep 13 20:12:52.799667 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.799549 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae6e4a30-1019-4b10-980a-2938365bdc5f-konnectivity-ca\") pod \"konnectivity-agent-rj2v7\" (UID: \"ae6e4a30-1019-4b10-980a-2938365bdc5f\") " pod="kube-system/konnectivity-agent-rj2v7" Sep 13 20:12:52.799667 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.799596 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-etc-sysctl-d\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.799667 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.799624 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/428ee95f-1def-45a2-9238-552a99aa32f2-tmp-dir\") pod \"node-resolver-lj9m7\" (UID: \"428ee95f-1def-45a2-9238-552a99aa32f2\") " pod="openshift-dns/node-resolver-lj9m7" Sep 13 20:12:52.799667 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.799652 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-etc-sysconfig\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.799878 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.799676 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq9lk\" (UniqueName: \"kubernetes.io/projected/4025fa18-2c8c-470e-9754-18789bc510d6-kube-api-access-kq9lk\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.799878 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.799699 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99516c6f-8366-4e37-9e2f-dadcc15b75e3-sys-fs\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.799878 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.799772 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/99516c6f-8366-4e37-9e2f-dadcc15b75e3-sys-fs\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.799878 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.799799 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-etc-sysctl-d\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.799878 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.799820 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-etc-sysconfig\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.800081 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.799966 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-etc-sysctl-conf\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.800081 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.799974 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/428ee95f-1def-45a2-9238-552a99aa32f2-tmp-dir\") pod \"node-resolver-lj9m7\" (UID: \"428ee95f-1def-45a2-9238-552a99aa32f2\") " pod="openshift-dns/node-resolver-lj9m7" Sep 13 20:12:52.800081 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800052 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1333ff89-11cb-4c73-b911-73172880232c-host-slash\") pod \"iptables-alerter-nn8pp\" (UID: \"1333ff89-11cb-4c73-b911-73172880232c\") " pod="openshift-network-operator/iptables-alerter-nn8pp" Sep 13 20:12:52.800205 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800102 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99516c6f-8366-4e37-9e2f-dadcc15b75e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.800205 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800120 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-etc-sysctl-conf\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.800205 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800131 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99516c6f-8366-4e37-9e2f-dadcc15b75e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.800205 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800164 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-lib-modules\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.800205 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800180 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/99516c6f-8366-4e37-9e2f-dadcc15b75e3-etc-selinux\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.800205 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800189 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-host\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.800440 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800203 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/99516c6f-8366-4e37-9e2f-dadcc15b75e3-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.800440 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800215 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4025fa18-2c8c-470e-9754-18789bc510d6-etc-tuned\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.800440 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800215 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ae6e4a30-1019-4b10-980a-2938365bdc5f-konnectivity-ca\") pod \"konnectivity-agent-rj2v7\" (UID: \"ae6e4a30-1019-4b10-980a-2938365bdc5f\") " pod="kube-system/konnectivity-agent-rj2v7" Sep 13 20:12:52.800440 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800222 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1333ff89-11cb-4c73-b911-73172880232c-host-slash\") pod \"iptables-alerter-nn8pp\" (UID: \"1333ff89-11cb-4c73-b911-73172880232c\") " pod="openshift-network-operator/iptables-alerter-nn8pp" Sep 13 20:12:52.800440 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800263 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-host\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.800440 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800237 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8758\" (UniqueName: \"kubernetes.io/projected/428ee95f-1def-45a2-9238-552a99aa32f2-kube-api-access-l8758\") pod \"node-resolver-lj9m7\" (UID: \"428ee95f-1def-45a2-9238-552a99aa32f2\") " pod="openshift-dns/node-resolver-lj9m7" Sep 13 20:12:52.800440 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800285 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-lib-modules\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.800440 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800306 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gf84\" (UniqueName: \"kubernetes.io/projected/1333ff89-11cb-4c73-b911-73172880232c-kube-api-access-5gf84\") pod \"iptables-alerter-nn8pp\" (UID: \"1333ff89-11cb-4c73-b911-73172880232c\") " pod="openshift-network-operator/iptables-alerter-nn8pp" Sep 13 20:12:52.800440 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800334 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-etc-systemd\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.800440 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800358 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-sys\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.800440 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800382 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1333ff89-11cb-4c73-b911-73172880232c-iptables-alerter-script\") pod \"iptables-alerter-nn8pp\" (UID: \"1333ff89-11cb-4c73-b911-73172880232c\") " pod="openshift-network-operator/iptables-alerter-nn8pp" Sep 13 20:12:52.800440 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800412 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s56zw\" (UniqueName: \"kubernetes.io/projected/99516c6f-8366-4e37-9e2f-dadcc15b75e3-kube-api-access-s56zw\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.800440 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800440 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-etc-systemd\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.801002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800446 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99516c6f-8366-4e37-9e2f-dadcc15b75e3-registration-dir\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.801002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800488 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-etc-modprobe-d\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.801002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800494 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/99516c6f-8366-4e37-9e2f-dadcc15b75e3-registration-dir\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.801002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800571 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-sys\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.801002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800578 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-run\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.801002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800647 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99516c6f-8366-4e37-9e2f-dadcc15b75e3-socket-dir\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.801002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800658 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-etc-modprobe-d\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.801002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800674 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99516c6f-8366-4e37-9e2f-dadcc15b75e3-device-dir\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.801002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800699 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-etc-kubernetes\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.801002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800713 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-run\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.801002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800722 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-var-lib-kubelet\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.801002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800745 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4025fa18-2c8c-470e-9754-18789bc510d6-tmp\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.801002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800775 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-etc-kubernetes\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.801002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800778 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/99516c6f-8366-4e37-9e2f-dadcc15b75e3-device-dir\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.801002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800791 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/99516c6f-8366-4e37-9e2f-dadcc15b75e3-socket-dir\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.801002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800824 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4025fa18-2c8c-470e-9754-18789bc510d6-var-lib-kubelet\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.801002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.800927 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1333ff89-11cb-4c73-b911-73172880232c-iptables-alerter-script\") pod \"iptables-alerter-nn8pp\" (UID: \"1333ff89-11cb-4c73-b911-73172880232c\") " pod="openshift-network-operator/iptables-alerter-nn8pp" Sep 13 20:12:52.802260 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.802237 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ae6e4a30-1019-4b10-980a-2938365bdc5f-agent-certs\") pod \"konnectivity-agent-rj2v7\" (UID: \"ae6e4a30-1019-4b10-980a-2938365bdc5f\") " pod="kube-system/konnectivity-agent-rj2v7" Sep 13 20:12:52.802694 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.802669 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4025fa18-2c8c-470e-9754-18789bc510d6-etc-tuned\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.803086 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.803053 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4025fa18-2c8c-470e-9754-18789bc510d6-tmp\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.808003 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.807980 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq9lk\" (UniqueName: \"kubernetes.io/projected/4025fa18-2c8c-470e-9754-18789bc510d6-kube-api-access-kq9lk\") pod \"tuned-n5hgm\" (UID: \"4025fa18-2c8c-470e-9754-18789bc510d6\") " pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.808395 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.808363 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s56zw\" (UniqueName: \"kubernetes.io/projected/99516c6f-8366-4e37-9e2f-dadcc15b75e3-kube-api-access-s56zw\") pod \"aws-ebs-csi-driver-node-zgkw9\" (UID: \"99516c6f-8366-4e37-9e2f-dadcc15b75e3\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.808492 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.808470 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gf84\" (UniqueName: \"kubernetes.io/projected/1333ff89-11cb-4c73-b911-73172880232c-kube-api-access-5gf84\") pod \"iptables-alerter-nn8pp\" (UID: \"1333ff89-11cb-4c73-b911-73172880232c\") " pod="openshift-network-operator/iptables-alerter-nn8pp" Sep 13 20:12:52.808750 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.808734 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8758\" (UniqueName: \"kubernetes.io/projected/428ee95f-1def-45a2-9238-552a99aa32f2-kube-api-access-l8758\") pod \"node-resolver-lj9m7\" (UID: \"428ee95f-1def-45a2-9238-552a99aa32f2\") " pod="openshift-dns/node-resolver-lj9m7" Sep 13 20:12:52.884791 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.884729 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-ffvkb" Sep 13 20:12:52.890439 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.890416 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-h4zf8" Sep 13 20:12:52.900161 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.900139 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:12:52.904746 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.904728 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-nbqnk" Sep 13 20:12:52.913308 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.913280 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nn8pp" Sep 13 20:12:52.921921 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.921906 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" Sep 13 20:12:52.927663 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.927647 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-rj2v7" Sep 13 20:12:52.934042 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.934024 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" Sep 13 20:12:52.937412 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:52.937397 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lj9m7" Sep 13 20:12:53.204087 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:53.204002 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret\") pod \"global-pull-secret-syncer-tqzd4\" (UID: \"599cb3c5-7fb7-4f7c-bacc-e500d844967e\") " pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:12:53.204087 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:53.204049 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs\") pod \"network-metrics-daemon-8bbtk\" (UID: \"3a23dc7b-d272-4973-8fa8-439c8db80153\") " pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:12:53.204298 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:53.204179 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 20:12:53.204298 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:53.204205 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:12:53.204298 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:53.204251 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret podName:599cb3c5-7fb7-4f7c-bacc-e500d844967e nodeName:}" failed. No retries permitted until 2026-09-13 20:12:54.204229972 +0000 UTC m=+4.020805527 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret") pod "global-pull-secret-syncer-tqzd4" (UID: "599cb3c5-7fb7-4f7c-bacc-e500d844967e") : object "kube-system"/"original-pull-secret" not registered Sep 13 20:12:53.204298 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:53.204271 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs podName:3a23dc7b-d272-4973-8fa8-439c8db80153 nodeName:}" failed. No retries permitted until 2026-09-13 20:12:54.204260468 +0000 UTC m=+4.020836014 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs") pod "network-metrics-daemon-8bbtk" (UID: "3a23dc7b-d272-4973-8fa8-439c8db80153") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:12:53.305101 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:53.305070 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v9qm\" (UniqueName: \"kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm\") pod \"network-check-target-r7xjr\" (UID: \"ffb004f5-2003-4db1-a1a9-33520224afda\") " pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:12:53.305267 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:53.305205 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 20:12:53.305267 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:53.305231 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 20:12:53.305267 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:53.305244 2561 projected.go:196] Error preparing data for projected volume kube-api-access-5v9qm for pod openshift-network-diagnostics/network-check-target-r7xjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:12:53.305429 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:53.305308 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm podName:ffb004f5-2003-4db1-a1a9-33520224afda nodeName:}" failed. No retries permitted until 2026-09-13 20:12:54.305290776 +0000 UTC m=+4.121866323 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-5v9qm" (UniqueName: "kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm") pod "network-check-target-r7xjr" (UID: "ffb004f5-2003-4db1-a1a9-33520224afda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:12:53.537629 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:53.537493 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod428ee95f_1def_45a2_9238_552a99aa32f2.slice/crio-37a227d6f52cf95a9b9eb60505ebe830eef2e3717dbcf479d36471d4522a9cd6 WatchSource:0}: Error finding container 37a227d6f52cf95a9b9eb60505ebe830eef2e3717dbcf479d36471d4522a9cd6: Status 404 returned error can't find the container with id 37a227d6f52cf95a9b9eb60505ebe830eef2e3717dbcf479d36471d4522a9cd6 Sep 13 20:12:53.540818 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:53.540676 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4025fa18_2c8c_470e_9754_18789bc510d6.slice/crio-43cd5171a57fd3e494671bbd49e721586970b4c892b9e60a045a3af586c1f444 WatchSource:0}: Error finding container 43cd5171a57fd3e494671bbd49e721586970b4c892b9e60a045a3af586c1f444: Status 404 returned error can't find the container with id 43cd5171a57fd3e494671bbd49e721586970b4c892b9e60a045a3af586c1f444 Sep 13 20:12:53.542280 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:53.542210 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1333ff89_11cb_4c73_b911_73172880232c.slice/crio-27fb3e1e17e56109a555679d7eacde8a9a6b8342af687416cec50be5337839f7 WatchSource:0}: Error finding container 27fb3e1e17e56109a555679d7eacde8a9a6b8342af687416cec50be5337839f7: Status 404 returned error can't find the container with id 27fb3e1e17e56109a555679d7eacde8a9a6b8342af687416cec50be5337839f7 Sep 13 20:12:53.542971 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:53.542946 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb39db385_6547_430c_894e_4976abd54196.slice/crio-4b689f3d398bc0c224d05115bf6e50109cefd1f225b36c69d38687d65b824578 WatchSource:0}: Error finding container 4b689f3d398bc0c224d05115bf6e50109cefd1f225b36c69d38687d65b824578: Status 404 returned error can't find the container with id 4b689f3d398bc0c224d05115bf6e50109cefd1f225b36c69d38687d65b824578 Sep 13 20:12:53.544416 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:53.544380 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab1d9571_0fb7_43a9_83b1_3980310e1650.slice/crio-d633cb5482bec3ea7bf0d77be147fab4e8494065bc470140e732df6c132bbf86 WatchSource:0}: Error finding container d633cb5482bec3ea7bf0d77be147fab4e8494065bc470140e732df6c132bbf86: Status 404 returned error can't find the container with id d633cb5482bec3ea7bf0d77be147fab4e8494065bc470140e732df6c132bbf86 Sep 13 20:12:53.544795 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:53.544759 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43f60dd5_273c_43c1_8c93_e8d20b6e8540.slice/crio-5996db1577788cddef9b773b946e7eba86cc075785bbacbdf476df95f358f196 WatchSource:0}: Error finding container 5996db1577788cddef9b773b946e7eba86cc075785bbacbdf476df95f358f196: Status 404 returned error can't find the container with id 5996db1577788cddef9b773b946e7eba86cc075785bbacbdf476df95f358f196 Sep 13 20:12:53.545408 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:53.545325 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod915e7743_2942_46c6_9484_b79f4b96a918.slice/crio-61f68044c3cc27ea220e26f9cf626640851349e6b08a8c7fac6bc8b0954df8ab WatchSource:0}: Error finding container 61f68044c3cc27ea220e26f9cf626640851349e6b08a8c7fac6bc8b0954df8ab: Status 404 returned error can't find the container with id 61f68044c3cc27ea220e26f9cf626640851349e6b08a8c7fac6bc8b0954df8ab Sep 13 20:12:53.566467 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:53.566419 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99516c6f_8366_4e37_9e2f_dadcc15b75e3.slice/crio-3bd4575ae4b6c5383e06910963725418b5ac9638e9cb35bbfc7f93490c222ba2 WatchSource:0}: Error finding container 3bd4575ae4b6c5383e06910963725418b5ac9638e9cb35bbfc7f93490c222ba2: Status 404 returned error can't find the container with id 3bd4575ae4b6c5383e06910963725418b5ac9638e9cb35bbfc7f93490c222ba2 Sep 13 20:12:53.567248 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:12:53.567208 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae6e4a30_1019_4b10_980a_2938365bdc5f.slice/crio-0e8524c94b1619bea5a6189cf6968736aa0062845fed9e82d9c390b759a6174c WatchSource:0}: Error finding container 0e8524c94b1619bea5a6189cf6968736aa0062845fed9e82d9c390b759a6174c: Status 404 returned error can't find the container with id 0e8524c94b1619bea5a6189cf6968736aa0062845fed9e82d9c390b759a6174c Sep 13 20:12:53.621937 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:53.621905 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-12 20:07:52 +0000 UTC" deadline="2028-06-13 17:48:30.128069576 +0000 UTC" Sep 13 20:12:53.622033 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:53.621951 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15333h35m36.506137397s" Sep 13 20:12:53.690819 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:53.690797 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:12:53.690925 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:53.690897 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8bbtk" podUID="3a23dc7b-d272-4973-8fa8-439c8db80153" Sep 13 20:12:53.702127 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:53.702095 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" event={"ID":"adb95b757af8a0d6b709ad0e466205b6","Type":"ContainerStarted","Data":"7567b3fc0ded2593c03ebd9a40a4ac3229fba51970861b5816b60197ff3f8cf5"} Sep 13 20:12:53.703764 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:53.703733 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" event={"ID":"99516c6f-8366-4e37-9e2f-dadcc15b75e3","Type":"ContainerStarted","Data":"3bd4575ae4b6c5383e06910963725418b5ac9638e9cb35bbfc7f93490c222ba2"} Sep 13 20:12:53.705119 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:53.705091 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" event={"ID":"915e7743-2942-46c6-9484-b79f4b96a918","Type":"ContainerStarted","Data":"61f68044c3cc27ea220e26f9cf626640851349e6b08a8c7fac6bc8b0954df8ab"} Sep 13 20:12:53.706425 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:53.706399 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h4zf8" event={"ID":"43f60dd5-273c-43c1-8c93-e8d20b6e8540","Type":"ContainerStarted","Data":"5996db1577788cddef9b773b946e7eba86cc075785bbacbdf476df95f358f196"} Sep 13 20:12:53.707656 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:53.707632 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ffvkb" event={"ID":"b39db385-6547-430c-894e-4976abd54196","Type":"ContainerStarted","Data":"4b689f3d398bc0c224d05115bf6e50109cefd1f225b36c69d38687d65b824578"} Sep 13 20:12:53.709082 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:53.709045 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nn8pp" event={"ID":"1333ff89-11cb-4c73-b911-73172880232c","Type":"ContainerStarted","Data":"27fb3e1e17e56109a555679d7eacde8a9a6b8342af687416cec50be5337839f7"} Sep 13 20:12:53.710283 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:53.710262 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" event={"ID":"4025fa18-2c8c-470e-9754-18789bc510d6","Type":"ContainerStarted","Data":"43cd5171a57fd3e494671bbd49e721586970b4c892b9e60a045a3af586c1f444"} Sep 13 20:12:53.711458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:53.711440 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rj2v7" event={"ID":"ae6e4a30-1019-4b10-980a-2938365bdc5f","Type":"ContainerStarted","Data":"0e8524c94b1619bea5a6189cf6968736aa0062845fed9e82d9c390b759a6174c"} Sep 13 20:12:53.712711 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:53.712680 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nbqnk" event={"ID":"ab1d9571-0fb7-43a9-83b1-3980310e1650","Type":"ContainerStarted","Data":"d633cb5482bec3ea7bf0d77be147fab4e8494065bc470140e732df6c132bbf86"} Sep 13 20:12:53.713856 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:53.713834 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lj9m7" event={"ID":"428ee95f-1def-45a2-9238-552a99aa32f2","Type":"ContainerStarted","Data":"37a227d6f52cf95a9b9eb60505ebe830eef2e3717dbcf479d36471d4522a9cd6"} Sep 13 20:12:53.714055 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:53.714014 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-59.ec2.internal" podStartSLOduration=2.714001514 podStartE2EDuration="2.714001514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:12:53.71397367 +0000 UTC m=+3.530549235" watchObservedRunningTime="2026-09-13 20:12:53.714001514 +0000 UTC m=+3.530577076" Sep 13 20:12:54.211558 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:54.210999 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret\") pod \"global-pull-secret-syncer-tqzd4\" (UID: \"599cb3c5-7fb7-4f7c-bacc-e500d844967e\") " pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:12:54.211558 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:54.211265 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 20:12:54.211558 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:54.211337 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret podName:599cb3c5-7fb7-4f7c-bacc-e500d844967e nodeName:}" failed. No retries permitted until 2026-09-13 20:12:56.211317325 +0000 UTC m=+6.027892873 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret") pod "global-pull-secret-syncer-tqzd4" (UID: "599cb3c5-7fb7-4f7c-bacc-e500d844967e") : object "kube-system"/"original-pull-secret" not registered Sep 13 20:12:54.211558 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:54.211358 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:12:54.211558 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:54.211410 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs podName:3a23dc7b-d272-4973-8fa8-439c8db80153 nodeName:}" failed. No retries permitted until 2026-09-13 20:12:56.211393391 +0000 UTC m=+6.027968937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs") pod "network-metrics-daemon-8bbtk" (UID: "3a23dc7b-d272-4973-8fa8-439c8db80153") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:12:54.211558 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:54.211272 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs\") pod \"network-metrics-daemon-8bbtk\" (UID: \"3a23dc7b-d272-4973-8fa8-439c8db80153\") " pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:12:54.312669 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:54.312086 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v9qm\" (UniqueName: \"kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm\") pod \"network-check-target-r7xjr\" (UID: \"ffb004f5-2003-4db1-a1a9-33520224afda\") " pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:12:54.312669 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:54.312239 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 20:12:54.312669 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:54.312259 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 20:12:54.312669 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:54.312270 2561 projected.go:196] Error preparing data for projected volume kube-api-access-5v9qm for pod openshift-network-diagnostics/network-check-target-r7xjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:12:54.312669 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:54.312322 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm podName:ffb004f5-2003-4db1-a1a9-33520224afda nodeName:}" failed. No retries permitted until 2026-09-13 20:12:56.312306608 +0000 UTC m=+6.128882155 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-5v9qm" (UniqueName: "kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm") pod "network-check-target-r7xjr" (UID: "ffb004f5-2003-4db1-a1a9-33520224afda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:12:54.622645 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:54.622489 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-12 20:07:52 +0000 UTC" deadline="2028-04-03 03:38:42.561310058 +0000 UTC" Sep 13 20:12:54.622645 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:54.622553 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13615h25m47.938761365s" Sep 13 20:12:54.693543 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:54.693382 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:12:54.693543 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:54.693507 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7xjr" podUID="ffb004f5-2003-4db1-a1a9-33520224afda" Sep 13 20:12:54.694735 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:54.693929 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:12:54.694735 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:54.694026 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqzd4" podUID="599cb3c5-7fb7-4f7c-bacc-e500d844967e" Sep 13 20:12:54.726992 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:54.725728 2561 generic.go:356] "Generic (PLEG): container finished" podID="bcb7cd3b90b7caa77496ef09bdb65921" containerID="bb4bba3316e06fc3179b7b2299fdb1b89b808f0413be35cd95d7bffb2c0995e2" exitCode=0 Sep 13 20:12:54.726992 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:54.726691 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" event={"ID":"bcb7cd3b90b7caa77496ef09bdb65921","Type":"ContainerDied","Data":"bb4bba3316e06fc3179b7b2299fdb1b89b808f0413be35cd95d7bffb2c0995e2"} Sep 13 20:12:55.690857 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:55.690781 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:12:55.691315 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:55.690920 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8bbtk" podUID="3a23dc7b-d272-4973-8fa8-439c8db80153" Sep 13 20:12:55.754896 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:55.754519 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" event={"ID":"bcb7cd3b90b7caa77496ef09bdb65921","Type":"ContainerStarted","Data":"566433d7dea995c9be62ac3dc71950b04fe01fe2fbbe9a77303564905b012141"} Sep 13 20:12:55.769489 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:55.768927 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-59.ec2.internal" podStartSLOduration=4.768906296 podStartE2EDuration="4.768906296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:12:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:12:55.768345426 +0000 UTC m=+5.584920990" watchObservedRunningTime="2026-09-13 20:12:55.768906296 +0000 UTC m=+5.585481860" Sep 13 20:12:56.239545 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:56.239501 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret\") pod \"global-pull-secret-syncer-tqzd4\" (UID: \"599cb3c5-7fb7-4f7c-bacc-e500d844967e\") " pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:12:56.239709 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:56.239562 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs\") pod \"network-metrics-daemon-8bbtk\" (UID: \"3a23dc7b-d272-4973-8fa8-439c8db80153\") " pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:12:56.239709 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:56.239703 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:12:56.239821 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:56.239777 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs podName:3a23dc7b-d272-4973-8fa8-439c8db80153 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:00.239758371 +0000 UTC m=+10.056333914 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs") pod "network-metrics-daemon-8bbtk" (UID: "3a23dc7b-d272-4973-8fa8-439c8db80153") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:12:56.240267 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:56.240244 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 20:12:56.240397 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:56.240309 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret podName:599cb3c5-7fb7-4f7c-bacc-e500d844967e nodeName:}" failed. No retries permitted until 2026-09-13 20:13:00.240285638 +0000 UTC m=+10.056861197 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret") pod "global-pull-secret-syncer-tqzd4" (UID: "599cb3c5-7fb7-4f7c-bacc-e500d844967e") : object "kube-system"/"original-pull-secret" not registered Sep 13 20:12:56.340817 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:56.340776 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v9qm\" (UniqueName: \"kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm\") pod \"network-check-target-r7xjr\" (UID: \"ffb004f5-2003-4db1-a1a9-33520224afda\") " pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:12:56.340987 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:56.340948 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 20:12:56.340987 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:56.340969 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 20:12:56.340987 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:56.340983 2561 projected.go:196] Error preparing data for projected volume kube-api-access-5v9qm for pod openshift-network-diagnostics/network-check-target-r7xjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:12:56.341245 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:56.341053 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm podName:ffb004f5-2003-4db1-a1a9-33520224afda nodeName:}" failed. No retries permitted until 2026-09-13 20:13:00.341034762 +0000 UTC m=+10.157610313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-5v9qm" (UniqueName: "kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm") pod "network-check-target-r7xjr" (UID: "ffb004f5-2003-4db1-a1a9-33520224afda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:12:56.691512 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:56.691426 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:12:56.691928 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:56.691570 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqzd4" podUID="599cb3c5-7fb7-4f7c-bacc-e500d844967e" Sep 13 20:12:56.691986 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:56.691970 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:12:56.692099 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:56.692076 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7xjr" podUID="ffb004f5-2003-4db1-a1a9-33520224afda" Sep 13 20:12:57.691252 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:57.691220 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:12:57.691425 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:57.691357 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8bbtk" podUID="3a23dc7b-d272-4973-8fa8-439c8db80153" Sep 13 20:12:58.691726 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:58.691593 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:12:58.691726 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:58.691626 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:12:58.692267 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:58.691766 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7xjr" podUID="ffb004f5-2003-4db1-a1a9-33520224afda" Sep 13 20:12:58.692267 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:58.691866 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqzd4" podUID="599cb3c5-7fb7-4f7c-bacc-e500d844967e" Sep 13 20:12:59.691008 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:12:59.690718 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:12:59.691008 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:12:59.690866 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8bbtk" podUID="3a23dc7b-d272-4973-8fa8-439c8db80153" Sep 13 20:13:00.274575 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:00.273892 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret\") pod \"global-pull-secret-syncer-tqzd4\" (UID: \"599cb3c5-7fb7-4f7c-bacc-e500d844967e\") " pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:13:00.274575 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:00.273943 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs\") pod \"network-metrics-daemon-8bbtk\" (UID: \"3a23dc7b-d272-4973-8fa8-439c8db80153\") " pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:13:00.274575 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:00.274125 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:13:00.274575 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:00.274185 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs podName:3a23dc7b-d272-4973-8fa8-439c8db80153 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:08.274166743 +0000 UTC m=+18.090742305 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs") pod "network-metrics-daemon-8bbtk" (UID: "3a23dc7b-d272-4973-8fa8-439c8db80153") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:13:00.274575 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:00.274260 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 20:13:00.274575 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:00.274294 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret podName:599cb3c5-7fb7-4f7c-bacc-e500d844967e nodeName:}" failed. No retries permitted until 2026-09-13 20:13:08.274282375 +0000 UTC m=+18.090857931 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret") pod "global-pull-secret-syncer-tqzd4" (UID: "599cb3c5-7fb7-4f7c-bacc-e500d844967e") : object "kube-system"/"original-pull-secret" not registered Sep 13 20:13:00.375237 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:00.374532 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v9qm\" (UniqueName: \"kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm\") pod \"network-check-target-r7xjr\" (UID: \"ffb004f5-2003-4db1-a1a9-33520224afda\") " pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:13:00.375237 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:00.374747 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 20:13:00.375237 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:00.374767 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 20:13:00.375237 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:00.374783 2561 projected.go:196] Error preparing data for projected volume kube-api-access-5v9qm for pod openshift-network-diagnostics/network-check-target-r7xjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:13:00.375237 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:00.374843 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm podName:ffb004f5-2003-4db1-a1a9-33520224afda nodeName:}" failed. No retries permitted until 2026-09-13 20:13:08.374822904 +0000 UTC m=+18.191398465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-5v9qm" (UniqueName: "kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm") pod "network-check-target-r7xjr" (UID: "ffb004f5-2003-4db1-a1a9-33520224afda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:13:00.691003 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:00.690892 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:13:00.692310 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:00.691963 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7xjr" podUID="ffb004f5-2003-4db1-a1a9-33520224afda" Sep 13 20:13:00.692310 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:00.692134 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:13:00.692310 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:00.692240 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqzd4" podUID="599cb3c5-7fb7-4f7c-bacc-e500d844967e" Sep 13 20:13:01.691009 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:01.690767 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:13:01.691009 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:01.690906 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8bbtk" podUID="3a23dc7b-d272-4973-8fa8-439c8db80153" Sep 13 20:13:02.690672 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:02.690609 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:13:02.690848 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:02.690743 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7xjr" podUID="ffb004f5-2003-4db1-a1a9-33520224afda" Sep 13 20:13:02.690848 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:02.690753 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:13:02.690848 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:02.690843 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqzd4" podUID="599cb3c5-7fb7-4f7c-bacc-e500d844967e" Sep 13 20:13:03.691376 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:03.691350 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:13:03.691681 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:03.691453 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8bbtk" podUID="3a23dc7b-d272-4973-8fa8-439c8db80153" Sep 13 20:13:04.691609 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:04.691575 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:13:04.692052 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:04.691574 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:13:04.692052 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:04.691716 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqzd4" podUID="599cb3c5-7fb7-4f7c-bacc-e500d844967e" Sep 13 20:13:04.692052 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:04.691843 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7xjr" podUID="ffb004f5-2003-4db1-a1a9-33520224afda" Sep 13 20:13:05.691274 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:05.691227 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:13:05.691461 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:05.691376 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8bbtk" podUID="3a23dc7b-d272-4973-8fa8-439c8db80153" Sep 13 20:13:06.690921 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:06.690891 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:13:06.691347 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:06.690891 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:13:06.691347 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:06.691033 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqzd4" podUID="599cb3c5-7fb7-4f7c-bacc-e500d844967e" Sep 13 20:13:06.691347 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:06.691050 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7xjr" podUID="ffb004f5-2003-4db1-a1a9-33520224afda" Sep 13 20:13:07.691372 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:07.691337 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:13:07.691864 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:07.691468 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8bbtk" podUID="3a23dc7b-d272-4973-8fa8-439c8db80153" Sep 13 20:13:08.330456 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:08.330419 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret\") pod \"global-pull-secret-syncer-tqzd4\" (UID: \"599cb3c5-7fb7-4f7c-bacc-e500d844967e\") " pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:13:08.330456 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:08.330464 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs\") pod \"network-metrics-daemon-8bbtk\" (UID: \"3a23dc7b-d272-4973-8fa8-439c8db80153\") " pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:13:08.330715 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:08.330594 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:13:08.330715 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:08.330646 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs podName:3a23dc7b-d272-4973-8fa8-439c8db80153 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:24.330631097 +0000 UTC m=+34.147206638 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs") pod "network-metrics-daemon-8bbtk" (UID: "3a23dc7b-d272-4973-8fa8-439c8db80153") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:13:08.330715 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:08.330596 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 20:13:08.330877 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:08.330734 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret podName:599cb3c5-7fb7-4f7c-bacc-e500d844967e nodeName:}" failed. No retries permitted until 2026-09-13 20:13:24.33071655 +0000 UTC m=+34.147292094 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret") pod "global-pull-secret-syncer-tqzd4" (UID: "599cb3c5-7fb7-4f7c-bacc-e500d844967e") : object "kube-system"/"original-pull-secret" not registered Sep 13 20:13:08.431231 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:08.431175 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v9qm\" (UniqueName: \"kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm\") pod \"network-check-target-r7xjr\" (UID: \"ffb004f5-2003-4db1-a1a9-33520224afda\") " pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:13:08.431418 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:08.431359 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 20:13:08.431418 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:08.431387 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 20:13:08.431418 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:08.431401 2561 projected.go:196] Error preparing data for projected volume kube-api-access-5v9qm for pod openshift-network-diagnostics/network-check-target-r7xjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:13:08.431591 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:08.431481 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm podName:ffb004f5-2003-4db1-a1a9-33520224afda nodeName:}" failed. No retries permitted until 2026-09-13 20:13:24.431450022 +0000 UTC m=+34.248025565 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-5v9qm" (UniqueName: "kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm") pod "network-check-target-r7xjr" (UID: "ffb004f5-2003-4db1-a1a9-33520224afda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:13:08.691160 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:08.691125 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:13:08.691338 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:08.691130 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:13:08.691338 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:08.691250 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7xjr" podUID="ffb004f5-2003-4db1-a1a9-33520224afda" Sep 13 20:13:08.691747 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:08.691337 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqzd4" podUID="599cb3c5-7fb7-4f7c-bacc-e500d844967e" Sep 13 20:13:09.691226 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:09.691190 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:13:09.691393 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:09.691301 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8bbtk" podUID="3a23dc7b-d272-4973-8fa8-439c8db80153" Sep 13 20:13:10.691536 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:10.691504 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:13:10.691971 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:10.691584 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7xjr" podUID="ffb004f5-2003-4db1-a1a9-33520224afda" Sep 13 20:13:10.691971 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:10.691645 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:13:10.691971 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:10.691732 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqzd4" podUID="599cb3c5-7fb7-4f7c-bacc-e500d844967e" Sep 13 20:13:11.690986 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:11.690713 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:13:11.691103 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:11.691085 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8bbtk" podUID="3a23dc7b-d272-4973-8fa8-439c8db80153" Sep 13 20:13:11.786478 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:11.786449 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" event={"ID":"4025fa18-2c8c-470e-9754-18789bc510d6","Type":"ContainerStarted","Data":"cd9359b408ca661a48c930ed350a3fd1c49287c2cb5a1e102ce7bf66df1568ed"} Sep 13 20:13:11.787739 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:11.787716 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-rj2v7" event={"ID":"ae6e4a30-1019-4b10-980a-2938365bdc5f","Type":"ContainerStarted","Data":"d4341d4d79446ed147bad4261f8a83b5648fd585c208dbfb5412fbcfab026c75"} Sep 13 20:13:11.789002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:11.788973 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-nbqnk" event={"ID":"ab1d9571-0fb7-43a9-83b1-3980310e1650","Type":"ContainerStarted","Data":"758272fef5990300bc15ccdfa2182071a6eab4321f6cb7beee654c9ad2e63c41"} Sep 13 20:13:11.790573 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:11.790552 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lj9m7" event={"ID":"428ee95f-1def-45a2-9238-552a99aa32f2","Type":"ContainerStarted","Data":"997924994ac408f3be3fbbc438ba871eff0dd5b62d20bdb27595731a1f3a9898"} Sep 13 20:13:11.791898 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:11.791879 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" event={"ID":"99516c6f-8366-4e37-9e2f-dadcc15b75e3","Type":"ContainerStarted","Data":"7d588c64d0c91f4ae58c7fcd45de9f7542de40e0b5d4465616eebe296f0fc421"} Sep 13 20:13:11.794904 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:11.794885 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" event={"ID":"915e7743-2942-46c6-9484-b79f4b96a918","Type":"ContainerStarted","Data":"6bd6e52f55d02c57fdc4fb18eefc7a9211cc891bbba12b9ca69c641325d5cdc0"} Sep 13 20:13:11.795000 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:11.794945 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" event={"ID":"915e7743-2942-46c6-9484-b79f4b96a918","Type":"ContainerStarted","Data":"44ade2246dc50c91b0c1aa75d22eedc791ac07f85ae89096dc5c0846578903d8"} Sep 13 20:13:11.795000 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:11.794990 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" event={"ID":"915e7743-2942-46c6-9484-b79f4b96a918","Type":"ContainerStarted","Data":"985ea6717831eaf57f21a9da09fa799bb54dd8d4d1257b5f47d214203d4cb2df"} Sep 13 20:13:11.795112 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:11.795038 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" event={"ID":"915e7743-2942-46c6-9484-b79f4b96a918","Type":"ContainerStarted","Data":"4d5159d9ae74d40f9179183782bb35da653a92055b68d8236e67d2d599582fc3"} Sep 13 20:13:11.795112 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:11.795101 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" event={"ID":"915e7743-2942-46c6-9484-b79f4b96a918","Type":"ContainerStarted","Data":"6ef4e31e9c23cfa58e9d063d2b9769555c049fc1b732c249898d2c7c27fbc6b7"} Sep 13 20:13:11.796543 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:11.796523 2561 generic.go:356] "Generic (PLEG): container finished" podID="43f60dd5-273c-43c1-8c93-e8d20b6e8540" containerID="e1e5a096a528f06b0b9a01dc16c131d9d0718c6e3491fa213a7bce912fa67e75" exitCode=0 Sep 13 20:13:11.796635 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:11.796585 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h4zf8" event={"ID":"43f60dd5-273c-43c1-8c93-e8d20b6e8540","Type":"ContainerDied","Data":"e1e5a096a528f06b0b9a01dc16c131d9d0718c6e3491fa213a7bce912fa67e75"} Sep 13 20:13:11.798130 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:11.798053 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-ffvkb" event={"ID":"b39db385-6547-430c-894e-4976abd54196","Type":"ContainerStarted","Data":"1647953ffefb01f79946b14a6c4eafc35d7849635d78ff943d5d20a7e2a7f1e9"} Sep 13 20:13:11.801732 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:11.801696 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n5hgm" podStartSLOduration=4.232985204 podStartE2EDuration="21.801685209s" totalImagesPullingTime="17.568700005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:11.801291813 +0000 UTC m=+21.617867390" watchObservedRunningTime="2026-09-13 20:13:11.801685209 +0000 UTC m=+21.618260768" Sep 13 20:13:11.830547 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:11.830462 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-ffvkb" podStartSLOduration=4.262532646 podStartE2EDuration="21.830447251s" totalImagesPullingTime="17.567914605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:11.813571257 +0000 UTC m=+21.630146820" watchObservedRunningTime="2026-09-13 20:13:11.830447251 +0000 UTC m=+21.647022814" Sep 13 20:13:11.842889 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:11.842856 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-nbqnk" podStartSLOduration=4.217804155 podStartE2EDuration="21.842846004s" totalImagesPullingTime="17.625041849s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:11.830206768 +0000 UTC m=+21.646782329" watchObservedRunningTime="2026-09-13 20:13:11.842846004 +0000 UTC m=+21.659421569" Sep 13 20:13:11.843097 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:11.843075 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-rj2v7" podStartSLOduration=4.357419651 podStartE2EDuration="21.84304919s" totalImagesPullingTime="17.485629539s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:11.842970381 +0000 UTC m=+21.659545933" watchObservedRunningTime="2026-09-13 20:13:11.84304919 +0000 UTC m=+21.659624755" Sep 13 20:13:11.873536 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:11.873494 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lj9m7" podStartSLOduration=4.358708311 podStartE2EDuration="21.873484376s" totalImagesPullingTime="17.514776065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:11.87324229 +0000 UTC m=+21.689817852" watchObservedRunningTime="2026-09-13 20:13:11.873484376 +0000 UTC m=+21.690059938" Sep 13 20:13:12.411900 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:12.411791 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 13 20:13:12.640457 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:12.640371 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-13T20:13:12.411808087Z","UUID":"9c05e544-adcf-49fc-95b9-13df0d5077c7","Handler":null,"Name":"","Endpoint":""} Sep 13 20:13:12.641931 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:12.641908 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 13 20:13:12.642053 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:12.641942 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 13 20:13:12.691077 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:12.691038 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:13:12.691207 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:12.691041 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:13:12.691207 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:12.691163 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqzd4" podUID="599cb3c5-7fb7-4f7c-bacc-e500d844967e" Sep 13 20:13:12.691318 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:12.691247 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7xjr" podUID="ffb004f5-2003-4db1-a1a9-33520224afda" Sep 13 20:13:12.802960 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:12.802923 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nn8pp" event={"ID":"1333ff89-11cb-4c73-b911-73172880232c","Type":"ContainerStarted","Data":"38e03b7a268f5306a97886a3de41affa209fed47bb08b42cf8a65a9a10f0d568"} Sep 13 20:13:12.805538 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:12.805511 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" event={"ID":"99516c6f-8366-4e37-9e2f-dadcc15b75e3","Type":"ContainerStarted","Data":"95374116158a9d1f0e9d46ce9ca8db453514a747016d1c0452db96346bb6f329"} Sep 13 20:13:12.810281 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:12.809785 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" event={"ID":"915e7743-2942-46c6-9484-b79f4b96a918","Type":"ContainerStarted","Data":"fb97800506bfa6024822166f1bffac5b8a409751082a754440e9441be21975ce"} Sep 13 20:13:12.816524 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:12.816473 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nn8pp" podStartSLOduration=5.201746316 podStartE2EDuration="22.81645722s" totalImagesPullingTime="17.614710904s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:12.816194203 +0000 UTC m=+22.632769766" watchObservedRunningTime="2026-09-13 20:13:12.81645722 +0000 UTC m=+22.633032785" Sep 13 20:13:13.691372 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:13.691335 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:13:13.691543 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:13.691488 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8bbtk" podUID="3a23dc7b-d272-4973-8fa8-439c8db80153" Sep 13 20:13:13.814472 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:13.814436 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" event={"ID":"99516c6f-8366-4e37-9e2f-dadcc15b75e3","Type":"ContainerStarted","Data":"f2d6d618fe0466729370030e0b060826c8268933e2f87964f12e7978f961e95c"} Sep 13 20:13:13.831486 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:13.831428 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zgkw9" podStartSLOduration=4.6068243760000005 podStartE2EDuration="23.831406733s" totalImagesPullingTime="19.224582357s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:12:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:13.830712297 +0000 UTC m=+23.647287862" watchObservedRunningTime="2026-09-13 20:13:13.831406733 +0000 UTC m=+23.647982338" Sep 13 20:13:14.691053 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:14.691025 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:13:14.691324 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:14.691161 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqzd4" podUID="599cb3c5-7fb7-4f7c-bacc-e500d844967e" Sep 13 20:13:14.691324 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:14.691220 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:13:14.691437 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:14.691333 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7xjr" podUID="ffb004f5-2003-4db1-a1a9-33520224afda" Sep 13 20:13:14.820363 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:14.820325 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" event={"ID":"915e7743-2942-46c6-9484-b79f4b96a918","Type":"ContainerStarted","Data":"59f4b92dc15f3cf0d03e5c42408fa9b28a2dcc0bdd85d7a71abf74bd2f734c73"} Sep 13 20:13:15.690867 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:15.690835 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:13:15.691041 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:15.690939 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8bbtk" podUID="3a23dc7b-d272-4973-8fa8-439c8db80153" Sep 13 20:13:16.529434 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:16.529274 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-rj2v7" Sep 13 20:13:16.529980 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:16.529951 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-rj2v7" Sep 13 20:13:16.691473 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:16.691446 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:13:16.691633 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:16.691453 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:13:16.691633 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:16.691523 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7xjr" podUID="ffb004f5-2003-4db1-a1a9-33520224afda" Sep 13 20:13:16.691633 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:16.691594 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqzd4" podUID="599cb3c5-7fb7-4f7c-bacc-e500d844967e" Sep 13 20:13:16.827583 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:16.827520 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" event={"ID":"915e7743-2942-46c6-9484-b79f4b96a918","Type":"ContainerStarted","Data":"a410d2156ba8698d6ce537625580e136557957ff1254ac8baf4c772622071094"} Sep 13 20:13:16.827867 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:16.827842 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:13:16.827981 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:16.827916 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:13:16.829501 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:16.829479 2561 generic.go:356] "Generic (PLEG): container finished" podID="43f60dd5-273c-43c1-8c93-e8d20b6e8540" containerID="b6bd785ad39b12c7d28f9d97d1f70707cd1ea474522b766c87534c0f9f354073" exitCode=0 Sep 13 20:13:16.829608 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:16.829551 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h4zf8" event={"ID":"43f60dd5-273c-43c1-8c93-e8d20b6e8540","Type":"ContainerDied","Data":"b6bd785ad39b12c7d28f9d97d1f70707cd1ea474522b766c87534c0f9f354073"} Sep 13 20:13:16.829703 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:16.829689 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-rj2v7" Sep 13 20:13:16.830147 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:16.830127 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-rj2v7" Sep 13 20:13:16.843307 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:16.843291 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:13:16.854688 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:16.854650 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" podStartSLOduration=9.032332926 podStartE2EDuration="26.854638036s" totalImagesPullingTime="17.82230511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:16.852829778 +0000 UTC m=+26.669405341" watchObservedRunningTime="2026-09-13 20:13:16.854638036 +0000 UTC m=+26.671213600" Sep 13 20:13:17.691012 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:17.690871 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:13:17.691362 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:17.691112 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8bbtk" podUID="3a23dc7b-d272-4973-8fa8-439c8db80153" Sep 13 20:13:17.833953 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:17.833859 2561 generic.go:356] "Generic (PLEG): container finished" podID="43f60dd5-273c-43c1-8c93-e8d20b6e8540" containerID="a73cd4155bdeae01a679b3007a81ec4a09ef8324c706c4bd42b7707096b573e1" exitCode=0 Sep 13 20:13:17.834104 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:17.833947 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h4zf8" event={"ID":"43f60dd5-273c-43c1-8c93-e8d20b6e8540","Type":"ContainerDied","Data":"a73cd4155bdeae01a679b3007a81ec4a09ef8324c706c4bd42b7707096b573e1"} Sep 13 20:13:17.834682 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:17.834593 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:13:17.849363 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:17.849346 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:13:17.891306 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:17.891274 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tqzd4"] Sep 13 20:13:17.891491 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:17.891472 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:13:17.891607 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:17.891589 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqzd4" podUID="599cb3c5-7fb7-4f7c-bacc-e500d844967e" Sep 13 20:13:17.894287 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:17.894263 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r7xjr"] Sep 13 20:13:17.894397 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:17.894377 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:13:17.894621 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:17.894473 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7xjr" podUID="ffb004f5-2003-4db1-a1a9-33520224afda" Sep 13 20:13:17.894856 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:17.894841 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8bbtk"] Sep 13 20:13:17.894924 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:17.894909 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:13:17.895021 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:17.895000 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8bbtk" podUID="3a23dc7b-d272-4973-8fa8-439c8db80153" Sep 13 20:13:18.838023 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:18.837990 2561 generic.go:356] "Generic (PLEG): container finished" podID="43f60dd5-273c-43c1-8c93-e8d20b6e8540" containerID="f8cef005138e2e8ce9fa8f2e74e6a3f43330d0baf1fa9d0dc96bf066d53e2a1f" exitCode=0 Sep 13 20:13:18.838551 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:18.838022 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h4zf8" event={"ID":"43f60dd5-273c-43c1-8c93-e8d20b6e8540","Type":"ContainerDied","Data":"f8cef005138e2e8ce9fa8f2e74e6a3f43330d0baf1fa9d0dc96bf066d53e2a1f"} Sep 13 20:13:19.691069 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:19.691033 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:13:19.691237 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:19.691152 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:13:19.691237 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:19.691158 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqzd4" podUID="599cb3c5-7fb7-4f7c-bacc-e500d844967e" Sep 13 20:13:19.691237 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:19.691167 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:13:19.691383 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:19.691256 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7xjr" podUID="ffb004f5-2003-4db1-a1a9-33520224afda" Sep 13 20:13:19.691383 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:19.691355 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8bbtk" podUID="3a23dc7b-d272-4973-8fa8-439c8db80153" Sep 13 20:13:21.691423 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:21.691389 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:13:21.691423 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:21.691407 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:13:21.691904 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:21.691402 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:13:21.691904 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:21.691520 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8bbtk" podUID="3a23dc7b-d272-4973-8fa8-439c8db80153" Sep 13 20:13:21.691904 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:21.691581 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqzd4" podUID="599cb3c5-7fb7-4f7c-bacc-e500d844967e" Sep 13 20:13:21.691904 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:21.691657 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7xjr" podUID="ffb004f5-2003-4db1-a1a9-33520224afda" Sep 13 20:13:23.690888 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:23.690712 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:13:23.691464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:23.690712 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:13:23.691464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:23.690717 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:13:23.691464 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:23.691051 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8bbtk" podUID="3a23dc7b-d272-4973-8fa8-439c8db80153" Sep 13 20:13:23.691464 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:23.690954 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r7xjr" podUID="ffb004f5-2003-4db1-a1a9-33520224afda" Sep 13 20:13:23.691464 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:23.691134 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-tqzd4" podUID="599cb3c5-7fb7-4f7c-bacc-e500d844967e" Sep 13 20:13:23.852412 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:23.852390 2561 generic.go:356] "Generic (PLEG): container finished" podID="43f60dd5-273c-43c1-8c93-e8d20b6e8540" containerID="04de8d1f830ff93e0909adb628cf3721b48508b4d6041ab795717dd28cf9df7b" exitCode=0 Sep 13 20:13:23.852508 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:23.852443 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h4zf8" event={"ID":"43f60dd5-273c-43c1-8c93-e8d20b6e8540","Type":"ContainerDied","Data":"04de8d1f830ff93e0909adb628cf3721b48508b4d6041ab795717dd28cf9df7b"} Sep 13 20:13:23.987417 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:23.987397 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-59.ec2.internal" event="NodeReady" Sep 13 20:13:23.987531 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:23.987521 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 13 20:13:24.025212 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.025190 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2mhhk"] Sep 13 20:13:24.039638 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.039595 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-m5jng"] Sep 13 20:13:24.039822 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.039803 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2mhhk" Sep 13 20:13:24.043006 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.042833 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 13 20:13:24.043006 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.042849 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 13 20:13:24.043205 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.043179 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9fnqc\"" Sep 13 20:13:24.063620 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.063596 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2mhhk"] Sep 13 20:13:24.063697 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.063634 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m5jng"] Sep 13 20:13:24.063738 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.063711 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m5jng" Sep 13 20:13:24.066172 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.066153 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 13 20:13:24.066284 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.066218 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 13 20:13:24.066453 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.066441 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dgck6\"" Sep 13 20:13:24.066514 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.066500 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 13 20:13:24.151185 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.151166 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:13:24.151285 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.151203 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d971a502-448a-4f93-9714-3929a9d7b868-cert\") pod \"ingress-canary-m5jng\" (UID: \"d971a502-448a-4f93-9714-3929a9d7b868\") " pod="openshift-ingress-canary/ingress-canary-m5jng" Sep 13 20:13:24.151350 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.151280 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vq4l\" (UniqueName: \"kubernetes.io/projected/948ab05f-dc3d-48aa-b295-3ecc708ae659-kube-api-access-5vq4l\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:13:24.151350 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.151304 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7rgk\" (UniqueName: \"kubernetes.io/projected/d971a502-448a-4f93-9714-3929a9d7b868-kube-api-access-m7rgk\") pod \"ingress-canary-m5jng\" (UID: \"d971a502-448a-4f93-9714-3929a9d7b868\") " pod="openshift-ingress-canary/ingress-canary-m5jng" Sep 13 20:13:24.151447 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.151368 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/948ab05f-dc3d-48aa-b295-3ecc708ae659-config-volume\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:13:24.151447 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.151393 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/948ab05f-dc3d-48aa-b295-3ecc708ae659-tmp-dir\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:13:24.252496 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.252455 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/948ab05f-dc3d-48aa-b295-3ecc708ae659-config-volume\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:13:24.252575 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.252480 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/948ab05f-dc3d-48aa-b295-3ecc708ae659-tmp-dir\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:13:24.252575 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.252523 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:13:24.252575 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.252547 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d971a502-448a-4f93-9714-3929a9d7b868-cert\") pod \"ingress-canary-m5jng\" (UID: \"d971a502-448a-4f93-9714-3929a9d7b868\") " pod="openshift-ingress-canary/ingress-canary-m5jng" Sep 13 20:13:24.252709 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.252597 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vq4l\" (UniqueName: \"kubernetes.io/projected/948ab05f-dc3d-48aa-b295-3ecc708ae659-kube-api-access-5vq4l\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:13:24.252709 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.252621 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7rgk\" (UniqueName: \"kubernetes.io/projected/d971a502-448a-4f93-9714-3929a9d7b868-kube-api-access-m7rgk\") pod \"ingress-canary-m5jng\" (UID: \"d971a502-448a-4f93-9714-3929a9d7b868\") " pod="openshift-ingress-canary/ingress-canary-m5jng" Sep 13 20:13:24.252709 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:24.252624 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 20:13:24.252855 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:24.252740 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls podName:948ab05f-dc3d-48aa-b295-3ecc708ae659 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:24.752720294 +0000 UTC m=+34.569295856 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls") pod "dns-default-2mhhk" (UID: "948ab05f-dc3d-48aa-b295-3ecc708ae659") : secret "dns-default-metrics-tls" not found Sep 13 20:13:24.252855 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.252841 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/948ab05f-dc3d-48aa-b295-3ecc708ae659-tmp-dir\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:13:24.253103 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.253084 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/948ab05f-dc3d-48aa-b295-3ecc708ae659-config-volume\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:13:24.256729 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.256709 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d971a502-448a-4f93-9714-3929a9d7b868-cert\") pod \"ingress-canary-m5jng\" (UID: \"d971a502-448a-4f93-9714-3929a9d7b868\") " pod="openshift-ingress-canary/ingress-canary-m5jng" Sep 13 20:13:24.260811 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.260792 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7rgk\" (UniqueName: \"kubernetes.io/projected/d971a502-448a-4f93-9714-3929a9d7b868-kube-api-access-m7rgk\") pod \"ingress-canary-m5jng\" (UID: \"d971a502-448a-4f93-9714-3929a9d7b868\") " pod="openshift-ingress-canary/ingress-canary-m5jng" Sep 13 20:13:24.271298 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.271279 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vq4l\" (UniqueName: \"kubernetes.io/projected/948ab05f-dc3d-48aa-b295-3ecc708ae659-kube-api-access-5vq4l\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:13:24.353410 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.353383 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret\") pod \"global-pull-secret-syncer-tqzd4\" (UID: \"599cb3c5-7fb7-4f7c-bacc-e500d844967e\") " pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:13:24.353485 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.353421 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs\") pod \"network-metrics-daemon-8bbtk\" (UID: \"3a23dc7b-d272-4973-8fa8-439c8db80153\") " pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:13:24.353526 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:24.353510 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:13:24.353558 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:24.353520 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 13 20:13:24.353558 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:24.353554 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs podName:3a23dc7b-d272-4973-8fa8-439c8db80153 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:56.353541954 +0000 UTC m=+66.170117495 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs") pod "network-metrics-daemon-8bbtk" (UID: "3a23dc7b-d272-4973-8fa8-439c8db80153") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 13 20:13:24.353622 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:24.353584 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret podName:599cb3c5-7fb7-4f7c-bacc-e500d844967e nodeName:}" failed. No retries permitted until 2026-09-13 20:13:56.35357149 +0000 UTC m=+66.170147031 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret") pod "global-pull-secret-syncer-tqzd4" (UID: "599cb3c5-7fb7-4f7c-bacc-e500d844967e") : object "kube-system"/"original-pull-secret" not registered Sep 13 20:13:24.388618 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.388598 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-m5jng" Sep 13 20:13:24.454156 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.454129 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v9qm\" (UniqueName: \"kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm\") pod \"network-check-target-r7xjr\" (UID: \"ffb004f5-2003-4db1-a1a9-33520224afda\") " pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:13:24.454314 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:24.454276 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 13 20:13:24.454314 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:24.454288 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 13 20:13:24.454314 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:24.454297 2561 projected.go:196] Error preparing data for projected volume kube-api-access-5v9qm for pod openshift-network-diagnostics/network-check-target-r7xjr: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:13:24.454440 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:24.454345 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm podName:ffb004f5-2003-4db1-a1a9-33520224afda nodeName:}" failed. No retries permitted until 2026-09-13 20:13:56.454332386 +0000 UTC m=+66.270907928 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-5v9qm" (UniqueName: "kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm") pod "network-check-target-r7xjr" (UID: "ffb004f5-2003-4db1-a1a9-33520224afda") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 13 20:13:24.688976 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.688826 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-m5jng"] Sep 13 20:13:24.692887 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:13:24.692863 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd971a502_448a_4f93_9714_3929a9d7b868.slice/crio-0f7dc933c4620c6bd3715d7b52e51b6aa6c61b5b2d021f6a32942fbdf37a45c4 WatchSource:0}: Error finding container 0f7dc933c4620c6bd3715d7b52e51b6aa6c61b5b2d021f6a32942fbdf37a45c4: Status 404 returned error can't find the container with id 0f7dc933c4620c6bd3715d7b52e51b6aa6c61b5b2d021f6a32942fbdf37a45c4 Sep 13 20:13:24.757046 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.757024 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:13:24.757156 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:24.757143 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 20:13:24.757204 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:24.757189 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls podName:948ab05f-dc3d-48aa-b295-3ecc708ae659 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:25.757174876 +0000 UTC m=+35.573750417 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls") pod "dns-default-2mhhk" (UID: "948ab05f-dc3d-48aa-b295-3ecc708ae659") : secret "dns-default-metrics-tls" not found Sep 13 20:13:24.855554 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.855526 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m5jng" event={"ID":"d971a502-448a-4f93-9714-3929a9d7b868","Type":"ContainerStarted","Data":"0f7dc933c4620c6bd3715d7b52e51b6aa6c61b5b2d021f6a32942fbdf37a45c4"} Sep 13 20:13:24.858536 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.858510 2561 generic.go:356] "Generic (PLEG): container finished" podID="43f60dd5-273c-43c1-8c93-e8d20b6e8540" containerID="a97e06bf7c9f5a70aab606c0f73f8a67e0eba75d1e6a318e82b6f49ede1fa1f4" exitCode=0 Sep 13 20:13:24.858624 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:24.858546 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h4zf8" event={"ID":"43f60dd5-273c-43c1-8c93-e8d20b6e8540","Type":"ContainerDied","Data":"a97e06bf7c9f5a70aab606c0f73f8a67e0eba75d1e6a318e82b6f49ede1fa1f4"} Sep 13 20:13:25.691608 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:25.691567 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:13:25.691774 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:25.691568 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:13:25.691774 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:25.691568 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:13:25.694283 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:25.694246 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 13 20:13:25.694688 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:25.694286 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 13 20:13:25.694688 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:25.694253 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 13 20:13:25.695268 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:25.695245 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5c5lx\"" Sep 13 20:13:25.695392 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:25.695279 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ln5vr\"" Sep 13 20:13:25.695392 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:25.695285 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 13 20:13:25.762109 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:25.761943 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:13:25.762220 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:25.762127 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 20:13:25.762220 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:25.762199 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls podName:948ab05f-dc3d-48aa-b295-3ecc708ae659 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:27.762172182 +0000 UTC m=+37.578747724 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls") pod "dns-default-2mhhk" (UID: "948ab05f-dc3d-48aa-b295-3ecc708ae659") : secret "dns-default-metrics-tls" not found Sep 13 20:13:25.864981 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:25.864950 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-h4zf8" event={"ID":"43f60dd5-273c-43c1-8c93-e8d20b6e8540","Type":"ContainerStarted","Data":"df05e1cd3a94e74fe448ca055621a5603ff90973c71962f4c0e921cc6c5f40ea"} Sep 13 20:13:25.884212 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:25.884164 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-h4zf8" podStartSLOduration=8.556055347000001 podStartE2EDuration="35.88414629s" totalImagesPullingTime="27.328090943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:12:50 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:25.882511796 +0000 UTC m=+35.699087361" watchObservedRunningTime="2026-09-13 20:13:25.88414629 +0000 UTC m=+35.700721859" Sep 13 20:13:27.775266 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:27.775230 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:13:27.775700 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:27.775369 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 20:13:27.775700 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:27.775457 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls podName:948ab05f-dc3d-48aa-b295-3ecc708ae659 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:31.775423947 +0000 UTC m=+41.591999508 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls") pod "dns-default-2mhhk" (UID: "948ab05f-dc3d-48aa-b295-3ecc708ae659") : secret "dns-default-metrics-tls" not found Sep 13 20:13:27.871587 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:27.871559 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-m5jng" event={"ID":"d971a502-448a-4f93-9714-3929a9d7b868","Type":"ContainerStarted","Data":"fe11bd1a65e8f5f483fe3f20b53b0e460c29b1a3b494a8704f76991e63a2ea2e"} Sep 13 20:13:27.887420 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:27.887376 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-m5jng" podStartSLOduration=1.327459846 podStartE2EDuration="3.887362852s" totalImagesPullingTime="2.559903006s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:13:27.885749076 +0000 UTC m=+37.702324639" watchObservedRunningTime="2026-09-13 20:13:27.887362852 +0000 UTC m=+37.703938413" Sep 13 20:13:31.801307 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:31.801139 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:13:31.801307 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:31.801292 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 20:13:31.801679 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:31.801353 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls podName:948ab05f-dc3d-48aa-b295-3ecc708ae659 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:39.801338468 +0000 UTC m=+49.617914023 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls") pod "dns-default-2mhhk" (UID: "948ab05f-dc3d-48aa-b295-3ecc708ae659") : secret "dns-default-metrics-tls" not found Sep 13 20:13:39.854541 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:39.854494 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:13:39.854973 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:39.854659 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 20:13:39.854973 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:39.854766 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls podName:948ab05f-dc3d-48aa-b295-3ecc708ae659 nodeName:}" failed. No retries permitted until 2026-09-13 20:13:55.854745215 +0000 UTC m=+65.671320784 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls") pod "dns-default-2mhhk" (UID: "948ab05f-dc3d-48aa-b295-3ecc708ae659") : secret "dns-default-metrics-tls" not found Sep 13 20:13:49.849970 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:49.849942 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-g54wf" Sep 13 20:13:55.870406 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:55.870357 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:13:55.870806 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:55.870503 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 20:13:55.870806 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:55.870567 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls podName:948ab05f-dc3d-48aa-b295-3ecc708ae659 nodeName:}" failed. No retries permitted until 2026-09-13 20:14:27.870550793 +0000 UTC m=+97.687126335 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls") pod "dns-default-2mhhk" (UID: "948ab05f-dc3d-48aa-b295-3ecc708ae659") : secret "dns-default-metrics-tls" not found Sep 13 20:13:56.374134 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:56.374092 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret\") pod \"global-pull-secret-syncer-tqzd4\" (UID: \"599cb3c5-7fb7-4f7c-bacc-e500d844967e\") " pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:13:56.374331 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:56.374144 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs\") pod \"network-metrics-daemon-8bbtk\" (UID: \"3a23dc7b-d272-4973-8fa8-439c8db80153\") " pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:13:56.377052 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:56.377030 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 13 20:13:56.377135 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:56.377030 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 13 20:13:56.385320 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:56.385301 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 13 20:13:56.385398 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:13:56.385367 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs podName:3a23dc7b-d272-4973-8fa8-439c8db80153 nodeName:}" failed. No retries permitted until 2026-09-13 20:15:00.385346144 +0000 UTC m=+130.201921708 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs") pod "network-metrics-daemon-8bbtk" (UID: "3a23dc7b-d272-4973-8fa8-439c8db80153") : secret "metrics-daemon-secret" not found Sep 13 20:13:56.388677 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:56.388657 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/599cb3c5-7fb7-4f7c-bacc-e500d844967e-original-pull-secret\") pod \"global-pull-secret-syncer-tqzd4\" (UID: \"599cb3c5-7fb7-4f7c-bacc-e500d844967e\") " pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:13:56.474460 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:56.474428 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v9qm\" (UniqueName: \"kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm\") pod \"network-check-target-r7xjr\" (UID: \"ffb004f5-2003-4db1-a1a9-33520224afda\") " pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:13:56.477541 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:56.477520 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 13 20:13:56.488073 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:56.488039 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 13 20:13:56.498184 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:56.498157 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v9qm\" (UniqueName: \"kubernetes.io/projected/ffb004f5-2003-4db1-a1a9-33520224afda-kube-api-access-5v9qm\") pod \"network-check-target-r7xjr\" (UID: \"ffb004f5-2003-4db1-a1a9-33520224afda\") " pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:13:56.612313 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:56.612289 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-ln5vr\"" Sep 13 20:13:56.615097 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:56.615083 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-tqzd4" Sep 13 20:13:56.620647 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:56.620632 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:13:56.884650 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:56.884575 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-tqzd4"] Sep 13 20:13:56.887786 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:56.887761 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r7xjr"] Sep 13 20:13:56.888502 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:13:56.888479 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod599cb3c5_7fb7_4f7c_bacc_e500d844967e.slice/crio-e1801c416c1b95cde8335016a6682129de1dd94f494a54f3fab7b721c18aeb2e WatchSource:0}: Error finding container e1801c416c1b95cde8335016a6682129de1dd94f494a54f3fab7b721c18aeb2e: Status 404 returned error can't find the container with id e1801c416c1b95cde8335016a6682129de1dd94f494a54f3fab7b721c18aeb2e Sep 13 20:13:56.890587 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:13:56.890569 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffb004f5_2003_4db1_a1a9_33520224afda.slice/crio-72227d551f0f702c7eddfd9f673724f46cb7203b8be3e95dccfabe8584d91aad WatchSource:0}: Error finding container 72227d551f0f702c7eddfd9f673724f46cb7203b8be3e95dccfabe8584d91aad: Status 404 returned error can't find the container with id 72227d551f0f702c7eddfd9f673724f46cb7203b8be3e95dccfabe8584d91aad Sep 13 20:13:56.936203 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:56.936170 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r7xjr" event={"ID":"ffb004f5-2003-4db1-a1a9-33520224afda","Type":"ContainerStarted","Data":"72227d551f0f702c7eddfd9f673724f46cb7203b8be3e95dccfabe8584d91aad"} Sep 13 20:13:56.937312 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:13:56.937289 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tqzd4" event={"ID":"599cb3c5-7fb7-4f7c-bacc-e500d844967e","Type":"ContainerStarted","Data":"e1801c416c1b95cde8335016a6682129de1dd94f494a54f3fab7b721c18aeb2e"} Sep 13 20:14:01.953501 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:01.953459 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r7xjr" event={"ID":"ffb004f5-2003-4db1-a1a9-33520224afda","Type":"ContainerStarted","Data":"91d4500a0dc577eb152c5587e9096650c6020bc47ce195701657e86bb5c52b80"} Sep 13 20:14:01.953956 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:01.953552 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:14:01.954997 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:01.954972 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-tqzd4" event={"ID":"599cb3c5-7fb7-4f7c-bacc-e500d844967e","Type":"ContainerStarted","Data":"bb10f885668884658aa2b908609cd08cbef66799fe102b1e315284ef45efc28a"} Sep 13 20:14:01.967016 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:01.966971 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r7xjr" podStartSLOduration=67.737607891 podStartE2EDuration="1m11.966957541s" totalImagesPullingTime="4.22934965s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:14:01.966814946 +0000 UTC m=+71.783390510" watchObservedRunningTime="2026-09-13 20:14:01.966957541 +0000 UTC m=+71.783533098" Sep 13 20:14:01.979316 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:01.979271 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-tqzd4" podStartSLOduration=67.744049789 podStartE2EDuration="1m11.979258809s" totalImagesPullingTime="4.23520902s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:14:01.979160872 +0000 UTC m=+71.795736438" watchObservedRunningTime="2026-09-13 20:14:01.979258809 +0000 UTC m=+71.795834372" Sep 13 20:14:27.876155 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:27.876113 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:14:27.876559 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:14:27.876235 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 20:14:27.876559 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:14:27.876284 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls podName:948ab05f-dc3d-48aa-b295-3ecc708ae659 nodeName:}" failed. No retries permitted until 2026-09-13 20:15:31.87626991 +0000 UTC m=+161.692845464 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls") pod "dns-default-2mhhk" (UID: "948ab05f-dc3d-48aa-b295-3ecc708ae659") : secret "dns-default-metrics-tls" not found Sep 13 20:14:32.959830 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:32.959790 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r7xjr" Sep 13 20:14:36.938455 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:36.938420 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j"] Sep 13 20:14:36.940958 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:36.940942 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:14:36.946776 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:36.943998 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\"" Sep 13 20:14:36.946776 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:36.944530 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Sep 13 20:14:36.946776 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:36.944601 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Sep 13 20:14:36.946776 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:36.944771 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\"" Sep 13 20:14:36.946776 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:36.944855 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\"" Sep 13 20:14:36.946776 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:36.944776 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\"" Sep 13 20:14:36.946776 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:36.944982 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Sep 13 20:14:36.954079 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:36.954041 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j"] Sep 13 20:14:37.043081 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:37.043016 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aec0a0d3-287e-4a0e-9cd0-3b404b500c22-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-848cf47757-bk67j\" (UID: \"aec0a0d3-287e-4a0e-9cd0-3b404b500c22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:14:37.043264 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:37.043117 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aec0a0d3-287e-4a0e-9cd0-3b404b500c22-ca\") pod \"cluster-proxy-proxy-agent-848cf47757-bk67j\" (UID: \"aec0a0d3-287e-4a0e-9cd0-3b404b500c22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:14:37.043264 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:37.043139 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aec0a0d3-287e-4a0e-9cd0-3b404b500c22-hub\") pod \"cluster-proxy-proxy-agent-848cf47757-bk67j\" (UID: \"aec0a0d3-287e-4a0e-9cd0-3b404b500c22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:14:37.043264 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:37.043177 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gw4mp\" (UniqueName: \"kubernetes.io/projected/aec0a0d3-287e-4a0e-9cd0-3b404b500c22-kube-api-access-gw4mp\") pod \"cluster-proxy-proxy-agent-848cf47757-bk67j\" (UID: \"aec0a0d3-287e-4a0e-9cd0-3b404b500c22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:14:37.043264 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:37.043196 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aec0a0d3-287e-4a0e-9cd0-3b404b500c22-additional-service-ca\") pod \"cluster-proxy-proxy-agent-848cf47757-bk67j\" (UID: \"aec0a0d3-287e-4a0e-9cd0-3b404b500c22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:14:37.043413 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:37.043277 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aec0a0d3-287e-4a0e-9cd0-3b404b500c22-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-848cf47757-bk67j\" (UID: \"aec0a0d3-287e-4a0e-9cd0-3b404b500c22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:14:37.143719 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:37.143684 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aec0a0d3-287e-4a0e-9cd0-3b404b500c22-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-848cf47757-bk67j\" (UID: \"aec0a0d3-287e-4a0e-9cd0-3b404b500c22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:14:37.143805 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:37.143726 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aec0a0d3-287e-4a0e-9cd0-3b404b500c22-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-848cf47757-bk67j\" (UID: \"aec0a0d3-287e-4a0e-9cd0-3b404b500c22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:14:37.143805 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:37.143759 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aec0a0d3-287e-4a0e-9cd0-3b404b500c22-ca\") pod \"cluster-proxy-proxy-agent-848cf47757-bk67j\" (UID: \"aec0a0d3-287e-4a0e-9cd0-3b404b500c22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:14:37.143805 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:37.143775 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aec0a0d3-287e-4a0e-9cd0-3b404b500c22-hub\") pod \"cluster-proxy-proxy-agent-848cf47757-bk67j\" (UID: \"aec0a0d3-287e-4a0e-9cd0-3b404b500c22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:14:37.143953 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:37.143806 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gw4mp\" (UniqueName: \"kubernetes.io/projected/aec0a0d3-287e-4a0e-9cd0-3b404b500c22-kube-api-access-gw4mp\") pod \"cluster-proxy-proxy-agent-848cf47757-bk67j\" (UID: \"aec0a0d3-287e-4a0e-9cd0-3b404b500c22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:14:37.143953 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:37.143833 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aec0a0d3-287e-4a0e-9cd0-3b404b500c22-additional-service-ca\") pod \"cluster-proxy-proxy-agent-848cf47757-bk67j\" (UID: \"aec0a0d3-287e-4a0e-9cd0-3b404b500c22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:14:37.144573 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:37.144548 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/aec0a0d3-287e-4a0e-9cd0-3b404b500c22-additional-service-ca\") pod \"cluster-proxy-proxy-agent-848cf47757-bk67j\" (UID: \"aec0a0d3-287e-4a0e-9cd0-3b404b500c22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:14:37.146181 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:37.146141 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/aec0a0d3-287e-4a0e-9cd0-3b404b500c22-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-848cf47757-bk67j\" (UID: \"aec0a0d3-287e-4a0e-9cd0-3b404b500c22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:14:37.146535 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:37.146515 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/aec0a0d3-287e-4a0e-9cd0-3b404b500c22-ca\") pod \"cluster-proxy-proxy-agent-848cf47757-bk67j\" (UID: \"aec0a0d3-287e-4a0e-9cd0-3b404b500c22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:14:37.146588 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:37.146557 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/aec0a0d3-287e-4a0e-9cd0-3b404b500c22-hub\") pod \"cluster-proxy-proxy-agent-848cf47757-bk67j\" (UID: \"aec0a0d3-287e-4a0e-9cd0-3b404b500c22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:14:37.146680 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:37.146664 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/aec0a0d3-287e-4a0e-9cd0-3b404b500c22-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-848cf47757-bk67j\" (UID: \"aec0a0d3-287e-4a0e-9cd0-3b404b500c22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:14:37.151887 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:37.151862 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gw4mp\" (UniqueName: \"kubernetes.io/projected/aec0a0d3-287e-4a0e-9cd0-3b404b500c22-kube-api-access-gw4mp\") pod \"cluster-proxy-proxy-agent-848cf47757-bk67j\" (UID: \"aec0a0d3-287e-4a0e-9cd0-3b404b500c22\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:14:37.260425 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:37.260342 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:14:37.525418 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:37.525329 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j"] Sep 13 20:14:37.528426 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:14:37.528393 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaec0a0d3_287e_4a0e_9cd0_3b404b500c22.slice/crio-b7514b0e2bd43f0cc85bfa0da46a3371ce4fbc37855e9b3106aa4253a34476ef WatchSource:0}: Error finding container b7514b0e2bd43f0cc85bfa0da46a3371ce4fbc37855e9b3106aa4253a34476ef: Status 404 returned error can't find the container with id b7514b0e2bd43f0cc85bfa0da46a3371ce4fbc37855e9b3106aa4253a34476ef Sep 13 20:14:38.038874 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:38.038841 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" event={"ID":"aec0a0d3-287e-4a0e-9cd0-3b404b500c22","Type":"ContainerStarted","Data":"b7514b0e2bd43f0cc85bfa0da46a3371ce4fbc37855e9b3106aa4253a34476ef"} Sep 13 20:14:42.052782 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:42.052747 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" event={"ID":"aec0a0d3-287e-4a0e-9cd0-3b404b500c22","Type":"ContainerStarted","Data":"c3f5c24853a3c606c8a08dffeebe1663dff51f5c127bf67d7757a265303fd795"} Sep 13 20:14:42.052782 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:42.052788 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" event={"ID":"aec0a0d3-287e-4a0e-9cd0-3b404b500c22","Type":"ContainerStarted","Data":"489d87acbac30e7dcfb0423c478f2d9bce865e7f090909fa43b0b2140da4ecdd"} Sep 13 20:14:42.053305 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:42.052802 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" event={"ID":"aec0a0d3-287e-4a0e-9cd0-3b404b500c22","Type":"ContainerStarted","Data":"da4e6a44a5e0a47f1f72e1763f10733594d01d755c52201463aa1241180f3043"} Sep 13 20:14:42.073557 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:14:42.073508 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" podStartSLOduration=2.255008107 podStartE2EDuration="6.073494649s" totalImagesPullingTime="3.818486542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:14:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:14:42.071701266 +0000 UTC m=+111.888276829" watchObservedRunningTime="2026-09-13 20:14:42.073494649 +0000 UTC m=+111.890070212" Sep 13 20:15:00.401395 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:15:00.401352 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs\") pod \"network-metrics-daemon-8bbtk\" (UID: \"3a23dc7b-d272-4973-8fa8-439c8db80153\") " pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:15:00.401882 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:15:00.401495 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 13 20:15:00.401882 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:15:00.401579 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs podName:3a23dc7b-d272-4973-8fa8-439c8db80153 nodeName:}" failed. No retries permitted until 2026-09-13 20:17:02.401563344 +0000 UTC m=+252.218138901 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs") pod "network-metrics-daemon-8bbtk" (UID: "3a23dc7b-d272-4973-8fa8-439c8db80153") : secret "metrics-daemon-secret" not found Sep 13 20:15:27.083943 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:15:27.083887 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2mhhk" podUID="948ab05f-dc3d-48aa-b295-3ecc708ae659" Sep 13 20:15:27.176314 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:15:27.176288 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2mhhk" Sep 13 20:15:28.703166 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:15:28.703124 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8bbtk" podUID="3a23dc7b-d272-4973-8fa8-439c8db80153" Sep 13 20:15:31.913406 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:15:31.913347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:15:31.913895 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:15:31.913462 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Sep 13 20:15:31.913895 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:15:31.913514 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls podName:948ab05f-dc3d-48aa-b295-3ecc708ae659 nodeName:}" failed. No retries permitted until 2026-09-13 20:17:33.913499599 +0000 UTC m=+283.730075141 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls") pod "dns-default-2mhhk" (UID: "948ab05f-dc3d-48aa-b295-3ecc708ae659") : secret "dns-default-metrics-tls" not found Sep 13 20:15:40.692402 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:15:40.692373 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:17:02.408525 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:02.408480 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs\") pod \"network-metrics-daemon-8bbtk\" (UID: \"3a23dc7b-d272-4973-8fa8-439c8db80153\") " pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:17:02.409004 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:02.408610 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Sep 13 20:17:02.409004 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:02.408682 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs podName:3a23dc7b-d272-4973-8fa8-439c8db80153 nodeName:}" failed. No retries permitted until 2026-09-13 20:19:04.408664715 +0000 UTC m=+374.225240262 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs") pod "network-metrics-daemon-8bbtk" (UID: "3a23dc7b-d272-4973-8fa8-439c8db80153") : secret "metrics-daemon-secret" not found Sep 13 20:17:08.394290 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.394260 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5bbd89c6ff-r4jtc"] Sep 13 20:17:08.396949 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.396932 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.399313 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.399289 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Sep 13 20:17:08.399414 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.399358 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Sep 13 20:17:08.399414 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.399376 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Sep 13 20:17:08.399757 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.399733 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-zlk89\"" Sep 13 20:17:08.404555 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.404538 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Sep 13 20:17:08.427910 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.427877 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bbd89c6ff-r4jtc"] Sep 13 20:17:08.450314 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.450287 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de38e26d-5a9a-496b-a503-f1330a0ecb49-installation-pull-secrets\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.450429 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.450319 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de38e26d-5a9a-496b-a503-f1330a0ecb49-image-registry-private-configuration\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.450498 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.450422 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de38e26d-5a9a-496b-a503-f1330a0ecb49-ca-trust-extracted\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.450498 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.450457 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de38e26d-5a9a-496b-a503-f1330a0ecb49-trusted-ca\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.450498 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.450486 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-bound-sa-token\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.450643 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.450540 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95p57\" (UniqueName: \"kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-kube-api-access-95p57\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.450643 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.450567 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.450643 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.450596 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-certificates\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.551284 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.551249 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de38e26d-5a9a-496b-a503-f1330a0ecb49-ca-trust-extracted\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.551284 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.551283 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de38e26d-5a9a-496b-a503-f1330a0ecb49-trusted-ca\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.551464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.551301 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-bound-sa-token\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.551464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.551438 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95p57\" (UniqueName: \"kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-kube-api-access-95p57\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.551533 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.551485 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.551579 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.551530 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-certificates\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.551622 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:08.551575 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 13 20:17:08.551622 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.551583 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de38e26d-5a9a-496b-a503-f1330a0ecb49-installation-pull-secrets\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.551622 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:08.551590 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bbd89c6ff-r4jtc: secret "image-registry-tls" not found Sep 13 20:17:08.551622 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.551605 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de38e26d-5a9a-496b-a503-f1330a0ecb49-image-registry-private-configuration\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.551786 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.551635 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de38e26d-5a9a-496b-a503-f1330a0ecb49-ca-trust-extracted\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.551786 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:08.551647 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls podName:de38e26d-5a9a-496b-a503-f1330a0ecb49 nodeName:}" failed. No retries permitted until 2026-09-13 20:17:09.051625938 +0000 UTC m=+258.868201498 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls") pod "image-registry-5bbd89c6ff-r4jtc" (UID: "de38e26d-5a9a-496b-a503-f1330a0ecb49") : secret "image-registry-tls" not found Sep 13 20:17:08.552114 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.552087 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-certificates\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.552320 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.552302 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de38e26d-5a9a-496b-a503-f1330a0ecb49-trusted-ca\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.553921 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.553899 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de38e26d-5a9a-496b-a503-f1330a0ecb49-image-registry-private-configuration\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.554000 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.553957 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de38e26d-5a9a-496b-a503-f1330a0ecb49-installation-pull-secrets\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.559442 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.559416 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-bound-sa-token\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:08.559800 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:08.559781 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95p57\" (UniqueName: \"kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-kube-api-access-95p57\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:09.056588 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:09.056549 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:09.056791 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:09.056687 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 13 20:17:09.056791 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:09.056701 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bbd89c6ff-r4jtc: secret "image-registry-tls" not found Sep 13 20:17:09.056791 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:09.056771 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls podName:de38e26d-5a9a-496b-a503-f1330a0ecb49 nodeName:}" failed. No retries permitted until 2026-09-13 20:17:10.056753082 +0000 UTC m=+259.873328623 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls") pod "image-registry-5bbd89c6ff-r4jtc" (UID: "de38e26d-5a9a-496b-a503-f1330a0ecb49") : secret "image-registry-tls" not found Sep 13 20:17:10.066510 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:10.066476 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:10.066884 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:10.066596 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 13 20:17:10.066884 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:10.066608 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bbd89c6ff-r4jtc: secret "image-registry-tls" not found Sep 13 20:17:10.066884 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:10.066664 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls podName:de38e26d-5a9a-496b-a503-f1330a0ecb49 nodeName:}" failed. No retries permitted until 2026-09-13 20:17:12.066650648 +0000 UTC m=+261.883226190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls") pod "image-registry-5bbd89c6ff-r4jtc" (UID: "de38e26d-5a9a-496b-a503-f1330a0ecb49") : secret "image-registry-tls" not found Sep 13 20:17:12.082178 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:12.082140 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:12.082624 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:12.082275 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 13 20:17:12.082624 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:12.082292 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bbd89c6ff-r4jtc: secret "image-registry-tls" not found Sep 13 20:17:12.082624 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:12.082358 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls podName:de38e26d-5a9a-496b-a503-f1330a0ecb49 nodeName:}" failed. No retries permitted until 2026-09-13 20:17:16.082339573 +0000 UTC m=+265.898915116 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls") pod "image-registry-5bbd89c6ff-r4jtc" (UID: "de38e26d-5a9a-496b-a503-f1330a0ecb49") : secret "image-registry-tls" not found Sep 13 20:17:13.595299 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.595228 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-btjbg"] Sep 13 20:17:13.597999 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.597983 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:13.600318 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.600289 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 13 20:17:13.601322 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.601305 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 13 20:17:13.601322 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.601315 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 13 20:17:13.601490 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.601339 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wx957\"" Sep 13 20:17:13.601490 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.601372 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 13 20:17:13.609375 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.609356 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-btjbg"] Sep 13 20:17:13.693516 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.693486 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d734676-73f6-4aa1-a8aa-025293c8393e-crio-socket\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:13.693671 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.693537 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d734676-73f6-4aa1-a8aa-025293c8393e-data-volume\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:13.693671 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.693597 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:13.693671 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.693644 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d734676-73f6-4aa1-a8aa-025293c8393e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:13.693671 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.693662 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jth8\" (UniqueName: \"kubernetes.io/projected/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-api-access-8jth8\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:13.794577 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.794553 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d734676-73f6-4aa1-a8aa-025293c8393e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:13.794577 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.794579 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jth8\" (UniqueName: \"kubernetes.io/projected/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-api-access-8jth8\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:13.794761 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.794596 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d734676-73f6-4aa1-a8aa-025293c8393e-crio-socket\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:13.794761 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.794637 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d734676-73f6-4aa1-a8aa-025293c8393e-data-volume\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:13.794761 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.794681 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:13.794761 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:13.794702 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 20:17:13.794761 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.794717 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/7d734676-73f6-4aa1-a8aa-025293c8393e-crio-socket\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:13.794761 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:13.794747 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 13 20:17:13.794761 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:13.794755 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d734676-73f6-4aa1-a8aa-025293c8393e-insights-runtime-extractor-tls podName:7d734676-73f6-4aa1-a8aa-025293c8393e nodeName:}" failed. No retries permitted until 2026-09-13 20:17:14.294739434 +0000 UTC m=+264.111314977 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d734676-73f6-4aa1-a8aa-025293c8393e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-btjbg" (UID: "7d734676-73f6-4aa1-a8aa-025293c8393e") : secret "insights-runtime-extractor-tls" not found Sep 13 20:17:13.794989 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:13.794809 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-rbac-proxy-cm podName:7d734676-73f6-4aa1-a8aa-025293c8393e nodeName:}" failed. No retries permitted until 2026-09-13 20:17:14.294792963 +0000 UTC m=+264.111368505 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-btjbg" (UID: "7d734676-73f6-4aa1-a8aa-025293c8393e") : configmap "kube-rbac-proxy" not found Sep 13 20:17:13.795092 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.795055 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/7d734676-73f6-4aa1-a8aa-025293c8393e-data-volume\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:13.802788 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:13.802770 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jth8\" (UniqueName: \"kubernetes.io/projected/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-api-access-8jth8\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:14.297850 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:14.297805 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:14.298025 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:14.297865 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d734676-73f6-4aa1-a8aa-025293c8393e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:14.298025 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:14.297938 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 13 20:17:14.298025 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:14.297972 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 20:17:14.298025 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:14.298015 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-rbac-proxy-cm podName:7d734676-73f6-4aa1-a8aa-025293c8393e nodeName:}" failed. No retries permitted until 2026-09-13 20:17:15.297998591 +0000 UTC m=+265.114574138 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-btjbg" (UID: "7d734676-73f6-4aa1-a8aa-025293c8393e") : configmap "kube-rbac-proxy" not found Sep 13 20:17:14.298199 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:14.298039 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d734676-73f6-4aa1-a8aa-025293c8393e-insights-runtime-extractor-tls podName:7d734676-73f6-4aa1-a8aa-025293c8393e nodeName:}" failed. No retries permitted until 2026-09-13 20:17:15.298024856 +0000 UTC m=+265.114600397 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d734676-73f6-4aa1-a8aa-025293c8393e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-btjbg" (UID: "7d734676-73f6-4aa1-a8aa-025293c8393e") : secret "insights-runtime-extractor-tls" not found Sep 13 20:17:15.305783 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:15.305746 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:15.306166 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:15.305796 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d734676-73f6-4aa1-a8aa-025293c8393e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:15.306166 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:15.305855 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 13 20:17:15.306166 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:15.305876 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 20:17:15.306166 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:15.305925 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-rbac-proxy-cm podName:7d734676-73f6-4aa1-a8aa-025293c8393e nodeName:}" failed. No retries permitted until 2026-09-13 20:17:17.30589858 +0000 UTC m=+267.122474123 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-btjbg" (UID: "7d734676-73f6-4aa1-a8aa-025293c8393e") : configmap "kube-rbac-proxy" not found Sep 13 20:17:15.306166 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:15.305939 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d734676-73f6-4aa1-a8aa-025293c8393e-insights-runtime-extractor-tls podName:7d734676-73f6-4aa1-a8aa-025293c8393e nodeName:}" failed. No retries permitted until 2026-09-13 20:17:17.305933124 +0000 UTC m=+267.122508665 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d734676-73f6-4aa1-a8aa-025293c8393e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-btjbg" (UID: "7d734676-73f6-4aa1-a8aa-025293c8393e") : secret "insights-runtime-extractor-tls" not found Sep 13 20:17:16.112268 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:16.112224 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:16.112455 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:16.112336 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Sep 13 20:17:16.112455 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:16.112349 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5bbd89c6ff-r4jtc: secret "image-registry-tls" not found Sep 13 20:17:16.112455 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:16.112396 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls podName:de38e26d-5a9a-496b-a503-f1330a0ecb49 nodeName:}" failed. No retries permitted until 2026-09-13 20:17:24.112383802 +0000 UTC m=+273.928959343 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls") pod "image-registry-5bbd89c6ff-r4jtc" (UID: "de38e26d-5a9a-496b-a503-f1330a0ecb49") : secret "image-registry-tls" not found Sep 13 20:17:16.163186 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:16.163166 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lj9m7_428ee95f-1def-45a2-9238-552a99aa32f2/dns-node-resolver/0.log" Sep 13 20:17:17.320104 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:17.320043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:17.320481 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:17.320143 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d734676-73f6-4aa1-a8aa-025293c8393e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:17.320481 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:17.320164 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 13 20:17:17.320481 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:17.320226 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-rbac-proxy-cm podName:7d734676-73f6-4aa1-a8aa-025293c8393e nodeName:}" failed. No retries permitted until 2026-09-13 20:17:21.320209012 +0000 UTC m=+271.136784559 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-btjbg" (UID: "7d734676-73f6-4aa1-a8aa-025293c8393e") : configmap "kube-rbac-proxy" not found Sep 13 20:17:17.320481 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:17.320280 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 20:17:17.320481 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:17.320333 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d734676-73f6-4aa1-a8aa-025293c8393e-insights-runtime-extractor-tls podName:7d734676-73f6-4aa1-a8aa-025293c8393e nodeName:}" failed. No retries permitted until 2026-09-13 20:17:21.320319828 +0000 UTC m=+271.136895371 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d734676-73f6-4aa1-a8aa-025293c8393e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-btjbg" (UID: "7d734676-73f6-4aa1-a8aa-025293c8393e") : secret "insights-runtime-extractor-tls" not found Sep 13 20:17:17.359851 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:17.359832 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ffvkb_b39db385-6547-430c-894e-4976abd54196/node-ca/0.log" Sep 13 20:17:18.359236 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:18.359206 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m5jng_d971a502-448a-4f93-9714-3929a9d7b868/serve-healthcheck-canary/0.log" Sep 13 20:17:21.350830 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:21.350798 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d734676-73f6-4aa1-a8aa-025293c8393e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:21.351221 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:21.350857 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:21.351221 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:21.350917 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Sep 13 20:17:21.351221 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:21.350941 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Sep 13 20:17:21.351221 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:21.350964 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-rbac-proxy-cm podName:7d734676-73f6-4aa1-a8aa-025293c8393e nodeName:}" failed. No retries permitted until 2026-09-13 20:17:29.35095104 +0000 UTC m=+279.167526582 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-btjbg" (UID: "7d734676-73f6-4aa1-a8aa-025293c8393e") : configmap "kube-rbac-proxy" not found Sep 13 20:17:21.351221 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:21.350988 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d734676-73f6-4aa1-a8aa-025293c8393e-insights-runtime-extractor-tls podName:7d734676-73f6-4aa1-a8aa-025293c8393e nodeName:}" failed. No retries permitted until 2026-09-13 20:17:29.35097666 +0000 UTC m=+279.167552207 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/7d734676-73f6-4aa1-a8aa-025293c8393e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-btjbg" (UID: "7d734676-73f6-4aa1-a8aa-025293c8393e") : secret "insights-runtime-extractor-tls" not found Sep 13 20:17:24.171129 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:24.171081 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:24.173341 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:24.173321 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls\") pod \"image-registry-5bbd89c6ff-r4jtc\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:24.306073 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:24.306036 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:24.574301 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:24.574225 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5bbd89c6ff-r4jtc"] Sep 13 20:17:24.578107 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:17:24.578078 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde38e26d_5a9a_496b_a503_f1330a0ecb49.slice/crio-a10b6004e45527214d4a83c7912c7033b24a7c5e2f5dfdc345704feda86fba7f WatchSource:0}: Error finding container a10b6004e45527214d4a83c7912c7033b24a7c5e2f5dfdc345704feda86fba7f: Status 404 returned error can't find the container with id a10b6004e45527214d4a83c7912c7033b24a7c5e2f5dfdc345704feda86fba7f Sep 13 20:17:25.501495 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:25.501459 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" event={"ID":"de38e26d-5a9a-496b-a503-f1330a0ecb49","Type":"ContainerStarted","Data":"9437a0cd25264576949a002403278a11810cc35b56b8a7c7ef96fa4b01b1e7aa"} Sep 13 20:17:25.501892 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:25.501514 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" event={"ID":"de38e26d-5a9a-496b-a503-f1330a0ecb49","Type":"ContainerStarted","Data":"a10b6004e45527214d4a83c7912c7033b24a7c5e2f5dfdc345704feda86fba7f"} Sep 13 20:17:25.501892 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:25.501553 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:17:25.520495 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:25.520448 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" podStartSLOduration=17.520433872 podStartE2EDuration="17.520433872s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:17:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:17:25.519331425 +0000 UTC m=+275.335906986" watchObservedRunningTime="2026-09-13 20:17:25.520433872 +0000 UTC m=+275.337009435" Sep 13 20:17:29.409125 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:29.409091 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:29.409502 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:29.409136 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d734676-73f6-4aa1-a8aa-025293c8393e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:29.409686 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:29.409666 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/7d734676-73f6-4aa1-a8aa-025293c8393e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:29.411403 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:29.411372 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/7d734676-73f6-4aa1-a8aa-025293c8393e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-btjbg\" (UID: \"7d734676-73f6-4aa1-a8aa-025293c8393e\") " pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:29.507026 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:29.506999 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-btjbg" Sep 13 20:17:29.776237 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:29.776174 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-btjbg"] Sep 13 20:17:29.779050 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:17:29.779023 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d734676_73f6_4aa1_a8aa_025293c8393e.slice/crio-493b4499dd16a24c8af196e75c828cbcffb44560110506cc8dc7d0ecd51a7f10 WatchSource:0}: Error finding container 493b4499dd16a24c8af196e75c828cbcffb44560110506cc8dc7d0ecd51a7f10: Status 404 returned error can't find the container with id 493b4499dd16a24c8af196e75c828cbcffb44560110506cc8dc7d0ecd51a7f10 Sep 13 20:17:30.177286 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:30.177250 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2mhhk" podUID="948ab05f-dc3d-48aa-b295-3ecc708ae659" Sep 13 20:17:30.519958 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:30.519937 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2mhhk" Sep 13 20:17:30.520259 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:30.519944 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-btjbg" event={"ID":"7d734676-73f6-4aa1-a8aa-025293c8393e","Type":"ContainerStarted","Data":"70bf9ffd0916a41766df3eab774dcf9cb7d57a4ab127e0b1d691eeba85bf3892"} Sep 13 20:17:30.520259 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:30.520048 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-btjbg" event={"ID":"7d734676-73f6-4aa1-a8aa-025293c8393e","Type":"ContainerStarted","Data":"493b4499dd16a24c8af196e75c828cbcffb44560110506cc8dc7d0ecd51a7f10"} Sep 13 20:17:31.527915 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:31.527877 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-btjbg" event={"ID":"7d734676-73f6-4aa1-a8aa-025293c8393e","Type":"ContainerStarted","Data":"974a0fc274cd33517d257639c0a39b6d19df3d4e6f46592449039071feb704a6"} Sep 13 20:17:32.532861 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:32.532825 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-btjbg" event={"ID":"7d734676-73f6-4aa1-a8aa-025293c8393e","Type":"ContainerStarted","Data":"1378d0f9f4aeea1c487e1926bf19e9707e97a75220758165fa91d7a21c90e19b"} Sep 13 20:17:32.551619 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:32.551577 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-btjbg" podStartSLOduration=17.430839265 podStartE2EDuration="19.55156295s" totalImagesPullingTime="2.120723685s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:17:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:17:32.551530308 +0000 UTC m=+282.368105872" watchObservedRunningTime="2026-09-13 20:17:32.55156295 +0000 UTC m=+282.368138495" Sep 13 20:17:33.940106 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:33.940048 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:17:33.942381 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:33.942362 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/948ab05f-dc3d-48aa-b295-3ecc708ae659-metrics-tls\") pod \"dns-default-2mhhk\" (UID: \"948ab05f-dc3d-48aa-b295-3ecc708ae659\") " pod="openshift-dns/dns-default-2mhhk" Sep 13 20:17:34.123969 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:34.123941 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9fnqc\"" Sep 13 20:17:34.131892 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:34.131875 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2mhhk" Sep 13 20:17:34.398676 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:34.398648 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2mhhk"] Sep 13 20:17:34.401660 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:17:34.401634 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod948ab05f_dc3d_48aa_b295_3ecc708ae659.slice/crio-02a15e400247b1858754a30f8a3ff6b2e314693d87113fd68c2ae7660d936119 WatchSource:0}: Error finding container 02a15e400247b1858754a30f8a3ff6b2e314693d87113fd68c2ae7660d936119: Status 404 returned error can't find the container with id 02a15e400247b1858754a30f8a3ff6b2e314693d87113fd68c2ae7660d936119 Sep 13 20:17:34.539639 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:34.539605 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2mhhk" event={"ID":"948ab05f-dc3d-48aa-b295-3ecc708ae659","Type":"ContainerStarted","Data":"02a15e400247b1858754a30f8a3ff6b2e314693d87113fd68c2ae7660d936119"} Sep 13 20:17:36.547150 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:36.547115 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2mhhk" event={"ID":"948ab05f-dc3d-48aa-b295-3ecc708ae659","Type":"ContainerStarted","Data":"d3101338557e4fb1327ffc83dd26bd70690bfe563daea3d33497f9750096ad68"} Sep 13 20:17:36.547518 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:36.547189 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2mhhk" event={"ID":"948ab05f-dc3d-48aa-b295-3ecc708ae659","Type":"ContainerStarted","Data":"ff4891ed100edd7af90f2d784cbd5c69b53b4c6946506b4476c43aefa3f21da8"} Sep 13 20:17:36.547518 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:36.547263 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2mhhk" Sep 13 20:17:36.563018 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:36.562973 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2mhhk" podStartSLOduration=251.154585833 podStartE2EDuration="4m12.562961932s" totalImagesPullingTime="1.408376099s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:13:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:17:36.562637139 +0000 UTC m=+286.379212704" watchObservedRunningTime="2026-09-13 20:17:36.562961932 +0000 UTC m=+286.379537496" Sep 13 20:17:37.261733 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:37.261669 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" podUID="aec0a0d3-287e-4a0e-9cd0-3b404b500c22" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 13 20:17:38.762773 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:38.762739 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bbd89c6ff-r4jtc"] Sep 13 20:17:43.103338 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:43.103308 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-gnjx4"] Sep 13 20:17:43.105998 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:43.105983 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-gnjx4" Sep 13 20:17:43.108361 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:43.108328 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Sep 13 20:17:43.108482 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:43.108432 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-4dhzf\"" Sep 13 20:17:43.113377 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:43.113352 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-gnjx4"] Sep 13 20:17:43.200588 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:43.200564 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f8839133-f5f7-4a80-b0c7-9583a22650e2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-gnjx4\" (UID: \"f8839133-f5f7-4a80-b0c7-9583a22650e2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-gnjx4" Sep 13 20:17:43.300819 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:43.300799 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f8839133-f5f7-4a80-b0c7-9583a22650e2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-gnjx4\" (UID: \"f8839133-f5f7-4a80-b0c7-9583a22650e2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-gnjx4" Sep 13 20:17:43.300906 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:43.300892 2561 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Sep 13 20:17:43.300956 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:43.300947 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8839133-f5f7-4a80-b0c7-9583a22650e2-tls-certificates podName:f8839133-f5f7-4a80-b0c7-9583a22650e2 nodeName:}" failed. No retries permitted until 2026-09-13 20:17:43.800933304 +0000 UTC m=+293.617508846 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/f8839133-f5f7-4a80-b0c7-9583a22650e2-tls-certificates") pod "prometheus-operator-admission-webhook-5864cd99d7-gnjx4" (UID: "f8839133-f5f7-4a80-b0c7-9583a22650e2") : secret "prometheus-operator-admission-webhook-tls" not found Sep 13 20:17:43.693027 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:17:43.692990 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-8bbtk" podUID="3a23dc7b-d272-4973-8fa8-439c8db80153" Sep 13 20:17:43.803612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:43.803587 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f8839133-f5f7-4a80-b0c7-9583a22650e2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-gnjx4\" (UID: \"f8839133-f5f7-4a80-b0c7-9583a22650e2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-gnjx4" Sep 13 20:17:43.805923 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:43.805896 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f8839133-f5f7-4a80-b0c7-9583a22650e2-tls-certificates\") pod \"prometheus-operator-admission-webhook-5864cd99d7-gnjx4\" (UID: \"f8839133-f5f7-4a80-b0c7-9583a22650e2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-gnjx4" Sep 13 20:17:44.015361 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:44.015286 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-gnjx4" Sep 13 20:17:44.278729 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:44.278657 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-gnjx4"] Sep 13 20:17:44.281448 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:17:44.281424 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8839133_f5f7_4a80_b0c7_9583a22650e2.slice/crio-119e7e2b863777c56d671f9fe921cbc7729fc00496ce4d8208b617dc12acd9dd WatchSource:0}: Error finding container 119e7e2b863777c56d671f9fe921cbc7729fc00496ce4d8208b617dc12acd9dd: Status 404 returned error can't find the container with id 119e7e2b863777c56d671f9fe921cbc7729fc00496ce4d8208b617dc12acd9dd Sep 13 20:17:44.572481 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:44.572406 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-gnjx4" event={"ID":"f8839133-f5f7-4a80-b0c7-9583a22650e2","Type":"ContainerStarted","Data":"119e7e2b863777c56d671f9fe921cbc7729fc00496ce4d8208b617dc12acd9dd"} Sep 13 20:17:45.576514 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:45.576482 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-gnjx4" event={"ID":"f8839133-f5f7-4a80-b0c7-9583a22650e2","Type":"ContainerStarted","Data":"531e743aeed09dca92cf1d1429834574fa6da37c866fe76546863d3c4c3713fe"} Sep 13 20:17:45.576852 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:45.576684 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-gnjx4" Sep 13 20:17:45.581458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:45.581429 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-gnjx4" Sep 13 20:17:45.590884 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:45.590843 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5864cd99d7-gnjx4" podStartSLOduration=1.495166885 podStartE2EDuration="2.590828858s" totalImagesPullingTime="1.095661973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:17:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:17:45.590173305 +0000 UTC m=+295.406748863" watchObservedRunningTime="2026-09-13 20:17:45.590828858 +0000 UTC m=+295.407404421" Sep 13 20:17:46.552271 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:46.552242 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2mhhk" Sep 13 20:17:47.261551 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:47.261517 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" podUID="aec0a0d3-287e-4a0e-9cd0-3b404b500c22" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 13 20:17:48.768165 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:48.768131 2561 patch_prober.go:28] interesting pod/image-registry-5bbd89c6ff-r4jtc container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Sep 13 20:17:48.768499 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:48.768179 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" podUID="de38e26d-5a9a-496b-a503-f1330a0ecb49" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 13 20:17:50.516173 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.516140 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-c78jc"] Sep 13 20:17:50.519213 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.519193 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.521891 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.521855 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 13 20:17:50.522190 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.522171 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 13 20:17:50.522513 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.522496 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 13 20:17:50.522666 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.522644 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb"] Sep 13 20:17:50.523035 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.523014 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 13 20:17:50.523035 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.523025 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 13 20:17:50.523213 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.523084 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hkdjk\"" Sep 13 20:17:50.523213 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.523085 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 13 20:17:50.526104 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.526008 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" Sep 13 20:17:50.528357 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.528335 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gl4g7\"" Sep 13 20:17:50.528357 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.528348 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 13 20:17:50.528510 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.528495 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 13 20:17:50.528643 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.528629 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 13 20:17:50.535335 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.535315 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb"] Sep 13 20:17:50.598208 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.598171 2561 kubelet.go:1648] "Image garbage collection succeeded" Sep 13 20:17:50.648049 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.648028 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a03fd19-2202-4788-91a1-07cce1d7571d-node-exporter-tls\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.648148 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.648055 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb6ed232-0d31-4001-a956-5b9f25463dea-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-wxhbb\" (UID: \"eb6ed232-0d31-4001-a956-5b9f25463dea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" Sep 13 20:17:50.648148 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.648108 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6q477\" (UniqueName: \"kubernetes.io/projected/8a03fd19-2202-4788-91a1-07cce1d7571d-kube-api-access-6q477\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.648229 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.648156 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb6ed232-0d31-4001-a956-5b9f25463dea-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-wxhbb\" (UID: \"eb6ed232-0d31-4001-a956-5b9f25463dea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" Sep 13 20:17:50.648229 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.648182 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8a03fd19-2202-4788-91a1-07cce1d7571d-node-exporter-wtmp\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.648229 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.648204 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8a03fd19-2202-4788-91a1-07cce1d7571d-node-exporter-textfile\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.648321 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.648230 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8a03fd19-2202-4788-91a1-07cce1d7571d-node-exporter-accelerators-collector-config\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.648321 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.648251 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a03fd19-2202-4788-91a1-07cce1d7571d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.648321 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.648267 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/eb6ed232-0d31-4001-a956-5b9f25463dea-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-wxhbb\" (UID: \"eb6ed232-0d31-4001-a956-5b9f25463dea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" Sep 13 20:17:50.648321 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.648283 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwb4x\" (UniqueName: \"kubernetes.io/projected/eb6ed232-0d31-4001-a956-5b9f25463dea-kube-api-access-kwb4x\") pod \"kube-state-metrics-59fbdd77d-wxhbb\" (UID: \"eb6ed232-0d31-4001-a956-5b9f25463dea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" Sep 13 20:17:50.648438 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.648352 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8a03fd19-2202-4788-91a1-07cce1d7571d-root\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.648438 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.648369 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a03fd19-2202-4788-91a1-07cce1d7571d-sys\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.648438 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.648388 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/eb6ed232-0d31-4001-a956-5b9f25463dea-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-wxhbb\" (UID: \"eb6ed232-0d31-4001-a956-5b9f25463dea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" Sep 13 20:17:50.648438 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.648417 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a03fd19-2202-4788-91a1-07cce1d7571d-metrics-client-ca\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.648555 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.648439 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb6ed232-0d31-4001-a956-5b9f25463dea-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-wxhbb\" (UID: \"eb6ed232-0d31-4001-a956-5b9f25463dea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" Sep 13 20:17:50.749216 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.749040 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a03fd19-2202-4788-91a1-07cce1d7571d-sys\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.749216 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.749106 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/eb6ed232-0d31-4001-a956-5b9f25463dea-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-wxhbb\" (UID: \"eb6ed232-0d31-4001-a956-5b9f25463dea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" Sep 13 20:17:50.749216 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.749118 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8a03fd19-2202-4788-91a1-07cce1d7571d-sys\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.749216 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.749151 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a03fd19-2202-4788-91a1-07cce1d7571d-metrics-client-ca\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.749216 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.749177 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb6ed232-0d31-4001-a956-5b9f25463dea-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-wxhbb\" (UID: \"eb6ed232-0d31-4001-a956-5b9f25463dea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" Sep 13 20:17:50.749216 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.749206 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a03fd19-2202-4788-91a1-07cce1d7571d-node-exporter-tls\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.785876 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.749232 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb6ed232-0d31-4001-a956-5b9f25463dea-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-wxhbb\" (UID: \"eb6ed232-0d31-4001-a956-5b9f25463dea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" Sep 13 20:17:50.785876 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.749266 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6q477\" (UniqueName: \"kubernetes.io/projected/8a03fd19-2202-4788-91a1-07cce1d7571d-kube-api-access-6q477\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.785876 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.749294 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb6ed232-0d31-4001-a956-5b9f25463dea-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-wxhbb\" (UID: \"eb6ed232-0d31-4001-a956-5b9f25463dea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" Sep 13 20:17:50.785876 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.749319 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8a03fd19-2202-4788-91a1-07cce1d7571d-node-exporter-wtmp\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.785876 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.749351 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8a03fd19-2202-4788-91a1-07cce1d7571d-node-exporter-textfile\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.785876 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.749377 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8a03fd19-2202-4788-91a1-07cce1d7571d-node-exporter-accelerators-collector-config\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.785876 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.749401 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a03fd19-2202-4788-91a1-07cce1d7571d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.785876 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.749425 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/eb6ed232-0d31-4001-a956-5b9f25463dea-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-wxhbb\" (UID: \"eb6ed232-0d31-4001-a956-5b9f25463dea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" Sep 13 20:17:50.785876 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.749452 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwb4x\" (UniqueName: \"kubernetes.io/projected/eb6ed232-0d31-4001-a956-5b9f25463dea-kube-api-access-kwb4x\") pod \"kube-state-metrics-59fbdd77d-wxhbb\" (UID: \"eb6ed232-0d31-4001-a956-5b9f25463dea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" Sep 13 20:17:50.785876 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.749481 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/8a03fd19-2202-4788-91a1-07cce1d7571d-node-exporter-wtmp\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.785876 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.749491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8a03fd19-2202-4788-91a1-07cce1d7571d-root\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.785876 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.749494 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/eb6ed232-0d31-4001-a956-5b9f25463dea-volume-directive-shadow\") pod \"kube-state-metrics-59fbdd77d-wxhbb\" (UID: \"eb6ed232-0d31-4001-a956-5b9f25463dea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" Sep 13 20:17:50.785876 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.749528 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/8a03fd19-2202-4788-91a1-07cce1d7571d-root\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.785876 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.749715 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/8a03fd19-2202-4788-91a1-07cce1d7571d-node-exporter-textfile\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.785876 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.751808 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 13 20:17:50.785876 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.751808 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 13 20:17:50.785876 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.751902 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 13 20:17:50.785876 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.752103 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 13 20:17:50.785876 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.752134 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 13 20:17:50.786450 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.752164 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 13 20:17:50.786450 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.752652 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 13 20:17:50.786450 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.757031 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 13 20:17:50.786450 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.760391 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8a03fd19-2202-4788-91a1-07cce1d7571d-metrics-client-ca\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.786450 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.760403 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/8a03fd19-2202-4788-91a1-07cce1d7571d-node-exporter-accelerators-collector-config\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.786450 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.760511 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb6ed232-0d31-4001-a956-5b9f25463dea-metrics-client-ca\") pod \"kube-state-metrics-59fbdd77d-wxhbb\" (UID: \"eb6ed232-0d31-4001-a956-5b9f25463dea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" Sep 13 20:17:50.786450 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.760984 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/eb6ed232-0d31-4001-a956-5b9f25463dea-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-59fbdd77d-wxhbb\" (UID: \"eb6ed232-0d31-4001-a956-5b9f25463dea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" Sep 13 20:17:50.786450 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.762202 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8a03fd19-2202-4788-91a1-07cce1d7571d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.786450 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.762273 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/8a03fd19-2202-4788-91a1-07cce1d7571d-node-exporter-tls\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.786450 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.762277 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb6ed232-0d31-4001-a956-5b9f25463dea-kube-state-metrics-tls\") pod \"kube-state-metrics-59fbdd77d-wxhbb\" (UID: \"eb6ed232-0d31-4001-a956-5b9f25463dea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" Sep 13 20:17:50.786450 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.762614 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb6ed232-0d31-4001-a956-5b9f25463dea-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-59fbdd77d-wxhbb\" (UID: \"eb6ed232-0d31-4001-a956-5b9f25463dea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" Sep 13 20:17:50.786450 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.767274 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 13 20:17:50.786450 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.778258 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwb4x\" (UniqueName: \"kubernetes.io/projected/eb6ed232-0d31-4001-a956-5b9f25463dea-kube-api-access-kwb4x\") pod \"kube-state-metrics-59fbdd77d-wxhbb\" (UID: \"eb6ed232-0d31-4001-a956-5b9f25463dea\") " pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" Sep 13 20:17:50.786450 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.778450 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6q477\" (UniqueName: \"kubernetes.io/projected/8a03fd19-2202-4788-91a1-07cce1d7571d-kube-api-access-6q477\") pod \"node-exporter-c78jc\" (UID: \"8a03fd19-2202-4788-91a1-07cce1d7571d\") " pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.831816 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.831791 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hkdjk\"" Sep 13 20:17:50.836464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.836444 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-gl4g7\"" Sep 13 20:17:50.840259 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.840247 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-c78jc" Sep 13 20:17:50.844657 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:50.844641 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" Sep 13 20:17:50.850508 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:17:50.850484 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a03fd19_2202_4788_91a1_07cce1d7571d.slice/crio-193341f961a8563481ed66191644d22e3d415b44894ce1b31e80c385c0035517 WatchSource:0}: Error finding container 193341f961a8563481ed66191644d22e3d415b44894ce1b31e80c385c0035517: Status 404 returned error can't find the container with id 193341f961a8563481ed66191644d22e3d415b44894ce1b31e80c385c0035517 Sep 13 20:17:51.114518 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.114487 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb"] Sep 13 20:17:51.118422 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:17:51.118398 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb6ed232_0d31_4001_a956_5b9f25463dea.slice/crio-5735cc3bfbf91f39b968f48678d57a4a5a7121b17da03052b29c7f9298d4415c WatchSource:0}: Error finding container 5735cc3bfbf91f39b968f48678d57a4a5a7121b17da03052b29c7f9298d4415c: Status 404 returned error can't find the container with id 5735cc3bfbf91f39b968f48678d57a4a5a7121b17da03052b29c7f9298d4415c Sep 13 20:17:51.584548 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.584468 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 13 20:17:51.588626 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.588604 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.591193 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.591171 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 13 20:17:51.591193 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.591188 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 13 20:17:51.591356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.591171 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 13 20:17:51.591356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.591238 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 13 20:17:51.591604 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.591547 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 13 20:17:51.591697 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.591657 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 13 20:17:51.591889 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.591867 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 13 20:17:51.591889 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.591883 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9gfdd\"" Sep 13 20:17:51.592008 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.591867 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 13 20:17:51.592008 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.591867 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 13 20:17:51.597754 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.597725 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" event={"ID":"eb6ed232-0d31-4001-a956-5b9f25463dea","Type":"ContainerStarted","Data":"5735cc3bfbf91f39b968f48678d57a4a5a7121b17da03052b29c7f9298d4415c"} Sep 13 20:17:51.599219 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.599159 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c78jc" event={"ID":"8a03fd19-2202-4788-91a1-07cce1d7571d","Type":"ContainerStarted","Data":"193341f961a8563481ed66191644d22e3d415b44894ce1b31e80c385c0035517"} Sep 13 20:17:51.600749 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.600729 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 13 20:17:51.655364 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.655339 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aaa36711-2596-4f52-afdd-fb91da9bbca1-config-out\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.655460 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.655381 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-web-config\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.655460 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.655406 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.655536 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.655458 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaa36711-2596-4f52-afdd-fb91da9bbca1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.655536 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.655484 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.655536 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.655509 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-config-volume\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.655650 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.655539 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.655650 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.655567 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.655650 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.655582 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.655650 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.655597 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aaa36711-2596-4f52-afdd-fb91da9bbca1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.655650 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.655623 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaa36711-2596-4f52-afdd-fb91da9bbca1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.655839 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.655680 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aaa36711-2596-4f52-afdd-fb91da9bbca1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.655839 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.655712 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwrzs\" (UniqueName: \"kubernetes.io/projected/aaa36711-2596-4f52-afdd-fb91da9bbca1-kube-api-access-bwrzs\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.756155 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.756121 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaa36711-2596-4f52-afdd-fb91da9bbca1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.756334 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.756165 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aaa36711-2596-4f52-afdd-fb91da9bbca1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.756334 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.756191 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwrzs\" (UniqueName: \"kubernetes.io/projected/aaa36711-2596-4f52-afdd-fb91da9bbca1-kube-api-access-bwrzs\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.756334 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.756224 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aaa36711-2596-4f52-afdd-fb91da9bbca1-config-out\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.756334 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.756272 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-web-config\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.756334 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.756302 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.756602 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.756347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaa36711-2596-4f52-afdd-fb91da9bbca1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.756602 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.756375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.756706 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.756641 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aaa36711-2596-4f52-afdd-fb91da9bbca1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.756832 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.756809 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-config-volume\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.756926 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.756857 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.756926 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.756912 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.757028 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.756945 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.757028 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.756970 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aaa36711-2596-4f52-afdd-fb91da9bbca1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.757155 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.757117 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaa36711-2596-4f52-afdd-fb91da9bbca1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.757210 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.757158 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaa36711-2596-4f52-afdd-fb91da9bbca1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.759289 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.759268 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.759460 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.759434 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-web-config\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.760053 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.760028 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aaa36711-2596-4f52-afdd-fb91da9bbca1-config-out\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.760053 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.760038 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.760053 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.760028 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.760242 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.760160 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-config-volume\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.761177 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.761141 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.761270 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.761186 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aaa36711-2596-4f52-afdd-fb91da9bbca1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.761536 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.761519 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.763654 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.763626 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwrzs\" (UniqueName: \"kubernetes.io/projected/aaa36711-2596-4f52-afdd-fb91da9bbca1-kube-api-access-bwrzs\") pod \"alertmanager-main-0\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:51.900323 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:51.900296 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:17:52.177705 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:52.177636 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 13 20:17:52.180554 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:17:52.180526 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaa36711_2596_4f52_afdd_fb91da9bbca1.slice/crio-0bb370bcfaf8c0840e1576f4a8491995c9adf96c58a4fa97ac3972e0a05fb144 WatchSource:0}: Error finding container 0bb370bcfaf8c0840e1576f4a8491995c9adf96c58a4fa97ac3972e0a05fb144: Status 404 returned error can't find the container with id 0bb370bcfaf8c0840e1576f4a8491995c9adf96c58a4fa97ac3972e0a05fb144 Sep 13 20:17:52.182610 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:52.182589 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 13 20:17:52.604840 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:52.604810 2561 generic.go:356] "Generic (PLEG): container finished" podID="8a03fd19-2202-4788-91a1-07cce1d7571d" containerID="54402c7da57b2a938bd00d96a61a07b6c2901ee5560c511451a1adbd972510ca" exitCode=0 Sep 13 20:17:52.605318 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:52.604903 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c78jc" event={"ID":"8a03fd19-2202-4788-91a1-07cce1d7571d","Type":"ContainerDied","Data":"54402c7da57b2a938bd00d96a61a07b6c2901ee5560c511451a1adbd972510ca"} Sep 13 20:17:52.606436 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:52.606401 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaa36711-2596-4f52-afdd-fb91da9bbca1","Type":"ContainerStarted","Data":"0bb370bcfaf8c0840e1576f4a8491995c9adf96c58a4fa97ac3972e0a05fb144"} Sep 13 20:17:53.610806 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:53.610778 2561 generic.go:356] "Generic (PLEG): container finished" podID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerID="02157e184702c8bf8c1c7ae29600b61a79decb93bcbbf76f2bfed261eaae591c" exitCode=0 Sep 13 20:17:53.611166 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:53.610866 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaa36711-2596-4f52-afdd-fb91da9bbca1","Type":"ContainerDied","Data":"02157e184702c8bf8c1c7ae29600b61a79decb93bcbbf76f2bfed261eaae591c"} Sep 13 20:17:53.613374 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:53.613344 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" event={"ID":"eb6ed232-0d31-4001-a956-5b9f25463dea","Type":"ContainerStarted","Data":"2debfbc06d3a787706a8a70099c3dea99bdb61b802eaaad83ae2e452ef605d74"} Sep 13 20:17:53.613477 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:53.613400 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" event={"ID":"eb6ed232-0d31-4001-a956-5b9f25463dea","Type":"ContainerStarted","Data":"7c82f5fa6aeffd6eee43d3258d88691beb10f1fe7997f191941b5fdf9ab1bdcd"} Sep 13 20:17:53.613477 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:53.613429 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" event={"ID":"eb6ed232-0d31-4001-a956-5b9f25463dea","Type":"ContainerStarted","Data":"7ad51c8366681f1986f382bb24d71dfe4075481e6dde224bbdbb3e8663d1043b"} Sep 13 20:17:53.615666 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:53.615642 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c78jc" event={"ID":"8a03fd19-2202-4788-91a1-07cce1d7571d","Type":"ContainerStarted","Data":"0cad9bea143831dfc360c582323e33947a8a8f483ab8ccebb6f8a89b0b11d090"} Sep 13 20:17:53.615750 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:53.615685 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-c78jc" event={"ID":"8a03fd19-2202-4788-91a1-07cce1d7571d","Type":"ContainerStarted","Data":"d56343b6499c61b35d480b8331b6830ffb5034231447a0cd2f113484b067af45"} Sep 13 20:17:53.658232 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:53.658192 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-59fbdd77d-wxhbb" podStartSLOduration=2.069341404 podStartE2EDuration="3.658179692s" totalImagesPullingTime="1.588838288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:17:53.656579871 +0000 UTC m=+303.473155436" watchObservedRunningTime="2026-09-13 20:17:53.658179692 +0000 UTC m=+303.474755256" Sep 13 20:17:53.676820 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:53.676787 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-c78jc" podStartSLOduration=2.56192527 podStartE2EDuration="3.67677514s" totalImagesPullingTime="1.053497719s" totalInitContainerRuntime="61.352151ms" isStatefulPod=true podCreationTimestamp="2026-09-13 20:17:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:17:53.675985451 +0000 UTC m=+303.492561050" watchObservedRunningTime="2026-09-13 20:17:53.67677514 +0000 UTC m=+303.493350704" Sep 13 20:17:54.810986 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.810948 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-d4766f978-gdr49"] Sep 13 20:17:54.814127 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.814106 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.816817 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.816797 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Sep 13 20:17:54.817850 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.817830 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Sep 13 20:17:54.817933 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.817913 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Sep 13 20:17:54.818177 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.818155 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-r6nsr\"" Sep 13 20:17:54.818265 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.818244 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-9qm6j3ne3b9ms\"" Sep 13 20:17:54.818345 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.818331 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 13 20:17:54.822696 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.822674 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d4766f978-gdr49"] Sep 13 20:17:54.877766 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.877726 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/937a943d-118b-437a-8e47-bed42c6b759e-secret-metrics-server-tls\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.877941 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.877778 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/937a943d-118b-437a-8e47-bed42c6b759e-client-ca-bundle\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.877941 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.877857 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/937a943d-118b-437a-8e47-bed42c6b759e-audit-log\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.877941 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.877929 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/937a943d-118b-437a-8e47-bed42c6b759e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.878104 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.877976 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkw5j\" (UniqueName: \"kubernetes.io/projected/937a943d-118b-437a-8e47-bed42c6b759e-kube-api-access-fkw5j\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.878104 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.878030 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/937a943d-118b-437a-8e47-bed42c6b759e-metrics-server-audit-profiles\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.878104 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.878084 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/937a943d-118b-437a-8e47-bed42c6b759e-secret-metrics-server-client-certs\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.978456 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.978418 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/937a943d-118b-437a-8e47-bed42c6b759e-audit-log\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.978699 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.978484 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/937a943d-118b-437a-8e47-bed42c6b759e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.978699 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.978512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkw5j\" (UniqueName: \"kubernetes.io/projected/937a943d-118b-437a-8e47-bed42c6b759e-kube-api-access-fkw5j\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.978699 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.978555 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/937a943d-118b-437a-8e47-bed42c6b759e-metrics-server-audit-profiles\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.978699 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.978581 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/937a943d-118b-437a-8e47-bed42c6b759e-secret-metrics-server-client-certs\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.978699 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.978633 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/937a943d-118b-437a-8e47-bed42c6b759e-secret-metrics-server-tls\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.978699 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.978659 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/937a943d-118b-437a-8e47-bed42c6b759e-client-ca-bundle\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.979428 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.979397 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/937a943d-118b-437a-8e47-bed42c6b759e-audit-log\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.980260 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.980118 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/937a943d-118b-437a-8e47-bed42c6b759e-metrics-server-audit-profiles\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.980260 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.980123 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/937a943d-118b-437a-8e47-bed42c6b759e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.981754 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.981733 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/937a943d-118b-437a-8e47-bed42c6b759e-secret-metrics-server-client-certs\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.981931 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.981909 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/937a943d-118b-437a-8e47-bed42c6b759e-client-ca-bundle\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.982012 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.981917 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/937a943d-118b-437a-8e47-bed42c6b759e-secret-metrics-server-tls\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:54.986712 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:54.986689 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkw5j\" (UniqueName: \"kubernetes.io/projected/937a943d-118b-437a-8e47-bed42c6b759e-kube-api-access-fkw5j\") pod \"metrics-server-d4766f978-gdr49\" (UID: \"937a943d-118b-437a-8e47-bed42c6b759e\") " pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:55.124519 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.124468 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:17:55.411466 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.411439 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-d4766f978-gdr49"] Sep 13 20:17:55.420954 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:17:55.420929 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937a943d_118b_437a_8e47_bed42c6b759e.slice/crio-9b1f533e8cacc4987590eb52a3245692a633c548a419070d1e55907bc03df16e WatchSource:0}: Error finding container 9b1f533e8cacc4987590eb52a3245692a633c548a419070d1e55907bc03df16e: Status 404 returned error can't find the container with id 9b1f533e8cacc4987590eb52a3245692a633c548a419070d1e55907bc03df16e Sep 13 20:17:55.630202 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.630112 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaa36711-2596-4f52-afdd-fb91da9bbca1","Type":"ContainerStarted","Data":"a6e562ee37484f5d427e1bcad3cb3bd57b0c9176d89e12714630236d35f795ac"} Sep 13 20:17:55.630202 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.630202 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaa36711-2596-4f52-afdd-fb91da9bbca1","Type":"ContainerStarted","Data":"8f7e36fe8cb300d73694717e831381442a0c419c0a7902047db604afc6d4eab9"} Sep 13 20:17:55.630396 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.630230 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaa36711-2596-4f52-afdd-fb91da9bbca1","Type":"ContainerStarted","Data":"9c80f13a3c791884cb3202cd9792ba79843832815525fbddf65d1ac65bdac112"} Sep 13 20:17:55.630396 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.630254 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaa36711-2596-4f52-afdd-fb91da9bbca1","Type":"ContainerStarted","Data":"c4587c7b1a325357e2bf7013556f0fe1a636908eace94d5dad17068ec9663b38"} Sep 13 20:17:55.630396 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.630284 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaa36711-2596-4f52-afdd-fb91da9bbca1","Type":"ContainerStarted","Data":"ea6f3f616e4e1e958f508be3ca2f195da00e122dc53468666b0f84db67020680"} Sep 13 20:17:55.631222 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.631199 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d4766f978-gdr49" event={"ID":"937a943d-118b-437a-8e47-bed42c6b759e","Type":"ContainerStarted","Data":"9b1f533e8cacc4987590eb52a3245692a633c548a419070d1e55907bc03df16e"} Sep 13 20:17:55.710745 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.710708 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-57c7875ff5-29qdr"] Sep 13 20:17:55.714054 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.714033 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.716319 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.716298 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Sep 13 20:17:55.716453 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.716437 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Sep 13 20:17:55.716712 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.716694 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Sep 13 20:17:55.716784 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.716733 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Sep 13 20:17:55.716998 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.716982 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Sep 13 20:17:55.717094 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.717049 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-stgh4\"" Sep 13 20:17:55.721797 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.721774 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Sep 13 20:17:55.725871 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.725852 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-57c7875ff5-29qdr"] Sep 13 20:17:55.784982 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.784944 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/06ef87de-8e51-4c65-ace2-d35d45883d31-federate-client-tls\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.784982 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.784984 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06ef87de-8e51-4c65-ace2-d35d45883d31-serving-certs-ca-bundle\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.785253 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.785095 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnz2q\" (UniqueName: \"kubernetes.io/projected/06ef87de-8e51-4c65-ace2-d35d45883d31-kube-api-access-gnz2q\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.785253 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.785127 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/06ef87de-8e51-4c65-ace2-d35d45883d31-telemeter-client-tls\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.785253 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.785154 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/06ef87de-8e51-4c65-ace2-d35d45883d31-secret-telemeter-client\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.785253 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.785198 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06ef87de-8e51-4c65-ace2-d35d45883d31-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.785253 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.785238 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06ef87de-8e51-4c65-ace2-d35d45883d31-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.785422 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.785257 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06ef87de-8e51-4c65-ace2-d35d45883d31-metrics-client-ca\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.886218 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.886126 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/06ef87de-8e51-4c65-ace2-d35d45883d31-telemeter-client-tls\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.886218 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.886170 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/06ef87de-8e51-4c65-ace2-d35d45883d31-secret-telemeter-client\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.886218 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.886204 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06ef87de-8e51-4c65-ace2-d35d45883d31-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.886218 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.886227 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06ef87de-8e51-4c65-ace2-d35d45883d31-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.886823 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.886246 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06ef87de-8e51-4c65-ace2-d35d45883d31-metrics-client-ca\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.886823 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.886264 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/06ef87de-8e51-4c65-ace2-d35d45883d31-federate-client-tls\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.886823 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.886290 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06ef87de-8e51-4c65-ace2-d35d45883d31-serving-certs-ca-bundle\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.886823 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.886370 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnz2q\" (UniqueName: \"kubernetes.io/projected/06ef87de-8e51-4c65-ace2-d35d45883d31-kube-api-access-gnz2q\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.887182 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.887155 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06ef87de-8e51-4c65-ace2-d35d45883d31-serving-certs-ca-bundle\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.887271 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.887201 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/06ef87de-8e51-4c65-ace2-d35d45883d31-telemeter-trusted-ca-bundle\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.887271 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.887205 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/06ef87de-8e51-4c65-ace2-d35d45883d31-metrics-client-ca\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.888726 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.888702 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/06ef87de-8e51-4c65-ace2-d35d45883d31-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.888854 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.888835 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/06ef87de-8e51-4c65-ace2-d35d45883d31-secret-telemeter-client\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.888984 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.888965 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/06ef87de-8e51-4c65-ace2-d35d45883d31-telemeter-client-tls\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.889035 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.888981 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/06ef87de-8e51-4c65-ace2-d35d45883d31-federate-client-tls\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:55.893361 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:55.893338 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnz2q\" (UniqueName: \"kubernetes.io/projected/06ef87de-8e51-4c65-ace2-d35d45883d31-kube-api-access-gnz2q\") pod \"telemeter-client-57c7875ff5-29qdr\" (UID: \"06ef87de-8e51-4c65-ace2-d35d45883d31\") " pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:56.025149 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:56.023153 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" Sep 13 20:17:56.315321 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:56.315253 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-57c7875ff5-29qdr"] Sep 13 20:17:56.331501 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:17:56.331459 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06ef87de_8e51_4c65_ace2_d35d45883d31.slice/crio-5b1fdaf8c20aae4944461c82364322eb6f319efbd85c49917ea5af819cc9a072 WatchSource:0}: Error finding container 5b1fdaf8c20aae4944461c82364322eb6f319efbd85c49917ea5af819cc9a072: Status 404 returned error can't find the container with id 5b1fdaf8c20aae4944461c82364322eb6f319efbd85c49917ea5af819cc9a072 Sep 13 20:17:56.639359 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:56.639313 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaa36711-2596-4f52-afdd-fb91da9bbca1","Type":"ContainerStarted","Data":"dcd91937782a9c537f572a6097fbe8a3cd9a3200e2678c2dd52621b34626aa22"} Sep 13 20:17:56.640745 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:56.640715 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" event={"ID":"06ef87de-8e51-4c65-ace2-d35d45883d31","Type":"ContainerStarted","Data":"5b1fdaf8c20aae4944461c82364322eb6f319efbd85c49917ea5af819cc9a072"} Sep 13 20:17:56.664922 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:56.664872 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=1.904977239 podStartE2EDuration="5.664850097s" totalImagesPullingTime="3.740853643s" totalInitContainerRuntime="19.019215ms" isStatefulPod=false podCreationTimestamp="2026-09-13 20:17:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:17:56.66252941 +0000 UTC m=+306.479104999" watchObservedRunningTime="2026-09-13 20:17:56.664850097 +0000 UTC m=+306.481425662" Sep 13 20:17:57.261783 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:57.261697 2561 prober.go:120] "Probe failed" probeType="Liveness" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" podUID="aec0a0d3-287e-4a0e-9cd0-3b404b500c22" containerName="service-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 500" Sep 13 20:17:57.262190 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:57.261794 2561 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" Sep 13 20:17:57.262512 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:57.262443 2561 kuberuntime_manager.go:1192] "Message for Container of pod" containerName="service-proxy" containerStatusID={"Type":"cri-o","ID":"c3f5c24853a3c606c8a08dffeebe1663dff51f5c127bf67d7757a265303fd795"} pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" containerMessage="Container service-proxy failed liveness probe, will be restarted" Sep 13 20:17:57.262557 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:57.262539 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" podUID="aec0a0d3-287e-4a0e-9cd0-3b404b500c22" containerName="service-proxy" containerID="cri-o://c3f5c24853a3c606c8a08dffeebe1663dff51f5c127bf67d7757a265303fd795" gracePeriod=30 Sep 13 20:17:57.645531 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:57.645494 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-d4766f978-gdr49" event={"ID":"937a943d-118b-437a-8e47-bed42c6b759e","Type":"ContainerStarted","Data":"544ffa1a3fd3e5afe06e89b674d2621426c8700ff561405334a402a8744424b4"} Sep 13 20:17:57.647988 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:57.647963 2561 generic.go:356] "Generic (PLEG): container finished" podID="aec0a0d3-287e-4a0e-9cd0-3b404b500c22" containerID="c3f5c24853a3c606c8a08dffeebe1663dff51f5c127bf67d7757a265303fd795" exitCode=2 Sep 13 20:17:57.648123 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:57.648027 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" event={"ID":"aec0a0d3-287e-4a0e-9cd0-3b404b500c22","Type":"ContainerDied","Data":"c3f5c24853a3c606c8a08dffeebe1663dff51f5c127bf67d7757a265303fd795"} Sep 13 20:17:57.648123 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:57.648080 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-848cf47757-bk67j" event={"ID":"aec0a0d3-287e-4a0e-9cd0-3b404b500c22","Type":"ContainerStarted","Data":"7b72ed93e34ce2d193c216501082fd54005defb7210a45f8476c52e5d77b0b37"} Sep 13 20:17:57.661999 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:57.661943 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-d4766f978-gdr49" podStartSLOduration=2.200924539 podStartE2EDuration="3.661922131s" totalImagesPullingTime="1.460997592s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:17:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:17:57.660983204 +0000 UTC m=+307.477558770" watchObservedRunningTime="2026-09-13 20:17:57.661922131 +0000 UTC m=+307.478497701" Sep 13 20:17:57.691266 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:57.691241 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:17:58.653618 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:58.653581 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" event={"ID":"06ef87de-8e51-4c65-ace2-d35d45883d31","Type":"ContainerStarted","Data":"f84224db6c3331a6e0ff8e178ae2efb288dbffd4903dadefa09a52b98aecff7e"} Sep 13 20:17:58.653977 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:58.653664 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" event={"ID":"06ef87de-8e51-4c65-ace2-d35d45883d31","Type":"ContainerStarted","Data":"7588a0bcb3aa2d0767f9216ae9d3cb41bf796f4e7301ca3dc48b89a748faaa52"} Sep 13 20:17:58.653977 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:58.653685 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" event={"ID":"06ef87de-8e51-4c65-ace2-d35d45883d31","Type":"ContainerStarted","Data":"ba798907ca0a15ca784a13c6e4b9536efc726c0463b590bf30cf54c83e351b9d"} Sep 13 20:17:58.676939 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:58.676886 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-57c7875ff5-29qdr" podStartSLOduration=1.701199066 podStartE2EDuration="3.676870942s" totalImagesPullingTime="1.975671876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:17:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:17:58.675807193 +0000 UTC m=+308.492382757" watchObservedRunningTime="2026-09-13 20:17:58.676870942 +0000 UTC m=+308.493446505" Sep 13 20:17:58.766852 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:17:58.766823 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:18:03.780909 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:03.780848 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" podUID="de38e26d-5a9a-496b-a503-f1330a0ecb49" containerName="registry" containerID="cri-o://9437a0cd25264576949a002403278a11810cc35b56b8a7c7ef96fa4b01b1e7aa" gracePeriod=30 Sep 13 20:18:04.020530 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.020506 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:18:04.048470 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.048384 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95p57\" (UniqueName: \"kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-kube-api-access-95p57\") pod \"de38e26d-5a9a-496b-a503-f1330a0ecb49\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " Sep 13 20:18:04.048470 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.048419 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-certificates\") pod \"de38e26d-5a9a-496b-a503-f1330a0ecb49\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " Sep 13 20:18:04.048470 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.048463 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de38e26d-5a9a-496b-a503-f1330a0ecb49-image-registry-private-configuration\") pod \"de38e26d-5a9a-496b-a503-f1330a0ecb49\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " Sep 13 20:18:04.048740 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.048518 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-bound-sa-token\") pod \"de38e26d-5a9a-496b-a503-f1330a0ecb49\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " Sep 13 20:18:04.048740 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.048541 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de38e26d-5a9a-496b-a503-f1330a0ecb49-installation-pull-secrets\") pod \"de38e26d-5a9a-496b-a503-f1330a0ecb49\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " Sep 13 20:18:04.048740 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.048576 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls\") pod \"de38e26d-5a9a-496b-a503-f1330a0ecb49\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " Sep 13 20:18:04.048740 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.048603 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de38e26d-5a9a-496b-a503-f1330a0ecb49-trusted-ca\") pod \"de38e26d-5a9a-496b-a503-f1330a0ecb49\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " Sep 13 20:18:04.048740 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.048630 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de38e26d-5a9a-496b-a503-f1330a0ecb49-ca-trust-extracted\") pod \"de38e26d-5a9a-496b-a503-f1330a0ecb49\" (UID: \"de38e26d-5a9a-496b-a503-f1330a0ecb49\") " Sep 13 20:18:04.048994 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.048961 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "de38e26d-5a9a-496b-a503-f1330a0ecb49" (UID: "de38e26d-5a9a-496b-a503-f1330a0ecb49"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:18:04.049304 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.049263 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de38e26d-5a9a-496b-a503-f1330a0ecb49-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "de38e26d-5a9a-496b-a503-f1330a0ecb49" (UID: "de38e26d-5a9a-496b-a503-f1330a0ecb49"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:18:04.051349 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.051319 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-kube-api-access-95p57" (OuterVolumeSpecName: "kube-api-access-95p57") pod "de38e26d-5a9a-496b-a503-f1330a0ecb49" (UID: "de38e26d-5a9a-496b-a503-f1330a0ecb49"). InnerVolumeSpecName "kube-api-access-95p57". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:18:04.051498 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.051476 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de38e26d-5a9a-496b-a503-f1330a0ecb49-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "de38e26d-5a9a-496b-a503-f1330a0ecb49" (UID: "de38e26d-5a9a-496b-a503-f1330a0ecb49"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:18:04.051571 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.051482 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "de38e26d-5a9a-496b-a503-f1330a0ecb49" (UID: "de38e26d-5a9a-496b-a503-f1330a0ecb49"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:18:04.051618 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.051599 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "de38e26d-5a9a-496b-a503-f1330a0ecb49" (UID: "de38e26d-5a9a-496b-a503-f1330a0ecb49"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:18:04.051949 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.051924 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/de38e26d-5a9a-496b-a503-f1330a0ecb49-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "de38e26d-5a9a-496b-a503-f1330a0ecb49" (UID: "de38e26d-5a9a-496b-a503-f1330a0ecb49"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:18:04.057874 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.057850 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/de38e26d-5a9a-496b-a503-f1330a0ecb49-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "de38e26d-5a9a-496b-a503-f1330a0ecb49" (UID: "de38e26d-5a9a-496b-a503-f1330a0ecb49"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 20:18:04.149352 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.149310 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-tls\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:18:04.149352 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.149342 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/de38e26d-5a9a-496b-a503-f1330a0ecb49-trusted-ca\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:18:04.149352 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.149351 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/de38e26d-5a9a-496b-a503-f1330a0ecb49-ca-trust-extracted\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:18:04.149352 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.149361 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95p57\" (UniqueName: \"kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-kube-api-access-95p57\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:18:04.149610 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.149371 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/de38e26d-5a9a-496b-a503-f1330a0ecb49-registry-certificates\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:18:04.149610 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.149381 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/de38e26d-5a9a-496b-a503-f1330a0ecb49-image-registry-private-configuration\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:18:04.149610 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.149390 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/de38e26d-5a9a-496b-a503-f1330a0ecb49-bound-sa-token\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:18:04.149610 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.149398 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/de38e26d-5a9a-496b-a503-f1330a0ecb49-installation-pull-secrets\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:18:04.676624 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.676589 2561 generic.go:356] "Generic (PLEG): container finished" podID="de38e26d-5a9a-496b-a503-f1330a0ecb49" containerID="9437a0cd25264576949a002403278a11810cc35b56b8a7c7ef96fa4b01b1e7aa" exitCode=0 Sep 13 20:18:04.676793 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.676635 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" Sep 13 20:18:04.676793 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.676658 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" event={"ID":"de38e26d-5a9a-496b-a503-f1330a0ecb49","Type":"ContainerDied","Data":"9437a0cd25264576949a002403278a11810cc35b56b8a7c7ef96fa4b01b1e7aa"} Sep 13 20:18:04.676793 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.676699 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5bbd89c6ff-r4jtc" event={"ID":"de38e26d-5a9a-496b-a503-f1330a0ecb49","Type":"ContainerDied","Data":"a10b6004e45527214d4a83c7912c7033b24a7c5e2f5dfdc345704feda86fba7f"} Sep 13 20:18:04.676793 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.676717 2561 scope.go:117] "RemoveContainer" containerID="9437a0cd25264576949a002403278a11810cc35b56b8a7c7ef96fa4b01b1e7aa" Sep 13 20:18:04.684958 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.684941 2561 scope.go:117] "RemoveContainer" containerID="9437a0cd25264576949a002403278a11810cc35b56b8a7c7ef96fa4b01b1e7aa" Sep 13 20:18:04.685243 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:18:04.685221 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9437a0cd25264576949a002403278a11810cc35b56b8a7c7ef96fa4b01b1e7aa\": container with ID starting with 9437a0cd25264576949a002403278a11810cc35b56b8a7c7ef96fa4b01b1e7aa not found: ID does not exist" containerID="9437a0cd25264576949a002403278a11810cc35b56b8a7c7ef96fa4b01b1e7aa" Sep 13 20:18:04.685307 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.685252 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9437a0cd25264576949a002403278a11810cc35b56b8a7c7ef96fa4b01b1e7aa"} err="failed to get container status \"9437a0cd25264576949a002403278a11810cc35b56b8a7c7ef96fa4b01b1e7aa\": rpc error: code = NotFound desc = could not find container \"9437a0cd25264576949a002403278a11810cc35b56b8a7c7ef96fa4b01b1e7aa\": container with ID starting with 9437a0cd25264576949a002403278a11810cc35b56b8a7c7ef96fa4b01b1e7aa not found: ID does not exist" Sep 13 20:18:04.696285 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.696259 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5bbd89c6ff-r4jtc"] Sep 13 20:18:04.701292 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:04.701275 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5bbd89c6ff-r4jtc"] Sep 13 20:18:05.682179 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:05.682148 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-76f99584f4-w9xl8"] Sep 13 20:18:05.682514 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:05.682412 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de38e26d-5a9a-496b-a503-f1330a0ecb49" containerName="registry" Sep 13 20:18:05.682514 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:05.682423 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="de38e26d-5a9a-496b-a503-f1330a0ecb49" containerName="registry" Sep 13 20:18:05.682514 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:05.682468 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="de38e26d-5a9a-496b-a503-f1330a0ecb49" containerName="registry" Sep 13 20:18:05.687227 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:05.687204 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-w9xl8" Sep 13 20:18:05.691651 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:05.691632 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Sep 13 20:18:05.692007 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:05.691986 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-m8d9n\"" Sep 13 20:18:05.692120 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:05.692105 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Sep 13 20:18:05.701429 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:05.701403 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-w9xl8"] Sep 13 20:18:05.763148 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:05.763111 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlf5p\" (UniqueName: \"kubernetes.io/projected/549374a0-fa86-42fc-9a83-cb70ac440f2d-kube-api-access-qlf5p\") pod \"downloads-76f99584f4-w9xl8\" (UID: \"549374a0-fa86-42fc-9a83-cb70ac440f2d\") " pod="openshift-console/downloads-76f99584f4-w9xl8" Sep 13 20:18:05.863763 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:05.863737 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlf5p\" (UniqueName: \"kubernetes.io/projected/549374a0-fa86-42fc-9a83-cb70ac440f2d-kube-api-access-qlf5p\") pod \"downloads-76f99584f4-w9xl8\" (UID: \"549374a0-fa86-42fc-9a83-cb70ac440f2d\") " pod="openshift-console/downloads-76f99584f4-w9xl8" Sep 13 20:18:05.871042 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:05.871020 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlf5p\" (UniqueName: \"kubernetes.io/projected/549374a0-fa86-42fc-9a83-cb70ac440f2d-kube-api-access-qlf5p\") pod \"downloads-76f99584f4-w9xl8\" (UID: \"549374a0-fa86-42fc-9a83-cb70ac440f2d\") " pod="openshift-console/downloads-76f99584f4-w9xl8" Sep 13 20:18:05.996014 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:05.995945 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-76f99584f4-w9xl8" Sep 13 20:18:06.263986 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:06.263922 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-76f99584f4-w9xl8"] Sep 13 20:18:06.267650 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:18:06.267617 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod549374a0_fa86_42fc_9a83_cb70ac440f2d.slice/crio-dcfa3ccc7e5cf7866c726fbb21e3d4a7e5e230faecf68555ba843d2bdbef25d6 WatchSource:0}: Error finding container dcfa3ccc7e5cf7866c726fbb21e3d4a7e5e230faecf68555ba843d2bdbef25d6: Status 404 returned error can't find the container with id dcfa3ccc7e5cf7866c726fbb21e3d4a7e5e230faecf68555ba843d2bdbef25d6 Sep 13 20:18:06.685979 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:06.685952 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-w9xl8" event={"ID":"549374a0-fa86-42fc-9a83-cb70ac440f2d","Type":"ContainerStarted","Data":"dcfa3ccc7e5cf7866c726fbb21e3d4a7e5e230faecf68555ba843d2bdbef25d6"} Sep 13 20:18:06.695419 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:06.695393 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de38e26d-5a9a-496b-a503-f1330a0ecb49" path="/var/lib/kubelet/pods/de38e26d-5a9a-496b-a503-f1330a0ecb49/volumes" Sep 13 20:18:15.125502 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.125462 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:18:15.125965 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.125541 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:18:15.170138 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.170102 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fdbc7bc49-wg66z"] Sep 13 20:18:15.173723 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.173696 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:15.175999 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.175966 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 13 20:18:15.176141 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.176022 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 13 20:18:15.176141 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.176121 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 13 20:18:15.176229 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.176125 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 13 20:18:15.177248 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.177225 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-njzsp\"" Sep 13 20:18:15.177367 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.177226 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 13 20:18:15.182821 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.182790 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fdbc7bc49-wg66z"] Sep 13 20:18:15.244492 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.244457 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d36e5a6d-bac2-475a-96b8-47515b300773-oauth-serving-cert\") pod \"console-fdbc7bc49-wg66z\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:15.244718 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.244540 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62vtr\" (UniqueName: \"kubernetes.io/projected/d36e5a6d-bac2-475a-96b8-47515b300773-kube-api-access-62vtr\") pod \"console-fdbc7bc49-wg66z\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:15.244718 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.244579 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d36e5a6d-bac2-475a-96b8-47515b300773-console-serving-cert\") pod \"console-fdbc7bc49-wg66z\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:15.244718 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.244638 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d36e5a6d-bac2-475a-96b8-47515b300773-console-config\") pod \"console-fdbc7bc49-wg66z\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:15.244718 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.244675 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d36e5a6d-bac2-475a-96b8-47515b300773-service-ca\") pod \"console-fdbc7bc49-wg66z\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:15.244718 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.244711 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d36e5a6d-bac2-475a-96b8-47515b300773-console-oauth-config\") pod \"console-fdbc7bc49-wg66z\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:15.345841 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.345804 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d36e5a6d-bac2-475a-96b8-47515b300773-oauth-serving-cert\") pod \"console-fdbc7bc49-wg66z\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:15.346034 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.345875 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62vtr\" (UniqueName: \"kubernetes.io/projected/d36e5a6d-bac2-475a-96b8-47515b300773-kube-api-access-62vtr\") pod \"console-fdbc7bc49-wg66z\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:15.346034 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.345916 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d36e5a6d-bac2-475a-96b8-47515b300773-console-serving-cert\") pod \"console-fdbc7bc49-wg66z\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:15.346034 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.345953 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d36e5a6d-bac2-475a-96b8-47515b300773-console-config\") pod \"console-fdbc7bc49-wg66z\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:15.346034 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.345985 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d36e5a6d-bac2-475a-96b8-47515b300773-service-ca\") pod \"console-fdbc7bc49-wg66z\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:15.346034 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.346015 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d36e5a6d-bac2-475a-96b8-47515b300773-console-oauth-config\") pod \"console-fdbc7bc49-wg66z\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:15.346728 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.346679 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d36e5a6d-bac2-475a-96b8-47515b300773-oauth-serving-cert\") pod \"console-fdbc7bc49-wg66z\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:15.346975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.346930 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d36e5a6d-bac2-475a-96b8-47515b300773-console-config\") pod \"console-fdbc7bc49-wg66z\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:15.346975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.346960 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d36e5a6d-bac2-475a-96b8-47515b300773-service-ca\") pod \"console-fdbc7bc49-wg66z\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:15.348748 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.348730 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d36e5a6d-bac2-475a-96b8-47515b300773-console-oauth-config\") pod \"console-fdbc7bc49-wg66z\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:15.349206 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.349181 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d36e5a6d-bac2-475a-96b8-47515b300773-console-serving-cert\") pod \"console-fdbc7bc49-wg66z\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:15.353442 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.353419 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-62vtr\" (UniqueName: \"kubernetes.io/projected/d36e5a6d-bac2-475a-96b8-47515b300773-kube-api-access-62vtr\") pod \"console-fdbc7bc49-wg66z\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:15.485364 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:15.485279 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:22.090556 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:22.090513 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fdbc7bc49-wg66z"] Sep 13 20:18:22.093014 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:18:22.092984 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd36e5a6d_bac2_475a_96b8_47515b300773.slice/crio-765ac7feaf73cf2e749cfd5f6fbad7a04c367baca93ab3f8ea83bc304f6866f6 WatchSource:0}: Error finding container 765ac7feaf73cf2e749cfd5f6fbad7a04c367baca93ab3f8ea83bc304f6866f6: Status 404 returned error can't find the container with id 765ac7feaf73cf2e749cfd5f6fbad7a04c367baca93ab3f8ea83bc304f6866f6 Sep 13 20:18:22.751117 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:22.751054 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-76f99584f4-w9xl8" event={"ID":"549374a0-fa86-42fc-9a83-cb70ac440f2d","Type":"ContainerStarted","Data":"ddfec2abb7630b9ce47ba8e8261bb6bd140366170ed264e472aed3678693ef9b"} Sep 13 20:18:22.751318 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:22.751265 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-76f99584f4-w9xl8" Sep 13 20:18:22.752969 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:22.752785 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdbc7bc49-wg66z" event={"ID":"d36e5a6d-bac2-475a-96b8-47515b300773","Type":"ContainerStarted","Data":"765ac7feaf73cf2e749cfd5f6fbad7a04c367baca93ab3f8ea83bc304f6866f6"} Sep 13 20:18:22.764590 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:22.764569 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-76f99584f4-w9xl8" Sep 13 20:18:22.770152 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:22.770104 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-76f99584f4-w9xl8" podStartSLOduration=2.116373143 podStartE2EDuration="17.770055785s" totalImagesPullingTime="15.653682642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:18:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:18:22.768415418 +0000 UTC m=+332.584990984" watchObservedRunningTime="2026-09-13 20:18:22.770055785 +0000 UTC m=+332.586631351" Sep 13 20:18:24.604293 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:24.604247 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m5jng_d971a502-448a-4f93-9714-3929a9d7b868/serve-healthcheck-canary/0.log" Sep 13 20:18:26.775084 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:26.775020 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdbc7bc49-wg66z" event={"ID":"d36e5a6d-bac2-475a-96b8-47515b300773","Type":"ContainerStarted","Data":"5a46f85b0774d8ed2b8d417b2dcb0f47a558205e63d08ddddff6042675540464"} Sep 13 20:18:26.791961 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:26.791899 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fdbc7bc49-wg66z" podStartSLOduration=7.943755246 podStartE2EDuration="11.791882028s" totalImagesPullingTime="3.848126782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:18:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:18:26.790088076 +0000 UTC m=+336.606663640" watchObservedRunningTime="2026-09-13 20:18:26.791882028 +0000 UTC m=+336.608457592" Sep 13 20:18:34.547468 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:34.547434 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fdbc7bc49-wg66z"] Sep 13 20:18:35.130793 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:35.130766 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:18:35.134834 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:35.134806 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-d4766f978-gdr49" Sep 13 20:18:35.485455 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:35.485376 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:59.565802 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.565762 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-fdbc7bc49-wg66z" podUID="d36e5a6d-bac2-475a-96b8-47515b300773" containerName="console" containerID="cri-o://5a46f85b0774d8ed2b8d417b2dcb0f47a558205e63d08ddddff6042675540464" gracePeriod=15 Sep 13 20:18:59.837092 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.837038 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:59.894313 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.894282 2561 generic.go:356] "Generic (PLEG): container finished" podID="d36e5a6d-bac2-475a-96b8-47515b300773" containerID="5a46f85b0774d8ed2b8d417b2dcb0f47a558205e63d08ddddff6042675540464" exitCode=0 Sep 13 20:18:59.894439 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.894323 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fdbc7bc49-wg66z" Sep 13 20:18:59.894439 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.894324 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdbc7bc49-wg66z" event={"ID":"d36e5a6d-bac2-475a-96b8-47515b300773","Type":"ContainerDied","Data":"5a46f85b0774d8ed2b8d417b2dcb0f47a558205e63d08ddddff6042675540464"} Sep 13 20:18:59.894529 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.894456 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fdbc7bc49-wg66z" event={"ID":"d36e5a6d-bac2-475a-96b8-47515b300773","Type":"ContainerDied","Data":"765ac7feaf73cf2e749cfd5f6fbad7a04c367baca93ab3f8ea83bc304f6866f6"} Sep 13 20:18:59.894529 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.894487 2561 scope.go:117] "RemoveContainer" containerID="5a46f85b0774d8ed2b8d417b2dcb0f47a558205e63d08ddddff6042675540464" Sep 13 20:18:59.902229 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.902214 2561 scope.go:117] "RemoveContainer" containerID="5a46f85b0774d8ed2b8d417b2dcb0f47a558205e63d08ddddff6042675540464" Sep 13 20:18:59.902494 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:18:59.902474 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5a46f85b0774d8ed2b8d417b2dcb0f47a558205e63d08ddddff6042675540464\": container with ID starting with 5a46f85b0774d8ed2b8d417b2dcb0f47a558205e63d08ddddff6042675540464 not found: ID does not exist" containerID="5a46f85b0774d8ed2b8d417b2dcb0f47a558205e63d08ddddff6042675540464" Sep 13 20:18:59.902540 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.902503 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5a46f85b0774d8ed2b8d417b2dcb0f47a558205e63d08ddddff6042675540464"} err="failed to get container status \"5a46f85b0774d8ed2b8d417b2dcb0f47a558205e63d08ddddff6042675540464\": rpc error: code = NotFound desc = could not find container \"5a46f85b0774d8ed2b8d417b2dcb0f47a558205e63d08ddddff6042675540464\": container with ID starting with 5a46f85b0774d8ed2b8d417b2dcb0f47a558205e63d08ddddff6042675540464 not found: ID does not exist" Sep 13 20:18:59.911764 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.911748 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d36e5a6d-bac2-475a-96b8-47515b300773-console-serving-cert\") pod \"d36e5a6d-bac2-475a-96b8-47515b300773\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " Sep 13 20:18:59.911877 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.911772 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d36e5a6d-bac2-475a-96b8-47515b300773-service-ca\") pod \"d36e5a6d-bac2-475a-96b8-47515b300773\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " Sep 13 20:18:59.911877 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.911792 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d36e5a6d-bac2-475a-96b8-47515b300773-console-oauth-config\") pod \"d36e5a6d-bac2-475a-96b8-47515b300773\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " Sep 13 20:18:59.911877 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.911807 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d36e5a6d-bac2-475a-96b8-47515b300773-console-config\") pod \"d36e5a6d-bac2-475a-96b8-47515b300773\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " Sep 13 20:18:59.911877 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.911831 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d36e5a6d-bac2-475a-96b8-47515b300773-oauth-serving-cert\") pod \"d36e5a6d-bac2-475a-96b8-47515b300773\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " Sep 13 20:18:59.912085 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.911957 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62vtr\" (UniqueName: \"kubernetes.io/projected/d36e5a6d-bac2-475a-96b8-47515b300773-kube-api-access-62vtr\") pod \"d36e5a6d-bac2-475a-96b8-47515b300773\" (UID: \"d36e5a6d-bac2-475a-96b8-47515b300773\") " Sep 13 20:18:59.912208 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.912182 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d36e5a6d-bac2-475a-96b8-47515b300773-console-config" (OuterVolumeSpecName: "console-config") pod "d36e5a6d-bac2-475a-96b8-47515b300773" (UID: "d36e5a6d-bac2-475a-96b8-47515b300773"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:18:59.912342 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.912274 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d36e5a6d-bac2-475a-96b8-47515b300773-service-ca" (OuterVolumeSpecName: "service-ca") pod "d36e5a6d-bac2-475a-96b8-47515b300773" (UID: "d36e5a6d-bac2-475a-96b8-47515b300773"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:18:59.912411 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.912342 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d36e5a6d-bac2-475a-96b8-47515b300773-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d36e5a6d-bac2-475a-96b8-47515b300773" (UID: "d36e5a6d-bac2-475a-96b8-47515b300773"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:18:59.913963 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.913942 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d36e5a6d-bac2-475a-96b8-47515b300773-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d36e5a6d-bac2-475a-96b8-47515b300773" (UID: "d36e5a6d-bac2-475a-96b8-47515b300773"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:18:59.913963 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.913953 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d36e5a6d-bac2-475a-96b8-47515b300773-kube-api-access-62vtr" (OuterVolumeSpecName: "kube-api-access-62vtr") pod "d36e5a6d-bac2-475a-96b8-47515b300773" (UID: "d36e5a6d-bac2-475a-96b8-47515b300773"). InnerVolumeSpecName "kube-api-access-62vtr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:18:59.914100 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:18:59.913968 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d36e5a6d-bac2-475a-96b8-47515b300773-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d36e5a6d-bac2-475a-96b8-47515b300773" (UID: "d36e5a6d-bac2-475a-96b8-47515b300773"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:19:00.013547 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:00.013515 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d36e5a6d-bac2-475a-96b8-47515b300773-console-serving-cert\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:19:00.013547 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:00.013541 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d36e5a6d-bac2-475a-96b8-47515b300773-service-ca\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:19:00.013547 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:00.013551 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d36e5a6d-bac2-475a-96b8-47515b300773-console-oauth-config\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:19:00.013731 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:00.013559 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d36e5a6d-bac2-475a-96b8-47515b300773-console-config\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:19:00.013731 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:00.013568 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d36e5a6d-bac2-475a-96b8-47515b300773-oauth-serving-cert\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:19:00.013731 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:00.013577 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62vtr\" (UniqueName: \"kubernetes.io/projected/d36e5a6d-bac2-475a-96b8-47515b300773-kube-api-access-62vtr\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:19:00.214262 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:00.214230 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-fdbc7bc49-wg66z"] Sep 13 20:19:00.218216 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:00.218194 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-fdbc7bc49-wg66z"] Sep 13 20:19:00.695284 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:00.695247 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d36e5a6d-bac2-475a-96b8-47515b300773" path="/var/lib/kubelet/pods/d36e5a6d-bac2-475a-96b8-47515b300773/volumes" Sep 13 20:19:04.444922 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:04.444889 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs\") pod \"network-metrics-daemon-8bbtk\" (UID: \"3a23dc7b-d272-4973-8fa8-439c8db80153\") " pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:19:04.447355 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:04.447326 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3a23dc7b-d272-4973-8fa8-439c8db80153-metrics-certs\") pod \"network-metrics-daemon-8bbtk\" (UID: \"3a23dc7b-d272-4973-8fa8-439c8db80153\") " pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:19:04.594521 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:04.594499 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5c5lx\"" Sep 13 20:19:04.602439 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:04.602420 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8bbtk" Sep 13 20:19:04.919218 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:04.919190 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8bbtk"] Sep 13 20:19:04.922046 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:19:04.922017 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a23dc7b_d272_4973_8fa8_439c8db80153.slice/crio-10d1f6f3bf35a7b338c253b4577006b3114807a2c423d2ea65a6ca3fdedd5e5b WatchSource:0}: Error finding container 10d1f6f3bf35a7b338c253b4577006b3114807a2c423d2ea65a6ca3fdedd5e5b: Status 404 returned error can't find the container with id 10d1f6f3bf35a7b338c253b4577006b3114807a2c423d2ea65a6ca3fdedd5e5b Sep 13 20:19:05.916639 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:05.916609 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8bbtk" event={"ID":"3a23dc7b-d272-4973-8fa8-439c8db80153","Type":"ContainerStarted","Data":"10d1f6f3bf35a7b338c253b4577006b3114807a2c423d2ea65a6ca3fdedd5e5b"} Sep 13 20:19:06.922144 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:06.922093 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8bbtk" event={"ID":"3a23dc7b-d272-4973-8fa8-439c8db80153","Type":"ContainerStarted","Data":"83a72c39bf90e25f21e7c0fdde675a07973f0c8ce70fdaaed16749ae263a3288"} Sep 13 20:19:06.922499 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:06.922171 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8bbtk" event={"ID":"3a23dc7b-d272-4973-8fa8-439c8db80153","Type":"ContainerStarted","Data":"cab1b38bf87396946dc1771a789ca0d0fd34d6ab93cd17e6951397cd650a612d"} Sep 13 20:19:06.940183 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:06.940131 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8bbtk" podStartSLOduration=375.554133824 podStartE2EDuration="6m16.940112328s" totalImagesPullingTime="1.385978504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:12:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:19:06.937691456 +0000 UTC m=+376.754267021" watchObservedRunningTime="2026-09-13 20:19:06.940112328 +0000 UTC m=+376.756687893" Sep 13 20:19:08.666774 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.666741 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78954c94-dpcxh"] Sep 13 20:19:08.667170 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.667051 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d36e5a6d-bac2-475a-96b8-47515b300773" containerName="console" Sep 13 20:19:08.667170 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.667074 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="d36e5a6d-bac2-475a-96b8-47515b300773" containerName="console" Sep 13 20:19:08.667170 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.667130 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="d36e5a6d-bac2-475a-96b8-47515b300773" containerName="console" Sep 13 20:19:08.689096 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.689074 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78954c94-dpcxh"] Sep 13 20:19:08.689214 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.689186 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.691684 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.691653 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Sep 13 20:19:08.691794 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.691653 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Sep 13 20:19:08.692080 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.692035 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-njzsp\"" Sep 13 20:19:08.692229 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.692210 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Sep 13 20:19:08.692306 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.692296 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Sep 13 20:19:08.692407 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.692392 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Sep 13 20:19:08.696495 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.696475 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Sep 13 20:19:08.777706 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.777686 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-oauth-serving-cert\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.777814 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.777717 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-trusted-ca-bundle\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.777814 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.777738 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c69d4a64-0336-4f24-86bf-95b910ca1bdc-console-oauth-config\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.777814 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.777755 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-service-ca\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.777922 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.777823 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c69d4a64-0336-4f24-86bf-95b910ca1bdc-console-serving-cert\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.777922 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.777840 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnj8j\" (UniqueName: \"kubernetes.io/projected/c69d4a64-0336-4f24-86bf-95b910ca1bdc-kube-api-access-vnj8j\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.777922 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.777858 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-console-config\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.878834 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.878806 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-oauth-serving-cert\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.878933 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.878842 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-trusted-ca-bundle\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.878933 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.878866 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c69d4a64-0336-4f24-86bf-95b910ca1bdc-console-oauth-config\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.878933 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.878889 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-service-ca\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.878933 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.878927 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c69d4a64-0336-4f24-86bf-95b910ca1bdc-console-serving-cert\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.879148 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.878953 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnj8j\" (UniqueName: \"kubernetes.io/projected/c69d4a64-0336-4f24-86bf-95b910ca1bdc-kube-api-access-vnj8j\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.879148 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.878985 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-console-config\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.879678 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.879652 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-oauth-serving-cert\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.879801 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.879688 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-console-config\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.879801 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.879784 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-service-ca\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.879910 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.879862 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-trusted-ca-bundle\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.881392 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.881375 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c69d4a64-0336-4f24-86bf-95b910ca1bdc-console-oauth-config\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.881553 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.881533 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c69d4a64-0336-4f24-86bf-95b910ca1bdc-console-serving-cert\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.887168 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.887126 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnj8j\" (UniqueName: \"kubernetes.io/projected/c69d4a64-0336-4f24-86bf-95b910ca1bdc-kube-api-access-vnj8j\") pod \"console-78954c94-dpcxh\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:08.999037 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:08.998977 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:09.297939 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:09.297916 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78954c94-dpcxh"] Sep 13 20:19:09.300334 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:19:09.300305 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69d4a64_0336_4f24_86bf_95b910ca1bdc.slice/crio-e9b3cc10a9b429f94bc7c14e5fb2b7bc83aae12cbc729ec22e734fd20e34664e WatchSource:0}: Error finding container e9b3cc10a9b429f94bc7c14e5fb2b7bc83aae12cbc729ec22e734fd20e34664e: Status 404 returned error can't find the container with id e9b3cc10a9b429f94bc7c14e5fb2b7bc83aae12cbc729ec22e734fd20e34664e Sep 13 20:19:09.935629 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:09.935593 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78954c94-dpcxh" event={"ID":"c69d4a64-0336-4f24-86bf-95b910ca1bdc","Type":"ContainerStarted","Data":"09adf0392f05add59b96803dada78724375dd3ef7815cfb19159f2e6efccefde"} Sep 13 20:19:09.935943 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:09.935641 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78954c94-dpcxh" event={"ID":"c69d4a64-0336-4f24-86bf-95b910ca1bdc","Type":"ContainerStarted","Data":"e9b3cc10a9b429f94bc7c14e5fb2b7bc83aae12cbc729ec22e734fd20e34664e"} Sep 13 20:19:09.952482 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:09.952433 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78954c94-dpcxh" podStartSLOduration=1.9524189299999999 podStartE2EDuration="1.95241893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:19:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:19:09.950760381 +0000 UTC m=+379.767335946" watchObservedRunningTime="2026-09-13 20:19:09.95241893 +0000 UTC m=+379.768994493" Sep 13 20:19:10.837299 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:10.837267 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 13 20:19:10.837597 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:10.837569 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="alertmanager" containerID="cri-o://ea6f3f616e4e1e958f508be3ca2f195da00e122dc53468666b0f84db67020680" gracePeriod=120 Sep 13 20:19:10.837657 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:10.837606 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="kube-rbac-proxy-metric" containerID="cri-o://a6e562ee37484f5d427e1bcad3cb3bd57b0c9176d89e12714630236d35f795ac" gracePeriod=120 Sep 13 20:19:10.837709 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:10.837652 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="kube-rbac-proxy-web" containerID="cri-o://9c80f13a3c791884cb3202cd9792ba79843832815525fbddf65d1ac65bdac112" gracePeriod=120 Sep 13 20:19:10.837709 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:10.837682 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="prom-label-proxy" containerID="cri-o://dcd91937782a9c537f572a6097fbe8a3cd9a3200e2678c2dd52621b34626aa22" gracePeriod=120 Sep 13 20:19:10.837795 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:10.837699 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="config-reloader" containerID="cri-o://c4587c7b1a325357e2bf7013556f0fe1a636908eace94d5dad17068ec9663b38" gracePeriod=120 Sep 13 20:19:10.837847 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:10.837695 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="kube-rbac-proxy" containerID="cri-o://8f7e36fe8cb300d73694717e831381442a0c419c0a7902047db604afc6d4eab9" gracePeriod=120 Sep 13 20:19:11.946869 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:11.946838 2561 generic.go:356] "Generic (PLEG): container finished" podID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerID="dcd91937782a9c537f572a6097fbe8a3cd9a3200e2678c2dd52621b34626aa22" exitCode=0 Sep 13 20:19:11.946869 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:11.946870 2561 generic.go:356] "Generic (PLEG): container finished" podID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerID="8f7e36fe8cb300d73694717e831381442a0c419c0a7902047db604afc6d4eab9" exitCode=0 Sep 13 20:19:11.947190 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:11.946880 2561 generic.go:356] "Generic (PLEG): container finished" podID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerID="c4587c7b1a325357e2bf7013556f0fe1a636908eace94d5dad17068ec9663b38" exitCode=0 Sep 13 20:19:11.947190 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:11.946889 2561 generic.go:356] "Generic (PLEG): container finished" podID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerID="ea6f3f616e4e1e958f508be3ca2f195da00e122dc53468666b0f84db67020680" exitCode=0 Sep 13 20:19:11.947190 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:11.946914 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaa36711-2596-4f52-afdd-fb91da9bbca1","Type":"ContainerDied","Data":"dcd91937782a9c537f572a6097fbe8a3cd9a3200e2678c2dd52621b34626aa22"} Sep 13 20:19:11.947190 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:11.947003 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaa36711-2596-4f52-afdd-fb91da9bbca1","Type":"ContainerDied","Data":"8f7e36fe8cb300d73694717e831381442a0c419c0a7902047db604afc6d4eab9"} Sep 13 20:19:11.947190 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:11.947045 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaa36711-2596-4f52-afdd-fb91da9bbca1","Type":"ContainerDied","Data":"c4587c7b1a325357e2bf7013556f0fe1a636908eace94d5dad17068ec9663b38"} Sep 13 20:19:11.947190 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:11.947108 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaa36711-2596-4f52-afdd-fb91da9bbca1","Type":"ContainerDied","Data":"ea6f3f616e4e1e958f508be3ca2f195da00e122dc53468666b0f84db67020680"} Sep 13 20:19:12.073501 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.073482 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:12.203803 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.203737 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"aaa36711-2596-4f52-afdd-fb91da9bbca1\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " Sep 13 20:19:12.203803 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.203776 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-config-volume\") pod \"aaa36711-2596-4f52-afdd-fb91da9bbca1\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " Sep 13 20:19:12.203803 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.203798 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-kube-rbac-proxy-web\") pod \"aaa36711-2596-4f52-afdd-fb91da9bbca1\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " Sep 13 20:19:12.204013 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.203826 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaa36711-2596-4f52-afdd-fb91da9bbca1-metrics-client-ca\") pod \"aaa36711-2596-4f52-afdd-fb91da9bbca1\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " Sep 13 20:19:12.204013 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.203854 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aaa36711-2596-4f52-afdd-fb91da9bbca1-tls-assets\") pod \"aaa36711-2596-4f52-afdd-fb91da9bbca1\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " Sep 13 20:19:12.204013 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.203881 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-kube-rbac-proxy\") pod \"aaa36711-2596-4f52-afdd-fb91da9bbca1\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " Sep 13 20:19:12.204013 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.203907 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aaa36711-2596-4f52-afdd-fb91da9bbca1-config-out\") pod \"aaa36711-2596-4f52-afdd-fb91da9bbca1\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " Sep 13 20:19:12.204013 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.203942 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-main-tls\") pod \"aaa36711-2596-4f52-afdd-fb91da9bbca1\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " Sep 13 20:19:12.204991 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.204598 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaa36711-2596-4f52-afdd-fb91da9bbca1-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "aaa36711-2596-4f52-afdd-fb91da9bbca1" (UID: "aaa36711-2596-4f52-afdd-fb91da9bbca1"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:19:12.204991 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.204667 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwrzs\" (UniqueName: \"kubernetes.io/projected/aaa36711-2596-4f52-afdd-fb91da9bbca1-kube-api-access-bwrzs\") pod \"aaa36711-2596-4f52-afdd-fb91da9bbca1\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " Sep 13 20:19:12.204991 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.204715 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-cluster-tls-config\") pod \"aaa36711-2596-4f52-afdd-fb91da9bbca1\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " Sep 13 20:19:12.204991 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.204751 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aaa36711-2596-4f52-afdd-fb91da9bbca1-alertmanager-main-db\") pod \"aaa36711-2596-4f52-afdd-fb91da9bbca1\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " Sep 13 20:19:12.204991 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.204786 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-web-config\") pod \"aaa36711-2596-4f52-afdd-fb91da9bbca1\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " Sep 13 20:19:12.204991 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.204852 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaa36711-2596-4f52-afdd-fb91da9bbca1-alertmanager-trusted-ca-bundle\") pod \"aaa36711-2596-4f52-afdd-fb91da9bbca1\" (UID: \"aaa36711-2596-4f52-afdd-fb91da9bbca1\") " Sep 13 20:19:12.205372 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.205049 2561 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aaa36711-2596-4f52-afdd-fb91da9bbca1-metrics-client-ca\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:19:12.205670 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.205428 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aaa36711-2596-4f52-afdd-fb91da9bbca1-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "aaa36711-2596-4f52-afdd-fb91da9bbca1" (UID: "aaa36711-2596-4f52-afdd-fb91da9bbca1"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:19:12.206485 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.206450 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaa36711-2596-4f52-afdd-fb91da9bbca1-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "aaa36711-2596-4f52-afdd-fb91da9bbca1" (UID: "aaa36711-2596-4f52-afdd-fb91da9bbca1"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 20:19:12.206587 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.206562 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "aaa36711-2596-4f52-afdd-fb91da9bbca1" (UID: "aaa36711-2596-4f52-afdd-fb91da9bbca1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:19:12.206783 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.206754 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "aaa36711-2596-4f52-afdd-fb91da9bbca1" (UID: "aaa36711-2596-4f52-afdd-fb91da9bbca1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:19:12.206891 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.206781 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "aaa36711-2596-4f52-afdd-fb91da9bbca1" (UID: "aaa36711-2596-4f52-afdd-fb91da9bbca1"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:19:12.207178 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.207141 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aaa36711-2596-4f52-afdd-fb91da9bbca1-config-out" (OuterVolumeSpecName: "config-out") pod "aaa36711-2596-4f52-afdd-fb91da9bbca1" (UID: "aaa36711-2596-4f52-afdd-fb91da9bbca1"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 13 20:19:12.207261 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.207235 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-config-volume" (OuterVolumeSpecName: "config-volume") pod "aaa36711-2596-4f52-afdd-fb91da9bbca1" (UID: "aaa36711-2596-4f52-afdd-fb91da9bbca1"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:19:12.207350 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.207316 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaa36711-2596-4f52-afdd-fb91da9bbca1-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "aaa36711-2596-4f52-afdd-fb91da9bbca1" (UID: "aaa36711-2596-4f52-afdd-fb91da9bbca1"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:19:12.207415 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.207395 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "aaa36711-2596-4f52-afdd-fb91da9bbca1" (UID: "aaa36711-2596-4f52-afdd-fb91da9bbca1"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:19:12.207950 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.207936 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aaa36711-2596-4f52-afdd-fb91da9bbca1-kube-api-access-bwrzs" (OuterVolumeSpecName: "kube-api-access-bwrzs") pod "aaa36711-2596-4f52-afdd-fb91da9bbca1" (UID: "aaa36711-2596-4f52-afdd-fb91da9bbca1"). InnerVolumeSpecName "kube-api-access-bwrzs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:19:12.211593 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.211572 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "aaa36711-2596-4f52-afdd-fb91da9bbca1" (UID: "aaa36711-2596-4f52-afdd-fb91da9bbca1"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:19:12.217434 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.217415 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-web-config" (OuterVolumeSpecName: "web-config") pod "aaa36711-2596-4f52-afdd-fb91da9bbca1" (UID: "aaa36711-2596-4f52-afdd-fb91da9bbca1"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:19:12.305866 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.305845 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwrzs\" (UniqueName: \"kubernetes.io/projected/aaa36711-2596-4f52-afdd-fb91da9bbca1-kube-api-access-bwrzs\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:19:12.305928 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.305865 2561 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-cluster-tls-config\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:19:12.305928 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.305876 2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/aaa36711-2596-4f52-afdd-fb91da9bbca1-alertmanager-main-db\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:19:12.305928 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.305885 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-web-config\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:19:12.305928 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.305894 2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/aaa36711-2596-4f52-afdd-fb91da9bbca1-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:19:12.305928 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.305903 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:19:12.305928 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.305912 2561 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-config-volume\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:19:12.305928 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.305922 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:19:12.305928 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.305930 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/aaa36711-2596-4f52-afdd-fb91da9bbca1-tls-assets\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:19:12.306205 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.305938 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:19:12.306205 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.305946 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/aaa36711-2596-4f52-afdd-fb91da9bbca1-config-out\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:19:12.306205 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.305955 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/aaa36711-2596-4f52-afdd-fb91da9bbca1-secret-alertmanager-main-tls\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:19:12.953882 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.953819 2561 generic.go:356] "Generic (PLEG): container finished" podID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerID="a6e562ee37484f5d427e1bcad3cb3bd57b0c9176d89e12714630236d35f795ac" exitCode=0 Sep 13 20:19:12.953882 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.953843 2561 generic.go:356] "Generic (PLEG): container finished" podID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerID="9c80f13a3c791884cb3202cd9792ba79843832815525fbddf65d1ac65bdac112" exitCode=0 Sep 13 20:19:12.953882 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.953872 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaa36711-2596-4f52-afdd-fb91da9bbca1","Type":"ContainerDied","Data":"a6e562ee37484f5d427e1bcad3cb3bd57b0c9176d89e12714630236d35f795ac"} Sep 13 20:19:12.954324 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.953882 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:12.954324 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.953928 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaa36711-2596-4f52-afdd-fb91da9bbca1","Type":"ContainerDied","Data":"9c80f13a3c791884cb3202cd9792ba79843832815525fbddf65d1ac65bdac112"} Sep 13 20:19:12.954324 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.953954 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"aaa36711-2596-4f52-afdd-fb91da9bbca1","Type":"ContainerDied","Data":"0bb370bcfaf8c0840e1576f4a8491995c9adf96c58a4fa97ac3972e0a05fb144"} Sep 13 20:19:12.954324 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.953983 2561 scope.go:117] "RemoveContainer" containerID="dcd91937782a9c537f572a6097fbe8a3cd9a3200e2678c2dd52621b34626aa22" Sep 13 20:19:12.963178 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.963157 2561 scope.go:117] "RemoveContainer" containerID="a6e562ee37484f5d427e1bcad3cb3bd57b0c9176d89e12714630236d35f795ac" Sep 13 20:19:12.969988 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.969973 2561 scope.go:117] "RemoveContainer" containerID="8f7e36fe8cb300d73694717e831381442a0c419c0a7902047db604afc6d4eab9" Sep 13 20:19:12.976617 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.976589 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 13 20:19:12.980251 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.980230 2561 scope.go:117] "RemoveContainer" containerID="9c80f13a3c791884cb3202cd9792ba79843832815525fbddf65d1ac65bdac112" Sep 13 20:19:12.981715 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.981695 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 13 20:19:12.986695 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.986677 2561 scope.go:117] "RemoveContainer" containerID="c4587c7b1a325357e2bf7013556f0fe1a636908eace94d5dad17068ec9663b38" Sep 13 20:19:12.993020 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.993005 2561 scope.go:117] "RemoveContainer" containerID="ea6f3f616e4e1e958f508be3ca2f195da00e122dc53468666b0f84db67020680" Sep 13 20:19:12.999668 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:12.999654 2561 scope.go:117] "RemoveContainer" containerID="02157e184702c8bf8c1c7ae29600b61a79decb93bcbbf76f2bfed261eaae591c" Sep 13 20:19:13.006564 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.006543 2561 scope.go:117] "RemoveContainer" containerID="dcd91937782a9c537f572a6097fbe8a3cd9a3200e2678c2dd52621b34626aa22" Sep 13 20:19:13.006829 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:19:13.006812 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcd91937782a9c537f572a6097fbe8a3cd9a3200e2678c2dd52621b34626aa22\": container with ID starting with dcd91937782a9c537f572a6097fbe8a3cd9a3200e2678c2dd52621b34626aa22 not found: ID does not exist" containerID="dcd91937782a9c537f572a6097fbe8a3cd9a3200e2678c2dd52621b34626aa22" Sep 13 20:19:13.006891 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.006836 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcd91937782a9c537f572a6097fbe8a3cd9a3200e2678c2dd52621b34626aa22"} err="failed to get container status \"dcd91937782a9c537f572a6097fbe8a3cd9a3200e2678c2dd52621b34626aa22\": rpc error: code = NotFound desc = could not find container \"dcd91937782a9c537f572a6097fbe8a3cd9a3200e2678c2dd52621b34626aa22\": container with ID starting with dcd91937782a9c537f572a6097fbe8a3cd9a3200e2678c2dd52621b34626aa22 not found: ID does not exist" Sep 13 20:19:13.006891 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.006852 2561 scope.go:117] "RemoveContainer" containerID="a6e562ee37484f5d427e1bcad3cb3bd57b0c9176d89e12714630236d35f795ac" Sep 13 20:19:13.007129 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:19:13.007115 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6e562ee37484f5d427e1bcad3cb3bd57b0c9176d89e12714630236d35f795ac\": container with ID starting with a6e562ee37484f5d427e1bcad3cb3bd57b0c9176d89e12714630236d35f795ac not found: ID does not exist" containerID="a6e562ee37484f5d427e1bcad3cb3bd57b0c9176d89e12714630236d35f795ac" Sep 13 20:19:13.007175 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007133 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6e562ee37484f5d427e1bcad3cb3bd57b0c9176d89e12714630236d35f795ac"} err="failed to get container status \"a6e562ee37484f5d427e1bcad3cb3bd57b0c9176d89e12714630236d35f795ac\": rpc error: code = NotFound desc = could not find container \"a6e562ee37484f5d427e1bcad3cb3bd57b0c9176d89e12714630236d35f795ac\": container with ID starting with a6e562ee37484f5d427e1bcad3cb3bd57b0c9176d89e12714630236d35f795ac not found: ID does not exist" Sep 13 20:19:13.007175 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007152 2561 scope.go:117] "RemoveContainer" containerID="8f7e36fe8cb300d73694717e831381442a0c419c0a7902047db604afc6d4eab9" Sep 13 20:19:13.007245 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007217 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 13 20:19:13.007363 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:19:13.007350 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f7e36fe8cb300d73694717e831381442a0c419c0a7902047db604afc6d4eab9\": container with ID starting with 8f7e36fe8cb300d73694717e831381442a0c419c0a7902047db604afc6d4eab9 not found: ID does not exist" containerID="8f7e36fe8cb300d73694717e831381442a0c419c0a7902047db604afc6d4eab9" Sep 13 20:19:13.007396 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007365 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f7e36fe8cb300d73694717e831381442a0c419c0a7902047db604afc6d4eab9"} err="failed to get container status \"8f7e36fe8cb300d73694717e831381442a0c419c0a7902047db604afc6d4eab9\": rpc error: code = NotFound desc = could not find container \"8f7e36fe8cb300d73694717e831381442a0c419c0a7902047db604afc6d4eab9\": container with ID starting with 8f7e36fe8cb300d73694717e831381442a0c419c0a7902047db604afc6d4eab9 not found: ID does not exist" Sep 13 20:19:13.007396 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007375 2561 scope.go:117] "RemoveContainer" containerID="9c80f13a3c791884cb3202cd9792ba79843832815525fbddf65d1ac65bdac112" Sep 13 20:19:13.007526 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007510 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="config-reloader" Sep 13 20:19:13.007567 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007530 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="config-reloader" Sep 13 20:19:13.007567 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007550 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="kube-rbac-proxy-metric" Sep 13 20:19:13.007567 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007559 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="kube-rbac-proxy-metric" Sep 13 20:19:13.007656 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007570 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="alertmanager" Sep 13 20:19:13.007656 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007576 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="alertmanager" Sep 13 20:19:13.007656 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007583 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="kube-rbac-proxy" Sep 13 20:19:13.007656 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007588 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="kube-rbac-proxy" Sep 13 20:19:13.007656 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007596 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="kube-rbac-proxy-web" Sep 13 20:19:13.007656 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007600 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="kube-rbac-proxy-web" Sep 13 20:19:13.007656 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007606 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="prom-label-proxy" Sep 13 20:19:13.007656 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:19:13.007606 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9c80f13a3c791884cb3202cd9792ba79843832815525fbddf65d1ac65bdac112\": container with ID starting with 9c80f13a3c791884cb3202cd9792ba79843832815525fbddf65d1ac65bdac112 not found: ID does not exist" containerID="9c80f13a3c791884cb3202cd9792ba79843832815525fbddf65d1ac65bdac112" Sep 13 20:19:13.007656 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007625 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c80f13a3c791884cb3202cd9792ba79843832815525fbddf65d1ac65bdac112"} err="failed to get container status \"9c80f13a3c791884cb3202cd9792ba79843832815525fbddf65d1ac65bdac112\": rpc error: code = NotFound desc = could not find container \"9c80f13a3c791884cb3202cd9792ba79843832815525fbddf65d1ac65bdac112\": container with ID starting with 9c80f13a3c791884cb3202cd9792ba79843832815525fbddf65d1ac65bdac112 not found: ID does not exist" Sep 13 20:19:13.007656 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007636 2561 scope.go:117] "RemoveContainer" containerID="c4587c7b1a325357e2bf7013556f0fe1a636908eace94d5dad17068ec9663b38" Sep 13 20:19:13.007966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007611 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="prom-label-proxy" Sep 13 20:19:13.007966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007683 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="init-config-reloader" Sep 13 20:19:13.007966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007692 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="init-config-reloader" Sep 13 20:19:13.007966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007752 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="kube-rbac-proxy-metric" Sep 13 20:19:13.007966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007760 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="kube-rbac-proxy" Sep 13 20:19:13.007966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007765 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="prom-label-proxy" Sep 13 20:19:13.007966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007771 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="config-reloader" Sep 13 20:19:13.007966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007778 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="alertmanager" Sep 13 20:19:13.007966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007782 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" containerName="kube-rbac-proxy-web" Sep 13 20:19:13.007966 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:19:13.007846 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4587c7b1a325357e2bf7013556f0fe1a636908eace94d5dad17068ec9663b38\": container with ID starting with c4587c7b1a325357e2bf7013556f0fe1a636908eace94d5dad17068ec9663b38 not found: ID does not exist" containerID="c4587c7b1a325357e2bf7013556f0fe1a636908eace94d5dad17068ec9663b38" Sep 13 20:19:13.007966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007868 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4587c7b1a325357e2bf7013556f0fe1a636908eace94d5dad17068ec9663b38"} err="failed to get container status \"c4587c7b1a325357e2bf7013556f0fe1a636908eace94d5dad17068ec9663b38\": rpc error: code = NotFound desc = could not find container \"c4587c7b1a325357e2bf7013556f0fe1a636908eace94d5dad17068ec9663b38\": container with ID starting with c4587c7b1a325357e2bf7013556f0fe1a636908eace94d5dad17068ec9663b38 not found: ID does not exist" Sep 13 20:19:13.007966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.007884 2561 scope.go:117] "RemoveContainer" containerID="ea6f3f616e4e1e958f508be3ca2f195da00e122dc53468666b0f84db67020680" Sep 13 20:19:13.008534 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:19:13.008230 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea6f3f616e4e1e958f508be3ca2f195da00e122dc53468666b0f84db67020680\": container with ID starting with ea6f3f616e4e1e958f508be3ca2f195da00e122dc53468666b0f84db67020680 not found: ID does not exist" containerID="ea6f3f616e4e1e958f508be3ca2f195da00e122dc53468666b0f84db67020680" Sep 13 20:19:13.008534 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.008254 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea6f3f616e4e1e958f508be3ca2f195da00e122dc53468666b0f84db67020680"} err="failed to get container status \"ea6f3f616e4e1e958f508be3ca2f195da00e122dc53468666b0f84db67020680\": rpc error: code = NotFound desc = could not find container \"ea6f3f616e4e1e958f508be3ca2f195da00e122dc53468666b0f84db67020680\": container with ID starting with ea6f3f616e4e1e958f508be3ca2f195da00e122dc53468666b0f84db67020680 not found: ID does not exist" Sep 13 20:19:13.008534 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.008268 2561 scope.go:117] "RemoveContainer" containerID="02157e184702c8bf8c1c7ae29600b61a79decb93bcbbf76f2bfed261eaae591c" Sep 13 20:19:13.008624 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:19:13.008544 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02157e184702c8bf8c1c7ae29600b61a79decb93bcbbf76f2bfed261eaae591c\": container with ID starting with 02157e184702c8bf8c1c7ae29600b61a79decb93bcbbf76f2bfed261eaae591c not found: ID does not exist" containerID="02157e184702c8bf8c1c7ae29600b61a79decb93bcbbf76f2bfed261eaae591c" Sep 13 20:19:13.008624 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.008570 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02157e184702c8bf8c1c7ae29600b61a79decb93bcbbf76f2bfed261eaae591c"} err="failed to get container status \"02157e184702c8bf8c1c7ae29600b61a79decb93bcbbf76f2bfed261eaae591c\": rpc error: code = NotFound desc = could not find container \"02157e184702c8bf8c1c7ae29600b61a79decb93bcbbf76f2bfed261eaae591c\": container with ID starting with 02157e184702c8bf8c1c7ae29600b61a79decb93bcbbf76f2bfed261eaae591c not found: ID does not exist" Sep 13 20:19:13.008624 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.008583 2561 scope.go:117] "RemoveContainer" containerID="dcd91937782a9c537f572a6097fbe8a3cd9a3200e2678c2dd52621b34626aa22" Sep 13 20:19:13.008818 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.008800 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcd91937782a9c537f572a6097fbe8a3cd9a3200e2678c2dd52621b34626aa22"} err="failed to get container status \"dcd91937782a9c537f572a6097fbe8a3cd9a3200e2678c2dd52621b34626aa22\": rpc error: code = NotFound desc = could not find container \"dcd91937782a9c537f572a6097fbe8a3cd9a3200e2678c2dd52621b34626aa22\": container with ID starting with dcd91937782a9c537f572a6097fbe8a3cd9a3200e2678c2dd52621b34626aa22 not found: ID does not exist" Sep 13 20:19:13.008856 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.008818 2561 scope.go:117] "RemoveContainer" containerID="a6e562ee37484f5d427e1bcad3cb3bd57b0c9176d89e12714630236d35f795ac" Sep 13 20:19:13.009056 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.009039 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6e562ee37484f5d427e1bcad3cb3bd57b0c9176d89e12714630236d35f795ac"} err="failed to get container status \"a6e562ee37484f5d427e1bcad3cb3bd57b0c9176d89e12714630236d35f795ac\": rpc error: code = NotFound desc = could not find container \"a6e562ee37484f5d427e1bcad3cb3bd57b0c9176d89e12714630236d35f795ac\": container with ID starting with a6e562ee37484f5d427e1bcad3cb3bd57b0c9176d89e12714630236d35f795ac not found: ID does not exist" Sep 13 20:19:13.009056 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.009056 2561 scope.go:117] "RemoveContainer" containerID="8f7e36fe8cb300d73694717e831381442a0c419c0a7902047db604afc6d4eab9" Sep 13 20:19:13.009296 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.009274 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f7e36fe8cb300d73694717e831381442a0c419c0a7902047db604afc6d4eab9"} err="failed to get container status \"8f7e36fe8cb300d73694717e831381442a0c419c0a7902047db604afc6d4eab9\": rpc error: code = NotFound desc = could not find container \"8f7e36fe8cb300d73694717e831381442a0c419c0a7902047db604afc6d4eab9\": container with ID starting with 8f7e36fe8cb300d73694717e831381442a0c419c0a7902047db604afc6d4eab9 not found: ID does not exist" Sep 13 20:19:13.009341 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.009296 2561 scope.go:117] "RemoveContainer" containerID="9c80f13a3c791884cb3202cd9792ba79843832815525fbddf65d1ac65bdac112" Sep 13 20:19:13.009536 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.009518 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9c80f13a3c791884cb3202cd9792ba79843832815525fbddf65d1ac65bdac112"} err="failed to get container status \"9c80f13a3c791884cb3202cd9792ba79843832815525fbddf65d1ac65bdac112\": rpc error: code = NotFound desc = could not find container \"9c80f13a3c791884cb3202cd9792ba79843832815525fbddf65d1ac65bdac112\": container with ID starting with 9c80f13a3c791884cb3202cd9792ba79843832815525fbddf65d1ac65bdac112 not found: ID does not exist" Sep 13 20:19:13.009577 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.009537 2561 scope.go:117] "RemoveContainer" containerID="c4587c7b1a325357e2bf7013556f0fe1a636908eace94d5dad17068ec9663b38" Sep 13 20:19:13.009745 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.009730 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4587c7b1a325357e2bf7013556f0fe1a636908eace94d5dad17068ec9663b38"} err="failed to get container status \"c4587c7b1a325357e2bf7013556f0fe1a636908eace94d5dad17068ec9663b38\": rpc error: code = NotFound desc = could not find container \"c4587c7b1a325357e2bf7013556f0fe1a636908eace94d5dad17068ec9663b38\": container with ID starting with c4587c7b1a325357e2bf7013556f0fe1a636908eace94d5dad17068ec9663b38 not found: ID does not exist" Sep 13 20:19:13.009745 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.009744 2561 scope.go:117] "RemoveContainer" containerID="ea6f3f616e4e1e958f508be3ca2f195da00e122dc53468666b0f84db67020680" Sep 13 20:19:13.009956 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.009938 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea6f3f616e4e1e958f508be3ca2f195da00e122dc53468666b0f84db67020680"} err="failed to get container status \"ea6f3f616e4e1e958f508be3ca2f195da00e122dc53468666b0f84db67020680\": rpc error: code = NotFound desc = could not find container \"ea6f3f616e4e1e958f508be3ca2f195da00e122dc53468666b0f84db67020680\": container with ID starting with ea6f3f616e4e1e958f508be3ca2f195da00e122dc53468666b0f84db67020680 not found: ID does not exist" Sep 13 20:19:13.009993 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.009957 2561 scope.go:117] "RemoveContainer" containerID="02157e184702c8bf8c1c7ae29600b61a79decb93bcbbf76f2bfed261eaae591c" Sep 13 20:19:13.010218 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.010202 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02157e184702c8bf8c1c7ae29600b61a79decb93bcbbf76f2bfed261eaae591c"} err="failed to get container status \"02157e184702c8bf8c1c7ae29600b61a79decb93bcbbf76f2bfed261eaae591c\": rpc error: code = NotFound desc = could not find container \"02157e184702c8bf8c1c7ae29600b61a79decb93bcbbf76f2bfed261eaae591c\": container with ID starting with 02157e184702c8bf8c1c7ae29600b61a79decb93bcbbf76f2bfed261eaae591c not found: ID does not exist" Sep 13 20:19:13.011410 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.011398 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.013780 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.013761 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Sep 13 20:19:13.013886 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.013801 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Sep 13 20:19:13.013886 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.013821 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Sep 13 20:19:13.013886 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.013761 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Sep 13 20:19:13.013886 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.013825 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Sep 13 20:19:13.014369 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.014348 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Sep 13 20:19:13.014530 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.014514 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9gfdd\"" Sep 13 20:19:13.014612 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.014596 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Sep 13 20:19:13.014778 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.014599 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Sep 13 20:19:13.018830 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.018809 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Sep 13 20:19:13.025644 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.025626 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 13 20:19:13.110444 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.110419 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.110444 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.110444 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-web-config\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.110578 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.110463 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.110578 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.110486 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37056b57-da7d-4256-8ad4-95fb3d8b8924-config-out\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.110578 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.110542 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jx2lk\" (UniqueName: \"kubernetes.io/projected/37056b57-da7d-4256-8ad4-95fb3d8b8924-kube-api-access-jx2lk\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.110578 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.110571 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/37056b57-da7d-4256-8ad4-95fb3d8b8924-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.110700 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.110594 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-config-volume\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.110700 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.110614 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37056b57-da7d-4256-8ad4-95fb3d8b8924-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.110700 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.110631 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.110700 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.110659 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37056b57-da7d-4256-8ad4-95fb3d8b8924-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.110700 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.110683 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37056b57-da7d-4256-8ad4-95fb3d8b8924-tls-assets\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.110700 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.110698 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.110869 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.110761 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.211210 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.211159 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.211210 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.211190 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.211210 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.211205 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-web-config\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.211371 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.211222 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.211371 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.211253 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37056b57-da7d-4256-8ad4-95fb3d8b8924-config-out\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.211371 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.211289 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jx2lk\" (UniqueName: \"kubernetes.io/projected/37056b57-da7d-4256-8ad4-95fb3d8b8924-kube-api-access-jx2lk\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.211371 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.211327 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/37056b57-da7d-4256-8ad4-95fb3d8b8924-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.211371 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.211353 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-config-volume\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.211601 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.211381 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37056b57-da7d-4256-8ad4-95fb3d8b8924-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.211601 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.211404 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.211601 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.211424 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37056b57-da7d-4256-8ad4-95fb3d8b8924-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.211601 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.211450 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37056b57-da7d-4256-8ad4-95fb3d8b8924-tls-assets\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.211601 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.211471 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.211944 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.211906 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/37056b57-da7d-4256-8ad4-95fb3d8b8924-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.213635 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.212728 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/37056b57-da7d-4256-8ad4-95fb3d8b8924-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.213635 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.213341 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/37056b57-da7d-4256-8ad4-95fb3d8b8924-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.214401 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.214375 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-config-volume\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.214495 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.214433 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.214556 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.214497 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-web-config\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.214556 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.214529 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.214661 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.214551 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.214661 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.214609 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.215084 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.215050 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/37056b57-da7d-4256-8ad4-95fb3d8b8924-config-out\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.216185 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.216159 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/37056b57-da7d-4256-8ad4-95fb3d8b8924-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.216253 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.216203 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/37056b57-da7d-4256-8ad4-95fb3d8b8924-tls-assets\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.219047 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.219031 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jx2lk\" (UniqueName: \"kubernetes.io/projected/37056b57-da7d-4256-8ad4-95fb3d8b8924-kube-api-access-jx2lk\") pod \"alertmanager-main-0\" (UID: \"37056b57-da7d-4256-8ad4-95fb3d8b8924\") " pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.320905 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.320875 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Sep 13 20:19:13.596553 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.596528 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Sep 13 20:19:13.598799 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:19:13.598776 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37056b57_da7d_4256_8ad4_95fb3d8b8924.slice/crio-e6532ce2896c24cc5c366b7534d00f82dcf42bf8459d5fc60628b097478778ec WatchSource:0}: Error finding container e6532ce2896c24cc5c366b7534d00f82dcf42bf8459d5fc60628b097478778ec: Status 404 returned error can't find the container with id e6532ce2896c24cc5c366b7534d00f82dcf42bf8459d5fc60628b097478778ec Sep 13 20:19:13.958666 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.958594 2561 generic.go:356] "Generic (PLEG): container finished" podID="37056b57-da7d-4256-8ad4-95fb3d8b8924" containerID="3091b0643489c549137e5ae54d53837b19b0d573e40f59089cb782fe4ce8caeb" exitCode=0 Sep 13 20:19:13.959021 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.958689 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37056b57-da7d-4256-8ad4-95fb3d8b8924","Type":"ContainerDied","Data":"3091b0643489c549137e5ae54d53837b19b0d573e40f59089cb782fe4ce8caeb"} Sep 13 20:19:13.959021 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:13.958754 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37056b57-da7d-4256-8ad4-95fb3d8b8924","Type":"ContainerStarted","Data":"e6532ce2896c24cc5c366b7534d00f82dcf42bf8459d5fc60628b097478778ec"} Sep 13 20:19:14.696357 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:14.696327 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aaa36711-2596-4f52-afdd-fb91da9bbca1" path="/var/lib/kubelet/pods/aaa36711-2596-4f52-afdd-fb91da9bbca1/volumes" Sep 13 20:19:14.966315 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:14.966243 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37056b57-da7d-4256-8ad4-95fb3d8b8924","Type":"ContainerStarted","Data":"8ca0c94ecb84e766dc2d44315d9bd85c6b4f511611aa1a5c5066dbe7ac03ab95"} Sep 13 20:19:14.966697 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:14.966322 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37056b57-da7d-4256-8ad4-95fb3d8b8924","Type":"ContainerStarted","Data":"c2e6c666115207ca342ba35c903d8218e77c63e479024778359df410067e6e72"} Sep 13 20:19:14.966697 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:14.966362 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37056b57-da7d-4256-8ad4-95fb3d8b8924","Type":"ContainerStarted","Data":"c03abe498d673b6f9f7c4aaabf0ac5fed487c662ab38ee70726ea6c52b42a4e7"} Sep 13 20:19:14.966697 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:14.966403 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37056b57-da7d-4256-8ad4-95fb3d8b8924","Type":"ContainerStarted","Data":"be24e46f4cf0af3154d9a129cc94136fc33d7ed9ea427e5318c76509af4d586a"} Sep 13 20:19:14.966697 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:14.966447 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37056b57-da7d-4256-8ad4-95fb3d8b8924","Type":"ContainerStarted","Data":"2d84cf7a85a09bbbabc9787e324f8930ce234b3ec54bf8b53d1fbc4a26dc1070"} Sep 13 20:19:14.966697 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:14.966486 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"37056b57-da7d-4256-8ad4-95fb3d8b8924","Type":"ContainerStarted","Data":"2ce6ed124e6c28e30bd621faaa712e28cf68e51ed0de6a590aca0aa27b0ef78e"} Sep 13 20:19:14.994150 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:14.994091 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.979634842 podStartE2EDuration="2.99405248s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.417638ms" isStatefulPod=false podCreationTimestamp="2026-09-13 20:19:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:19:14.991604294 +0000 UTC m=+384.808179859" watchObservedRunningTime="2026-09-13 20:19:14.99405248 +0000 UTC m=+384.810628070" Sep 13 20:19:18.999593 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:18.999561 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:18.999981 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:18.999622 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:19.004324 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:19.004298 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:19:19.988911 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:19:19.988882 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:20:46.926798 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:20:46.926764 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mqf7z"] Sep 13 20:20:46.928631 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:20:46.928614 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mqf7z" Sep 13 20:20:46.930966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:20:46.930935 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-s5v5z\"" Sep 13 20:20:46.930966 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:20:46.930962 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 13 20:20:46.932152 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:20:46.932127 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 13 20:20:46.936614 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:20:46.936592 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mqf7z"] Sep 13 20:20:46.962365 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:20:46.962345 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgkdd\" (UniqueName: \"kubernetes.io/projected/81e9eccc-432c-4ada-a39d-a50019604d64-kube-api-access-wgkdd\") pod \"cert-manager-55b4d954d5-mqf7z\" (UID: \"81e9eccc-432c-4ada-a39d-a50019604d64\") " pod="cert-manager/cert-manager-55b4d954d5-mqf7z" Sep 13 20:20:46.962469 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:20:46.962386 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/81e9eccc-432c-4ada-a39d-a50019604d64-bound-sa-token\") pod \"cert-manager-55b4d954d5-mqf7z\" (UID: \"81e9eccc-432c-4ada-a39d-a50019604d64\") " pod="cert-manager/cert-manager-55b4d954d5-mqf7z" Sep 13 20:20:47.063491 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:20:47.063454 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgkdd\" (UniqueName: \"kubernetes.io/projected/81e9eccc-432c-4ada-a39d-a50019604d64-kube-api-access-wgkdd\") pod \"cert-manager-55b4d954d5-mqf7z\" (UID: \"81e9eccc-432c-4ada-a39d-a50019604d64\") " pod="cert-manager/cert-manager-55b4d954d5-mqf7z" Sep 13 20:20:47.063678 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:20:47.063513 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/81e9eccc-432c-4ada-a39d-a50019604d64-bound-sa-token\") pod \"cert-manager-55b4d954d5-mqf7z\" (UID: \"81e9eccc-432c-4ada-a39d-a50019604d64\") " pod="cert-manager/cert-manager-55b4d954d5-mqf7z" Sep 13 20:20:47.070686 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:20:47.070662 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/81e9eccc-432c-4ada-a39d-a50019604d64-bound-sa-token\") pod \"cert-manager-55b4d954d5-mqf7z\" (UID: \"81e9eccc-432c-4ada-a39d-a50019604d64\") " pod="cert-manager/cert-manager-55b4d954d5-mqf7z" Sep 13 20:20:47.070797 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:20:47.070780 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgkdd\" (UniqueName: \"kubernetes.io/projected/81e9eccc-432c-4ada-a39d-a50019604d64-kube-api-access-wgkdd\") pod \"cert-manager-55b4d954d5-mqf7z\" (UID: \"81e9eccc-432c-4ada-a39d-a50019604d64\") " pod="cert-manager/cert-manager-55b4d954d5-mqf7z" Sep 13 20:20:47.238344 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:20:47.238284 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-mqf7z" Sep 13 20:20:47.512088 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:20:47.512005 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-mqf7z"] Sep 13 20:20:47.515269 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:20:47.515242 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod81e9eccc_432c_4ada_a39d_a50019604d64.slice/crio-6817c657262de9eba6730602a6b917b8bfb5d053b14c40d26bef488fde63bcdd WatchSource:0}: Error finding container 6817c657262de9eba6730602a6b917b8bfb5d053b14c40d26bef488fde63bcdd: Status 404 returned error can't find the container with id 6817c657262de9eba6730602a6b917b8bfb5d053b14c40d26bef488fde63bcdd Sep 13 20:20:48.300965 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:20:48.300930 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mqf7z" event={"ID":"81e9eccc-432c-4ada-a39d-a50019604d64","Type":"ContainerStarted","Data":"6817c657262de9eba6730602a6b917b8bfb5d053b14c40d26bef488fde63bcdd"} Sep 13 20:21:06.367894 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:06.367859 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-mqf7z" event={"ID":"81e9eccc-432c-4ada-a39d-a50019604d64","Type":"ContainerStarted","Data":"e0f6d0099b180ecab4d4bb47cec85e144f77951caed3379749052a7dd277f6b7"} Sep 13 20:21:06.383614 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:06.383564 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-mqf7z" podStartSLOduration=2.430678642 podStartE2EDuration="20.383549916s" totalImagesPullingTime="17.952871274s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:20:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:21:06.38226381 +0000 UTC m=+496.198839372" watchObservedRunningTime="2026-09-13 20:21:06.383549916 +0000 UTC m=+496.200125478" Sep 13 20:21:09.937291 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:09.937258 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh"] Sep 13 20:21:09.940267 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:09.940252 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh" Sep 13 20:21:09.943973 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:09.943946 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 13 20:21:09.943973 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:09.943960 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 13 20:21:09.944160 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:09.944043 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 13 20:21:09.944247 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:09.944234 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-h792q\"" Sep 13 20:21:09.944347 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:09.944330 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 13 20:21:09.944399 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:09.944331 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 13 20:21:09.949326 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:09.949308 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh"] Sep 13 20:21:10.037202 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:10.037180 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/62c0719e-cebc-419c-8e1d-0425b847a577-metrics-cert\") pod \"lws-controller-manager-768f8bb9c7-ff6qh\" (UID: \"62c0719e-cebc-419c-8e1d-0425b847a577\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh" Sep 13 20:21:10.037317 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:10.037210 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62c0719e-cebc-419c-8e1d-0425b847a577-cert\") pod \"lws-controller-manager-768f8bb9c7-ff6qh\" (UID: \"62c0719e-cebc-419c-8e1d-0425b847a577\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh" Sep 13 20:21:10.037317 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:10.037226 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/62c0719e-cebc-419c-8e1d-0425b847a577-manager-config\") pod \"lws-controller-manager-768f8bb9c7-ff6qh\" (UID: \"62c0719e-cebc-419c-8e1d-0425b847a577\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh" Sep 13 20:21:10.037317 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:10.037252 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5g4fx\" (UniqueName: \"kubernetes.io/projected/62c0719e-cebc-419c-8e1d-0425b847a577-kube-api-access-5g4fx\") pod \"lws-controller-manager-768f8bb9c7-ff6qh\" (UID: \"62c0719e-cebc-419c-8e1d-0425b847a577\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh" Sep 13 20:21:10.138181 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:10.138148 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/62c0719e-cebc-419c-8e1d-0425b847a577-metrics-cert\") pod \"lws-controller-manager-768f8bb9c7-ff6qh\" (UID: \"62c0719e-cebc-419c-8e1d-0425b847a577\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh" Sep 13 20:21:10.138311 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:10.138186 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62c0719e-cebc-419c-8e1d-0425b847a577-cert\") pod \"lws-controller-manager-768f8bb9c7-ff6qh\" (UID: \"62c0719e-cebc-419c-8e1d-0425b847a577\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh" Sep 13 20:21:10.138311 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:10.138212 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/62c0719e-cebc-419c-8e1d-0425b847a577-manager-config\") pod \"lws-controller-manager-768f8bb9c7-ff6qh\" (UID: \"62c0719e-cebc-419c-8e1d-0425b847a577\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh" Sep 13 20:21:10.138311 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:10.138244 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5g4fx\" (UniqueName: \"kubernetes.io/projected/62c0719e-cebc-419c-8e1d-0425b847a577-kube-api-access-5g4fx\") pod \"lws-controller-manager-768f8bb9c7-ff6qh\" (UID: \"62c0719e-cebc-419c-8e1d-0425b847a577\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh" Sep 13 20:21:10.138879 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:10.138847 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/62c0719e-cebc-419c-8e1d-0425b847a577-manager-config\") pod \"lws-controller-manager-768f8bb9c7-ff6qh\" (UID: \"62c0719e-cebc-419c-8e1d-0425b847a577\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh" Sep 13 20:21:10.140643 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:10.140623 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/62c0719e-cebc-419c-8e1d-0425b847a577-metrics-cert\") pod \"lws-controller-manager-768f8bb9c7-ff6qh\" (UID: \"62c0719e-cebc-419c-8e1d-0425b847a577\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh" Sep 13 20:21:10.140731 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:10.140662 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/62c0719e-cebc-419c-8e1d-0425b847a577-cert\") pod \"lws-controller-manager-768f8bb9c7-ff6qh\" (UID: \"62c0719e-cebc-419c-8e1d-0425b847a577\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh" Sep 13 20:21:10.148975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:10.148953 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5g4fx\" (UniqueName: \"kubernetes.io/projected/62c0719e-cebc-419c-8e1d-0425b847a577-kube-api-access-5g4fx\") pod \"lws-controller-manager-768f8bb9c7-ff6qh\" (UID: \"62c0719e-cebc-419c-8e1d-0425b847a577\") " pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh" Sep 13 20:21:10.250185 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:10.250133 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh" Sep 13 20:21:10.517438 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:10.517412 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh"] Sep 13 20:21:10.519807 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:21:10.519780 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62c0719e_cebc_419c_8e1d_0425b847a577.slice/crio-6a243b351cc010c2ab81a95c43ba71a48d19dc214267fdb8aaec9c740abbfe6f WatchSource:0}: Error finding container 6a243b351cc010c2ab81a95c43ba71a48d19dc214267fdb8aaec9c740abbfe6f: Status 404 returned error can't find the container with id 6a243b351cc010c2ab81a95c43ba71a48d19dc214267fdb8aaec9c740abbfe6f Sep 13 20:21:11.392304 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:11.392249 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh" event={"ID":"62c0719e-cebc-419c-8e1d-0425b847a577","Type":"ContainerStarted","Data":"6a243b351cc010c2ab81a95c43ba71a48d19dc214267fdb8aaec9c740abbfe6f"} Sep 13 20:21:12.707563 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.707525 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj"] Sep 13 20:21:12.711203 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.711179 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" Sep 13 20:21:12.714583 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.714444 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 13 20:21:12.714583 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.714476 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 13 20:21:12.714583 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.714513 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 13 20:21:12.714799 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.714609 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 13 20:21:12.714859 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.714843 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-q5p9w\"" Sep 13 20:21:12.730788 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.730766 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj"] Sep 13 20:21:12.859956 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.859921 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/80058ba7-2e42-4b29-b240-2a193e7afba3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84f9f8b966-9w4rj\" (UID: \"80058ba7-2e42-4b29-b240-2a193e7afba3\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" Sep 13 20:21:12.860178 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.859963 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80058ba7-2e42-4b29-b240-2a193e7afba3-webhook-cert\") pod \"opendatahub-operator-controller-manager-84f9f8b966-9w4rj\" (UID: \"80058ba7-2e42-4b29-b240-2a193e7afba3\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" Sep 13 20:21:12.860178 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.859986 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80058ba7-2e42-4b29-b240-2a193e7afba3-tmp\") pod \"opendatahub-operator-controller-manager-84f9f8b966-9w4rj\" (UID: \"80058ba7-2e42-4b29-b240-2a193e7afba3\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" Sep 13 20:21:12.860178 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.860089 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/80058ba7-2e42-4b29-b240-2a193e7afba3-manifests\") pod \"opendatahub-operator-controller-manager-84f9f8b966-9w4rj\" (UID: \"80058ba7-2e42-4b29-b240-2a193e7afba3\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" Sep 13 20:21:12.860178 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.860130 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vjpv\" (UniqueName: \"kubernetes.io/projected/80058ba7-2e42-4b29-b240-2a193e7afba3-kube-api-access-2vjpv\") pod \"opendatahub-operator-controller-manager-84f9f8b966-9w4rj\" (UID: \"80058ba7-2e42-4b29-b240-2a193e7afba3\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" Sep 13 20:21:12.960928 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.960879 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vjpv\" (UniqueName: \"kubernetes.io/projected/80058ba7-2e42-4b29-b240-2a193e7afba3-kube-api-access-2vjpv\") pod \"opendatahub-operator-controller-manager-84f9f8b966-9w4rj\" (UID: \"80058ba7-2e42-4b29-b240-2a193e7afba3\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" Sep 13 20:21:12.960928 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.960921 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/80058ba7-2e42-4b29-b240-2a193e7afba3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84f9f8b966-9w4rj\" (UID: \"80058ba7-2e42-4b29-b240-2a193e7afba3\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" Sep 13 20:21:12.961076 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.960959 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80058ba7-2e42-4b29-b240-2a193e7afba3-webhook-cert\") pod \"opendatahub-operator-controller-manager-84f9f8b966-9w4rj\" (UID: \"80058ba7-2e42-4b29-b240-2a193e7afba3\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" Sep 13 20:21:12.961076 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.960988 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80058ba7-2e42-4b29-b240-2a193e7afba3-tmp\") pod \"opendatahub-operator-controller-manager-84f9f8b966-9w4rj\" (UID: \"80058ba7-2e42-4b29-b240-2a193e7afba3\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" Sep 13 20:21:12.961076 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.961043 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/80058ba7-2e42-4b29-b240-2a193e7afba3-manifests\") pod \"opendatahub-operator-controller-manager-84f9f8b966-9w4rj\" (UID: \"80058ba7-2e42-4b29-b240-2a193e7afba3\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" Sep 13 20:21:12.961458 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.961434 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/80058ba7-2e42-4b29-b240-2a193e7afba3-manifests\") pod \"opendatahub-operator-controller-manager-84f9f8b966-9w4rj\" (UID: \"80058ba7-2e42-4b29-b240-2a193e7afba3\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" Sep 13 20:21:12.963160 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.963128 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80058ba7-2e42-4b29-b240-2a193e7afba3-tmp\") pod \"opendatahub-operator-controller-manager-84f9f8b966-9w4rj\" (UID: \"80058ba7-2e42-4b29-b240-2a193e7afba3\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" Sep 13 20:21:12.963273 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.963248 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/80058ba7-2e42-4b29-b240-2a193e7afba3-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84f9f8b966-9w4rj\" (UID: \"80058ba7-2e42-4b29-b240-2a193e7afba3\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" Sep 13 20:21:12.963395 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.963376 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/80058ba7-2e42-4b29-b240-2a193e7afba3-webhook-cert\") pod \"opendatahub-operator-controller-manager-84f9f8b966-9w4rj\" (UID: \"80058ba7-2e42-4b29-b240-2a193e7afba3\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" Sep 13 20:21:12.968723 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:12.968702 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vjpv\" (UniqueName: \"kubernetes.io/projected/80058ba7-2e42-4b29-b240-2a193e7afba3-kube-api-access-2vjpv\") pod \"opendatahub-operator-controller-manager-84f9f8b966-9w4rj\" (UID: \"80058ba7-2e42-4b29-b240-2a193e7afba3\") " pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" Sep 13 20:21:13.023069 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:13.023041 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" Sep 13 20:21:13.302770 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:13.302724 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj"] Sep 13 20:21:13.305119 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:21:13.305085 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80058ba7_2e42_4b29_b240_2a193e7afba3.slice/crio-f03127689607b6885df551d1749ae3af487089b9ac5939ce2ef8dd67d1b292cb WatchSource:0}: Error finding container f03127689607b6885df551d1749ae3af487089b9ac5939ce2ef8dd67d1b292cb: Status 404 returned error can't find the container with id f03127689607b6885df551d1749ae3af487089b9ac5939ce2ef8dd67d1b292cb Sep 13 20:21:13.401670 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:13.401633 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" event={"ID":"80058ba7-2e42-4b29-b240-2a193e7afba3","Type":"ContainerStarted","Data":"f03127689607b6885df551d1749ae3af487089b9ac5939ce2ef8dd67d1b292cb"} Sep 13 20:21:13.403037 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:13.403009 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh" event={"ID":"62c0719e-cebc-419c-8e1d-0425b847a577","Type":"ContainerStarted","Data":"f40eaefa3c4eb27342a191ba11eb4e2a56f332dc44d84835753763ba86417776"} Sep 13 20:21:13.403176 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:13.403113 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh" Sep 13 20:21:13.417830 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:13.417784 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh" podStartSLOduration=2.063194167 podStartE2EDuration="4.417767294s" totalImagesPullingTime="2.354573127s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:21:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:21:13.416879776 +0000 UTC m=+503.233455347" watchObservedRunningTime="2026-09-13 20:21:13.417767294 +0000 UTC m=+503.234342857" Sep 13 20:21:16.418411 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:16.418380 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" event={"ID":"80058ba7-2e42-4b29-b240-2a193e7afba3","Type":"ContainerStarted","Data":"2785af64b9b9567f194a90949e6d4fbb42d9ca0dfafbad1b71bfa28d0ed75553"} Sep 13 20:21:17.424273 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:17.424240 2561 generic.go:356] "Generic (PLEG): container finished" podID="80058ba7-2e42-4b29-b240-2a193e7afba3" containerID="2785af64b9b9567f194a90949e6d4fbb42d9ca0dfafbad1b71bfa28d0ed75553" exitCode=0 Sep 13 20:21:17.424671 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:17.424294 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" event={"ID":"80058ba7-2e42-4b29-b240-2a193e7afba3","Type":"ContainerDied","Data":"2785af64b9b9567f194a90949e6d4fbb42d9ca0dfafbad1b71bfa28d0ed75553"} Sep 13 20:21:18.430525 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:18.430323 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" event={"ID":"80058ba7-2e42-4b29-b240-2a193e7afba3","Type":"ContainerStarted","Data":"9242e47a9804e34a7e3f6c58610d19b3ef10c3d30d6f805faba1723e1cb05898"} Sep 13 20:21:18.430525 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:18.430430 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" Sep 13 20:21:18.451270 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:18.451229 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" podStartSLOduration=2.136378421 podStartE2EDuration="6.451215181s" totalImagesPullingTime="3.370425913s" totalInitContainerRuntime="944.410847ms" isStatefulPod=false podCreationTimestamp="2026-09-13 20:21:12 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:21:18.4492149 +0000 UTC m=+508.265790463" watchObservedRunningTime="2026-09-13 20:21:18.451215181 +0000 UTC m=+508.267790744" Sep 13 20:21:24.411451 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:24.411421 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-768f8bb9c7-ff6qh" Sep 13 20:21:29.436557 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:29.436530 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-84f9f8b966-9w4rj" Sep 13 20:21:32.548213 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:32.548184 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-54976cff48-7dgcb"] Sep 13 20:21:32.679818 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:32.679783 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54976cff48-7dgcb"] Sep 13 20:21:32.679974 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:32.679879 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54976cff48-7dgcb" Sep 13 20:21:32.682345 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:32.682312 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 13 20:21:32.682345 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:32.682335 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 13 20:21:32.683472 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:32.683444 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 13 20:21:32.683472 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:32.683457 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 13 20:21:32.683596 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:32.683519 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-4mxgx\"" Sep 13 20:21:32.818796 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:32.818734 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18f88ad6-f254-46d4-a31c-10bdd15474d7-tls-certs\") pod \"kube-auth-proxy-54976cff48-7dgcb\" (UID: \"18f88ad6-f254-46d4-a31c-10bdd15474d7\") " pod="openshift-ingress/kube-auth-proxy-54976cff48-7dgcb" Sep 13 20:21:32.818913 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:32.818806 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvnrc\" (UniqueName: \"kubernetes.io/projected/18f88ad6-f254-46d4-a31c-10bdd15474d7-kube-api-access-pvnrc\") pod \"kube-auth-proxy-54976cff48-7dgcb\" (UID: \"18f88ad6-f254-46d4-a31c-10bdd15474d7\") " pod="openshift-ingress/kube-auth-proxy-54976cff48-7dgcb" Sep 13 20:21:32.818913 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:32.818872 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18f88ad6-f254-46d4-a31c-10bdd15474d7-tmp\") pod \"kube-auth-proxy-54976cff48-7dgcb\" (UID: \"18f88ad6-f254-46d4-a31c-10bdd15474d7\") " pod="openshift-ingress/kube-auth-proxy-54976cff48-7dgcb" Sep 13 20:21:32.920025 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:32.919999 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18f88ad6-f254-46d4-a31c-10bdd15474d7-tmp\") pod \"kube-auth-proxy-54976cff48-7dgcb\" (UID: \"18f88ad6-f254-46d4-a31c-10bdd15474d7\") " pod="openshift-ingress/kube-auth-proxy-54976cff48-7dgcb" Sep 13 20:21:32.920136 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:32.920034 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18f88ad6-f254-46d4-a31c-10bdd15474d7-tls-certs\") pod \"kube-auth-proxy-54976cff48-7dgcb\" (UID: \"18f88ad6-f254-46d4-a31c-10bdd15474d7\") " pod="openshift-ingress/kube-auth-proxy-54976cff48-7dgcb" Sep 13 20:21:32.920136 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:32.920096 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvnrc\" (UniqueName: \"kubernetes.io/projected/18f88ad6-f254-46d4-a31c-10bdd15474d7-kube-api-access-pvnrc\") pod \"kube-auth-proxy-54976cff48-7dgcb\" (UID: \"18f88ad6-f254-46d4-a31c-10bdd15474d7\") " pod="openshift-ingress/kube-auth-proxy-54976cff48-7dgcb" Sep 13 20:21:32.920224 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:21:32.920204 2561 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Sep 13 20:21:32.920314 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:21:32.920302 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/18f88ad6-f254-46d4-a31c-10bdd15474d7-tls-certs podName:18f88ad6-f254-46d4-a31c-10bdd15474d7 nodeName:}" failed. No retries permitted until 2026-09-13 20:21:33.420283181 +0000 UTC m=+523.236858723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/18f88ad6-f254-46d4-a31c-10bdd15474d7-tls-certs") pod "kube-auth-proxy-54976cff48-7dgcb" (UID: "18f88ad6-f254-46d4-a31c-10bdd15474d7") : secret "kube-auth-proxy-tls" not found Sep 13 20:21:32.922209 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:32.922192 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/18f88ad6-f254-46d4-a31c-10bdd15474d7-tmp\") pod \"kube-auth-proxy-54976cff48-7dgcb\" (UID: \"18f88ad6-f254-46d4-a31c-10bdd15474d7\") " pod="openshift-ingress/kube-auth-proxy-54976cff48-7dgcb" Sep 13 20:21:32.928297 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:32.928278 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvnrc\" (UniqueName: \"kubernetes.io/projected/18f88ad6-f254-46d4-a31c-10bdd15474d7-kube-api-access-pvnrc\") pod \"kube-auth-proxy-54976cff48-7dgcb\" (UID: \"18f88ad6-f254-46d4-a31c-10bdd15474d7\") " pod="openshift-ingress/kube-auth-proxy-54976cff48-7dgcb" Sep 13 20:21:33.423544 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:33.423509 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18f88ad6-f254-46d4-a31c-10bdd15474d7-tls-certs\") pod \"kube-auth-proxy-54976cff48-7dgcb\" (UID: \"18f88ad6-f254-46d4-a31c-10bdd15474d7\") " pod="openshift-ingress/kube-auth-proxy-54976cff48-7dgcb" Sep 13 20:21:33.425830 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:33.425801 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18f88ad6-f254-46d4-a31c-10bdd15474d7-tls-certs\") pod \"kube-auth-proxy-54976cff48-7dgcb\" (UID: \"18f88ad6-f254-46d4-a31c-10bdd15474d7\") " pod="openshift-ingress/kube-auth-proxy-54976cff48-7dgcb" Sep 13 20:21:33.588991 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:33.588961 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-54976cff48-7dgcb" Sep 13 20:21:33.857037 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:33.857014 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-54976cff48-7dgcb"] Sep 13 20:21:33.859428 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:21:33.859402 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18f88ad6_f254_46d4_a31c_10bdd15474d7.slice/crio-8ebb00bc1c37f5678afbe325292cccfce06dbeff65ec4aee49f1fcca06610d8f WatchSource:0}: Error finding container 8ebb00bc1c37f5678afbe325292cccfce06dbeff65ec4aee49f1fcca06610d8f: Status 404 returned error can't find the container with id 8ebb00bc1c37f5678afbe325292cccfce06dbeff65ec4aee49f1fcca06610d8f Sep 13 20:21:34.497470 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:34.497392 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54976cff48-7dgcb" event={"ID":"18f88ad6-f254-46d4-a31c-10bdd15474d7","Type":"ContainerStarted","Data":"8ebb00bc1c37f5678afbe325292cccfce06dbeff65ec4aee49f1fcca06610d8f"} Sep 13 20:21:36.508147 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:36.508119 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-54976cff48-7dgcb" event={"ID":"18f88ad6-f254-46d4-a31c-10bdd15474d7","Type":"ContainerStarted","Data":"457f827e900cb4a0a768463ec28fdee08ed7e009fcc66a5c77a92a596440bee8"} Sep 13 20:21:36.548541 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:21:36.548492 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-54976cff48-7dgcb" podStartSLOduration=1.985229877 podStartE2EDuration="4.548475271s" totalImagesPullingTime="2.563245394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:21:36.546182698 +0000 UTC m=+526.362758260" watchObservedRunningTime="2026-09-13 20:21:36.548475271 +0000 UTC m=+526.365050833" Sep 13 20:23:12.721143 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:12.721106 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-9wlht"] Sep 13 20:23:12.724569 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:12.724546 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9wlht" Sep 13 20:23:12.727076 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:12.727040 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 13 20:23:12.727181 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:12.727106 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 13 20:23:12.727181 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:12.727124 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-lszmf\"" Sep 13 20:23:12.728172 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:12.728153 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 13 20:23:12.728266 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:12.728219 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 13 20:23:12.730948 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:12.730925 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-9wlht"] Sep 13 20:23:12.803369 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:12.803325 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea6553ea-d9e2-4684-8d04-747bc1e826a3-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-9wlht\" (UID: \"ea6553ea-d9e2-4684-8d04-747bc1e826a3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9wlht" Sep 13 20:23:12.803535 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:12.803381 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ea6553ea-d9e2-4684-8d04-747bc1e826a3-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-9wlht\" (UID: \"ea6553ea-d9e2-4684-8d04-747bc1e826a3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9wlht" Sep 13 20:23:12.803535 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:12.803463 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkhxc\" (UniqueName: \"kubernetes.io/projected/ea6553ea-d9e2-4684-8d04-747bc1e826a3-kube-api-access-kkhxc\") pod \"kuadrant-console-plugin-fbdd4f445-9wlht\" (UID: \"ea6553ea-d9e2-4684-8d04-747bc1e826a3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9wlht" Sep 13 20:23:12.904243 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:12.904204 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea6553ea-d9e2-4684-8d04-747bc1e826a3-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-9wlht\" (UID: \"ea6553ea-d9e2-4684-8d04-747bc1e826a3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9wlht" Sep 13 20:23:12.904415 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:12.904254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ea6553ea-d9e2-4684-8d04-747bc1e826a3-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-9wlht\" (UID: \"ea6553ea-d9e2-4684-8d04-747bc1e826a3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9wlht" Sep 13 20:23:12.904415 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:12.904296 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkhxc\" (UniqueName: \"kubernetes.io/projected/ea6553ea-d9e2-4684-8d04-747bc1e826a3-kube-api-access-kkhxc\") pod \"kuadrant-console-plugin-fbdd4f445-9wlht\" (UID: \"ea6553ea-d9e2-4684-8d04-747bc1e826a3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9wlht" Sep 13 20:23:12.904893 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:12.904868 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ea6553ea-d9e2-4684-8d04-747bc1e826a3-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-9wlht\" (UID: \"ea6553ea-d9e2-4684-8d04-747bc1e826a3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9wlht" Sep 13 20:23:12.906690 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:12.906659 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ea6553ea-d9e2-4684-8d04-747bc1e826a3-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-9wlht\" (UID: \"ea6553ea-d9e2-4684-8d04-747bc1e826a3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9wlht" Sep 13 20:23:12.912600 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:12.912578 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkhxc\" (UniqueName: \"kubernetes.io/projected/ea6553ea-d9e2-4684-8d04-747bc1e826a3-kube-api-access-kkhxc\") pod \"kuadrant-console-plugin-fbdd4f445-9wlht\" (UID: \"ea6553ea-d9e2-4684-8d04-747bc1e826a3\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9wlht" Sep 13 20:23:13.034749 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:13.034667 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9wlht" Sep 13 20:23:13.303771 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:13.303703 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-9wlht"] Sep 13 20:23:13.305957 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:23:13.305930 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea6553ea_d9e2_4684_8d04_747bc1e826a3.slice/crio-7e334e5960ddab26aec8203175812f6ac450a5bc7fe7e4035eb27ede488ad616 WatchSource:0}: Error finding container 7e334e5960ddab26aec8203175812f6ac450a5bc7fe7e4035eb27ede488ad616: Status 404 returned error can't find the container with id 7e334e5960ddab26aec8203175812f6ac450a5bc7fe7e4035eb27ede488ad616 Sep 13 20:23:13.307362 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:13.307346 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 13 20:23:13.932454 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:13.932416 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9wlht" event={"ID":"ea6553ea-d9e2-4684-8d04-747bc1e826a3","Type":"ContainerStarted","Data":"7e334e5960ddab26aec8203175812f6ac450a5bc7fe7e4035eb27ede488ad616"} Sep 13 20:23:17.954725 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:17.954634 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9wlht" event={"ID":"ea6553ea-d9e2-4684-8d04-747bc1e826a3","Type":"ContainerStarted","Data":"161826eca90d69942bf9b4d93429dd0d6819195c89f86813c732589888b523dc"} Sep 13 20:23:17.973558 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:17.973508 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-9wlht" podStartSLOduration=1.616201975 podStartE2EDuration="5.97349332s" totalImagesPullingTime="4.357291345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:23:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:23:17.972206326 +0000 UTC m=+627.788781889" watchObservedRunningTime="2026-09-13 20:23:17.97349332 +0000 UTC m=+627.790068884" Sep 13 20:23:32.016598 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:32.016553 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78954c94-dpcxh"] Sep 13 20:23:55.546181 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:55.546147 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7hxvc"] Sep 13 20:23:55.561415 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:55.561390 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-7hxvc" Sep 13 20:23:55.561895 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:55.561871 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7hxvc"] Sep 13 20:23:55.563560 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:55.563535 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Sep 13 20:23:55.573483 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:55.573464 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7hxvc"] Sep 13 20:23:55.648904 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:55.648879 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/274b20c7-f1f9-4596-8cbd-aac40c520e4a-config-file\") pod \"limitador-limitador-84994f7ffc-7hxvc\" (UID: \"274b20c7-f1f9-4596-8cbd-aac40c520e4a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-7hxvc" Sep 13 20:23:55.648997 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:55.648907 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6pxbp\" (UniqueName: \"kubernetes.io/projected/274b20c7-f1f9-4596-8cbd-aac40c520e4a-kube-api-access-6pxbp\") pod \"limitador-limitador-84994f7ffc-7hxvc\" (UID: \"274b20c7-f1f9-4596-8cbd-aac40c520e4a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-7hxvc" Sep 13 20:23:55.749526 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:55.749493 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/274b20c7-f1f9-4596-8cbd-aac40c520e4a-config-file\") pod \"limitador-limitador-84994f7ffc-7hxvc\" (UID: \"274b20c7-f1f9-4596-8cbd-aac40c520e4a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-7hxvc" Sep 13 20:23:55.749675 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:55.749528 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6pxbp\" (UniqueName: \"kubernetes.io/projected/274b20c7-f1f9-4596-8cbd-aac40c520e4a-kube-api-access-6pxbp\") pod \"limitador-limitador-84994f7ffc-7hxvc\" (UID: \"274b20c7-f1f9-4596-8cbd-aac40c520e4a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-7hxvc" Sep 13 20:23:55.750098 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:55.750054 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/274b20c7-f1f9-4596-8cbd-aac40c520e4a-config-file\") pod \"limitador-limitador-84994f7ffc-7hxvc\" (UID: \"274b20c7-f1f9-4596-8cbd-aac40c520e4a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-7hxvc" Sep 13 20:23:55.756830 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:55.756805 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6pxbp\" (UniqueName: \"kubernetes.io/projected/274b20c7-f1f9-4596-8cbd-aac40c520e4a-kube-api-access-6pxbp\") pod \"limitador-limitador-84994f7ffc-7hxvc\" (UID: \"274b20c7-f1f9-4596-8cbd-aac40c520e4a\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-7hxvc" Sep 13 20:23:55.872133 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:55.872100 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-7hxvc" Sep 13 20:23:56.047994 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:56.047958 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-b7z44"] Sep 13 20:23:56.050459 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:56.050443 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-b7z44" Sep 13 20:23:56.052663 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:56.052644 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-9d6ll\"" Sep 13 20:23:56.055743 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:56.055719 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-b7z44"] Sep 13 20:23:56.136983 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:56.136962 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7hxvc"] Sep 13 20:23:56.138965 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:23:56.138939 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod274b20c7_f1f9_4596_8cbd_aac40c520e4a.slice/crio-62c7e63e6adc0d0ba9578716768b616544144af366ebc45f1e6bb188ba7898bf WatchSource:0}: Error finding container 62c7e63e6adc0d0ba9578716768b616544144af366ebc45f1e6bb188ba7898bf: Status 404 returned error can't find the container with id 62c7e63e6adc0d0ba9578716768b616544144af366ebc45f1e6bb188ba7898bf Sep 13 20:23:56.151728 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:56.151708 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5lcp\" (UniqueName: \"kubernetes.io/projected/1c340e8e-86b5-4a93-a5bf-102e39006c5e-kube-api-access-g5lcp\") pod \"authorino-59c974bd48-b7z44\" (UID: \"1c340e8e-86b5-4a93-a5bf-102e39006c5e\") " pod="kuadrant-system/authorino-59c974bd48-b7z44" Sep 13 20:23:56.252096 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:56.252048 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5lcp\" (UniqueName: \"kubernetes.io/projected/1c340e8e-86b5-4a93-a5bf-102e39006c5e-kube-api-access-g5lcp\") pod \"authorino-59c974bd48-b7z44\" (UID: \"1c340e8e-86b5-4a93-a5bf-102e39006c5e\") " pod="kuadrant-system/authorino-59c974bd48-b7z44" Sep 13 20:23:56.260208 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:56.260185 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5lcp\" (UniqueName: \"kubernetes.io/projected/1c340e8e-86b5-4a93-a5bf-102e39006c5e-kube-api-access-g5lcp\") pod \"authorino-59c974bd48-b7z44\" (UID: \"1c340e8e-86b5-4a93-a5bf-102e39006c5e\") " pod="kuadrant-system/authorino-59c974bd48-b7z44" Sep 13 20:23:56.360253 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:56.360226 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-b7z44" Sep 13 20:23:56.622926 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:56.622895 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-b7z44"] Sep 13 20:23:56.625663 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:23:56.625636 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c340e8e_86b5_4a93_a5bf_102e39006c5e.slice/crio-67321e1a05fe5e9c9d0ba57dc0851ec403b37eac4ff9d2c2abdeb766a9d65e97 WatchSource:0}: Error finding container 67321e1a05fe5e9c9d0ba57dc0851ec403b37eac4ff9d2c2abdeb766a9d65e97: Status 404 returned error can't find the container with id 67321e1a05fe5e9c9d0ba57dc0851ec403b37eac4ff9d2c2abdeb766a9d65e97 Sep 13 20:23:57.038107 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.038028 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78954c94-dpcxh" podUID="c69d4a64-0336-4f24-86bf-95b910ca1bdc" containerName="console" containerID="cri-o://09adf0392f05add59b96803dada78724375dd3ef7815cfb19159f2e6efccefde" gracePeriod=15 Sep 13 20:23:57.118171 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.118101 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-7hxvc" event={"ID":"274b20c7-f1f9-4596-8cbd-aac40c520e4a","Type":"ContainerStarted","Data":"62c7e63e6adc0d0ba9578716768b616544144af366ebc45f1e6bb188ba7898bf"} Sep 13 20:23:57.119597 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.119563 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-b7z44" event={"ID":"1c340e8e-86b5-4a93-a5bf-102e39006c5e","Type":"ContainerStarted","Data":"67321e1a05fe5e9c9d0ba57dc0851ec403b37eac4ff9d2c2abdeb766a9d65e97"} Sep 13 20:23:57.303001 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.302935 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:23:57.363961 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.363201 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnj8j\" (UniqueName: \"kubernetes.io/projected/c69d4a64-0336-4f24-86bf-95b910ca1bdc-kube-api-access-vnj8j\") pod \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " Sep 13 20:23:57.363961 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.363246 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-oauth-serving-cert\") pod \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " Sep 13 20:23:57.363961 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.363282 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-service-ca\") pod \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " Sep 13 20:23:57.363961 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.363309 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c69d4a64-0336-4f24-86bf-95b910ca1bdc-console-serving-cert\") pod \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " Sep 13 20:23:57.363961 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.363335 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-console-config\") pod \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " Sep 13 20:23:57.363961 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.363364 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c69d4a64-0336-4f24-86bf-95b910ca1bdc-console-oauth-config\") pod \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " Sep 13 20:23:57.363961 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.363463 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-trusted-ca-bundle\") pod \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\" (UID: \"c69d4a64-0336-4f24-86bf-95b910ca1bdc\") " Sep 13 20:23:57.363961 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.363712 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-service-ca" (OuterVolumeSpecName: "service-ca") pod "c69d4a64-0336-4f24-86bf-95b910ca1bdc" (UID: "c69d4a64-0336-4f24-86bf-95b910ca1bdc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:23:57.363961 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.363731 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c69d4a64-0336-4f24-86bf-95b910ca1bdc" (UID: "c69d4a64-0336-4f24-86bf-95b910ca1bdc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:23:57.363961 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.363825 2561 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-oauth-serving-cert\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:23:57.363961 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.363842 2561 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-service-ca\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:23:57.364661 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.364219 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-console-config" (OuterVolumeSpecName: "console-config") pod "c69d4a64-0336-4f24-86bf-95b910ca1bdc" (UID: "c69d4a64-0336-4f24-86bf-95b910ca1bdc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:23:57.364754 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.364726 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c69d4a64-0336-4f24-86bf-95b910ca1bdc" (UID: "c69d4a64-0336-4f24-86bf-95b910ca1bdc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 13 20:23:57.367732 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.367693 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c69d4a64-0336-4f24-86bf-95b910ca1bdc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c69d4a64-0336-4f24-86bf-95b910ca1bdc" (UID: "c69d4a64-0336-4f24-86bf-95b910ca1bdc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:23:57.367964 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.367935 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c69d4a64-0336-4f24-86bf-95b910ca1bdc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c69d4a64-0336-4f24-86bf-95b910ca1bdc" (UID: "c69d4a64-0336-4f24-86bf-95b910ca1bdc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:23:57.369332 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.369304 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c69d4a64-0336-4f24-86bf-95b910ca1bdc-kube-api-access-vnj8j" (OuterVolumeSpecName: "kube-api-access-vnj8j") pod "c69d4a64-0336-4f24-86bf-95b910ca1bdc" (UID: "c69d4a64-0336-4f24-86bf-95b910ca1bdc"). InnerVolumeSpecName "kube-api-access-vnj8j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:23:57.465371 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.465304 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnj8j\" (UniqueName: \"kubernetes.io/projected/c69d4a64-0336-4f24-86bf-95b910ca1bdc-kube-api-access-vnj8j\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:23:57.465371 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.465340 2561 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c69d4a64-0336-4f24-86bf-95b910ca1bdc-console-serving-cert\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:23:57.465371 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.465355 2561 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-console-config\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:23:57.465371 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.465371 2561 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c69d4a64-0336-4f24-86bf-95b910ca1bdc-console-oauth-config\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:23:57.465371 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:57.465386 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c69d4a64-0336-4f24-86bf-95b910ca1bdc-trusted-ca-bundle\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:23:58.126565 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:58.126448 2561 generic.go:356] "Generic (PLEG): container finished" podID="c69d4a64-0336-4f24-86bf-95b910ca1bdc" containerID="09adf0392f05add59b96803dada78724375dd3ef7815cfb19159f2e6efccefde" exitCode=0 Sep 13 20:23:58.126565 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:58.126505 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78954c94-dpcxh" Sep 13 20:23:58.126565 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:58.126501 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78954c94-dpcxh" event={"ID":"c69d4a64-0336-4f24-86bf-95b910ca1bdc","Type":"ContainerDied","Data":"09adf0392f05add59b96803dada78724375dd3ef7815cfb19159f2e6efccefde"} Sep 13 20:23:58.126565 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:58.126571 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78954c94-dpcxh" event={"ID":"c69d4a64-0336-4f24-86bf-95b910ca1bdc","Type":"ContainerDied","Data":"e9b3cc10a9b429f94bc7c14e5fb2b7bc83aae12cbc729ec22e734fd20e34664e"} Sep 13 20:23:58.127192 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:58.126598 2561 scope.go:117] "RemoveContainer" containerID="09adf0392f05add59b96803dada78724375dd3ef7815cfb19159f2e6efccefde" Sep 13 20:23:58.152053 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:58.152025 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78954c94-dpcxh"] Sep 13 20:23:58.154943 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:58.154917 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78954c94-dpcxh"] Sep 13 20:23:58.197693 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:58.197675 2561 scope.go:117] "RemoveContainer" containerID="09adf0392f05add59b96803dada78724375dd3ef7815cfb19159f2e6efccefde" Sep 13 20:23:58.198028 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:23:58.198006 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09adf0392f05add59b96803dada78724375dd3ef7815cfb19159f2e6efccefde\": container with ID starting with 09adf0392f05add59b96803dada78724375dd3ef7815cfb19159f2e6efccefde not found: ID does not exist" containerID="09adf0392f05add59b96803dada78724375dd3ef7815cfb19159f2e6efccefde" Sep 13 20:23:58.198086 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:58.198039 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09adf0392f05add59b96803dada78724375dd3ef7815cfb19159f2e6efccefde"} err="failed to get container status \"09adf0392f05add59b96803dada78724375dd3ef7815cfb19159f2e6efccefde\": rpc error: code = NotFound desc = could not find container \"09adf0392f05add59b96803dada78724375dd3ef7815cfb19159f2e6efccefde\": container with ID starting with 09adf0392f05add59b96803dada78724375dd3ef7815cfb19159f2e6efccefde not found: ID does not exist" Sep 13 20:23:58.698775 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:58.698740 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c69d4a64-0336-4f24-86bf-95b910ca1bdc" path="/var/lib/kubelet/pods/c69d4a64-0336-4f24-86bf-95b910ca1bdc/volumes" Sep 13 20:23:59.132870 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:59.132831 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-7hxvc" event={"ID":"274b20c7-f1f9-4596-8cbd-aac40c520e4a","Type":"ContainerStarted","Data":"8c218dc4b0d0381f7ea2b6a143dd3484a8901a67adc02a70460a469203c48d1f"} Sep 13 20:23:59.133345 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:59.132897 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-7hxvc" Sep 13 20:23:59.134450 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:59.134423 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-b7z44" event={"ID":"1c340e8e-86b5-4a93-a5bf-102e39006c5e","Type":"ContainerStarted","Data":"664da7b15fd53f23120cb9646e09c6d964be168017b71a1a61e1ec71d9534106"} Sep 13 20:23:59.149024 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:59.148980 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-7hxvc" podStartSLOduration=1.454609637 podStartE2EDuration="4.148967086s" totalImagesPullingTime="2.694357449s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:23:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:23:59.147474609 +0000 UTC m=+668.964050176" watchObservedRunningTime="2026-09-13 20:23:59.148967086 +0000 UTC m=+668.965542651" Sep 13 20:23:59.161753 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:23:59.161712 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-b7z44" podStartSLOduration=0.947850264 podStartE2EDuration="3.16169686s" totalImagesPullingTime="2.213846596s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:23:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:23:59.16063022 +0000 UTC m=+668.977205785" watchObservedRunningTime="2026-09-13 20:23:59.16169686 +0000 UTC m=+668.978272424" Sep 13 20:24:10.140962 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:10.140932 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-7hxvc" Sep 13 20:24:29.085352 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:29.085313 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-57d46b74dd-fvqw8"] Sep 13 20:24:29.085730 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:29.085693 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c69d4a64-0336-4f24-86bf-95b910ca1bdc" containerName="console" Sep 13 20:24:29.085730 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:29.085711 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="c69d4a64-0336-4f24-86bf-95b910ca1bdc" containerName="console" Sep 13 20:24:29.085824 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:29.085801 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="c69d4a64-0336-4f24-86bf-95b910ca1bdc" containerName="console" Sep 13 20:24:29.088834 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:29.088819 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57d46b74dd-fvqw8" Sep 13 20:24:29.091356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:29.091336 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 13 20:24:29.095383 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:29.095366 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57d46b74dd-fvqw8"] Sep 13 20:24:29.243360 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:29.243327 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/531a970d-42ec-438d-a3f3-86206cd41070-tls-cert\") pod \"authorino-57d46b74dd-fvqw8\" (UID: \"531a970d-42ec-438d-a3f3-86206cd41070\") " pod="kuadrant-system/authorino-57d46b74dd-fvqw8" Sep 13 20:24:29.243519 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:29.243376 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnb8p\" (UniqueName: \"kubernetes.io/projected/531a970d-42ec-438d-a3f3-86206cd41070-kube-api-access-vnb8p\") pod \"authorino-57d46b74dd-fvqw8\" (UID: \"531a970d-42ec-438d-a3f3-86206cd41070\") " pod="kuadrant-system/authorino-57d46b74dd-fvqw8" Sep 13 20:24:29.344356 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:29.344324 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnb8p\" (UniqueName: \"kubernetes.io/projected/531a970d-42ec-438d-a3f3-86206cd41070-kube-api-access-vnb8p\") pod \"authorino-57d46b74dd-fvqw8\" (UID: \"531a970d-42ec-438d-a3f3-86206cd41070\") " pod="kuadrant-system/authorino-57d46b74dd-fvqw8" Sep 13 20:24:29.344506 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:29.344405 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/531a970d-42ec-438d-a3f3-86206cd41070-tls-cert\") pod \"authorino-57d46b74dd-fvqw8\" (UID: \"531a970d-42ec-438d-a3f3-86206cd41070\") " pod="kuadrant-system/authorino-57d46b74dd-fvqw8" Sep 13 20:24:29.346837 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:29.346819 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/531a970d-42ec-438d-a3f3-86206cd41070-tls-cert\") pod \"authorino-57d46b74dd-fvqw8\" (UID: \"531a970d-42ec-438d-a3f3-86206cd41070\") " pod="kuadrant-system/authorino-57d46b74dd-fvqw8" Sep 13 20:24:29.351453 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:29.351430 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnb8p\" (UniqueName: \"kubernetes.io/projected/531a970d-42ec-438d-a3f3-86206cd41070-kube-api-access-vnb8p\") pod \"authorino-57d46b74dd-fvqw8\" (UID: \"531a970d-42ec-438d-a3f3-86206cd41070\") " pod="kuadrant-system/authorino-57d46b74dd-fvqw8" Sep 13 20:24:29.398367 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:29.398344 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57d46b74dd-fvqw8" Sep 13 20:24:29.664223 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:29.664197 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-57d46b74dd-fvqw8"] Sep 13 20:24:29.666757 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:24:29.666722 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod531a970d_42ec_438d_a3f3_86206cd41070.slice/crio-5f7c47b966449092fb484f2d002acc721a905ee9243cc8b4668e12e406a94e3b WatchSource:0}: Error finding container 5f7c47b966449092fb484f2d002acc721a905ee9243cc8b4668e12e406a94e3b: Status 404 returned error can't find the container with id 5f7c47b966449092fb484f2d002acc721a905ee9243cc8b4668e12e406a94e3b Sep 13 20:24:30.273696 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:30.273659 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57d46b74dd-fvqw8" event={"ID":"531a970d-42ec-438d-a3f3-86206cd41070","Type":"ContainerStarted","Data":"f2d70cc44b5222825cede83f87c7d76bfb6e6d9197331cf5607703962413c288"} Sep 13 20:24:30.273696 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:30.273702 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57d46b74dd-fvqw8" event={"ID":"531a970d-42ec-438d-a3f3-86206cd41070","Type":"ContainerStarted","Data":"5f7c47b966449092fb484f2d002acc721a905ee9243cc8b4668e12e406a94e3b"} Sep 13 20:24:30.288455 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:30.288404 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-57d46b74dd-fvqw8" podStartSLOduration=0.895729987 podStartE2EDuration="1.288387417s" totalImagesPullingTime="392.65743ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:24:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:24:30.287472913 +0000 UTC m=+700.104048477" watchObservedRunningTime="2026-09-13 20:24:30.288387417 +0000 UTC m=+700.104963010" Sep 13 20:24:30.310994 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:30.310913 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-b7z44"] Sep 13 20:24:30.311160 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:30.311117 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-b7z44" podUID="1c340e8e-86b5-4a93-a5bf-102e39006c5e" containerName="authorino" containerID="cri-o://664da7b15fd53f23120cb9646e09c6d964be168017b71a1a61e1ec71d9534106" gracePeriod=30 Sep 13 20:24:30.560477 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:30.560445 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-b7z44" Sep 13 20:24:30.656591 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:30.656558 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g5lcp\" (UniqueName: \"kubernetes.io/projected/1c340e8e-86b5-4a93-a5bf-102e39006c5e-kube-api-access-g5lcp\") pod \"1c340e8e-86b5-4a93-a5bf-102e39006c5e\" (UID: \"1c340e8e-86b5-4a93-a5bf-102e39006c5e\") " Sep 13 20:24:30.658719 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:30.658694 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c340e8e-86b5-4a93-a5bf-102e39006c5e-kube-api-access-g5lcp" (OuterVolumeSpecName: "kube-api-access-g5lcp") pod "1c340e8e-86b5-4a93-a5bf-102e39006c5e" (UID: "1c340e8e-86b5-4a93-a5bf-102e39006c5e"). InnerVolumeSpecName "kube-api-access-g5lcp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:24:30.758240 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:30.758196 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g5lcp\" (UniqueName: \"kubernetes.io/projected/1c340e8e-86b5-4a93-a5bf-102e39006c5e-kube-api-access-g5lcp\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:24:31.279548 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:31.279511 2561 generic.go:356] "Generic (PLEG): container finished" podID="1c340e8e-86b5-4a93-a5bf-102e39006c5e" containerID="664da7b15fd53f23120cb9646e09c6d964be168017b71a1a61e1ec71d9534106" exitCode=0 Sep 13 20:24:31.280015 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:31.279553 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-b7z44" Sep 13 20:24:31.280015 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:31.279594 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-b7z44" event={"ID":"1c340e8e-86b5-4a93-a5bf-102e39006c5e","Type":"ContainerDied","Data":"664da7b15fd53f23120cb9646e09c6d964be168017b71a1a61e1ec71d9534106"} Sep 13 20:24:31.280015 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:31.279635 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-b7z44" event={"ID":"1c340e8e-86b5-4a93-a5bf-102e39006c5e","Type":"ContainerDied","Data":"67321e1a05fe5e9c9d0ba57dc0851ec403b37eac4ff9d2c2abdeb766a9d65e97"} Sep 13 20:24:31.280015 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:31.279651 2561 scope.go:117] "RemoveContainer" containerID="664da7b15fd53f23120cb9646e09c6d964be168017b71a1a61e1ec71d9534106" Sep 13 20:24:31.289229 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:31.289191 2561 scope.go:117] "RemoveContainer" containerID="664da7b15fd53f23120cb9646e09c6d964be168017b71a1a61e1ec71d9534106" Sep 13 20:24:31.289649 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:24:31.289630 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"664da7b15fd53f23120cb9646e09c6d964be168017b71a1a61e1ec71d9534106\": container with ID starting with 664da7b15fd53f23120cb9646e09c6d964be168017b71a1a61e1ec71d9534106 not found: ID does not exist" containerID="664da7b15fd53f23120cb9646e09c6d964be168017b71a1a61e1ec71d9534106" Sep 13 20:24:31.289722 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:31.289656 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"664da7b15fd53f23120cb9646e09c6d964be168017b71a1a61e1ec71d9534106"} err="failed to get container status \"664da7b15fd53f23120cb9646e09c6d964be168017b71a1a61e1ec71d9534106\": rpc error: code = NotFound desc = could not find container \"664da7b15fd53f23120cb9646e09c6d964be168017b71a1a61e1ec71d9534106\": container with ID starting with 664da7b15fd53f23120cb9646e09c6d964be168017b71a1a61e1ec71d9534106 not found: ID does not exist" Sep 13 20:24:31.293819 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:31.293798 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-b7z44"] Sep 13 20:24:31.296886 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:31.296865 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-b7z44"] Sep 13 20:24:32.696156 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:24:32.696123 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c340e8e-86b5-4a93-a5bf-102e39006c5e" path="/var/lib/kubelet/pods/1c340e8e-86b5-4a93-a5bf-102e39006c5e/volumes" Sep 13 20:25:12.192938 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:25:12.192894 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7hxvc"] Sep 13 20:25:37.800551 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:25:37.800511 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7hxvc"] Sep 13 20:25:44.903180 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:25:44.903140 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7hxvc"] Sep 13 20:25:52.442828 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:25:52.442791 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7hxvc"] Sep 13 20:26:07.894911 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:07.894872 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7hxvc"] Sep 13 20:26:20.293579 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.293542 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2"] Sep 13 20:26:20.293972 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.293879 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c340e8e-86b5-4a93-a5bf-102e39006c5e" containerName="authorino" Sep 13 20:26:20.293972 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.293891 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c340e8e-86b5-4a93-a5bf-102e39006c5e" containerName="authorino" Sep 13 20:26:20.293972 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.293951 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c340e8e-86b5-4a93-a5bf-102e39006c5e" containerName="authorino" Sep 13 20:26:20.295803 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.295786 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:20.298329 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.298305 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 13 20:26:20.298329 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.298320 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 13 20:26:20.299344 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.299320 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Sep 13 20:26:20.299460 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.299364 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-9rx5w\"" Sep 13 20:26:20.307203 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.307180 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2"] Sep 13 20:26:20.400759 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.400720 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/185591bf-4216-40fd-a5f9-43f0574b6ad0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2\" (UID: \"185591bf-4216-40fd-a5f9-43f0574b6ad0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:20.400906 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.400771 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/185591bf-4216-40fd-a5f9-43f0574b6ad0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2\" (UID: \"185591bf-4216-40fd-a5f9-43f0574b6ad0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:20.400906 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.400861 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmg7r\" (UniqueName: \"kubernetes.io/projected/185591bf-4216-40fd-a5f9-43f0574b6ad0-kube-api-access-hmg7r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2\" (UID: \"185591bf-4216-40fd-a5f9-43f0574b6ad0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:20.400906 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.400894 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/185591bf-4216-40fd-a5f9-43f0574b6ad0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2\" (UID: \"185591bf-4216-40fd-a5f9-43f0574b6ad0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:20.401045 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.400917 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/185591bf-4216-40fd-a5f9-43f0574b6ad0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2\" (UID: \"185591bf-4216-40fd-a5f9-43f0574b6ad0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:20.401045 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.400945 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/185591bf-4216-40fd-a5f9-43f0574b6ad0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2\" (UID: \"185591bf-4216-40fd-a5f9-43f0574b6ad0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:20.502210 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.502185 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/185591bf-4216-40fd-a5f9-43f0574b6ad0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2\" (UID: \"185591bf-4216-40fd-a5f9-43f0574b6ad0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:20.502353 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.502217 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/185591bf-4216-40fd-a5f9-43f0574b6ad0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2\" (UID: \"185591bf-4216-40fd-a5f9-43f0574b6ad0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:20.502353 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.502243 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmg7r\" (UniqueName: \"kubernetes.io/projected/185591bf-4216-40fd-a5f9-43f0574b6ad0-kube-api-access-hmg7r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2\" (UID: \"185591bf-4216-40fd-a5f9-43f0574b6ad0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:20.502353 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.502269 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/185591bf-4216-40fd-a5f9-43f0574b6ad0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2\" (UID: \"185591bf-4216-40fd-a5f9-43f0574b6ad0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:20.502353 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.502293 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/185591bf-4216-40fd-a5f9-43f0574b6ad0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2\" (UID: \"185591bf-4216-40fd-a5f9-43f0574b6ad0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:20.502353 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.502329 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/185591bf-4216-40fd-a5f9-43f0574b6ad0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2\" (UID: \"185591bf-4216-40fd-a5f9-43f0574b6ad0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:20.502650 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.502631 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/185591bf-4216-40fd-a5f9-43f0574b6ad0-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2\" (UID: \"185591bf-4216-40fd-a5f9-43f0574b6ad0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:20.502744 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.502723 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/185591bf-4216-40fd-a5f9-43f0574b6ad0-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2\" (UID: \"185591bf-4216-40fd-a5f9-43f0574b6ad0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:20.502803 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.502731 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/185591bf-4216-40fd-a5f9-43f0574b6ad0-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2\" (UID: \"185591bf-4216-40fd-a5f9-43f0574b6ad0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:20.504514 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.504496 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/185591bf-4216-40fd-a5f9-43f0574b6ad0-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2\" (UID: \"185591bf-4216-40fd-a5f9-43f0574b6ad0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:20.504930 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.504906 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/185591bf-4216-40fd-a5f9-43f0574b6ad0-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2\" (UID: \"185591bf-4216-40fd-a5f9-43f0574b6ad0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:20.509707 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.509681 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmg7r\" (UniqueName: \"kubernetes.io/projected/185591bf-4216-40fd-a5f9-43f0574b6ad0-kube-api-access-hmg7r\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2\" (UID: \"185591bf-4216-40fd-a5f9-43f0574b6ad0\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:20.606391 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.606358 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:20.871030 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:20.870881 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2"] Sep 13 20:26:20.873097 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:26:20.873069 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod185591bf_4216_40fd_a5f9_43f0574b6ad0.slice/crio-ab268281341e48893f0020a8a6e5226089573fd9d658aa602ff934dd72c4d1c6 WatchSource:0}: Error finding container ab268281341e48893f0020a8a6e5226089573fd9d658aa602ff934dd72c4d1c6: Status 404 returned error can't find the container with id ab268281341e48893f0020a8a6e5226089573fd9d658aa602ff934dd72c4d1c6 Sep 13 20:26:21.752516 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:21.752484 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" event={"ID":"185591bf-4216-40fd-a5f9-43f0574b6ad0","Type":"ContainerStarted","Data":"ab268281341e48893f0020a8a6e5226089573fd9d658aa602ff934dd72c4d1c6"} Sep 13 20:26:21.794716 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:21.794643 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7hxvc"] Sep 13 20:26:22.759052 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:22.759018 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" event={"ID":"185591bf-4216-40fd-a5f9-43f0574b6ad0","Type":"ContainerStarted","Data":"f6196812b5537736f1cd01e5290e9c2c2baf9d1bd6ee1b2460ac6540b00ec45b"} Sep 13 20:26:22.774720 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:22.774659 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" podStartSLOduration=1.763746464 podStartE2EDuration="2.774641708s" totalImagesPullingTime="1.010895244s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:26:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:26:22.773969743 +0000 UTC m=+812.590545322" watchObservedRunningTime="2026-09-13 20:26:22.774641708 +0000 UTC m=+812.591217275" Sep 13 20:26:27.992797 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:27.992763 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc"] Sep 13 20:26:27.995215 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:27.995192 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:27.997896 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:27.997873 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Sep 13 20:26:28.008874 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.008849 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc"] Sep 13 20:26:28.072257 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.072222 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85ba0654-3ecf-40ec-bf8e-b52104ad1783-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jscsc\" (UID: \"85ba0654-3ecf-40ec-bf8e-b52104ad1783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:28.072408 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.072274 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85ba0654-3ecf-40ec-bf8e-b52104ad1783-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jscsc\" (UID: \"85ba0654-3ecf-40ec-bf8e-b52104ad1783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:28.072408 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.072327 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85ba0654-3ecf-40ec-bf8e-b52104ad1783-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jscsc\" (UID: \"85ba0654-3ecf-40ec-bf8e-b52104ad1783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:28.072408 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.072369 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85ba0654-3ecf-40ec-bf8e-b52104ad1783-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jscsc\" (UID: \"85ba0654-3ecf-40ec-bf8e-b52104ad1783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:28.072408 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.072396 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw9wl\" (UniqueName: \"kubernetes.io/projected/85ba0654-3ecf-40ec-bf8e-b52104ad1783-kube-api-access-kw9wl\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jscsc\" (UID: \"85ba0654-3ecf-40ec-bf8e-b52104ad1783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:28.072565 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.072415 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85ba0654-3ecf-40ec-bf8e-b52104ad1783-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jscsc\" (UID: \"85ba0654-3ecf-40ec-bf8e-b52104ad1783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:28.173198 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.173156 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85ba0654-3ecf-40ec-bf8e-b52104ad1783-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jscsc\" (UID: \"85ba0654-3ecf-40ec-bf8e-b52104ad1783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:28.173391 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.173212 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85ba0654-3ecf-40ec-bf8e-b52104ad1783-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jscsc\" (UID: \"85ba0654-3ecf-40ec-bf8e-b52104ad1783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:28.173391 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.173249 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85ba0654-3ecf-40ec-bf8e-b52104ad1783-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jscsc\" (UID: \"85ba0654-3ecf-40ec-bf8e-b52104ad1783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:28.173391 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.173283 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85ba0654-3ecf-40ec-bf8e-b52104ad1783-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jscsc\" (UID: \"85ba0654-3ecf-40ec-bf8e-b52104ad1783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:28.173556 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.173440 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw9wl\" (UniqueName: \"kubernetes.io/projected/85ba0654-3ecf-40ec-bf8e-b52104ad1783-kube-api-access-kw9wl\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jscsc\" (UID: \"85ba0654-3ecf-40ec-bf8e-b52104ad1783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:28.173556 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.173484 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85ba0654-3ecf-40ec-bf8e-b52104ad1783-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jscsc\" (UID: \"85ba0654-3ecf-40ec-bf8e-b52104ad1783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:28.173657 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.173618 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/85ba0654-3ecf-40ec-bf8e-b52104ad1783-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jscsc\" (UID: \"85ba0654-3ecf-40ec-bf8e-b52104ad1783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:28.173657 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.173628 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/85ba0654-3ecf-40ec-bf8e-b52104ad1783-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jscsc\" (UID: \"85ba0654-3ecf-40ec-bf8e-b52104ad1783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:28.173866 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.173848 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/85ba0654-3ecf-40ec-bf8e-b52104ad1783-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jscsc\" (UID: \"85ba0654-3ecf-40ec-bf8e-b52104ad1783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:28.175475 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.175452 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/85ba0654-3ecf-40ec-bf8e-b52104ad1783-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jscsc\" (UID: \"85ba0654-3ecf-40ec-bf8e-b52104ad1783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:28.175785 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.175766 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/85ba0654-3ecf-40ec-bf8e-b52104ad1783-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jscsc\" (UID: \"85ba0654-3ecf-40ec-bf8e-b52104ad1783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:28.181101 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.181084 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw9wl\" (UniqueName: \"kubernetes.io/projected/85ba0654-3ecf-40ec-bf8e-b52104ad1783-kube-api-access-kw9wl\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-jscsc\" (UID: \"85ba0654-3ecf-40ec-bf8e-b52104ad1783\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:28.309941 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.309847 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:28.576353 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.576280 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc"] Sep 13 20:26:28.579291 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:26:28.579267 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod85ba0654_3ecf_40ec_bf8e_b52104ad1783.slice/crio-2732bd40aec1e8d63e6a97b092728a980e1b65c86beaf932dbb9526a1f2e07d8 WatchSource:0}: Error finding container 2732bd40aec1e8d63e6a97b092728a980e1b65c86beaf932dbb9526a1f2e07d8: Status 404 returned error can't find the container with id 2732bd40aec1e8d63e6a97b092728a980e1b65c86beaf932dbb9526a1f2e07d8 Sep 13 20:26:28.788125 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.788097 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" event={"ID":"85ba0654-3ecf-40ec-bf8e-b52104ad1783","Type":"ContainerStarted","Data":"60644b673057f5ae02638e601e15ec9cb5db685b308088a21ac52231be15a90e"} Sep 13 20:26:28.788247 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.788148 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" event={"ID":"85ba0654-3ecf-40ec-bf8e-b52104ad1783","Type":"ContainerStarted","Data":"2732bd40aec1e8d63e6a97b092728a980e1b65c86beaf932dbb9526a1f2e07d8"} Sep 13 20:26:28.803936 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:28.803889 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" podStartSLOduration=1.6586514129999999 podStartE2EDuration="1.803872536s" totalImagesPullingTime="145.221123ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:26:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:26:28.802945931 +0000 UTC m=+818.619521497" watchObservedRunningTime="2026-09-13 20:26:28.803872536 +0000 UTC m=+818.620448099" Sep 13 20:26:29.595785 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:29.595744 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-7hxvc"] Sep 13 20:26:30.607002 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:30.606950 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:30.607474 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:30.607027 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:30.619516 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:30.619492 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:30.810369 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:30.810331 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fgmcj2" Sep 13 20:26:38.310879 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:38.310838 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:38.311397 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:38.310901 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:38.323039 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:38.323014 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:26:38.842367 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:26:38.842338 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-jscsc" Sep 13 20:27:42.221395 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:42.221364 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-64fbbfb745-hbmbs"] Sep 13 20:27:42.224506 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:42.224483 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64fbbfb745-hbmbs" Sep 13 20:27:42.232464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:42.232441 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64fbbfb745-hbmbs"] Sep 13 20:27:42.395113 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:42.389945 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh2dz\" (UniqueName: \"kubernetes.io/projected/520ed8ae-24ca-4e8f-b829-49c72e508c1a-kube-api-access-jh2dz\") pod \"authorino-64fbbfb745-hbmbs\" (UID: \"520ed8ae-24ca-4e8f-b829-49c72e508c1a\") " pod="kuadrant-system/authorino-64fbbfb745-hbmbs" Sep 13 20:27:42.395113 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:42.390558 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/520ed8ae-24ca-4e8f-b829-49c72e508c1a-tls-cert\") pod \"authorino-64fbbfb745-hbmbs\" (UID: \"520ed8ae-24ca-4e8f-b829-49c72e508c1a\") " pod="kuadrant-system/authorino-64fbbfb745-hbmbs" Sep 13 20:27:42.491101 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:42.491025 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh2dz\" (UniqueName: \"kubernetes.io/projected/520ed8ae-24ca-4e8f-b829-49c72e508c1a-kube-api-access-jh2dz\") pod \"authorino-64fbbfb745-hbmbs\" (UID: \"520ed8ae-24ca-4e8f-b829-49c72e508c1a\") " pod="kuadrant-system/authorino-64fbbfb745-hbmbs" Sep 13 20:27:42.491203 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:42.491106 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/520ed8ae-24ca-4e8f-b829-49c72e508c1a-tls-cert\") pod \"authorino-64fbbfb745-hbmbs\" (UID: \"520ed8ae-24ca-4e8f-b829-49c72e508c1a\") " pod="kuadrant-system/authorino-64fbbfb745-hbmbs" Sep 13 20:27:42.493477 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:42.493458 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/520ed8ae-24ca-4e8f-b829-49c72e508c1a-tls-cert\") pod \"authorino-64fbbfb745-hbmbs\" (UID: \"520ed8ae-24ca-4e8f-b829-49c72e508c1a\") " pod="kuadrant-system/authorino-64fbbfb745-hbmbs" Sep 13 20:27:42.500380 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:42.500353 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh2dz\" (UniqueName: \"kubernetes.io/projected/520ed8ae-24ca-4e8f-b829-49c72e508c1a-kube-api-access-jh2dz\") pod \"authorino-64fbbfb745-hbmbs\" (UID: \"520ed8ae-24ca-4e8f-b829-49c72e508c1a\") " pod="kuadrant-system/authorino-64fbbfb745-hbmbs" Sep 13 20:27:42.561389 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:42.561356 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-64fbbfb745-hbmbs" Sep 13 20:27:42.825537 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:42.825462 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-64fbbfb745-hbmbs"] Sep 13 20:27:42.827671 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:27:42.827635 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod520ed8ae_24ca_4e8f_b829_49c72e508c1a.slice/crio-69e8a858729895d78171fbdd61d8afbb67a4f3e65b0dc37472307e0d6a9a4f81 WatchSource:0}: Error finding container 69e8a858729895d78171fbdd61d8afbb67a4f3e65b0dc37472307e0d6a9a4f81: Status 404 returned error can't find the container with id 69e8a858729895d78171fbdd61d8afbb67a4f3e65b0dc37472307e0d6a9a4f81 Sep 13 20:27:43.104404 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:43.104340 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64fbbfb745-hbmbs" event={"ID":"520ed8ae-24ca-4e8f-b829-49c72e508c1a","Type":"ContainerStarted","Data":"69e8a858729895d78171fbdd61d8afbb67a4f3e65b0dc37472307e0d6a9a4f81"} Sep 13 20:27:44.112158 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:44.112113 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-64fbbfb745-hbmbs" event={"ID":"520ed8ae-24ca-4e8f-b829-49c72e508c1a","Type":"ContainerStarted","Data":"3fd17049f9819ea97dd59ecae7025b0fa057ba6f14cfb6e7e76aec6fb0b29bb3"} Sep 13 20:27:44.128464 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:44.128386 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-64fbbfb745-hbmbs" podStartSLOduration=1.28540035 podStartE2EDuration="2.128363957s" totalImagesPullingTime="842.963607ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:27:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:27:44.127443954 +0000 UTC m=+893.944019519" watchObservedRunningTime="2026-09-13 20:27:44.128363957 +0000 UTC m=+893.944939524" Sep 13 20:27:44.153818 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:44.153772 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57d46b74dd-fvqw8"] Sep 13 20:27:44.154457 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:44.154226 2561 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-57d46b74dd-fvqw8" podUID="531a970d-42ec-438d-a3f3-86206cd41070" containerName="authorino" containerID="cri-o://f2d70cc44b5222825cede83f87c7d76bfb6e6d9197331cf5607703962413c288" gracePeriod=30 Sep 13 20:27:44.433075 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:44.433028 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57d46b74dd-fvqw8" Sep 13 20:27:44.508384 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:44.508334 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/531a970d-42ec-438d-a3f3-86206cd41070-tls-cert\") pod \"531a970d-42ec-438d-a3f3-86206cd41070\" (UID: \"531a970d-42ec-438d-a3f3-86206cd41070\") " Sep 13 20:27:44.508537 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:44.508500 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vnb8p\" (UniqueName: \"kubernetes.io/projected/531a970d-42ec-438d-a3f3-86206cd41070-kube-api-access-vnb8p\") pod \"531a970d-42ec-438d-a3f3-86206cd41070\" (UID: \"531a970d-42ec-438d-a3f3-86206cd41070\") " Sep 13 20:27:44.510479 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:44.510447 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/531a970d-42ec-438d-a3f3-86206cd41070-kube-api-access-vnb8p" (OuterVolumeSpecName: "kube-api-access-vnb8p") pod "531a970d-42ec-438d-a3f3-86206cd41070" (UID: "531a970d-42ec-438d-a3f3-86206cd41070"). InnerVolumeSpecName "kube-api-access-vnb8p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 13 20:27:44.518042 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:44.518005 2561 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/531a970d-42ec-438d-a3f3-86206cd41070-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "531a970d-42ec-438d-a3f3-86206cd41070" (UID: "531a970d-42ec-438d-a3f3-86206cd41070"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 13 20:27:44.609112 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:44.609078 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vnb8p\" (UniqueName: \"kubernetes.io/projected/531a970d-42ec-438d-a3f3-86206cd41070-kube-api-access-vnb8p\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:27:44.609112 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:44.609106 2561 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/531a970d-42ec-438d-a3f3-86206cd41070-tls-cert\") on node \"ip-10-0-141-59.ec2.internal\" DevicePath \"\"" Sep 13 20:27:45.117556 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:45.117517 2561 generic.go:356] "Generic (PLEG): container finished" podID="531a970d-42ec-438d-a3f3-86206cd41070" containerID="f2d70cc44b5222825cede83f87c7d76bfb6e6d9197331cf5607703962413c288" exitCode=0 Sep 13 20:27:45.118018 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:45.117570 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-57d46b74dd-fvqw8" Sep 13 20:27:45.118018 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:45.117599 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57d46b74dd-fvqw8" event={"ID":"531a970d-42ec-438d-a3f3-86206cd41070","Type":"ContainerDied","Data":"f2d70cc44b5222825cede83f87c7d76bfb6e6d9197331cf5607703962413c288"} Sep 13 20:27:45.118018 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:45.117644 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-57d46b74dd-fvqw8" event={"ID":"531a970d-42ec-438d-a3f3-86206cd41070","Type":"ContainerDied","Data":"5f7c47b966449092fb484f2d002acc721a905ee9243cc8b4668e12e406a94e3b"} Sep 13 20:27:45.118018 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:45.117662 2561 scope.go:117] "RemoveContainer" containerID="f2d70cc44b5222825cede83f87c7d76bfb6e6d9197331cf5607703962413c288" Sep 13 20:27:45.126332 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:45.126313 2561 scope.go:117] "RemoveContainer" containerID="f2d70cc44b5222825cede83f87c7d76bfb6e6d9197331cf5607703962413c288" Sep 13 20:27:45.126645 ip-10-0-141-59 kubenswrapper[2561]: E0913 20:27:45.126621 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2d70cc44b5222825cede83f87c7d76bfb6e6d9197331cf5607703962413c288\": container with ID starting with f2d70cc44b5222825cede83f87c7d76bfb6e6d9197331cf5607703962413c288 not found: ID does not exist" containerID="f2d70cc44b5222825cede83f87c7d76bfb6e6d9197331cf5607703962413c288" Sep 13 20:27:45.126807 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:45.126659 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2d70cc44b5222825cede83f87c7d76bfb6e6d9197331cf5607703962413c288"} err="failed to get container status \"f2d70cc44b5222825cede83f87c7d76bfb6e6d9197331cf5607703962413c288\": rpc error: code = NotFound desc = could not find container \"f2d70cc44b5222825cede83f87c7d76bfb6e6d9197331cf5607703962413c288\": container with ID starting with f2d70cc44b5222825cede83f87c7d76bfb6e6d9197331cf5607703962413c288 not found: ID does not exist" Sep 13 20:27:45.133145 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:45.133114 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-57d46b74dd-fvqw8"] Sep 13 20:27:45.136411 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:45.136388 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-57d46b74dd-fvqw8"] Sep 13 20:27:46.696698 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:27:46.696651 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="531a970d-42ec-438d-a3f3-86206cd41070" path="/var/lib/kubelet/pods/531a970d-42ec-438d-a3f3-86206cd41070/volumes" Sep 13 20:31:32.577894 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:32.577865 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-tqzd4_599cb3c5-7fb7-4f7c-bacc-e500d844967e/global-pull-secret-syncer/0.log" Sep 13 20:31:32.665315 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:32.665274 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-rj2v7_ae6e4a30-1019-4b10-980a-2938365bdc5f/konnectivity-agent/0.log" Sep 13 20:31:32.726585 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:32.726556 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-59.ec2.internal_adb95b757af8a0d6b709ad0e466205b6/haproxy/0.log" Sep 13 20:31:37.512384 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:37.512351 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-64fbbfb745-hbmbs_520ed8ae-24ca-4e8f-b829-49c72e508c1a/authorino/0.log" Sep 13 20:31:37.622708 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:37.622676 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-9wlht_ea6553ea-d9e2-4684-8d04-747bc1e826a3/kuadrant-console-plugin/0.log" Sep 13 20:31:37.690268 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:37.690234 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-7hxvc_274b20c7-f1f9-4596-8cbd-aac40c520e4a/limitador/0.log" Sep 13 20:31:38.324433 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:38.324399 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-66wrq"] Sep 13 20:31:38.325574 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:38.325527 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="531a970d-42ec-438d-a3f3-86206cd41070" containerName="authorino" Sep 13 20:31:38.325812 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:38.325798 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="531a970d-42ec-438d-a3f3-86206cd41070" containerName="authorino" Sep 13 20:31:38.326292 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:38.326277 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="531a970d-42ec-438d-a3f3-86206cd41070" containerName="authorino" Sep 13 20:31:38.332351 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:38.332325 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-66wrq" Sep 13 20:31:38.334809 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:38.334786 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 13 20:31:38.335113 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:38.335091 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-k9jgj\"" Sep 13 20:31:38.335558 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:38.335535 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-66wrq"] Sep 13 20:31:38.461690 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:38.461654 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb5hv\" (UniqueName: \"kubernetes.io/projected/80fb8f17-9c1f-4208-b08c-b8186488ba4a-kube-api-access-cb5hv\") pod \"payload-pre-processing-59fbc47bf8-66wrq\" (UID: \"80fb8f17-9c1f-4208-b08c-b8186488ba4a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-66wrq" Sep 13 20:31:38.461875 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:38.461789 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80fb8f17-9c1f-4208-b08c-b8186488ba4a-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-66wrq\" (UID: \"80fb8f17-9c1f-4208-b08c-b8186488ba4a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-66wrq" Sep 13 20:31:38.562700 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:38.562656 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80fb8f17-9c1f-4208-b08c-b8186488ba4a-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-66wrq\" (UID: \"80fb8f17-9c1f-4208-b08c-b8186488ba4a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-66wrq" Sep 13 20:31:38.563105 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:38.562715 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb5hv\" (UniqueName: \"kubernetes.io/projected/80fb8f17-9c1f-4208-b08c-b8186488ba4a-kube-api-access-cb5hv\") pod \"payload-pre-processing-59fbc47bf8-66wrq\" (UID: \"80fb8f17-9c1f-4208-b08c-b8186488ba4a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-66wrq" Sep 13 20:31:38.563432 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:38.563411 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/80fb8f17-9c1f-4208-b08c-b8186488ba4a-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-66wrq\" (UID: \"80fb8f17-9c1f-4208-b08c-b8186488ba4a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-66wrq" Sep 13 20:31:38.570026 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:38.570001 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb5hv\" (UniqueName: \"kubernetes.io/projected/80fb8f17-9c1f-4208-b08c-b8186488ba4a-kube-api-access-cb5hv\") pod \"payload-pre-processing-59fbc47bf8-66wrq\" (UID: \"80fb8f17-9c1f-4208-b08c-b8186488ba4a\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-66wrq" Sep 13 20:31:38.644694 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:38.644657 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-66wrq" Sep 13 20:31:38.916264 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:38.916153 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-66wrq"] Sep 13 20:31:38.922636 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:38.922618 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 13 20:31:39.136134 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:39.136101 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-66wrq" event={"ID":"80fb8f17-9c1f-4208-b08c-b8186488ba4a","Type":"ContainerStarted","Data":"0cfcdc8f4f4333a0d2319562eafacc8ec268d396a57a467e9a6aed6aa1baf268"} Sep 13 20:31:39.359686 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:39.359660 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37056b57-da7d-4256-8ad4-95fb3d8b8924/alertmanager/0.log" Sep 13 20:31:39.382024 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:39.382001 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37056b57-da7d-4256-8ad4-95fb3d8b8924/config-reloader/0.log" Sep 13 20:31:39.402597 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:39.402568 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37056b57-da7d-4256-8ad4-95fb3d8b8924/kube-rbac-proxy-web/0.log" Sep 13 20:31:39.425341 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:39.425314 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37056b57-da7d-4256-8ad4-95fb3d8b8924/kube-rbac-proxy/0.log" Sep 13 20:31:39.449345 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:39.449317 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37056b57-da7d-4256-8ad4-95fb3d8b8924/kube-rbac-proxy-metric/0.log" Sep 13 20:31:39.471552 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:39.471520 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37056b57-da7d-4256-8ad4-95fb3d8b8924/prom-label-proxy/0.log" Sep 13 20:31:39.496266 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:39.496237 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_37056b57-da7d-4256-8ad4-95fb3d8b8924/init-config-reloader/0.log" Sep 13 20:31:39.568380 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:39.568346 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-wxhbb_eb6ed232-0d31-4001-a956-5b9f25463dea/kube-state-metrics/0.log" Sep 13 20:31:39.588488 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:39.588447 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-wxhbb_eb6ed232-0d31-4001-a956-5b9f25463dea/kube-rbac-proxy-main/0.log" Sep 13 20:31:39.612210 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:39.612133 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-59fbdd77d-wxhbb_eb6ed232-0d31-4001-a956-5b9f25463dea/kube-rbac-proxy-self/0.log" Sep 13 20:31:39.640014 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:39.639984 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-d4766f978-gdr49_937a943d-118b-437a-8e47-bed42c6b759e/metrics-server/0.log" Sep 13 20:31:39.782519 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:39.782490 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c78jc_8a03fd19-2202-4788-91a1-07cce1d7571d/node-exporter/0.log" Sep 13 20:31:39.802457 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:39.802426 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c78jc_8a03fd19-2202-4788-91a1-07cce1d7571d/kube-rbac-proxy/0.log" Sep 13 20:31:39.821607 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:39.821579 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-c78jc_8a03fd19-2202-4788-91a1-07cce1d7571d/init-textfile/0.log" Sep 13 20:31:40.329649 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:40.329625 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5864cd99d7-gnjx4_f8839133-f5f7-4a80-b0c7-9583a22650e2/prometheus-operator-admission-webhook/0.log" Sep 13 20:31:40.396565 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:40.396533 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57c7875ff5-29qdr_06ef87de-8e51-4c65-ace2-d35d45883d31/telemeter-client/0.log" Sep 13 20:31:40.434511 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:40.434473 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57c7875ff5-29qdr_06ef87de-8e51-4c65-ace2-d35d45883d31/reload/0.log" Sep 13 20:31:40.458812 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:40.458738 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-57c7875ff5-29qdr_06ef87de-8e51-4c65-ace2-d35d45883d31/kube-rbac-proxy/0.log" Sep 13 20:31:41.148512 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:41.148475 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-66wrq" event={"ID":"80fb8f17-9c1f-4208-b08c-b8186488ba4a","Type":"ContainerStarted","Data":"ffcae26f77aa836e748fed6049854678b7814ea394bb42cdab995ddf31273fe4"} Sep 13 20:31:41.148906 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:41.148613 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-66wrq" Sep 13 20:31:41.166423 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:41.166373 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-66wrq" podStartSLOduration=1.8858635320000001 podStartE2EDuration="3.166358052s" totalImagesPullingTime="1.28049452s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-13 20:31:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:31:41.165286907 +0000 UTC m=+1130.981862471" watchObservedRunningTime="2026-09-13 20:31:41.166358052 +0000 UTC m=+1130.982933615" Sep 13 20:31:42.852868 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:42.852828 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z"] Sep 13 20:31:42.856563 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:42.856538 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" Sep 13 20:31:42.858678 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:42.858653 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-6p8pc\"/\"default-dockercfg-kbdk7\"" Sep 13 20:31:42.858793 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:42.858673 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6p8pc\"/\"kube-root-ca.crt\"" Sep 13 20:31:42.859698 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:42.859678 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-6p8pc\"/\"openshift-service-ca.crt\"" Sep 13 20:31:42.865954 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:42.865930 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z"] Sep 13 20:31:42.901670 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:42.901621 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/440fca15-59c7-4e45-9277-46fb77241d45-lib-modules\") pod \"perf-node-gather-daemonset-6794z\" (UID: \"440fca15-59c7-4e45-9277-46fb77241d45\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" Sep 13 20:31:42.901858 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:42.901709 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/440fca15-59c7-4e45-9277-46fb77241d45-proc\") pod \"perf-node-gather-daemonset-6794z\" (UID: \"440fca15-59c7-4e45-9277-46fb77241d45\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" Sep 13 20:31:42.901858 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:42.901771 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/440fca15-59c7-4e45-9277-46fb77241d45-podres\") pod \"perf-node-gather-daemonset-6794z\" (UID: \"440fca15-59c7-4e45-9277-46fb77241d45\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" Sep 13 20:31:42.901858 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:42.901792 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/440fca15-59c7-4e45-9277-46fb77241d45-sys\") pod \"perf-node-gather-daemonset-6794z\" (UID: \"440fca15-59c7-4e45-9277-46fb77241d45\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" Sep 13 20:31:42.901858 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:42.901811 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hrnt\" (UniqueName: \"kubernetes.io/projected/440fca15-59c7-4e45-9277-46fb77241d45-kube-api-access-4hrnt\") pod \"perf-node-gather-daemonset-6794z\" (UID: \"440fca15-59c7-4e45-9277-46fb77241d45\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" Sep 13 20:31:43.003199 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:43.003148 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/440fca15-59c7-4e45-9277-46fb77241d45-proc\") pod \"perf-node-gather-daemonset-6794z\" (UID: \"440fca15-59c7-4e45-9277-46fb77241d45\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" Sep 13 20:31:43.003362 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:43.003254 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/440fca15-59c7-4e45-9277-46fb77241d45-podres\") pod \"perf-node-gather-daemonset-6794z\" (UID: \"440fca15-59c7-4e45-9277-46fb77241d45\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" Sep 13 20:31:43.003362 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:43.003280 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/440fca15-59c7-4e45-9277-46fb77241d45-proc\") pod \"perf-node-gather-daemonset-6794z\" (UID: \"440fca15-59c7-4e45-9277-46fb77241d45\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" Sep 13 20:31:43.003362 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:43.003289 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/440fca15-59c7-4e45-9277-46fb77241d45-sys\") pod \"perf-node-gather-daemonset-6794z\" (UID: \"440fca15-59c7-4e45-9277-46fb77241d45\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" Sep 13 20:31:43.003362 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:43.003318 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hrnt\" (UniqueName: \"kubernetes.io/projected/440fca15-59c7-4e45-9277-46fb77241d45-kube-api-access-4hrnt\") pod \"perf-node-gather-daemonset-6794z\" (UID: \"440fca15-59c7-4e45-9277-46fb77241d45\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" Sep 13 20:31:43.003584 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:43.003367 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/440fca15-59c7-4e45-9277-46fb77241d45-lib-modules\") pod \"perf-node-gather-daemonset-6794z\" (UID: \"440fca15-59c7-4e45-9277-46fb77241d45\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" Sep 13 20:31:43.003584 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:43.003385 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/440fca15-59c7-4e45-9277-46fb77241d45-sys\") pod \"perf-node-gather-daemonset-6794z\" (UID: \"440fca15-59c7-4e45-9277-46fb77241d45\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" Sep 13 20:31:43.003584 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:43.003404 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/440fca15-59c7-4e45-9277-46fb77241d45-podres\") pod \"perf-node-gather-daemonset-6794z\" (UID: \"440fca15-59c7-4e45-9277-46fb77241d45\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" Sep 13 20:31:43.003584 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:43.003472 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/440fca15-59c7-4e45-9277-46fb77241d45-lib-modules\") pod \"perf-node-gather-daemonset-6794z\" (UID: \"440fca15-59c7-4e45-9277-46fb77241d45\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" Sep 13 20:31:43.010975 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:43.010935 2561 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hrnt\" (UniqueName: \"kubernetes.io/projected/440fca15-59c7-4e45-9277-46fb77241d45-kube-api-access-4hrnt\") pod \"perf-node-gather-daemonset-6794z\" (UID: \"440fca15-59c7-4e45-9277-46fb77241d45\") " pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" Sep 13 20:31:43.166764 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:43.166677 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" Sep 13 20:31:43.258548 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:43.258517 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-76f99584f4-w9xl8_549374a0-fa86-42fc-9a83-cb70ac440f2d/download-server/0.log" Sep 13 20:31:43.440550 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:43.440525 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z"] Sep 13 20:31:43.443214 ip-10-0-141-59 kubenswrapper[2561]: W0913 20:31:43.443184 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod440fca15_59c7_4e45_9277_46fb77241d45.slice/crio-ff4a2d56c291cba84ca6bf456fcc5b5859411fd686d265193cabc0627b93aa3b WatchSource:0}: Error finding container ff4a2d56c291cba84ca6bf456fcc5b5859411fd686d265193cabc0627b93aa3b: Status 404 returned error can't find the container with id ff4a2d56c291cba84ca6bf456fcc5b5859411fd686d265193cabc0627b93aa3b Sep 13 20:31:44.162182 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:44.162145 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" event={"ID":"440fca15-59c7-4e45-9277-46fb77241d45","Type":"ContainerStarted","Data":"d72beb91e3f9f8cc3adbc3d336f749d69e37267963818ea51d5f5d56e547605e"} Sep 13 20:31:44.162558 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:44.162197 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" event={"ID":"440fca15-59c7-4e45-9277-46fb77241d45","Type":"ContainerStarted","Data":"ff4a2d56c291cba84ca6bf456fcc5b5859411fd686d265193cabc0627b93aa3b"} Sep 13 20:31:44.162558 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:44.162233 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" Sep 13 20:31:44.178256 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:44.178196 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" podStartSLOduration=2.178179615 podStartE2EDuration="2.178179615s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-13 20:31:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-13 20:31:44.177030217 +0000 UTC m=+1133.993605784" watchObservedRunningTime="2026-09-13 20:31:44.178179615 +0000 UTC m=+1133.994755179" Sep 13 20:31:44.921151 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:44.921125 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2mhhk_948ab05f-dc3d-48aa-b295-3ecc708ae659/dns/0.log" Sep 13 20:31:44.939976 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:44.939949 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2mhhk_948ab05f-dc3d-48aa-b295-3ecc708ae659/kube-rbac-proxy/0.log" Sep 13 20:31:45.053378 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:45.053350 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lj9m7_428ee95f-1def-45a2-9238-552a99aa32f2/dns-node-resolver/0.log" Sep 13 20:31:45.631314 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:45.631290 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-ffvkb_b39db385-6547-430c-894e-4976abd54196/node-ca/0.log" Sep 13 20:31:46.585138 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:46.585108 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54976cff48-7dgcb_18f88ad6-f254-46d4-a31c-10bdd15474d7/kube-auth-proxy/0.log" Sep 13 20:31:46.649891 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:46.649860 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-66wrq_80fb8f17-9c1f-4208-b08c-b8186488ba4a/payload-pre-processing/0.log" Sep 13 20:31:47.332740 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:47.332712 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-m5jng_d971a502-448a-4f93-9714-3929a9d7b868/serve-healthcheck-canary/0.log" Sep 13 20:31:47.814016 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:47.813976 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-btjbg_7d734676-73f6-4aa1-a8aa-025293c8393e/kube-rbac-proxy/0.log" Sep 13 20:31:47.833086 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:47.833002 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-btjbg_7d734676-73f6-4aa1-a8aa-025293c8393e/exporter/0.log" Sep 13 20:31:47.855807 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:47.855784 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-btjbg_7d734676-73f6-4aa1-a8aa-025293c8393e/extractor/0.log" Sep 13 20:31:50.177241 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:50.177212 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-6p8pc/perf-node-gather-daemonset-6794z" Sep 13 20:31:50.247176 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:50.247144 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84f9f8b966-9w4rj_80058ba7-2e42-4b29-b240-2a193e7afba3/manager/0.log" Sep 13 20:31:50.261509 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:50.261485 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84f9f8b966-9w4rj_80058ba7-2e42-4b29-b240-2a193e7afba3/copy-manifests/0.log" Sep 13 20:31:51.540222 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:51.540193 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-768f8bb9c7-ff6qh_62c0719e-cebc-419c-8e1d-0425b847a577/manager/0.log" Sep 13 20:31:52.154741 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:52.154710 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-66wrq" Sep 13 20:31:53.497490 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:53.497459 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54976cff48-7dgcb_18f88ad6-f254-46d4-a31c-10bdd15474d7/kube-auth-proxy/0.log" Sep 13 20:31:53.546098 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:53.546054 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-66wrq_80fb8f17-9c1f-4208-b08c-b8186488ba4a/payload-pre-processing/0.log" Sep 13 20:31:54.804515 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:54.804440 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-54976cff48-7dgcb_18f88ad6-f254-46d4-a31c-10bdd15474d7/kube-auth-proxy/0.log" Sep 13 20:31:54.856151 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:54.856124 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-66wrq_80fb8f17-9c1f-4208-b08c-b8186488ba4a/payload-pre-processing/0.log" Sep 13 20:31:58.098977 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:58.098947 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h4zf8_43f60dd5-273c-43c1-8c93-e8d20b6e8540/kube-multus-additional-cni-plugins/0.log" Sep 13 20:31:58.117892 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:58.117869 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h4zf8_43f60dd5-273c-43c1-8c93-e8d20b6e8540/egress-router-binary-copy/0.log" Sep 13 20:31:58.136149 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:58.136128 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h4zf8_43f60dd5-273c-43c1-8c93-e8d20b6e8540/cni-plugins/0.log" Sep 13 20:31:58.154946 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:58.154921 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h4zf8_43f60dd5-273c-43c1-8c93-e8d20b6e8540/bond-cni-plugin/0.log" Sep 13 20:31:58.174549 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:58.174522 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h4zf8_43f60dd5-273c-43c1-8c93-e8d20b6e8540/routeoverride-cni/0.log" Sep 13 20:31:58.192333 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:58.192305 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h4zf8_43f60dd5-273c-43c1-8c93-e8d20b6e8540/whereabouts-cni-bincopy/0.log" Sep 13 20:31:58.211291 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:58.211261 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-h4zf8_43f60dd5-273c-43c1-8c93-e8d20b6e8540/whereabouts-cni/0.log" Sep 13 20:31:58.511133 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:58.511105 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-nbqnk_ab1d9571-0fb7-43a9-83b1-3980310e1650/kube-multus/0.log" Sep 13 20:31:58.570469 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:58.570441 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8bbtk_3a23dc7b-d272-4973-8fa8-439c8db80153/network-metrics-daemon/0.log" Sep 13 20:31:58.588199 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:58.588160 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8bbtk_3a23dc7b-d272-4973-8fa8-439c8db80153/kube-rbac-proxy/0.log" Sep 13 20:31:59.608569 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:59.608540 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54wf_915e7743-2942-46c6-9484-b79f4b96a918/ovn-controller/0.log" Sep 13 20:31:59.626752 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:59.626728 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54wf_915e7743-2942-46c6-9484-b79f4b96a918/ovn-acl-logging/0.log" Sep 13 20:31:59.648629 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:59.648606 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54wf_915e7743-2942-46c6-9484-b79f4b96a918/kube-rbac-proxy-node/0.log" Sep 13 20:31:59.667178 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:59.667155 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54wf_915e7743-2942-46c6-9484-b79f4b96a918/kube-rbac-proxy-ovn-metrics/0.log" Sep 13 20:31:59.682444 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:59.682422 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54wf_915e7743-2942-46c6-9484-b79f4b96a918/northd/0.log" Sep 13 20:31:59.699651 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:59.699632 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54wf_915e7743-2942-46c6-9484-b79f4b96a918/nbdb/0.log" Sep 13 20:31:59.717433 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:59.717412 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54wf_915e7743-2942-46c6-9484-b79f4b96a918/sbdb/0.log" Sep 13 20:31:59.751163 ip-10-0-141-59 kubenswrapper[2561]: I0913 20:31:59.751141 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-g54wf_915e7743-2942-46c6-9484-b79f4b96a918/ovnkube-controller/0.log"